Human Generated Data

Title

Untitled (crowd of people walking on busy city street; man with shorts and argyle knee-socks in center)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14798

Human Generated Data

Title

Untitled (crowd of people walking on busy city street; man with shorts and argyle knee-socks in center)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.2
Clothing 99.1
Apparel 99.1
Accessory 98.2
Accessories 98.2
Tie 98.2
Person 97.6
Person 96.2
Footwear 95
Shoe 95
Person 94.8
Shorts 90.2
Shoe 86.5
Flooring 82.6
Dance Pose 75.6
Leisure Activities 75.6
Floor 69
Text 68.4
Shoe 65.4
Person 64.4
People 63.6
Overcoat 58.3
Coat 58.3
Pedestrian 57.2
Suit 55.5
Advertisement 55.2
Shoe 50.6

Imagga
created on 2022-01-29

locker 100
fastener 85.6
restraint 64.5
device 42.3
newspaper 24.6
product 19
window 15.5
creation 15
business 14
wall 13.7
door 13.6
people 13.4
house 13.4
city 12.5
interior 12.4
man 12.1
black 11.4
old 11.1
person 11
building 10.6
indoors 10.5
home 10.4
architecture 10.1
design 10.1
urban 9.6
looking 9.6
room 9.4
grunge 9.4
smile 9.3
portrait 9.1
paint 9
light 8.7
adult 8.4
modern 8.4
power 8.4
fashion 8.3
vintage 8.3
water 8
sliding door 7.8
travel 7.7
empty 7.7
men 7.7
elegant 7.7
office 7.5
male 7.1
refrigerator 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 99.6
clothing 95.5
person 92.7
footwear 91.8
black and white 91.7
street 81.7
scene 75.9
dance 73.4
white 69.9
clothes 15.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 94.6%
Confused 2.8%
Disgusted 1.5%
Sad 0.3%
Happy 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 85.9%
Calm 99.9%
Happy 0%
Confused 0%
Surprised 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 95.1%
Fear 97.3%
Calm 1.4%
Confused 0.6%
Angry 0.2%
Sad 0.2%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Male, 96.4%
Calm 98.3%
Surprised 0.8%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%

AWS Rekognition

Age 23-33
Gender Female, 69.8%
Calm 84.9%
Surprised 13%
Disgusted 0.7%
Sad 0.5%
Fear 0.3%
Confused 0.2%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 37-45
Gender Female, 98.1%
Calm 91.3%
Angry 3%
Disgusted 2.6%
Happy 1.1%
Confused 0.9%
Sad 0.4%
Surprised 0.3%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 98.2%
Shoe 95%

Captions

Microsoft

a group of people walking down a street 85%
a group of people walking down the street 84.9%
a group of people walking on a street 80.3%

Text analysis

Amazon

FILM
KODAK
KODAK SAFETY FILM
SAFETY
TR
6
FI
LM

Google

FI ... KODAK SAFETY FILM
...
FILM
FI
KODAK
SAFETY