Human Generated Data

Title

Untitled (scowling man in profile)

Date

n.d.

People

Artist: Walker Evans, American 1903 - 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.286

Copyright

© Walker Evans Archive, The Metropolitan Museum of Art

Human Generated Data

Title

Untitled (scowling man in profile)

People

Artist: Walker Evans, American 1903 - 1975

Date

n.d.

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.8
Person 99.8
Clothing 99.8
Hat 99.8
Apparel 99.8
Person 99.2
Person 98.9
Person 97.1
Person 94.3
Person 93.4
Person 85
Face 84.6
Military Uniform 84.3
Military 84.3
Officer 84.3
Overcoat 79.2
Coat 79.2
Accessories 76
Tie 76
Accessory 76
Pedestrian 74.8
Shoe 74.2
Footwear 74.2
Shoe 73.3
People 65.3
Suit 61.1
Shoe 50.1

Imagga
created on 2022-01-08

hat 57.3
man 37.6
people 32.3
cowboy hat 31.6
person 31.2
male 29.8
clothing 26
cowboy 24.9
headdress 24.7
adult 20.8
portrait 18.8
smile 17.1
outdoors 16.4
happy 16.3
suit 15.9
face 15.6
two 15.2
guy 14.8
western 14.5
horse 14.4
handsome 14.3
shirt 14
couple 13.9
men 13.7
business 13.4
hand 12.9
city 12.5
lifestyle 12.3
urban 12.2
black 12.2
senior 12.2
occupation 11.9
women 11.9
helmet 11.7
covering 11.4
boy 11.3
style 11.1
love 11
field 10.9
fashion 10.6
together 10.5
attractive 10.5
old 10.4
standing 10.4
consumer goods 10.4
hair 10.3
happiness 10.2
smiling 10.1
street 10.1
model 10.1
human 9.7
one 9.7
professional 9.5
passenger 9.4
outside 9.4
outdoor 9.2
cowgirl 8.9
looking 8.8
building 8.7
work 8.6
ranch 8.6
child 8.5
expression 8.5
pair 8.5
engineer 8.5
meeting 8.5
travel 8.4
head 8.4
safety 8.3
pose 8.1
foreman 8
posing 8
job 8
look 7.9
girlfriend 7.7
oriental 7.7
construction 7.7
industry 7.7
cap 7.7
youth 7.7
walk 7.6
wearing 7.6
leisure 7.5
manager 7.4
mature 7.4
success 7.2
mortarboard 7.2
romance 7.1
romantic 7.1
working 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

outdoor 99.6
person 99.2
clothing 98.6
hat 98.4
man 94.9
fashion accessory 93.8
fedora 92.3
text 88.9
human face 86.8
cowboy hat 81.5
sun hat 59.4
people 58.9
crowd 0.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 99.4%
Confused 0.4%
Sad 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 70-80
Gender Male, 100%
Sad 97.7%
Calm 1.9%
Confused 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 26-36
Gender Female, 67.2%
Calm 94.1%
Angry 2.5%
Disgusted 1.2%
Sad 0.7%
Happy 0.6%
Fear 0.5%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 16-22
Gender Female, 54.6%
Calm 86.3%
Happy 12.1%
Surprised 0.5%
Sad 0.3%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 2-10
Gender Male, 63.4%
Calm 62.6%
Sad 12.9%
Angry 10.1%
Confused 4.1%
Disgusted 3.8%
Happy 3.6%
Fear 1.9%
Surprised 1%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 20
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.8%
Hat 99.8%
Tie 76%
Shoe 74.2%
Suit 61.1%

Captions

Microsoft

a group of people in an old photo of a man 91.6%
a man standing in front of a crowd 91.5%
a man standing in front of a crowd of people 91.4%