Human Generated Data

Title

Day of the Dead, Tilisca, Rumania

Date

1967, printed later

People

Artist: Paul Strand, American 1890 - 1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Artist, P1972.240

Copyright

© Aperture Foundation Inc., Paul Strand Archive

Human Generated Data

Title

Day of the Dead, Tilisca, Rumania

People

Artist: Paul Strand, American 1890 - 1976

Date

1967, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Person 99.4
Person 99
Person 99
Person 98.3
Person 98.1
Person 97.8
Person 97.7
Person 97.6
Person 97.2
Person 96.8
Person 96.1
Apparel 91.7
Clothing 91.7
Crowd 91.6
Face 86.3
Person 84.6
Person 83.6
Performer 83
Parade 74.9
Suit 71.9
Overcoat 71.9
Coat 71.9
People 71.4
Person 64.9
Hat 62.7
Pedestrian 57.7

Imagga
created on 2021-12-15

academic gown 87.4
gown 80.7
mortarboard 61.3
clothing 59.8
outerwear 52.4
cap 52.1
man 38.3
headdress 35.2
person 32.5
covering 32.2
male 30.5
adult 29.7
people 29.5
consumer goods 29
suit 27.1
business 24.3
umbrella 23
businessman 22.9
smile 20.7
success 20.1
portrait 19.4
happy 18.8
standing 18.2
hat 17.8
black 17.6
holding 17.3
smiling 16.6
professional 15.2
face 14.9
group 14.5
attractive 14
executive 13.9
corporate 13.7
businesswoman 12.7
manager 12.1
office 12
one 11.9
women 11.9
handsome 11.6
looking 11.2
building 11.1
work 11
successful 11
happiness 11
confident 10.9
graduation 10.8
formal 10.5
human 10.5
pretty 10.5
couple 10.4
rain 10.4
meeting 10.4
men 10.3
elegant 10.3
car 10.1
protection 10
student 9.9
team 9.8
cheerful 9.7
colleagues 9.7
outdoors 9.7
businesspeople 9.5
tie 9.5
expression 9.4
guy 9.2
fashion 9
graduate 8.8
look 8.8
two 8.5
teamwork 8.3
20s 8.2
school 8.1
job 8
working 7.9
love 7.9
university 7.7
automobile 7.7
serious 7.6
college 7.6
career 7.6
communication 7.6
smart 7.5
future 7.4
scholar 7.3
weather 7.2
worker 7.1

Google
created on 2021-12-15

Photograph 94.2
Facial expression 93.2
Black 89.8
Human 89.2
Hat 86.6
Mortarboard 85.8
Coat 85.4
Gesture 85.3
Style 84
Black-and-white 83.9
Scholar 83.9
Headgear 82.7
Collar 80.5
Crowd 78.7
Academic dress 78.3
People 77.7
Monochrome 76.7
Monochrome photography 76.1
Graduation 75.7
Snapshot 74.3

Microsoft
created on 2021-12-15

person 99.8
outdoor 98.6
text 98
clothing 97.8
human face 97.8
man 95.6
people 89.2
hat 88.3
smile 82.7
group 82.6
black and white 81.9
fashion accessory 81.4
crowd 53.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 92.8%
Sad 50.3%
Confused 33.6%
Angry 4.5%
Fear 3.8%
Disgusted 3.5%
Calm 2.4%
Surprised 1.3%
Happy 0.6%

AWS Rekognition

Age 24-38
Gender Female, 98.4%
Happy 39.9%
Calm 36.4%
Confused 6.8%
Sad 6.5%
Angry 4.5%
Fear 3.4%
Surprised 1.7%
Disgusted 0.8%

AWS Rekognition

Age 42-60
Gender Female, 93%
Calm 94.3%
Sad 2.8%
Happy 1.9%
Surprised 0.4%
Fear 0.3%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 41-59
Gender Male, 96.7%
Calm 94.6%
Angry 5.1%
Sad 0.2%
Surprised 0.1%
Happy 0%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 34-50
Gender Male, 99.8%
Calm 96.1%
Sad 2.3%
Confused 0.7%
Angry 0.6%
Fear 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 37-55
Gender Male, 72.2%
Angry 97.8%
Calm 1.6%
Sad 0.3%
Confused 0.2%
Fear 0.1%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 44-62
Gender Female, 99.4%
Happy 79.5%
Calm 10.4%
Confused 3%
Disgusted 1.8%
Angry 1.5%
Fear 1.4%
Sad 1.4%
Surprised 1%

AWS Rekognition

Age 23-35
Gender Female, 92.3%
Sad 50.2%
Happy 26.3%
Calm 7.1%
Angry 6.1%
Confused 4.9%
Fear 4.7%
Surprised 0.4%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Male, 76.7%
Fear 61.4%
Calm 22%
Sad 7.4%
Confused 3%
Angry 2.6%
Surprised 2.3%
Happy 0.9%
Disgusted 0.4%

AWS Rekognition

Age 36-54
Gender Male, 90%
Sad 93.8%
Calm 5.7%
Confused 0.1%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 26-40
Gender Male, 83.6%
Sad 85.1%
Calm 7.4%
Fear 4.4%
Confused 1.3%
Happy 1.1%
Surprised 0.3%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 36-52
Gender Male, 93.1%
Calm 96.1%
Happy 2.2%
Sad 1.4%
Angry 0.2%
Confused 0%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 32-48
Gender Male, 78.9%
Calm 99%
Sad 0.8%
Angry 0.1%
Happy 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 33-49
Gender Male, 87.6%
Calm 48.9%
Sad 38.4%
Confused 3.1%
Fear 3.1%
Surprised 2.2%
Happy 1.7%
Angry 1.4%
Disgusted 1.3%

AWS Rekognition

Age 18-30
Gender Male, 98.8%
Angry 95.7%
Calm 1.9%
Sad 1.6%
Confused 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 36-52
Gender Male, 99.5%
Calm 54.8%
Sad 41.1%
Angry 1.9%
Confused 0.9%
Fear 0.9%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 33-49
Gender Male, 95.4%
Sad 81.2%
Calm 16.5%
Fear 0.9%
Angry 0.5%
Confused 0.5%
Disgusted 0.2%
Happy 0.2%
Surprised 0.2%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 56
Gender Female

Microsoft Cognitive Services

Age 62
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 71.9%
Hat 62.7%

Captions

Microsoft

a group of people standing in front of a crowd 97.1%
a group of people standing in front of a crowd of people 96.8%
a group of people in front of a crowd 96.7%

Text analysis

Google

YENO
YENO &
&