Human Generated Data

Title

Untitled (crowd of men and women)
Date

c. 1950, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.177
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of men and women)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Audience 100
Crowd 100
Human 100
Person 97.7
Person 97.6
Person 96.8
Tie 95.6
Accessories 95.6
Accessory 95.6
Person 95.3
Person 93.6
Tie 92.2
Person 90.6
Person 89
Person 88.7
Tie 82.6
Person 81.6
Person 79.3
Person 77.5
Person 76.7
Speech 75.9
Person 72.6
Person 69.3
Tie 67.7
Person 67.4
Person 65.4
Clothing 65.3
Apparel 65.3
Helmet 65.3
Lecture 62.6
People 60.2

Imagga
created on 2022-01-08

people 23.4
person 22.2
man 20.1
black 18.2
clothing 16.8
male 14.9
business 14
adult 13.9
group 13.7
portrait 12.9
mortarboard 12.7
women 11.9
dress 11.7
happy 10
cap 9.8
design 9.6
happiness 9.4
grunge 9.4
attractive 9.1
fashion 9
team 8.9
lifestyle 8.7
smile 8.5
clothes 8.4
street 8.3
style 8.2
headdress 8.1
sexy 8
umbrella 8
holiday 7.9
urban 7.9
spectator 7.8
standing 7.8
face 7.8
travel 7.7
men 7.7
groom 7.7
covering 7.6
room 7.6
city 7.5
lady 7.3
music 7.2
suit 7.2
celebration 7.2
photographer 7.1
hair 7.1
work 7.1
businessman 7.1
modern 7

Google
created on 2022-01-08

Coat 87
Gesture 85.3
Font 82.9
Mortarboard 81.5
Art 81.2
Suit 80.8
Adaptation 79.4
Crowd 76.4
Scholar 76.1
Monochrome 75.2
Event 73.7
Monochrome photography 73.3
Academic dress 73.3
Hat 72
Poster 70
Uniform 68.8
Illustration 67.8
Room 66
Graduation 65.2
Photo caption 65.1

Microsoft
created on 2022-01-08

person 99.3
text 91.2
clothing 89.8
man 80.1
black and white 77.5
group 71.2
white 67.8
people 57.5
crowd 54.3
posing 42
team 33.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Male, 99.3%
Calm 80.9%
Confused 7.4%
Angry 3%
Disgusted 2.2%
Happy 2%
Fear 1.6%
Sad 1.5%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Happy 78.5%
Calm 9.2%
Sad 3.1%
Angry 3%
Confused 2.7%
Fear 1.2%
Disgusted 1.1%
Surprised 1.1%

AWS Rekognition

Age 35-43
Gender Male, 92.7%
Angry 60.8%
Confused 18.5%
Sad 11%
Disgusted 3.3%
Calm 2.1%
Surprised 2%
Fear 1.5%
Happy 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 83.5%
Happy 9.5%
Confused 3.4%
Sad 1.1%
Disgusted 0.8%
Angry 0.8%
Fear 0.6%
Surprised 0.3%

AWS Rekognition

Age 16-24
Gender Female, 53.7%
Disgusted 60.4%
Fear 31.6%
Calm 1.9%
Confused 1.5%
Sad 1.5%
Surprised 1.5%
Happy 0.9%
Angry 0.7%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 51.8%
Sad 28.8%
Angry 8.7%
Disgusted 4.7%
Confused 4%
Fear 0.9%
Happy 0.8%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Angry 59.2%
Calm 14.4%
Disgusted 13.4%
Confused 4.1%
Sad 3.8%
Fear 2.1%
Happy 1.5%
Surprised 1.4%

AWS Rekognition

Age 20-28
Gender Male, 98.3%
Calm 95.8%
Confused 1.4%
Angry 1.1%
Sad 0.7%
Disgusted 0.4%
Surprised 0.4%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 54-62
Gender Female, 98.9%
Calm 57.6%
Happy 35.8%
Angry 2.2%
Sad 1.4%
Surprised 1%
Disgusted 0.9%
Confused 0.5%
Fear 0.5%

AWS Rekognition

Age 24-34
Gender Male, 97%
Sad 57.8%
Fear 25.3%
Disgusted 8.7%
Angry 2.8%
Happy 2.4%
Confused 1.6%
Calm 0.8%
Surprised 0.6%

AWS Rekognition

Age 23-31
Gender Female, 99%
Sad 84.2%
Calm 14%
Fear 0.6%
Angry 0.5%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 93.7%
Sad 4.9%
Angry 0.5%
Surprised 0.3%
Happy 0.2%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Calm 82.3%
Surprised 4.6%
Happy 3.6%
Sad 2.8%
Fear 2.8%
Angry 2%
Confused 1%
Disgusted 0.9%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Happy 95.5%
Calm 2.3%
Surprised 0.5%
Sad 0.4%
Disgusted 0.3%
Fear 0.3%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Sad 93.4%
Calm 4.9%
Angry 0.7%
Fear 0.5%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 7-17
Gender Male, 99.9%
Calm 53%
Happy 18.1%
Surprised 8.9%
Confused 7.3%
Angry 4%
Sad 3.2%
Fear 3.2%
Disgusted 2.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Happy 69.8%
Calm 15.5%
Surprised 4.7%
Confused 3.2%
Sad 2.6%
Angry 2%
Fear 1.1%
Disgusted 1.1%

AWS Rekognition

Age 26-36
Gender Male, 91.8%
Angry 51.2%
Calm 16.4%
Sad 13.8%
Disgusted 7.6%
Fear 3.7%
Surprised 3.4%
Happy 2.4%
Confused 1.5%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Sad 91.5%
Calm 7.6%
Confused 0.2%
Fear 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 91.4%
Angry 2%
Sad 1.9%
Disgusted 1.6%
Confused 1.4%
Surprised 0.9%
Happy 0.4%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Male, 60.6%
Calm 100%
Sad 0%
Angry 0%
Fear 0%
Surprised 0%
Happy 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 26-36
Gender Female, 88.2%
Calm 40.3%
Confused 19.2%
Fear 16.2%
Happy 11.3%
Sad 8.2%
Surprised 2.1%
Angry 1.8%
Disgusted 1%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 94.6%
Confused 3.9%
Sad 0.8%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 59-69
Gender Male, 100%
Calm 75.1%
Happy 12.6%
Surprised 3.3%
Disgusted 2.6%
Sad 2.4%
Confused 1.8%
Angry 1.1%
Fear 1%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 86.4%
Sad 6.1%
Happy 3%
Angry 1.9%
Surprised 1.2%
Confused 0.6%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Female, 89.9%
Sad 84.3%
Fear 5%
Surprised 4.6%
Disgusted 2.3%
Calm 1.7%
Confused 1.1%
Angry 0.5%
Happy 0.5%

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Calm 56.8%
Surprised 15.5%
Fear 8%
Angry 5.9%
Disgusted 4.2%
Confused 3.5%
Happy 3.1%
Sad 2.9%

AWS Rekognition

Age 35-43
Gender Female, 99.1%
Calm 69.6%
Confused 9.3%
Sad 8.8%
Angry 6.7%
Disgusted 2%
Surprised 1.6%
Happy 1.2%
Fear 0.8%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 99.2%
Angry 0.3%
Happy 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 64.2%
Disgusted 22.3%
Happy 5.6%
Sad 3.2%
Angry 1.5%
Fear 1.3%
Surprised 1.1%
Confused 0.9%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 70.2%
Sad 23.8%
Angry 2.5%
Confused 1.9%
Surprised 0.6%
Disgusted 0.4%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 27-37
Gender Female, 77.8%
Calm 50.8%
Happy 46.6%
Sad 2.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 21-29
Gender Male, 98.6%
Fear 65.5%
Sad 14%
Calm 6.9%
Surprised 4.9%
Angry 4.8%
Disgusted 1.8%
Confused 1.1%
Happy 1%

AWS Rekognition

Age 23-33
Gender Female, 62.8%
Disgusted 73.7%
Sad 16.8%
Fear 3.3%
Happy 1.9%
Angry 1.2%
Calm 1.2%
Confused 1%
Surprised 0.8%

AWS Rekognition

Age 29-39
Gender Female, 82.7%
Sad 96.7%
Calm 0.9%
Fear 0.6%
Surprised 0.5%
Angry 0.4%
Disgusted 0.4%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 89.9%
Sad 80.5%
Angry 7.8%
Disgusted 4.7%
Calm 3.6%
Fear 1.1%
Surprised 0.8%
Happy 0.8%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Male, 99.5%
Sad 79%
Happy 10.9%
Fear 3.2%
Confused 2.3%
Disgusted 1.5%
Calm 1.5%
Angry 1.2%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 98.2%
Happy 42.8%
Disgusted 21.4%
Surprised 10%
Confused 9.4%
Sad 7.7%
Fear 4.1%
Angry 3.5%
Calm 1.1%

AWS Rekognition

Age 22-30
Gender Male, 97.1%
Calm 84%
Fear 10.9%
Surprised 1.7%
Confused 1.6%
Sad 0.5%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Sad 45.1%
Calm 44.5%
Fear 3%
Angry 2.9%
Disgusted 2.4%
Confused 0.9%
Happy 0.7%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 97.9%
Angry 0.8%
Fear 0.6%
Calm 0.5%
Happy 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Happy 94%
Calm 2.4%
Confused 1%
Sad 0.9%
Disgusted 0.7%
Surprised 0.4%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.4%
Calm 97.4%
Fear 0.8%
Angry 0.6%
Sad 0.5%
Disgusted 0.4%
Surprised 0.2%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.6%
Calm 65.3%
Fear 24.5%
Angry 4.4%
Surprised 2.6%
Confused 1%
Disgusted 0.9%
Happy 0.8%
Sad 0.5%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Angry 75.9%
Fear 16.1%
Sad 4.3%
Surprised 1.3%
Disgusted 0.9%
Calm 0.8%
Happy 0.6%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 95.2%
Fear 2.3%
Sad 0.8%
Disgusted 0.8%
Happy 0.3%
Angry 0.3%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 60.7%
Disgusted 18.7%
Fear 10.9%
Happy 4.1%
Angry 2.4%
Sad 1.7%
Surprised 1%
Confused 0.5%

AWS Rekognition

Age 45-51
Gender Male, 99.5%
Sad 58.8%
Calm 16.4%
Fear 9%
Confused 5.8%
Angry 4.3%
Surprised 2.3%
Disgusted 2%
Happy 1.4%

AWS Rekognition

Age 18-26
Gender Male, 91.1%
Fear 45.7%
Angry 21.1%
Surprised 13.4%
Disgusted 10.3%
Sad 3.4%
Confused 2.7%
Happy 2.7%
Calm 0.8%

AWS Rekognition

Age 39-47
Gender Male, 80.3%
Calm 88.4%
Sad 5.7%
Angry 1.5%
Fear 1.4%
Surprised 1.4%
Disgusted 0.9%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 28-38
Gender Male, 93%
Calm 34.5%
Fear 24.6%
Sad 24.6%
Disgusted 5.6%
Angry 3.6%
Confused 3.1%
Surprised 2.2%
Happy 1.8%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Sad 40.1%
Calm 16.4%
Disgusted 14.8%
Confused 14.2%
Surprised 9.1%
Angry 2.6%
Happy 1.8%
Fear 1%

AWS Rekognition

Age 23-31
Gender Female, 51.2%
Sad 55.8%
Calm 36.7%
Confused 2.6%
Fear 1.2%
Surprised 1.2%
Happy 1.1%
Disgusted 0.8%
Angry 0.6%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.9%
Sad 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Female, 57.5%
Fear 52.7%
Happy 26%
Angry 9.8%
Sad 6%
Calm 2.4%
Confused 1.3%
Disgusted 1%
Surprised 0.9%

AWS Rekognition

Age 22-30
Gender Female, 74.2%
Fear 54.2%
Calm 14.1%
Angry 9.9%
Sad 7.3%
Surprised 5.2%
Confused 4.4%
Happy 3.8%
Disgusted 1.2%

AWS Rekognition

Age 18-24
Gender Male, 99.5%
Calm 97.4%
Sad 0.8%
Angry 0.7%
Happy 0.3%
Surprised 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Fear 30.4%
Sad 23.2%
Calm 23%
Angry 10.9%
Happy 7.8%
Disgusted 2.2%
Surprised 1.3%
Confused 1.3%

AWS Rekognition

Age 26-36
Gender Female, 97.5%
Fear 42.9%
Sad 34%
Calm 18.3%
Happy 1.4%
Angry 1.2%
Surprised 1.1%
Confused 0.7%
Disgusted 0.4%

AWS Rekognition

Age 38-46
Gender Female, 70%
Calm 23%
Fear 21.7%
Sad 14.1%
Surprised 12%
Disgusted 9.2%
Confused 8.8%
Happy 6.4%
Angry 4.9%

AWS Rekognition

Age 34-42
Gender Male, 98.9%
Calm 98.1%
Sad 1.1%
Fear 0.5%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Happy 0%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Tie 95.6%
Helmet 65.3%

Captions

Microsoft

a group of people posing for a photo in front of a crowd 94.3%
a group of people standing in front of a crowd posing for the camera 92.5%
a group of people standing in front of a crowd 92.4%