Human Generated Data

Title

Untitled (men and women gathered in room with hands raised)

Date

1960

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10523

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women gathered in room with hands raised)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.4
Person 99.4
Apparel 99.4
Clothing 99.4
Person 99.4
Person 98.9
Person 98.4
Person 98
Person 97.8
Person 97.8
Person 97.5
Person 97.5
Person 97.4
Person 96.9
Coat 96.1
Suit 96.1
Overcoat 96.1
Face 95.2
Sunglasses 93.7
Accessory 93.7
Accessories 93.7
Person 93.2
Person 92.4
Head 91.8
Crowd 89
Tuxedo 85.3
Shirt 75.4
Smile 74.5
Person 72.1
Glasses 72.1
Indoors 69.8
Photo 69.5
Portrait 69.5
Photography 69.5
People 69.2
Audience 68.6
Person 61.2
Man 57.1
Party 55.9
Female 55.8

Imagga
created on 2022-01-09

nurse 85.2
senior 36.5
people 35.7
man 35.6
person 33
elderly 30.6
adult 28.2
hospital 25.4
medical 23.8
happy 23.8
mature 23.2
old 23
male 22.7
couple 21.8
doctor 20.7
patient 19.7
smiling 19.5
health 19.4
portrait 19.4
home 19.1
looking 17.6
retirement 17.3
shower cap 16.6
retired 16.5
cap 15.7
camera 15.7
men 15.4
husband 15.2
professional 15.1
women 15
medicine 15
grandfather 14.7
together 14
older 13.6
aged 13.6
clothing 13.5
illness 13.3
clinic 13.2
care 13.2
grandma 13.1
lifestyle 13
occupation 12.8
smile 12.8
worker 12.6
team 12.5
married 12.4
family 12.4
wife 12.3
indoors 12.3
face 12.1
room 12
human 12
hair 11.9
surgery 11.7
surgeon 11.6
teacher 11.6
cheerful 11.4
lady 11.3
sitting 11.2
love 11
happiness 11
case 10.9
age 10.5
student 10.4
headdress 10
coat 10
hand 9.9
casual 9.3
lab coat 9.1
holding 9.1
group 8.9
look 8.7
standing 8.7
education 8.6
day 8.6
aging 8.6
business 8.5
kin 8.5
specialist 8.4
pretty 8.4
joy 8.3
indoor 8.2
pensioner 8.2
mother 8.2
stethoscope 8
science 8
to 8
job 8
facing camera 7.9
citizen 7.9
70s 7.9
work 7.8
grandmother 7.8
60s 7.8
half length 7.8
two people 7.8
lab 7.8
affection 7.7
laboratory 7.7
attractive 7.7
exam 7.7
two 7.6
child 7.6
marriage 7.6
enjoying 7.6
fun 7.5
sick person 7.5
glasses 7.4
handsome 7.1
working 7.1

Google
created on 2022-01-09

Photograph 94.3
Coat 90.9
Hat 89.1
Gesture 85.3
Black-and-white 83.6
Headgear 83.2
Suit 82.9
Art 75.3
Snapshot 74.3
Font 74
Vintage clothing 73.7
Event 73.4
Monochrome photography 73
Tie 72.3
Monochrome 72
Team 71.9
Sun hat 68.7
Crowd 66.6
Crew 65.4
Stock photography 64.1

Microsoft
created on 2022-01-09

person 99.8
posing 97.1
group 95
clothing 95
man 88
smile 87.2
human face 82.4
text 82
people 71
woman 53.3
old 44.6
crowd 1.5

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.8%
Sad 72.9%
Confused 16.1%
Happy 5%
Calm 2.1%
Disgusted 1.9%
Angry 1%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Happy 40.9%
Calm 35.9%
Sad 8.3%
Confused 5.7%
Angry 4.4%
Disgusted 3%
Surprised 1.3%
Fear 0.6%

AWS Rekognition

Age 34-42
Gender Female, 55.8%
Happy 63.8%
Sad 34.3%
Angry 0.5%
Disgusted 0.4%
Confused 0.4%
Fear 0.2%
Calm 0.2%
Surprised 0.1%

AWS Rekognition

Age 39-47
Gender Male, 93.4%
Sad 97.5%
Happy 0.8%
Confused 0.5%
Calm 0.4%
Fear 0.3%
Angry 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 45-51
Gender Female, 59.7%
Happy 62.3%
Calm 24.5%
Surprised 5.9%
Confused 1.9%
Angry 1.7%
Sad 1.7%
Disgusted 1%
Fear 1%

AWS Rekognition

Age 45-53
Gender Male, 85.5%
Happy 43.9%
Confused 25%
Calm 14.6%
Disgusted 5.4%
Sad 3.7%
Angry 3.7%
Surprised 3.2%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Female, 94.7%
Calm 96.1%
Sad 2.4%
Happy 0.7%
Confused 0.3%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 98.2%
Sad 84.5%
Happy 4.7%
Fear 3.5%
Angry 1.8%
Calm 1.6%
Confused 1.4%
Disgusted 1.4%
Surprised 1.1%

AWS Rekognition

Age 40-48
Gender Male, 89.3%
Happy 59.8%
Calm 25.6%
Disgusted 4.4%
Surprised 3.9%
Sad 3.4%
Angry 1.5%
Confused 0.9%
Fear 0.5%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Happy 77.8%
Disgusted 5.7%
Sad 5.1%
Surprised 3.5%
Calm 2.9%
Fear 1.9%
Angry 1.8%
Confused 1.4%

AWS Rekognition

Age 51-59
Gender Male, 99.6%
Happy 45.7%
Sad 44.8%
Confused 2.9%
Surprised 1.5%
Disgusted 1.5%
Fear 1.4%
Angry 1.3%
Calm 0.8%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Angry 75.9%
Sad 8.5%
Surprised 4.9%
Calm 3.7%
Confused 2.2%
Happy 1.7%
Disgusted 1.6%
Fear 1.4%

AWS Rekognition

Age 38-46
Gender Female, 84.4%
Happy 93.5%
Calm 3%
Sad 1.2%
Angry 0.8%
Disgusted 0.7%
Confused 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 99.4%
Sad 71.6%
Happy 19.2%
Confused 4.4%
Calm 1.3%
Fear 1.1%
Disgusted 1%
Angry 1%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Sunglasses 93.7%

Captions

Microsoft

a group of people posing for a photo 98.4%
a group of people posing for the camera 98.3%
a group of people posing for a picture 98.2%

Text analysis

Amazon

46527
M113--YTA3

Google

527
4
6
4 6 527