Human Generated Data

Title

Untitled (crowd with "Pepsi-Cola 5 cents" cups)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4529

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd with "Pepsi-Cola 5 cents" cups)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99
Person 98.6
Person 98.6
Person 97.7
Person 97.6
Person 97
Clothing 88.8
Apparel 88.8
Person 85.2
Person 83.6
Crowd 80.1
Photographer 78.5
Person 76.4
Person 72.5
Electronics 65.5
Lighting 63.2
People 62.1
Coat 59.2
Photo 58.7
Photography 58.7
Camera 57.4
Scientist 55.3

Imagga
created on 2022-01-23

nurse 100
man 41.7
person 36.4
people 36.3
senior 33.7
male 33.3
patient 30.5
couple 29.6
medical 26.5
professional 26.1
adult 26
doctor 24.4
happy 23.8
mature 23.2
smiling 23.1
elderly 22
indoors 21.1
coat 19.8
home 18.3
hospital 18.1
job 17.7
sitting 17.2
men 17.2
worker 17
office 16.9
women 16.6
lab coat 16.6
work 16.5
business 16.4
team 16.1
health 16
businessman 15.9
smile 15.7
occupation 15.6
clinic 15.6
portrait 15.5
lifestyle 15.2
group 14.5
looking 14.4
specialist 14.3
husband 14.3
wife 14.2
room 14
old 13.9
colleagues 13.6
case 13.4
medicine 13.2
care 13.2
together 13.1
happiness 12.5
casual 11.9
day 11.8
sick person 11.6
laboratory 11.6
illness 11.4
businesspeople 11.4
student 11.1
teamwork 11.1
love 11
associates 10.8
bright 10.7
two people 10.7
lab 10.7
face 10.7
30s 10.6
cheerful 10.6
desk 10.4
education 10.4
two 10.2
clothing 10.1
indoor 10
scientist 9.8
look 9.6
table 9.5
talking 9.5
color 9.5
corporate 9.4
teacher 9.4
modern 9.1
businesswoman 9.1
family 8.9
working 8.8
40s 8.8
middle aged 8.8
examination 8.7
chemistry 8.7
affection 8.7
retirement 8.6
profession 8.6
uniform 8.6
inside 8.3
treatment 8.3
technology 8.2
handsome 8
writing 8
romantic 8
computer 8
science 8
to 8
stethoscope 7.8
retired 7.8
mid adult 7.7
test 7.7
attractive 7.7
married 7.7
research 7.6
adults 7.6
togetherness 7.6
help 7.5
mother 7.4
practitioner 7.4
focus 7.4
camera 7.4

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.3
person 99.2
clothing 98
group 85.2
footwear 79.1
woman 67.9
posing 62.3
dress 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.1%
Surprised 99.5%
Calm 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%
Sad 0%

AWS Rekognition

Age 51-59
Gender Male, 99.7%
Sad 87.1%
Angry 7.4%
Disgusted 2%
Calm 1.4%
Confused 1%
Fear 0.5%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 52-60
Gender Male, 99.7%
Surprised 42.5%
Calm 25%
Fear 10.2%
Confused 8.2%
Disgusted 5.4%
Sad 4.4%
Happy 2.4%
Angry 1.9%

AWS Rekognition

Age 33-41
Gender Male, 98.1%
Surprised 39.5%
Confused 29.5%
Happy 18.1%
Disgusted 5.1%
Calm 3.4%
Sad 2.1%
Angry 1.5%
Fear 0.8%

AWS Rekognition

Age 31-41
Gender Female, 93.6%
Calm 91%
Happy 4.5%
Confused 1.2%
Sad 1.1%
Disgusted 0.7%
Surprised 0.6%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Sad 56.4%
Confused 22%
Fear 12.7%
Happy 3.9%
Surprised 2.1%
Disgusted 1.3%
Angry 0.9%
Calm 0.7%

AWS Rekognition

Age 43-51
Gender Female, 93.4%
Calm 75.9%
Angry 8.5%
Happy 8.2%
Sad 2.4%
Fear 1.9%
Surprised 1.6%
Confused 0.9%
Disgusted 0.6%

AWS Rekognition

Age 43-51
Gender Male, 97.1%
Sad 81.4%
Calm 16.7%
Confused 0.6%
Angry 0.5%
Disgusted 0.3%
Happy 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 48-54
Gender Male, 100%
Confused 30.8%
Calm 27.5%
Angry 19.4%
Disgusted 7.9%
Surprised 4.4%
Sad 4.2%
Happy 4.2%
Fear 1.6%

AWS Rekognition

Age 48-56
Gender Male, 98.9%
Sad 55%
Happy 19%
Surprised 10.3%
Calm 8.6%
Fear 3.4%
Confused 1.7%
Angry 1%
Disgusted 1%

AWS Rekognition

Age 47-53
Gender Male, 87.6%
Happy 95.2%
Calm 2.2%
Sad 0.8%
Surprised 0.8%
Confused 0.4%
Disgusted 0.3%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 97.3%
Fear 90.9%
Surprised 3.2%
Confused 1.7%
Sad 1.7%
Angry 1%
Calm 0.9%
Disgusted 0.4%
Happy 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 93.9%
a group of people posing for the camera 93.8%
a group of people posing for a picture 93.7%

Text analysis

Amazon

13538
5
-MAMT2A3
NANON-YT3RAS -MAMT2A3
NANON-YT3RAS
TO

Google

) 35 38 · T3538.
)
38
·
T3538.
35