Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4989

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.3
Human 99.3
Person 99
Person 98.9
Person 98.8
Clothing 97.4
Apparel 97.4
Person 97.3
Person 96.1
Person 92.6
Person 92.1
Person 91.4
Tie 81.1
Accessories 81.1
Accessory 81.1
Person 76.4
Footwear 73.7
Tie 72.2
Photography 67.9
Photo 67.9
Beer 65.4
Beverage 65.4
Alcohol 65.4
Drink 65.4
Face 65.1
Photographer 63.8
Boot 62.1
Beer 61.5
Portrait 61.4
Poster 59.6
Advertisement 59.6
Beer 55.6
Collage 55.2
Person 47.9

Imagga
created on 2022-01-22

person 38.4
man 32.9
professional 32.9
coat 32.5
people 30.1
male 29.1
lab coat 27.6
work 25.9
adult 25
nurse 24.6
businessman 23
medical 22.1
business 21.9
doctor 20.7
medicine 19.4
worker 18
job 17.7
looking 17.6
student 17.5
laboratory 17.4
education 17.3
lab 16.5
face 16.3
teacher 16.3
portrait 14.9
scientist 14.7
occupation 14.7
men 14.6
handsome 14.3
holding 14
corporate 13.7
office 13.7
chemistry 13.5
hospital 13.4
biology 13.3
health 13.2
human 12.7
happy 12.5
test 12.5
science 12.4
serious 12.4
research 12.4
businesspeople 12.3
hand 12.2
two 11.9
groom 11.8
team 11.6
profession 11.5
desk 11.3
standing 11.3
group 11.3
technology 11.1
garment 10.9
chemical 10.7
clothing 10.4
life 10.4
patient 10.3
suit 10.1
clinic 9.8
scientific 9.7
indoors 9.7
educator 9.6
brass 9.6
exam 9.6
surgeon 9.5
tie 9.5
manager 9.3
smile 9.3
attractive 9.1
care 9.1
film 8.9
working 8.8
wind instrument 8.8
lifestyle 8.7
day 8.6
uniform 8.6
study 8.4
teamwork 8.3
case 8.1
cheerful 8.1
computer 8
smiling 8
women 7.9
chemist 7.9
brunette 7.8
color 7.8
corporation 7.7
construction 7.7
expression 7.7
development 7.6
instrument 7.5
negative 7.5
successful 7.3
indoor 7.3
musical instrument 7.3
room 7.3
businesswoman 7.3
love 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.8
posing 99.4
drawing 97.8
sketch 95.8
person 87.5
group 84.3
cartoon 83.9
clothing 79.4
black and white 75.7
man 65.2
old 57.4
painting 50.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.3%
Sad 99.5%
Angry 0.2%
Calm 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Sad 74.8%
Confused 21.1%
Happy 1%
Calm 0.7%
Disgusted 0.7%
Fear 0.6%
Surprised 0.5%
Angry 0.5%

AWS Rekognition

Age 27-37
Gender Male, 95.3%
Angry 74.3%
Disgusted 7.1%
Surprised 6.4%
Calm 6.3%
Happy 2.5%
Sad 1.6%
Confused 0.9%
Fear 0.9%

AWS Rekognition

Age 53-61
Gender Male, 99.8%
Calm 74.3%
Happy 7.5%
Disgusted 5.8%
Surprised 3.9%
Confused 3%
Angry 2.4%
Sad 1.7%
Fear 1.3%

AWS Rekognition

Age 20-28
Gender Male, 93.6%
Surprised 76.3%
Fear 10.9%
Happy 5.1%
Angry 3.1%
Calm 1.9%
Sad 1.7%
Disgusted 0.6%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 81.1%
Beer 65.4%

Captions

Microsoft

a group of people posing for a photo 97%
a group of people posing for the camera 96.9%
a group of people posing for a picture 96.8%

Text analysis

Amazon

13534
EPSI
S
13534.
EPSI COLA
COLA
5€
5
PEPSI-COLA
Per
Hol

Google

135-34.AU-YT3RA2-MAMTZA3 PSH OLA 13534.
135-34.AU-YT3RA2-MAMTZA3
PSH
OLA
13534.