Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4988
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98.8
Person 98.8
Person 97.7
Person 96.1
Person 95.4
Person 93.4
Person 93.2
Person 87.6
Person 84.3
Person 84.1
Person 80.9
Person 78.4
Doctor 78.4
Crowd 75.8
Clinic 75.2
People 74.8
Person 72.5
Clothing 61.7
Apparel 61.7
Face 59
Person 57.4
Person 54.5

Imagga
created on 2022-01-22

nurse 100
man 45.7
male 36.2
person 36
patient 35.4
people 32.9
adult 31.4
professional 30.2
coat 27.9
doctor 27.3
businessman 26.5
medical 26.5
business 25.5
lab coat 25.5
indoors 22.8
office 22.5
working 22.1
hospital 21.9
colleagues 21.4
work 21.2
team 20.6
clinic 19.7
casual 19.5
businesspeople 19
case 19
men 18.9
indoor 18.3
smiling 18.1
desk 18
mature 17.7
occupation 17.4
health 17.4
job 16.8
medicine 16.7
specialist 16.5
laboratory 16.4
sick person 16.4
face 16.3
group 16.1
worker 16.1
senior 15.9
teamwork 15.8
day 15.7
happy 15.7
table 15.6
lab 15.5
sitting 15.5
businesswoman 15.5
talking 15.2
meeting 15.1
care 14.8
education 14.7
40s 14.6
lifestyle 14.5
computer 14.4
student 14.4
looking 14.4
bright 14.3
portrait 14.2
color 13.9
associates 13.8
20s 13.7
chemistry 13.5
room 13
scientist 12.7
science 12.5
elderly 12.4
clothing 12.4
corporate 12
coworkers 11.8
horizontal 11.7
discussion 11.7
expertise 11.6
chemical 11.6
research 11.4
biology 11.4
home 11.2
discussing 10.8
test 10.6
30s 10.6
together 10.5
women 10.3
happiness 10.2
camera 10.2
two 10.2
confident 10
technology 9.7
profession 9.6
illness 9.5
teacher 9.4
smile 9.3
glasses 9.3
laptop 9.1
holding 9.1
board 9
cheerful 8.9
doctors 8.8
forties 8.8
assistant 8.7
scientific 8.7
couple 8.7
check 8.7
mid adult 8.7
four 8.6
exam 8.6
serious 8.6
hand 8.4
treatment 8.3
handsome 8
light 8
writing 8
interior 8
business people 7.9
explaining 7.9
crew 7.9
chemist 7.9
examining 7.8
good mood 7.8
diagnosis 7.8
clinical 7.8
businessmen 7.8
experiment 7.8
consultant 7.8
two people 7.8
examination 7.8
concentration 7.7
busy 7.7
modern 7.7
uniform 7.6
bed 7.6
adults 7.6
practitioner 7.3
classroom 7.1
look 7

Google
created on 2022-01-22

Photograph 94.3
White 92.2
Black 89.7
Smile 85.9
Coat 85.9
Black-and-white 84.7
Style 83.8
Apron 83.4
Font 82.2
Sleeve 81.2
Monochrome 75.6
Monochrome photography 75
Snapshot 74.3
Cooking 71.8
Event 71.3
Service 70.5
Room 69.8
Nurse uniform 69.3
T-shirt 68.5
Chef 67.5

Microsoft
created on 2022-01-22

text 99.6
clothing 95.3
person 94.8
man 89
smile 83.2
human face 78.9
drawing 65.8

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Happy 68.7%
Surprised 13.1%
Confused 4.7%
Calm 4.3%
Disgusted 3.7%
Sad 2.7%
Fear 1.4%
Angry 1.4%

AWS Rekognition

Age 50-58
Gender Female, 95%
Happy 94.8%
Calm 3.2%
Confused 0.7%
Surprised 0.4%
Disgusted 0.4%
Sad 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 56-64
Gender Male, 97.7%
Calm 99.5%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Surprised 69.5%
Confused 10.5%
Sad 8.7%
Calm 3.1%
Disgusted 3%
Happy 1.9%
Angry 1.7%
Fear 1.7%

AWS Rekognition

Age 50-58
Gender Male, 93.2%
Happy 82.7%
Sad 8.4%
Surprised 4.2%
Calm 3.3%
Confused 0.6%
Disgusted 0.3%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Female, 73.7%
Calm 79.4%
Happy 12.6%
Sad 2.3%
Surprised 1.7%
Disgusted 1.4%
Confused 0.9%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 53-61
Gender Male, 71%
Calm 72.3%
Fear 8.5%
Surprised 4.5%
Sad 4%
Happy 3.8%
Disgusted 2.5%
Angry 2.4%
Confused 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people posing for a photo 75.7%
a group of people posing for the camera 75.6%
a group of people posing for a picture 75.5%

Text analysis

Amazon

5
13537.
:
13337.

Google

13537. 11 T3337. -YT3RA2 MAMT2A3
-YT3RA2
MAMT2A3
13537.
T3337.
11