Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4987

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people drinking Pepsi-Cola surrounding seated man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4987

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99
Human 99
Person 97.6
Person 97.4
Person 95.3
Person 93.2
Person 92.1
Person 92.1
Clothing 91.4
Apparel 91.4
Person 90.1
Person 87.7
Person 86.6
Person 85.4
Sunglasses 84.7
Accessories 84.7
Accessory 84.7
Person 84.6
Face 83.5
Head 82
Tie 81.7
Scientist 71.4
Crowd 71.3
Text 69.9
Person 67.9
Suit 67.2
Overcoat 67.2
Coat 67.2
Person 66.9
Portrait 63.9
Photography 63.9
Photo 63.9
People 60.8
Drawing 57.2
Art 57.2
Smile 56.5
Performer 56.5
Person 50
Person 45.9

Clarifai
created on 2023-10-26

people 99.8
group 99.3
adult 97.6
man 97.5
group together 96.1
many 95.7
uniform 87.7
woman 87.3
education 86.7
portrait 86.2
scientist 85.4
leader 85.2
administration 83.8
wear 83.4
monochrome 78.4
several 78.3
outfit 75.7
outerwear 74.5
coat 72.6
medical practitioner 71.8

Imagga
created on 2022-01-22

lab coat 79.7
coat 72.6
man 45
male 41.2
medical 38.9
doctor 38.6
professional 38.4
people 35.7
person 34.3
businessman 29.1
adult 28.7
hospital 28.2
garment 28.2
business 27.3
occupation 25.7
medicine 25.5
work 24.3
job 23.9
team 23.3
health 22.9
worker 22.6
nurse 22.3
practitioner 22.1
laboratory 21.2
clothing 21.1
office 20.9
looking 20.8
men 20.6
lab 20.4
patient 20.2
businesspeople 19.9
care 19.8
mature 19.5
clinic 19.4
working 18.6
colleagues 17.5
research 17.1
student 17
senior 16.9
portrait 16.8
scientist 16.7
chemistry 16.4
confident 16.4
face 16.3
smiling 15.9
indoors 15.8
happy 15.7
stethoscope 15.6
indoor 15.5
serious 15.3
biology 15.2
education 14.7
corporate 14.6
expertise 14.6
businesswoman 14.5
group 14.5
30s 14.4
elderly 14.4
profession 14.4
bright 14.3
handsome 14.3
science 14.2
teamwork 13.9
mid adult 13.5
chemical 12.7
casual 12.7
day 12.6
exam 12.5
illness 12.4
color 11.7
lifestyle 11.6
test 11.6
confidence 11.5
uniform 11.4
desk 11.3
secretary 11.3
standing 11.3
study 11.2
sitting 11.2
20s 11
associates 10.8
discussing 10.8
executive 10.8
40s 10.7
assistant 10.7
busy 10.6
staff 10.5
talking 10.5
computer 10.4
technology 10.4
surgeon 10.2
two 10.2
camera 10.2
room 10.1
smile 10
specialist 9.9
human 9.8
discussion 9.7
middle aged 9.7
scientific 9.7
couple 9.6
teacher 9.5
table 9.5
women 9.5
meeting 9.4
horizontal 9.2
hand 9.1
pharmacist 8.9
chemist 8.9
coworkers 8.8
clinical 8.8
consultant 8.8
examination 8.8
thoughtful 8.8
development 8.6
thinking 8.6
company 8.4
suit 8.3
treatment 8.3
microscope 7.9
doctors 7.9
30 35 years 7.9
experiment 7.8
businessmen 7.8
writing 7.8
case 7.8
concentration 7.7
corporation 7.7
tube 7.7
modern 7.7
career 7.6
holding 7.4
glasses 7.4
light 7.4
successful 7.3
cheerful 7.3
building 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 97.7
text 96.5
clothing 91.8
indoor 90.6
posing 89.5
man 86.3
human face 76.7
drawing 73.5
poster 66.4
cartoon 51.9
black and white 51.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Sad 95.9%
Calm 1.8%
Angry 0.5%
Confused 0.5%
Surprised 0.5%
Happy 0.4%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.8%
Calm 70.3%
Surprised 19.2%
Happy 2.6%
Confused 2.2%
Angry 2%
Disgusted 1.7%
Fear 1.3%
Sad 0.7%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Sad 81.6%
Calm 5.6%
Confused 4.5%
Happy 3%
Fear 1.6%
Angry 1.3%
Disgusted 1.3%
Surprised 1.1%

AWS Rekognition

Age 42-50
Gender Male, 94.5%
Calm 72.6%
Angry 13.7%
Sad 8.3%
Disgusted 1.7%
Happy 1.1%
Fear 1%
Confused 0.9%
Surprised 0.7%

AWS Rekognition

Age 38-46
Gender Male, 94.7%
Happy 98.6%
Surprised 0.8%
Fear 0.2%
Calm 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%

AWS Rekognition

Age 21-29
Gender Female, 96.9%
Calm 70.6%
Happy 10.9%
Sad 6%
Disgusted 5.4%
Confused 2.3%
Surprised 2.2%
Angry 1.5%
Fear 1.1%

AWS Rekognition

Age 45-53
Gender Female, 62.1%
Happy 85.9%
Calm 5.9%
Surprised 2.9%
Sad 2.5%
Angry 1%
Fear 0.6%
Disgusted 0.6%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Male, 81.6%
Happy 73.9%
Calm 11%
Sad 5.6%
Disgusted 3.2%
Surprised 2.5%
Confused 2%
Angry 1.2%
Fear 0.7%

AWS Rekognition

Age 47-53
Gender Male, 85%
Calm 67.4%
Sad 30.2%
Confused 1.1%
Happy 0.5%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Sad 36.6%
Fear 24.5%
Angry 10%
Calm 9.4%
Surprised 7.4%
Confused 4.9%
Happy 4%
Disgusted 3.3%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 68.6%
Happy 21.6%
Angry 2.4%
Disgusted 1.9%
Surprised 1.7%
Confused 1.7%
Sad 1.5%
Fear 0.6%

Feature analysis

Amazon

Person 99%
Sunglasses 84.7%
Tie 81.7%

Text analysis

Amazon

13535
5
SEGEI
-MAMTSA3
Cola

Google

Sie 13535 ·
Sie
13535
·