Human Generated Data

Title

Untitled (group of young adults in riding outfits sitting around radio)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5186

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of young adults in riding outfits sitting around radio)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.2
Chair 99.2
Person 99.1
Human 99.1
Clinic 98.8
Person 98.8
Person 98.6
Person 98.3
Person 97.8
Hospital 92.8
Operating Theatre 88.6
Person 84
Doctor 78.5
Indoors 67.7
Room 67.1
People 64.6
Table 60.8
Nurse 56.7
Chair 51.1

Imagga
created on 2022-01-23

nurse 78
man 41.7
person 39.5
people 37.4
adult 36.8
professional 36.2
male 34.1
businessman 31.8
patient 29.2
business 28.6
medical 28.3
businesspeople 27.5
office 27.4
doctor 27.3
hospital 26
team 26
working 25.6
indoors 25.5
happy 25.1
businesswoman 24.6
colleagues 23.3
worker 22.6
coat 21.5
job 21.2
desk 20.8
clinic 20.8
smiling 20.3
room 19.8
work 19.6
teamwork 19.5
health 19.5
corporate 18.9
meeting 18.9
group 18.6
computer 17.6
indoor 17.4
30s 17.3
men 17.2
lab coat 17
associates 16.7
lifestyle 15.9
medicine 15.9
executive 15.7
care 15.6
occupation 15.6
20s 15.6
women 15
portrait 14.9
casual 14.4
table 13.9
coworkers 13.8
successful 13.7
laptop 13.7
looking 13.6
face 13.5
happiness 13.3
manager 13
sitting 12.9
smile 12.8
lab 12.6
laboratory 12.5
talking 12.4
color 12.2
home 12
confident 11.8
day 11.8
cooperation 11.6
test 11.6
bright 11.4
illness 11.4
cheerful 11.4
case 11.3
specialist 11.2
mature 11.2
horizontal 10.9
sick person 10.5
attractive 10.5
education 10.4
two 10.2
camera 10.2
hand 9.9
collaboration 9.9
explaining 9.8
doctors 9.8
discussing 9.8
40s 9.7
discussion 9.7
assistant 9.7
expertise 9.7
chemical 9.7
mid adult 9.7
together 9.6
couple 9.6
boss 9.6
research 9.5
communication 9.2
suit 9
to 8.9
success 8.9
scientist 8.8
diagnosis 8.8
25 30 years 8.8
consultant 8.8
thirties 8.8
examination 8.8
newspaper 8.7
sick 8.7
pharmacist 8.6
four 8.6
profession 8.6
career 8.5
modern 8.4
pretty 8.4
clothing 8.4
treatment 8.3
uniform 7.9
crew 7.9
brunette 7.8
teaching 7.8
two people 7.8
scientific 7.8
partnership 7.7
elderly 7.7
biology 7.6
senior 7.5
presentation 7.5
student 7.4
technology 7.4
new 7.3
handsome 7.1
science 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 97.1
person 93.4
drawing 88.7
clothing 86.5
human face 62.9

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 99.6%
Calm 61.5%
Happy 14.1%
Disgusted 10.7%
Confused 5.1%
Sad 5%
Angry 2%
Surprised 1.1%
Fear 0.6%

AWS Rekognition

Age 27-37
Gender Female, 62.5%
Calm 60.4%
Happy 36.4%
Sad 1.3%
Surprised 0.4%
Angry 0.4%
Disgusted 0.4%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 86.6%
Happy 5.7%
Sad 3.6%
Surprised 1.6%
Confused 0.8%
Angry 0.8%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 23-33
Gender Male, 98.8%
Surprised 69.6%
Sad 11%
Calm 9.9%
Happy 3.3%
Angry 2.7%
Disgusted 2%
Confused 1%
Fear 0.5%

AWS Rekognition

Age 45-53
Gender Male, 96%
Calm 89.7%
Sad 9.2%
Confused 0.6%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.2%
Person 99.1%

Captions

Microsoft

a group of people posing for the camera 77.4%
a group of people posing for a picture 77.3%
a group of people standing around a table 75.4%

Text analysis

Amazon

11523.
11528.
NAOOX
NAOOX VT33A2
VT33A2

Google

)528.
11523.
)528. 11523.