Human Generated Data

Title

Untitled (man with tray of drinks/two men holding plates of food)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5245

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with tray of drinks/two men holding plates of food)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99
Person 99
Person 99
Clothing 98.7
Apparel 98.7
Person 98.5
Person 97.8
Person 97.6
Person 97
Person 92.2
Scientist 86.8
Person 84.8
Coat 84.3
Suit 84.3
Overcoat 84.3
Clinic 77.4
Suit 72.1
Accessories 61.6
Accessory 61.6
Tie 61.6
People 60.6
Fashion 59.6
Robe 59.6
Gown 57.5
Shirt 55.5
Lab Coat 55.4

Imagga
created on 2022-01-23

lab coat 69.7
coat 62.8
man 52.5
person 44.6
male 43.3
professional 40.2
patient 39.2
adult 38.3
doctor 37.7
people 34.1
businessman 31.8
medical 31.8
hospital 31.4
office 30.6
business 29.8
nurse 29.5
colleagues 29.2
team 27.8
indoors 26.4
clinic 26.4
mature 25.2
practitioner 24.5
happy 24.5
garment 24.4
businesspeople 23.8
specialist 23.3
smiling 23.2
job 23
elderly 23
health 23
desk 22.7
looking 22.4
working 22.1
casual 22.1
worker 21.9
clothing 21.1
businesswoman 20.9
meeting 20.8
senior 20.7
men 20.6
care 20.6
work 20.4
medicine 20.3
indoor 20.1
teamwork 19.5
occupation 19.3
camera 18.5
case 17.8
group 17.8
associates 17.7
corporate 17.2
sitting 17.2
sick person 17.1
portrait 16.9
lifestyle 16.7
40s 16.6
day 16.5
table 16.5
30s 16.4
talking 16.2
computer 16.1
coworkers 15.7
bright 15
face 14.9
20s 14.7
room 14.6
color 14.5
women 14.3
stethoscope 14.2
clinical 13.7
laptop 13.7
illness 13.4
old 13.3
together 13.2
home 12.8
mid adult 12.6
executive 12.5
uniform 12.4
couple 12.2
cheerful 12.2
smile 12.1
doctors 11.8
discussing 11.8
healing 11.8
happiness 11.8
horizontal 11.7
suit 11.7
expertise 11.7
handsome 11.6
four 11.5
modern 11.2
pharmacist 11.1
treatment 11
successful 11
confident 10.9
50s 10.8
discussion 10.7
assistant 10.7
busy 10.6
profession 10.5
attractive 10.5
standing 10.4
light 10
business people 9.9
fifties 9.9
crew 9.9
forties 9.8
good mood 9.8
businessmen 9.8
technology 9.7
employee 9.5
ethnic 9.5
two 9.3
inside 9.2
life 9.1
clinician 8.9
general practitioner 8.9
boardroom 8.9
expert 8.9
success 8.9
30 35 years 8.9
heal 8.8
diagnosis 8.8
consultant 8.8
thirties 8.8
older 8.8
cooperation 8.7
corporation 8.7
twenties 8.6
help 8.4
health professional 8.3
human 8.3
teacher 8
explaining 7.9
colleague 7.8
middle aged 7.8
examination 7.8
sick 7.7
exam 7.7
hand 7.6
surgeon 7.5
manager 7.5

Google
created on 2022-01-23

Shirt 94.8
Coat 87.9
Gesture 85.3
Black-and-white 85.1
Monochrome photography 75.6
Monochrome 75.4
Snapshot 74.3
White-collar worker 74.2
Tie 73.6
Suit 73.5
Art 73.2
Event 72.9
Service 68.9
Font 66.5
Hat 65.5
Vintage clothing 64.7
Cooking 63.8
Stock photography 63
Room 62.5
Job 62.3

Microsoft
created on 2022-01-23

text 97.5
person 94
man 91.7
clothing 86.8
indoor 85.8
human face 79.8
drawing 63.6
old 55

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 56.3%
Sad 26%
Confused 7%
Surprised 6.6%
Disgusted 2%
Angry 0.9%
Happy 0.7%
Fear 0.4%

AWS Rekognition

Age 53-61
Gender Male, 98.2%
Calm 99%
Surprised 0.3%
Sad 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Sad 87.6%
Happy 5.1%
Calm 3.2%
Confused 1.2%
Surprised 1.1%
Angry 1%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Male, 98.9%
Happy 97.8%
Surprised 0.8%
Calm 0.8%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 42-50
Gender Male, 59.3%
Sad 50.6%
Happy 35.1%
Confused 7.4%
Calm 3.1%
Angry 1.3%
Fear 0.9%
Surprised 0.9%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 84.3%
Tie 61.6%

Captions

Microsoft

a group of people looking at each other 86.4%
a group of people looking at the camera 86.3%
a group of people standing in a kitchen 84.6%

Text analysis

Amazon

ة
YT3RAS
seas
seas YT3RAS A30M333
A30M333

Google

830M33
830M33