Human Generated Data

Title

Untitled (maid serving soup to guests, two girls talking with young man, PA)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11927
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (maid serving soup to guests, two girls talking with young man, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.6
Human 99.6
Person 98.6
Person 98.4
Person 97.3
Person 97.1
Person 91.5
Clothing 86
Apparel 86
Tie 71.4
Accessories 71.4
Accessory 71.4
Priest 65.1
People 64.7

Imagga
created on 2022-01-15

barbershop 69.5
shop 58
mercantile establishment 44.5
waiter 42.3
dining-room attendant 34
person 32.6
man 32.3
people 31.8
place of business 29.7
employee 29.4
worker 28.6
male 28.4
adult 25.9
medical 24.7
doctor 23.5
professional 22.1
nurse 21.2
business 20.7
happy 20.1
men 19.8
businessman 19.4
room 19.3
hospital 19.3
patient 19.2
office 17.9
indoors 17.6
smiling 17.4
work 17.3
health 16.7
colleagues 16.5
team 16.1
clinic 15.9
corporate 15.5
group 15.3
establishment 14.8
coat 14.6
businesswoman 14.5
lab coat 14.3
smile 14.3
women 14.2
businesspeople 14.2
job 14.2
couple 13.9
medicine 13.2
clothing 13
portrait 12.9
sitting 12.9
occupation 12.8
indoor 12.8
day 12.6
teamwork 12.1
two 11.9
happiness 11.8
care 11.5
desk 11.3
looking 11.2
casual 11
associates 10.8
bright 10.7
working 10.6
modern 10.5
attractive 10.5
standing 10.4
education 10.4
home 10.4
mature 10.2
lifestyle 10.1
life 9.9
coworkers 9.8
40s 9.7
interior 9.7
lab 9.7
laboratory 9.6
black 9.6
computer 9.6
profession 9.6
table 9.5
uniform 9.5
adults 9.5
color 9.5
meeting 9.4
senior 9.4
suit 9
human 9
success 8.9
case 8.8
together 8.8
teacher 8.7
corporation 8.7
busy 8.7
hairdresser 8.7
30s 8.7
partnership 8.6
face 8.5
career 8.5
clothes 8.4
treatment 8.3
20s 8.2
confident 8.2
family 8
scientist 7.8
sick person 7.8
businessmen 7.8
stethoscope 7.7
illness 7.6
ethnic 7.6
talking 7.6
student 7.5
study 7.5
to 7.1

Google
created on 2022-01-15

Picture frame 93.9
Coat 93.4
Black-and-white 85.1
Style 83.8
Suit 83.1
Vintage clothing 75.4
Monochrome photography 74.6
Monochrome 74.5
Classic 71.9
Event 71.8
Table 71.3
Curtain 70.4
Room 69.1
Art 67.5
Stock photography 63.5
History 62.6
Linens 62.5
Tablecloth 56.8
Chair 56.5
Photographic paper 54.8

Microsoft
created on 2022-01-15

person 93.7
clothing 93.5
text 78.7
man 68.2
vase 51.9
table 50.5

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 90.7%
Calm 91.2%
Happy 6.2%
Sad 0.9%
Angry 0.5%
Fear 0.3%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Male, 55.3%
Happy 60.4%
Calm 24.4%
Sad 9.1%
Surprised 2.4%
Angry 1.3%
Disgusted 0.9%
Fear 0.8%
Confused 0.6%

AWS Rekognition

Age 36-44
Gender Female, 64.1%
Calm 99.6%
Happy 0.2%
Sad 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 67.7%
Calm 100%
Sad 0%
Happy 0%
Surprised 0%
Confused 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 87%
Sad 94.7%
Calm 2%
Angry 1.2%
Fear 0.8%
Happy 0.5%
Disgusted 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 31-41
Gender Female, 93%
Calm 90%
Surprised 3.3%
Happy 2.3%
Angry 1.5%
Disgusted 1.5%
Sad 0.7%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 22-30
Gender Male, 71.6%
Fear 32.6%
Calm 28.3%
Happy 25%
Sad 4.9%
Confused 4.8%
Angry 2.1%
Surprised 1.2%
Disgusted 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 71.4%

Captions

Microsoft

a group of people standing in a room 92.8%
a man and a woman standing in a room 88%
a group of people posing for a photo 80.7%

Text analysis

Amazon

6461
1949

Google

6461 6461
6461