Human Generated Data

Title

Untitled (four men in tuxedos, two seated women, maid serving soup at table)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5305
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men in tuxedos, two seated women, maid serving soup at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 98.7
Person 98.7
Person 98.4
Person 98.2
Person 94.1
Clinic 71.6
People 69.2
Clothing 69.1
Apparel 69.1
Food 67
Meal 67
Indoors 59
Furniture 58.8
Crowd 57.4
Priest 56.6
Room 55.2

Imagga
created on 2022-01-22

lab coat 62.3
coat 54.3
person 38.7
man 37
people 33.5
male 33.4
adult 31.2
professional 26.1
garment 25.9
waiter 25.7
clothing 25.3
worker 24.6
happy 22.6
business 22.5
colleagues 22.4
businessman 22.1
groom 22
doctor 21.6
medical 21.2
office 20.9
work 19.6
employee 19.6
couple 19.2
dining-room attendant 19.1
patient 18.9
team 18.8
smiling 18.8
businesswoman 18.2
men 18
clinic 17.8
indoors 17.6
indoor 17.4
corporate 17.2
businesspeople 17.1
women 16.6
group 16.1
room 15.5
nurse 15.4
hospital 15.3
health 15.3
casual 15.3
job 15.1
portrait 14.9
associates 14.8
lab 14.6
laboratory 14.5
lifestyle 14.5
smile 14.3
day 14.1
mature 14
teamwork 13.9
coworkers 13.8
looking 13.6
two 13.6
face 13.5
happiness 13.3
attractive 13.3
desk 13.2
medicine 13.2
meeting 13.2
sitting 12.9
bright 12.9
occupation 12.8
30s 12.5
working 12.4
cheerful 12.2
home 12
modern 11.9
20s 11.9
scientist 11.8
color 11.7
mid adult 11.6
together 11.4
senior 11.3
computer 11.2
40s 10.7
care 10.7
barbershop 10.5
research 10.5
table 10.4
clothes 10.3
life 10.3
shop 9.8
corporation 9.7
standing 9.6
uniform 9.5
talking 9.5
human 9
science 8.9
success 8.9
interior 8.9
businessmen 8.8
assistant 8.8
chemistry 8.7
busy 8.7
jacket 8.7
education 8.7
profession 8.6
ethnic 8.6
adults 8.5
manager 8.4
sick person 8.4
student 8.3
holding 8.3
case 8.2
suit 8.1
30 35 years 7.9
chemical 7.7
partnership 7.7
four 7.7
elderly 7.7
biology 7.6
career 7.6
executive 7.5
study 7.5
focus 7.4
light 7.4
catholic 7.2
building 7.1
pretty 7

Google
created on 2022-01-22

Picture frame 94.7
Photograph 94.1
Coat 91.3
Black-and-white 85.7
Interior design 85.3
Style 83.8
Table 74.6
Monochrome photography 74.1
Monochrome 73.8
Suit 73.2
Vintage clothing 73
Event 72.8
Curtain 70.7
Room 70.2
Classic 69.9
Stock photography 63.8
Uniform 63.2
Tablecloth 63
Plant 62.7
History 60.4

Microsoft
created on 2022-01-22

text 94.1
wedding dress 93.1
clothing 90.1
person 86
bride 84.8
vase 79.8
man 75.5
white 68.5
black and white 53.7
table 52.9

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 79.3%
Calm 65.4%
Happy 33.3%
Sad 0.5%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Female, 89%
Happy 82.1%
Surprised 6.4%
Calm 6.3%
Sad 1.3%
Confused 1.1%
Fear 1%
Angry 1%
Disgusted 0.8%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 99.8%
Sad 0.1%
Confused 0%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 79.4%
Happy 43.3%
Surprised 27.5%
Calm 25.8%
Sad 1.7%
Fear 0.5%
Confused 0.4%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 22-30
Gender Female, 86.3%
Calm 98.8%
Surprised 0.7%
Happy 0.2%
Sad 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Female, 85.2%
Calm 39.2%
Surprised 33%
Happy 10.7%
Sad 7.2%
Angry 6.3%
Fear 1.2%
Disgusted 1.2%
Confused 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 77.7%
an old photo of a person 77.6%
a group of people standing in a room 77.5%

Text analysis

Amazon

6462

Google

6462
6462 6462