Human Generated Data

Title

Untitled (men dressed in costumes seated at table)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4961

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men dressed in costumes seated at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Person 99.5
Person 99.5
Person 99.4
Sitting 94.8
Furniture 93.5
Table 93.5
Dining Table 92.6
Person 91.7
Restaurant 84.9
Room 80.9
Indoors 80.9
Glass 72.9
Dining Room 68.7
Face 66.5
Portrait 66.5
Photo 66.5
Photography 66.5
Beverage 56.1
Drink 56.1
Dating 56.1

Imagga
created on 2022-01-23

person 44.3
man 42.4
coat 35.8
lab coat 35.1
people 32.3
male 31.2
work 27.5
adult 25.3
sitting 24.9
table 24.6
medical 23.8
patient 22.8
professional 22.6
office 21.9
senior 21.5
worker 21.4
indoors 20.2
men 19.7
businessman 19.4
happy 18.8
desk 18.5
working 17.7
business 17.6
home 17.5
smiling 17.4
meeting 17
surgeon 16.9
student 16.5
doctor 16
room 16
job 15.9
portrait 15.5
team 15.2
executive 15.2
looking 15.2
laptop 14.6
specialist 14.5
group 14.5
laboratory 14.5
scientist 13.7
garment 13.5
biology 13.3
medicine 13.2
health 13.2
couple 13.1
mature 13
education 13
teacher 12.9
chemistry 12.6
together 12.3
nurse 12.2
teamwork 12.1
computer 12
human 12
occupation 11.9
suit 11.7
lab 11.7
test 11.5
to 11.5
research 11.4
businesspeople 11.4
clothing 11.2
hospital 11.2
glasses 11.1
women 11.1
equipment 10.9
sick person 10.8
technician 10.8
case 10.7
assistant 10.7
science 10.7
interior 10.6
modern 10.5
clinic 10.4
corporate 10.3
businesswoman 10
face 9.9
holding 9.9
chemical 9.8
technology 9.6
exam 9.6
elderly 9.6
serious 9.5
talking 9.5
lifestyle 9.4
smile 9.3
hand 9.1
care 9.1
color 8.9
conference 8.8
industry 8.5
two 8.5
classroom 8.4
manager 8.4
presentation 8.4
inside 8.3
indoor 8.2
confident 8.2
success 8
handsome 8
experiment 7.8
colleagues 7.8
planner 7.7
salon 7.7
retirement 7.7
old 7.7
husband 7.6
ethnic 7.6
development 7.6
college 7.6
horizontal 7.5
study 7.5
successful 7.3
cheerful 7.3
microscope 7.3
board 7.2
school 7.2
life 7.1
happiness 7

Google
created on 2022-01-23

Shirt 95.3
Photograph 94.2
Tableware 93.4
Drinkware 90
Black 89.8
Table 87.5
Black-and-white 87.1
Style 84.1
Monochrome photography 78.4
Monochrome 77.6
Eyewear 75
Snapshot 74.3
Art 73.6
T-shirt 73.5
Science 72.4
Event 71.6
Room 67.6
Glass 67.6
Drink 66.9
Font 66.1

Microsoft
created on 2022-01-23

text 99.3
wall 98.7
person 97.1
indoor 95.6
bottle 94.5
drink 92.8
soft drink 91.9
human face 89.2
man 83.8
black and white 77.7
clothing 76.5
glasses 65.7

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 65.6%
Calm 99.3%
Sad 0.2%
Fear 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0%

AWS Rekognition

Age 41-49
Gender Male, 99.4%
Happy 98.8%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%
Calm 0.2%
Angry 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Female, 75.7%
Calm 37.8%
Fear 27.8%
Sad 10.7%
Angry 8%
Surprised 7.3%
Confused 4.1%
Disgusted 3%
Happy 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people sitting at a table 94.7%
a group of people standing around a table 94.6%
a group of people sitting around a table 94.4%

Text analysis

Amazon

10942
as
109

Google

10942
To942.
10942 To942.