Human Generated Data

Title

Untitled (six people sitting around table on cruise ship)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4833
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (six people sitting around table on cruise ship)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.8
Human 99.8
Person 99.5
Person 99.3
Person 99.3
Person 98.6
Furniture 97.6
Restaurant 97
Chair 95.7
Table 95.1
Dining Table 94.9
Person 92
Person 84.9
Room 84.5
Indoors 84.5
Meal 81.5
Food 81.5
Cafeteria 77.1
People 72.2
Food Court 65.6
Clinic 61.3
Dish 59.7
Dining Room 59.1
Couch 55.2

Imagga
created on 2022-01-29

hospital 52.7
man 34.3
person 32.2
patient 31.4
people 27.9
adult 27.3
male 22.7
nurse 21.7
men 20.6
couple 20
indoors 19.3
happy 18.2
case 18.1
passenger 17.8
sick person 17.1
lifestyle 16.6
women 16.6
room 16.3
love 15.8
work 15.7
happiness 15.7
home 15.1
modern 14.7
smiling 14.5
worker 14.4
specialist 14.4
health 13.9
together 13.1
portrait 12.9
two 12.7
interior 12.4
medical 12.4
professional 12
casual 11.9
groom 11.6
team 11.6
holding 11.5
business 11.5
looking 11.2
sitting 11.2
treatment 11
working 10.6
medicine 10.6
office 10.5
equipment 10.4
doctor 10.3
senior 10.3
care 9.9
human 9.7
businessman 9.7
elderly 9.6
illness 9.5
surgeon 9.5
bed 9.5
meeting 9.4
day 9.4
relaxation 9.2
horizontal 9.2
house 9.2
family 8.9
group 8.9
computer 8.8
married 8.6
model 8.5
smile 8.5
face 8.5
adults 8.5
togetherness 8.5
enjoyment 8.4
old 8.4
leisure 8.3
laptop 8.2
dress 8.1
casual clothing 7.8
two people 7.8
clinic 7.7
bride 7.7
grandma 7.6
comfortable 7.6
enjoying 7.6
fun 7.5
technology 7.4
teamwork 7.4
camera 7.4
vacation 7.4
wedding 7.4
joyful 7.3
color 7.2
clothing 7.1
romantic 7.1
kin 7.1
job 7.1
table 7

Google
created on 2022-01-29

Black 89.7
Black-and-white 84.2
Chair 80.7
Table 76.5
Hat 74.9
Snapshot 74.3
Monochrome photography 74.1
Monochrome 74.1
Event 70.9
Vintage clothing 69.7
Room 66.7
Cooking 63.8
Stock photography 62.4
History 62.2
Service 62.1
Recreation 60.9
Sitting 60.8
Team 60.6
Art 54.6
Suit 54.6

Microsoft
created on 2022-01-29

person 98.5
clothing 96.3
table 95.9
man 90.6
text 87.1
people 60
food 58.3
black and white 52.1

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 98.3%
Calm 59.7%
Happy 16.5%
Sad 13.5%
Angry 3.3%
Confused 2.8%
Disgusted 1.9%
Fear 1.2%
Surprised 1.1%

AWS Rekognition

Age 39-47
Gender Female, 61.7%
Calm 73.8%
Surprised 14%
Happy 8.1%
Sad 1.3%
Confused 0.9%
Disgusted 0.9%
Angry 0.5%
Fear 0.5%

AWS Rekognition

Age 28-38
Gender Female, 78.5%
Calm 73.2%
Sad 20.1%
Happy 3%
Angry 1.1%
Fear 0.8%
Confused 0.8%
Disgusted 0.5%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 95.7%

Captions

Microsoft

a group of people standing in a room 93.9%
a group of people standing around a table 90.4%
a group of people in a room 90.3%

Text analysis

Amazon

A78A
VT2742 A78A
VT2742