Human Generated Data

Title

Untitled (two couples at a ball seated near the stage)

Date

c.1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5632

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples at a ball seated near the stage)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c.1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.2
Human 99.2
Person 98.6
Person 96.8
Scientist 94
Person 86.2
Clothing 82.6
Apparel 82.6
Clinic 72.5
Crowd 71.4
Person 66.8
People 65.8
Face 60.5
Coat 60.3
Lab 56.6

Imagga
created on 2021-12-15

nurse 59
man 39.6
person 36.4
male 35.5
people 33.5
businessman 32.7
business 29.8
patient 29.5
adult 27.3
colleagues 25.3
professional 23.9
businesspeople 20.9
team 20.6
job 20.3
businesswoman 20
office 19.3
doctor 18.8
medical 18.5
work 18.1
hospital 17.9
case 17.9
happy 17.5
smiling 17.4
men 17.2
group 16.9
working 16.8
40s 16.5
portrait 16.2
worker 16.1
indoors 15.8
daily 15.6
casual 15.2
looking 15.2
meeting 15.1
associates 14.7
corporate 14.6
coat 14.5
desk 14.2
day 14.1
teamwork 13.9
coworkers 13.7
occupation 13.7
20s 13.7
30s 13.5
lab coat 13.4
health 13.2
senior 13.1
face 12.8
room 12.6
sick person 12.3
bright 12.2
manager 12.1
mature 12.1
suit 11.7
color 11.1
women 11.1
clinic 11
indoor 11
discussing 10.8
forties 10.8
smile 10.7
four 10.5
attractive 10.5
illness 10.5
talking 10.5
computer 10.4
life 10.3
lifestyle 10.1
jacket 9.9
business people 9.9
cheerful 9.7
assistant 9.7
happiness 9.4
executive 9.4
camera 9.2
successful 9.1
care 9.1
technology 8.9
four people 8.9
clothing 8.8
medicine 8.8
discussion 8.8
standing 8.7
education 8.7
table 8.7
profession 8.6
sitting 8.6
company 8.4
success 8
light 8
home 8
together 7.9
crew 7.9
writing 7.8
lab 7.8
laboratory 7.7
busy 7.7
engineer 7.7
specialist 7.7
student 7.7
chart 7.6
twenties 7.6
hand 7.6
plan 7.6
new 7.3
laptop 7.3
confident 7.3
building 7.2
interior 7.1
architecture 7
modern 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 98.5
drawing 96.3
person 94.8
sketch 90
clothing 87.8
outdoor 87.2
man 83.8
cartoon 82.4
black and white 64.3

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Female, 94.9%
Sad 64.7%
Calm 19.8%
Happy 14%
Confused 0.7%
Angry 0.3%
Fear 0.3%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 68.6%
Calm 45.4%
Happy 22%
Angry 13.9%
Surprised 5.8%
Sad 5.3%
Fear 5.1%
Confused 1.8%
Disgusted 0.8%

AWS Rekognition

Age 23-35
Gender Male, 91%
Calm 54%
Sad 45.5%
Angry 0.1%
Confused 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man doing a trick on a skateboard 34%
a group of people jumping in the air 33.9%
a man jumping in the air 33.8%

Text analysis

Amazon

10
13951.

Google

10
13951
13951 13951. 10
13951.