Human Generated Data

Title

Untitled (men and women seated at table laughing)
Date

c. 1938
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7496
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women seated at table laughing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.4
Person 99.4
Tie 99.3
Accessories 99.3
Accessory 99.3
Person 99
Person 93.8
Person 93.5
Sitting 86
Clothing 86
Apparel 86
Leisure Activities 80.3
Musician 73.6
Musical Instrument 73.6
Suit 72.8
Coat 72.8
Overcoat 72.8
Table 70
Furniture 70
Shirt 63.9
Guitar 62.8
Portrait 61.9
Face 61.9
Photography 61.9
Photo 61.9
Meal 59.4
Food 59.4
Tabletop 59.1
Guitarist 57.6
Performer 57.6
Restaurant 56

Imagga
created on 2022-01-08

iron lung 53.6
respirator 42.8
man 38.9
teacher 37.4
person 35.3
breathing device 32.2
blackboard 30.5
male 30.5
people 28.4
classroom 25.7
education 24.2
adult 24.2
nurse 24.2
student 22.9
patient 21.5
device 21
school 20.8
business 20
room 20
businessman 19.4
professional 17.4
class 17.3
office 17
educator 16.5
case 15.2
college 15.2
portrait 14.9
happy 14.4
senior 14
smiling 13.7
board 13.6
to 13.3
meeting 13.2
sick person 12.9
indoor 12.8
sitting 12
looking 12
old 11.8
hospital 11.6
holding 11.5
men 11.2
work 11
chalkboard 10.8
teaching 10.7
modern 10.5
group 10.5
couple 10.4
hand 9.9
team 9.8
science 9.8
cheerful 9.7
human 9.7
indoors 9.7
computer 9.6
exam 9.6
chart 9.6
desk 9.4
casual 9.3
smile 9.3
success 8.8
job 8.8
working 8.8
medical 8.8
home 8.8
students 8.8
30s 8.7
diagram 8.6
study 8.4
sign 8.3
occupation 8.2
handsome 8
interior 8
women 7.9
formula 7.9
mathematics 7.8
black 7.8
teach 7.8
table 7.8
studying 7.7
university 7.6
finance 7.6
child 7.6
plan 7.6
communication 7.6
mature 7.4
20s 7.3
laptop 7.3
lifestyle 7.2
clinic 7.1
creative 7.1
medicine 7
together 7

Google
created on 2022-01-08

Table 86
Cooking 76
Art 70.3
Event 70.2
Science 69.5
Vintage clothing 69.1
Room 67.4
History 61.9
T-shirt 59.5
Hat 56
Monochrome 55.6
Recreation 55.1
Tableware 55.1
Machine 52.5
Visual arts 51.7

Microsoft
created on 2022-01-08

text 99.1
clothing 88.8
person 86.6
black and white 78.2
drawing 70.5

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 82.3%
Surprised 42.3%
Happy 36.5%
Calm 10.6%
Sad 4.9%
Confused 1.9%
Disgusted 1.9%
Fear 1%
Angry 0.9%

AWS Rekognition

Age 45-53
Gender Female, 89.8%
Happy 99.1%
Calm 0.3%
Surprised 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Female, 67.5%
Calm 89.2%
Happy 5%
Sad 4.7%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Female, 98.9%
Surprised 70.5%
Happy 27.3%
Calm 0.9%
Disgusted 0.3%
Confused 0.3%
Sad 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.1%
Happy 69.5%
Calm 17.2%
Surprised 3.2%
Sad 3%
Fear 2.8%
Disgusted 1.7%
Angry 1.4%
Confused 1.2%

AWS Rekognition

Age 38-46
Gender Male, 97.2%
Calm 66.4%
Happy 32.2%
Confused 0.4%
Surprised 0.4%
Disgusted 0.3%
Sad 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 99.3%

Captions

Microsoft

a group of people in a room 88.8%
a group of people standing in a room 84.5%
a group of people posing for a photo 69.9%

Text analysis

Amazon

8779
osengarten
dershelm
eligy
on

Google

Osengarten dershelm oulston FOve ith pres 8779
Osengarten
dershelm
oulston
FOve
ith
pres
8779