Human Generated Data

Title

Untitled (man with three children in Halloween costumes)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10562
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with three children in Halloween costumes)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 100
Chair 100
Couch 99.6
Person 99.2
Human 99.2
Person 98.3
Person 98.1
Clothing 97.2
Apparel 97.2
Indoors 91.2
Person 90.8
Interior Design 90.4
Living Room 87.6
Room 87.6
Shoe 87.2
Footwear 87.2
Shoe 80.9
Shoe 75.3
Face 71.4
Shorts 68.1
Home Decor 64.8
People 63.3
Shoe 62.4
Portrait 60.9
Photography 60.9
Photo 60.9
Armchair 59.2
Shelf 58.1
Person 51.6

Imagga
created on 2022-01-09

surgeon 29.9
person 29.4
patient 29
iron lung 28.1
man 27.5
people 27.3
respirator 25.4
nurse 21.4
case 19.4
male 19.1
medical 17.6
breathing device 17.3
men 17.2
doctor 16.9
health 15.3
business 15.2
sick person 15.1
device 14.2
medicine 14.1
adult 13.9
equipment 13.7
mask 12.6
work 12.5
professional 12.5
hospital 12.2
human 12
technology 11.9
brass 11.8
room 11.6
working 11.5
group 10.5
women 10.3
worker 9.8
black 9
team 9
businessman 8.8
clinic 8.6
illness 8.6
travel 8.4
life 8.4
wind instrument 8.3
occupation 8.2
care 8.2
indoors 7.9
clothing 7.9
surgery 7.8
education 7.8
chemical 7.7
hand 7.6
sign 7.5
city 7.5
industrial 7.3
negative 7.1
coat 7.1
uniform 7.1
machine 7.1
modern 7

Google
created on 2022-01-09

Font 81.9
Monochrome 70.6
Photo caption 68.1
Monochrome photography 67.5
Vintage clothing 67.2
Room 65.3
Chair 65.1
Stock photography 63
Art 61.8
Advertising 58.5
Illustration 58.3
Sitting 57.8
Motor vehicle 57.4
Photographic paper 56
Suit 55.4
History 54
Crew 50.8

Microsoft
created on 2022-01-09

text 99.8
person 94.7
clothing 87.7
posing 57.3

Face analysis

Amazon

AWS Rekognition

Age 26-36
Gender Male, 80.4%
Surprised 82.4%
Calm 6.9%
Angry 5%
Sad 2.3%
Fear 1.1%
Disgusted 1%
Confused 0.8%
Happy 0.4%

AWS Rekognition

Age 31-41
Gender Male, 96.8%
Calm 84.1%
Sad 5.6%
Happy 5.5%
Surprised 1.7%
Confused 1.2%
Disgusted 0.9%
Angry 0.6%
Fear 0.5%

Feature analysis

Amazon

Person 99.2%
Shoe 87.2%

Captions

Microsoft

a group of people posing for a photo 89.6%
a group of people posing for the camera 89.5%
a group of people posing for a picture 89.4%

Text analysis

Amazon

8
20991.

Google

209 9l• 20991,
209
9l•
20991,