Human Generated Data

Title

Untitled (two men working in foundry)

Date

c. 1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15996

Human Generated Data

Title

Untitled (two men working in foundry)

People

Artist: Jack Gould, American

Date

c. 1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 98.7
Person 98.7
Apparel 90
Clothing 90
Wood 87.5
Painting 83.6
Art 83.6
Person 80.9
Carpenter 76.4
Face 64.2
Soil 62.7
Photography 61.3
Photo 61.3

Imagga
created on 2022-03-25

person 22.4
man 21.5
people 19.5
male 17.1
old 13.2
container 12.9
black 12.6
happy 12.5
adult 12.4
rubbish 11.6
mask 11.1
religion 10.7
worker 10.7
home 10.4
hospital 10
hand 9.9
portrait 9.7
newspaper 9.5
clothing 9.4
face 9.2
child 9.2
work 9.1
men 8.6
equipment 8.3
medical 7.9
love 7.9
uniform 7.9
smile 7.8
scholar 7.7
nurse 7.7
television 7.7
human 7.5
religious 7.5
care 7.4
bag 7.4
girls 7.3
dress 7.2
looking 7.2
holiday 7.2
history 7.2
baby bed 7.1
kid 7.1
working 7.1
travel 7
product 7

Microsoft
created on 2022-03-25

text 96.5
clothing 78.7
black and white 71.6
person 65.4
white 63.2
old 40.5

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Happy 38.4%
Calm 22.1%
Disgusted 20.5%
Fear 6.4%
Confused 4.5%
Surprised 3.1%
Sad 2.9%
Angry 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 83.6%

Captions

Microsoft

a vintage photo of a man 75.4%
a vintage photo of a man with a suitcase 65.4%
a vintage photo of a man sleeping in a suitcase 39.3%