Human Generated Data

Title

Untitled (two men working in foundry)
Date

c. 1946
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15996

Human Generated Data

Title

Untitled (two men working in foundry)

People

Artist: Jack Gould, American

Date

c. 1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 98.7
Person 98.7
Apparel 90
Clothing 90
Wood 87.5
Painting 83.6
Art 83.6
Person 80.9
Carpenter 76.4
Face 64.2
Soil 62.7
Photography 61.3
Photo 61.3

Imagga
created on 2022-03-25

person 22.4
man 21.5
people 19.5
male 17.1
old 13.2
container 12.9
black 12.6
happy 12.5
adult 12.4
rubbish 11.6
mask 11.1
religion 10.7
worker 10.7
home 10.4
hospital 10
hand 9.9
portrait 9.7
newspaper 9.5
clothing 9.4
face 9.2
child 9.2
work 9.1
men 8.6
equipment 8.3
medical 7.9
love 7.9
uniform 7.9
smile 7.8
scholar 7.7
nurse 7.7
television 7.7
human 7.5
religious 7.5
care 7.4
bag 7.4
girls 7.3
dress 7.2
looking 7.2
holiday 7.2
history 7.2
baby bed 7.1
kid 7.1
working 7.1
travel 7
product 7

Google
created on 2022-03-25

Gesture 85.3
Style 83.8
Black-and-white 82.8
Font 74
Monochrome photography 71.1
Monochrome 69.5
Art 69.5
Vintage clothing 69.2
Sitting 62.6
Flash photography 62.4
Stock photography 62
Paper product 61.5
Still life photography 61.4
Rectangle 57.5
Room 57.3
Palm tree 57.1
Paper 57.1
Photographic paper 54.4
Visual arts 54.2
Photo caption 53.8

Microsoft
created on 2022-03-25

text 96.5
clothing 78.7
black and white 71.6
person 65.4
white 63.2
old 40.5

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Happy 38.4%
Calm 22.1%
Disgusted 20.5%
Fear 6.4%
Confused 4.5%
Surprised 3.1%
Sad 2.9%
Angry 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 83.6%

Captions

Microsoft

a vintage photo of a man 75.4%
a vintage photo of a man with a suitcase 65.4%
a vintage photo of a man sleeping in a suitcase 39.3%