Human Generated Data

Title

Untitled (rail worker)

Date

c. 1970

People

Artist: Michael Mathers, American born 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1816

Human Generated Data

Title

Untitled (rail worker)

People

Artist: Michael Mathers, American born 1945

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Railway 99.9
Train Track 99.9
Rail 99.9
Transportation 99.9
Person 93.9
Human 93.9
Coal 68.9
Worker 55.5

Imagga
created on 2022-01-22

statue 57.1
sculpture 39.3
old 27.2
religion 25.1
mask 24.8
art 24.4
history 24.1
monument 23.3
ancient 22.5
trench coat 22.2
architecture 21.3
god 20.1
covering 19.8
helmet 18.9
culture 18.8
raincoat 18.7
coat 17.9
cloak 17.4
stone 16.9
church 15.7
historical 15.1
religious 15
antique 14.7
catholic 14.6
city 14.1
man 14.1
famous 14
travel 13.4
historic 12.8
landmark 12.6
saint 12.5
faith 12.4
armor plate 12.3
detail 12.1
building 11.9
protective covering 11.8
holy 11.6
tourism 11.5
symbol 11.4
marble 10.8
figure 10.2
dress 9.9
roman 9.7
clothing 9.6
bronze 9.4
black 9.3
person 9.3
tourist 9.3
male 9.2
temple 9
angel 8.8
cathedral 8.7
spirituality 8.6
wall 8.6
face 8.5
adult 8.4
people 8.4
protection 8.2
carving 8
cadaver 8
spiritual 7.7
garment 7.7
dark 7.5
vintage 7.4
style 7.4
plate 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

outdoor 99.6
text 98.7
person 97.9
clothing 95
man 93.6
black and white 91.3
human face 85.9
standing 81.5
monochrome 77.9
white 61.5
posing 61.3
old 59.3
jacket 53.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Sad 73.8%
Fear 7.1%
Confused 6.9%
Calm 5.6%
Surprised 2.1%
Angry 2%
Happy 1.8%
Disgusted 0.7%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.9%

Captions

Microsoft

a man posing for a photo 92.8%
a person standing posing for the camera 92.7%
a person posing for the camera 92.6%