Human Generated Data

Title

Untitled (two boys and a man seated in workshop, India)

Date

c. 1955 - c. 1975

People

Artist: Leon Levinstein, American 1910 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Eric Alterman, P2001.96

Human Generated Data

Title

Untitled (two boys and a man seated in workshop, India)

People

Artist: Leon Levinstein, American 1910 - 1988

Date

c. 1955 - c. 1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Eric Alterman, P2001.96

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.6
Person 99.6
Person 99.6
Person 97.5
Building 90.3
Face 83.5
Wheel 76.6
Machine 76.6
Urban 76.3
Forge 58.3
Slum 58
Worker 57.9

Clarifai
created on 2023-10-26

people 100
one 99.5
adult 99.5
artisan 97.8
man 97.6
war 96.2
actor 96.1
portrait 94.7
street 93.7
monochrome 93.7
two 91.5
indoors 90.9
child 90.1
dig 88.4
military 88.2
woman 87.4
boy 87
blacksmith 84.8
three 84.1
room 83.6

Imagga
created on 2022-01-22

washboard 33.3
device 31.9
old 24.4
vessel 23.2
bucket 21.3
container 18.9
gong 16.4
industrial 15.4
percussion instrument 14.8
person 13.5
steel 13.3
people 12.8
fashion 12.8
building 12.7
machine 12.1
musical instrument 12
man 11.4
adult 11
human 10.5
metal 10.5
industry 10.2
black 10.2
architecture 10.1
attractive 9.8
wall 9.4
grunge 9.4
light 9.4
potter's wheel 9.3
male 9.3
power 9.2
wheel 9
religion 9
lady 8.9
interior 8.8
urban 8.7
ancient 8.6
concrete 8.6
pretty 8.4
dirty 8.1
posing 8
art 7.8
work 7.8
construction 7.7
iron 7.7
stone 7.6
fire 7.5
one 7.5
vintage 7.4
window 7.3
lifestyle 7.2
portrait 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 97.1
black and white 96.5
text 96.4
clothing 94.4
man 86.9
monochrome 74.8
bicycle 69.1
tire 62.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 96.5%
Angry 96%
Disgusted 1.4%
Sad 0.7%
Calm 0.7%
Confused 0.4%
Fear 0.4%
Surprised 0.3%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Happy 84.9%
Confused 7%
Surprised 2.4%
Fear 2.2%
Sad 1.6%
Angry 1.1%
Disgusted 0.4%
Calm 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Happy 60.6%
Calm 12.8%
Angry 8.4%
Sad 6.6%
Confused 4%
Surprised 2.7%
Disgusted 2.5%
Fear 2.4%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Wheel 76.6%

Captions

Microsoft
created on 2022-01-22

a man sitting on a bed 47.3%
a man sitting on the ground 47.2%
an old photo of a man 47.1%