Human Generated Data

Title

Untitled (two photographs: portrait of shirtless man boxing in field; studio portrait of uniformed man in studio with sword)

Date

c. 1935, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6105

Human Generated Data

Title

Untitled (two photographs: portrait of shirtless man boxing in field; studio portrait of uniformed man in studio with sword)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clarifai
created on 2019-11-16

people 99.9
man 98.2
adult 97.6
street 95.7
war 95.6
group together 95.2
military 93.9
two 93.8
wear 93.4
actor 93.3
administration 92.7
outfit 91.6
uniform 91.4
portrait 90.5
monochrome 90
movie 89.3
child 88.9
group 87.8
three 87.5
leader 87.4

Imagga
created on 2019-11-16

squeegee 42.6
cleaning implement 36.7
man 24.2
silhouette 22.3
people 22.3
male 19.9
sunset 18.9
person 18
black 17.5
adult 16.9
sport 16.8
shovel 14.5
dark 14.2
water 12.7
posing 12.4
beach 11.8
cleaner 11.5
weapon 11.1
action 11.1
portrait 11
human 10.5
tool 10.5
sun 10.5
walking 10.4
hand tool 10.3
sword 10.2
sky 10.2
exercise 10
dirty 9.9
dress 9.9
model 9.3
outdoor 9.2
danger 9.1
fun 9
one 9
sexy 8.8
body 8.8
hair 8.7
couple 8.7
women 8.7
television 8.7
power 8.4
summer 8.4
ocean 8.3
outdoors 8.2
swing 8.2
protection 8.2
pose 8.1
happy 8.1
fitness 8.1
active 8.1
love 7.9
standing 7.8
device 7.8
attractive 7.7
fashion 7.5
leisure 7.5
lady 7.3
sensuality 7.3
lifestyle 7.2
recreation 7.2
shadow 7.2
businessman 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 92.4
clothing 92
outdoor 91
text 90
man 89
black and white 54.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Male, 54.8%
Angry 53%
Surprised 45%
Sad 45.2%
Happy 45%
Calm 46.7%
Fear 45%
Confused 45.1%
Disgusted 45%

AWS Rekognition

Age 16-28
Gender Male, 53.6%
Angry 45.1%
Happy 45.1%
Disgusted 45%
Confused 45%
Surprised 45.1%
Calm 54.3%
Fear 45%
Sad 45.5%

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a man standing in front of a door 87%
a man holding a baseball bat 34.6%
a black and white photo of a man 34.5%