Human Generated Data

Title

Untitled (studio portrait of boy in knee pants and white belt standing)

Date

c. 1905-1915, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5979

Human Generated Data

Title

Untitled (studio portrait of boy in knee pants and white belt standing)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.4
Person 98.4
Person 96.6
Clothing 91.8
Apparel 91.8
Overcoat 88.6
Coat 88.6
Suit 79.8
Man 66
Accessories 60.2
Tie 60.2
Accessory 60.2
Furniture 55.5
Chair 55.5

Clarifai
created on 2019-11-16

people 100
portrait 99.1
man 98.1
adult 97.6
group 95.3
two 95.3
wear 95.1
monochrome 95
actor 93.1
outfit 91.5
group together 90.7
three 90.1
movie 88.3
child 87.7
music 87.2
leader 85.8
woman 81.9
dancer 81.3
boy 80.1
room 79.4

Imagga
created on 2019-11-16

person 32.5
world 25.5
adult 24.7
dark 23.4
man 22.9
silhouette 22.4
people 22.3
male 19.2
black 17.1
one 15.7
portrait 15.5
sexy 15.3
body 15.2
model 14.8
style 14.1
attractive 14
mask 13.8
posing 13.3
fashion 12.8
human 12
sensuality 11.8
water 11.3
hair 11.1
light 10.8
sunset 10.8
shadow 10.8
night 10.7
urban 10.5
city 10
studio 9.9
cool 9.8
sky 9.6
alone 9.1
dirty 9
fitness 9
dress 9
landscape 8.9
darkness 8.8
looking 8.8
clothing 8.7
couple 8.7
suit 8.7
grunge 8.5
skin 8.5
beach 8.4
evening 8.4
sport 8.4
sensual 8.2
pose 8.2
sun 8.1
lifestyle 8
women 7.9
business 7.9
boy 7.8
horror 7.8
travel 7.7
sitting 7.7
naked 7.7
old 7.7
performer 7.7
walk 7.6
balance 7.6
passion 7.5
window 7.4
lady 7.3
covering 7.3
wet 7.2
love 7.1
spectator 7.1
modern 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 98.5
text 97.8
person 97.1
human face 95.4
black and white 93.4
suit 88.2
man 80.9
posing 59.9
monochrome 55.2
smile 50.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Male, 89.2%
Disgusted 0.4%
Happy 0.2%
Angry 2.4%
Confused 2.5%
Calm 44.7%
Fear 0.5%
Sad 49.1%
Surprised 0.2%

AWS Rekognition

Age 2-8
Gender Female, 60.7%
Angry 0.1%
Surprised 0%
Sad 97%
Happy 0%
Calm 2.1%
Fear 0.6%
Confused 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Suit 79.8%
Tie 60.2%

Captions

Microsoft

a group of people posing for a photo 91.2%
a man and woman posing for a photo 79.6%
a man and a woman posing for a photo 79.5%