Human Generated Data

Title

Untitled (six performers: musicians, a snake charmer, and two jugglers)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.50

Human Generated Data

Title

Untitled (six performers: musicians, a snake charmer, and two jugglers)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.50

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.6
Person 99.6
Person 99.5
Person 99.4
Person 99.4
Person 97.7
Person 97.7
Painting 93.3
Art 93.3
Sea Life 93.1
Reptile 93.1
Animal 93.1
Turtle 93.1
Musician 91.4
Musical Instrument 91.4
Leisure Activities 85.8
Clothing 75.7
Apparel 75.7
Shorts 75.7
People 62.1
Figurine 59.9
Guitarist 58.9
Performer 58.9
Guitar 58.9
Jaw 58.7
Music Band 57.2

Clarifai
created on 2018-10-19

people 100
group 99
adult 98.9
group together 97.7
man 97.3
wear 95.2
several 95
two 94.2
woman 92.8
three 92.7
veil 92.6
one 92.6
many 92.1
four 91.3
portrait 88.5
watercraft 88.2
five 85.3
position 85.3
monochrome 84.1
war 83.7

Imagga
created on 2018-10-19

sexy 32.1
body 30.4
person 28.4
model 27.2
adult 24.8
portrait 23.3
fashion 21.9
attractive 21
black 20.4
posing 20.4
people 19.5
swimsuit 19
kin 18.6
man 18.1
male 17.8
human 17.2
dress 17.2
clothing 16.5
style 16.3
pretty 16.1
garment 16
fitness 15.4
muscular 15.3
face 14.9
sensual 14.5
sensuality 13.6
hair 13.5
bikini 13.3
sport 13.3
skin 12.9
maillot 12.8
brunette 12.2
lady 12.2
strength 12.2
love 11.8
gorgeous 11.8
pose 11.8
dark 11.7
couple 11.3
strong 11.2
figure 11.1
training 11.1
women 11.1
exercise 10.9
lifestyle 10.8
torso 10.7
healthy 10.7
erotic 10.7
muscle 10.6
art 10.5
one 10.4
looking 10.4
elegance 10.1
studio 9.9
naked 9.6
energy 9.2
dancer 9.2
makeup 9.1
covering 9.1
handsome 8.9
sculpture 8.6
fashionable 8.5
decoration 8.5
power 8.4
relaxation 8.4
old 8.4
health 8.3
vintage 8.3
holding 8.3
stylish 8.1
cute 7.9
performer 7.9
macho 7.9
athlete 7.9
wall 7.8
ancient 7.8
fan 7.7
elegant 7.7
sexual 7.7
seductive 7.6
blond 7.4
slim 7.4
fit 7.4
musical instrument 7.2
travel 7

Google
created on 2018-10-19

Microsoft
created on 2018-10-19

old 98.4
person 98.4
text 97.3
wall 96.5
book 95.2
outdoor 90.7
player 87.7
vintage 68.6
white 67.6
posing 59.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 89.3%
Happy 4%
Sad 4%
Disgusted 7.5%
Confused 8.7%
Angry 8.2%
Surprised 5%
Calm 62.7%

AWS Rekognition

Age 26-43
Gender Male, 75%
Disgusted 1.1%
Calm 44.3%
Surprised 1.8%
Angry 29.1%
Happy 1.6%
Sad 19.7%
Confused 2.3%

AWS Rekognition

Age 26-43
Gender Female, 90.8%
Surprised 2%
Confused 4.2%
Angry 3.8%
Happy 2.6%
Disgusted 11.2%
Sad 71.7%
Calm 4.5%

AWS Rekognition

Age 26-43
Gender Male, 87.9%
Angry 8.1%
Surprised 5%
Calm 60.7%
Sad 16.4%
Disgusted 3.6%
Confused 4.2%
Happy 2%

AWS Rekognition

Age 48-68
Gender Male, 96.6%
Angry 40.7%
Happy 1.3%
Calm 47%
Sad 4.9%
Surprised 1.6%
Confused 3.6%
Disgusted 0.9%

AWS Rekognition

Age 27-44
Gender Male, 56%
Calm 3.7%
Disgusted 0.6%
Sad 90.9%
Happy 0.4%
Angry 1.2%
Confused 2.8%
Surprised 0.4%

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 93.3%
Turtle 93.1%

Categories