Human Generated Data

Title

Untitled (group of musicians)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.49

Human Generated Data

Title

Untitled (group of musicians)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.49

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.5
Human 99.5
Person 99.2
Person 98.5
Person 96.5
Person 95.3
Art 94.2
Painting 94.2
Person 92
People 68.7

Clarifai
created on 2018-10-18

people 100
group 99.9
adult 99.4
several 97.6
many 96.9
three 96.4
four 96.2
two 96.2
wear 96.1
man 96.1
group together 95.9
woman 94.3
print 91.6
military 91.2
vehicle 91.2
administration 91
five 89.7
furniture 89.1
one 88.8
child 88.1

Imagga
created on 2018-10-18

kin 37
statue 28.9
sculpture 28.1
ancient 22.5
religion 21.5
art 20.4
old 20.2
newspaper 19.5
ruler 17.5
culture 17.1
stone 16.9
architecture 16.4
history 15.2
monument 14.9
product 14.6
man 14.3
historical 14.1
religious 13.1
historic 12.8
travel 12.7
temple 12.6
vintage 12.4
tourism 12.4
god 11.5
creation 11.4
world 11.2
wall 11.1
person 10.9
antique 10.5
people 10
decoration 10
spiritual 9.6
building 9.5
grunge 9.4
famous 9.3
dollar 9.3
human 9
currency 9
carving 8.9
body 8.8
roman 8.8
symbol 8.7
male 8.5
money 8.5
figure 8.2
design 8.2
paper 7.8
sepia 7.8
spirituality 7.7
city 7.5
traditional 7.5
one 7.5
closeup 7.4
banking 7.3

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

outdoor 97.8
old 96.5
vintage 67.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 88.1%
Surprised 4.8%
Calm 31.9%
Angry 22.8%
Sad 8.7%
Happy 5.2%
Confused 16%
Disgusted 10.6%

AWS Rekognition

Age 20-38
Gender Male, 79.3%
Angry 5.3%
Surprised 1.9%
Calm 34.5%
Sad 39.3%
Disgusted 13.3%
Confused 2.5%
Happy 3.3%

AWS Rekognition

Age 26-43
Gender Female, 81.5%
Disgusted 0.6%
Angry 11.3%
Sad 41%
Surprised 1.9%
Confused 1.2%
Happy 1.7%
Calm 42.4%

AWS Rekognition

Age 27-44
Gender Female, 78.8%
Angry 2.1%
Calm 64.2%
Surprised 2.3%
Disgusted 3.7%
Confused 0.9%
Sad 7.4%
Happy 19.3%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Surprised 1.8%
Disgusted 3.5%
Sad 28%
Confused 2.6%
Happy 1.8%
Angry 3.3%
Calm 59%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 94.2%