Human Generated Data

Title

Untitled (musicians)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.79

Human Generated Data

Title

Untitled (musicians)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.79

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.8
Human 99.8
Person 99.7
Person 99.3
Person 98.7
Painting 97.9
Art 97.9
Military 80.1
Military Uniform 78.9
Clothing 68.3
Apparel 68.3
Outdoors 65.7
Nature 56.8
Soldier 56.7
Officer 55.7

Clarifai
created on 2018-10-18

people 100
group 99.9
adult 99.9
wear 99.5
two 99.4
group together 98.9
man 98.7
three 98.5
many 98
military 97.9
one 97.5
four 97.2
several 97.1
veil 96.8
woman 96
vehicle 95.6
outfit 95.3
five 94.4
administration 93.8
portrait 93.7

Imagga
created on 2018-10-18

wicker 34.3
work 24.3
hovel 23.6
product 19.9
travel 18.3
religion 17.9
old 16
architecture 14.8
creation 13.9
holiday 12.9
art 12.7
history 11.6
sky 11.5
earth 11.2
culture 11.1
building 10.9
traditional 10.8
tourism 10.7
structure 10.6
ancient 10.4
tree 10
tower 9.8
vacation 9.8
statue 9.7
hut 9.6
sculpture 9.4
shelter 9.3
world 9
man 8.7
scary 8.7
temple 8.7
dark 8.3
globe 8.3
outdoors 8.2
antique 8
season 7.8
golden 7.7
god 7.6
religious 7.5
city 7.5
famous 7.4
church 7.4
person 7.3
grass 7.1

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

wall 97.2
old 92.7
posing 68.3
people 59.2
stone 40.7
helmet 23.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 90.5%
Surprised 3.1%
Disgusted 13%
Happy 3.8%
Angry 18.1%
Calm 35%
Sad 20.5%
Confused 6.6%

AWS Rekognition

Age 35-52
Gender Female, 56.4%
Disgusted 17.7%
Angry 4.3%
Sad 65.7%
Surprised 0.9%
Confused 5.3%
Happy 1.9%
Calm 4.2%

AWS Rekognition

Age 57-77
Gender Male, 74.9%
Happy 21%
Sad 52.7%
Disgusted 1.3%
Confused 3.6%
Angry 3%
Surprised 1.7%
Calm 16.8%

AWS Rekognition

Age 35-52
Gender Female, 51.6%
Disgusted 43.3%
Happy 6.7%
Surprised 3.3%
Angry 11%
Calm 28.2%
Confused 3%
Sad 4.5%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 97.9%