Human Generated Data

Title

Untitled (a manservant or Khitmutghar with a flywhisk)
Date

c. 1860-1880
People

Artist: Willoughby Wallace Hooper, British 1837 - 1912
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.65

Human Generated Data

Title

Untitled (a manservant or Khitmutghar with a flywhisk)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Clothing 99.4
Apparel 99.4
Person 99.4
Human 99.4
Hat 98.7
Costume 93.3
Footwear 86.5
People 80.4
Boot 72.8
Face 71.7
Photo 67.2
Portrait 67.2
Photography 67.2
Art 55.5

Clarifai
created on 2018-10-18

people 99.9
adult 99.1
man 97.8
one 97.7
wear 97.5
military 97.2
administration 96.1
portrait 95.2
war 94.4
lid 94.4
uniform 93.1
soldier 92.3
weapon 90.8
leader 90.7
outfit 90.2
veil 89.4
gun 88.2
military uniform 83.6
retro 80.2
two 78.6

Imagga
created on 2018-10-18

brass 38.9
wind instrument 38.8
cornet 36.9
musical instrument 31.6
man 22.8
person 20.1
male 18.4
statue 17.7
old 17.4
people 16.7
adult 16.3
wall 16.2
fashion 14.3
sax 14.1
culture 13.7
portrait 13.6
building 13.5
sculpture 13.4
dress 12.6
wheeled vehicle 12.6
architecture 12.5
vintage 12.4
ancient 12.1
black 12
seller 11.8
art 11.7
face 11.4
human 11.2
helmet 11.2
style 11.1
stone 11
dirty 10.8
posing 10.7
women 10.3
monument 10.3
street 10.1
outdoor 9.9
trombone 9.6
historical 9.4
clothing 9.2
traditional 9.1
city 9.1
device 9.1
tricycle 8.9
vehicle 8.7
antique 8.6
model 8.5
grunge 8.5
travel 8.4
attractive 8.4
elegance 8.4
dark 8.3
holding 8.2
weapon 8.2
decoration 8.1
religion 8.1
sexy 8
lifestyle 7.9
hair 7.9
men 7.7
sport 7.4
horn 7.4
window 7.3
danger 7.3
sensuality 7.3
aged 7.2
armor plate 7.1

Google
created on 2018-10-18

standing 94.6
headgear 74.5
vintage clothing 72.2
human behavior 70
gentleman 68.1
uniform 60.5
military person 55.7
military officer 55.7
costume design 50.2

Microsoft
created on 2018-10-18

ground 97.1
outdoor 96.5
old 94.9
person 90.7
standing 80.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 66.3%
Surprised 7.6%
Disgusted 3.3%
Happy 2.7%
Angry 4.4%
Calm 57.1%
Sad 8.8%
Confused 16%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 98.7%

Captions

Microsoft

a person standing in front of a building 85%
an old man standing in front of a building 84.8%
a person standing posing for the camera 84.7%