Human Generated Data

Title

Portrait Photograph of Yi Ha-ŭng Seated and Wearing Traditional Scholar's Hat and Robes
Date

c. 1857-1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.89.1

Human Generated Data

Title

Portrait Photograph of Yi Ha-ŭng Seated and Wearing Traditional Scholar's Hat and Robes

People
Date

c. 1857-1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Coat 99.9
Apparel 99.9
Clothing 99.9
Human 96.3
Person 91.4
Face 81.9
Priest 78.5
Female 74.8
Art 73.9
Fashion 71.2
Overcoat 70.4
Photo 69.5
Photography 69.5
Portrait 69.5
Sculpture 67.3
Statue 67
Cloak 64.4
Bishop 56.6
Suit 56.1
Robe 55.6
Standing 55.1

Clarifai
created on 2019-07-07

people 100
portrait 98.5
one 97.9
adult 97.7
wear 97.6
leader 96.5
man 96
administration 94.4
outfit 92.9
lid 87.9
military 87.6
veil 85
uniform 82.5
woman 81.3
group 78
two 77.1
royalty 77.1
sit 77
facial hair 75.9
outerwear 75.4

Imagga
created on 2019-07-07

trench coat 74.7
raincoat 59.7
ruler 50.6
coat 46.2
statue 45.2
religion 30.5
sculpture 29.4
religious 23.4
old 23
garment 20
history 19.7
ancient 19
art 17.8
monument 17.8
stone 17.7
god 17.2
culture 16.2
person 16.2
man 16.1
catholic 15.8
cloak 15.7
architecture 15.6
people 15.6
face 14.9
pray 14.5
antique 13.9
faith 13.4
male 12.8
prayer 12.6
saint 12.5
spiritual 12.5
city 12.5
figure 11.9
portrait 11.7
tourism 11.6
building 11.1
holy 10.6
temple 10.6
travel 10.6
church 10.2
worship 9.7
symbol 9.4
historical 9.4
historic 9.2
vintage 9.1
fashion 9
dress 9
black 9
marble 8.9
white 8.9
roman 8.8
sacred 8.8
clothing 8.6
spirituality 8.6
adult 8.4
traditional 8.3
peace 8.2
hat 8.2
style 8.2
lady 8.1
carving 8
smile 7.8
model 7.8
museum 7.8
one 7.5
detail 7.2
landmark 7.2
hair 7.1

Google
created on 2019-07-07

Photograph 94.8
Lady 84.3
Elder 69.1
Sitting 57.5

Microsoft
created on 2019-07-07

person 99
clothing 97.7
coat 96.2
human face 92.9
old 91.3
fashion 87
man 83.1
portrait 79.9
suit 73.6
white 73.1
outerwear 69.2
posing 60.4
vintage clothing 53.7
vintage 52.8
standing 51.6
sleeve 51.4
gentleman 51.1
older 26.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 98.8%
Surprised 13.3%
Disgusted 5.5%
Calm 36.3%
Angry 13.2%
Happy 9%
Sad 5.4%
Confused 17.3%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.9%
Person 91.4%
Overcoat 70.4%

Captions

Microsoft

a vintage photo of a person wearing a suit and tie 97.1%
a vintage photo of a person wearing a suit and tie 96.4%
a vintage photo of a young man wearing a suit and tie 94.4%