Human Generated Data

Title

Three Korean Gentlemen Seated on the Veranda of a House (or Official Building)
Date

c. 1857-1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.90.1

Human Generated Data

Title

Three Korean Gentlemen Seated on the Veranda of a House (or Official Building)

People
Date

c. 1857-1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Apparel 98.2
Clothing 98.2
Human 96.8
Person 96.8
Person 95.9
Coat 90.5
Person 88.7
Sleeve 61.8
Hat 59
Sitting 55.6

Clarifai
created on 2019-07-07

people 100
adult 98.1
group 95.9
wear 94.5
man 94.3
leader 92.9
administration 92.4
portrait 91.7
three 90.3
woman 90
group together 89.6
two 88.6
several 88.4
veil 86.2
four 84.4
lid 82.4
military 80.9
outfit 80.9
five 80.3
uniform 78.8

Imagga
created on 2019-07-07

clothing 32.9
groom 31.4
bride 31
dress 30.7
people 26.2
wedding 25.8
robe 24.6
adult 24
happy 23.8
couple 23.5
garment 23.3
bathrobe 23.1
person 21
love 20.5
portrait 20.1
bouquet 20
happiness 19.6
nurse 19.2
marriage 19
gown 17.7
married 17.3
man 16.8
male 15.7
smile 15.7
pretty 15.4
attractive 15.4
smiling 15.2
family 15.1
fashion 13.6
trench coat 13.5
coat 13.4
celebration 12.8
two 12.7
bridal 12.6
together 12.3
clothes 12.2
looking 12
women 11.9
elegance 11.8
ceremony 11.6
cheerful 11.4
flowers 11.3
human 11.2
men 11.2
day 11
raincoat 10.8
full length 10.7
hand 10.6
wife 10.4
hair 10.3
mother 10
holding 9.9
old 9.8
lady 9.7
life 9.6
child 9.4
church 9.3
tradition 9.2
face 9.2
husband 9.2
suit 9.2
indoor 9.1
new 8.9
wed 8.8
home 8.8
brunette 8.7
engagement 8.7
holiday 8.6
model 8.6
adults 8.5
color 8.3
pose 8.2
romantic 8
posing 8
lifestyle 7.9
indoors 7.9
business 7.9
standing 7.8
flower 7.7
covering 7.6
vestment 7.6
kimono 7.5
one 7.5
closeup 7.4
historic 7.3
girls 7.3
children 7.3
interior 7.1
modern 7

Google
created on 2019-07-07

Photograph 95.1
People 93.4
Snapshot 85.5
Hairstyle 82.9
Geisha 64.4
Family 62.9
Costume 60.8

Microsoft
created on 2019-07-07

clothing 98.1
person 98.1
wall 97.1
smile 93
woman 90.3
old 82.6
hat 78.6
vintage clothing 77.6
human face 76.2
posing 76.1
dress 73.4
vestment 58.7
retro style 58.6
vintage 29
clothes 20.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 54.5%
Surprised 45.1%
Disgusted 45.1%
Confused 45.3%
Happy 45%
Angry 45.4%
Sad 48.7%
Calm 50.3%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Calm 53.8%
Angry 45.5%
Sad 45.4%
Surprised 45%
Confused 45.2%
Happy 45%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Sad 45.1%
Calm 47.8%
Disgusted 45.8%
Surprised 45.2%
Happy 45.1%
Angry 50.8%
Confused 45.2%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%
Coat 90.5%
Hat 59%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 82.7%
a vintage photo of a man and a woman posing for a picture 82.6%
a vintage photo of a person 82.5%