Human Generated Data

Title

Mary E. Cox M.D.

Date

19th century

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2019.158

Human Generated Data

Title

Mary E. Cox M.D.

People

Artist: Unidentified Artist,

Date

19th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-10-08

Clothing 99.3
Apparel 99.3
Person 97
Human 97
Overcoat 74.2
Coat 74.2
Photo 67.3
Portrait 67.3
Photography 67.3
Face 67.3
Female 65.9
People 60

Clarifai
created on 2019-10-08

people 100
one 99
adult 98.7
portrait 98.3
wear 97.6
administration 93.3
man 93
leader 92.8
two 92.1
outfit 88.2
woman 83.8
uniform 82.2
child 81
military 80.6
group 77.4
lid 77.4
three 77.3
retro 77
actor 76.7
music 74.7

Imagga
created on 2019-10-08

trench coat 100
raincoat 100
coat 93.2
garment 31.4
people 24.5
statue 23
person 22.7
portrait 22
adult 22
clothing 21.8
sculpture 20.1
old 18.8
military uniform 18.5
man 18.1
uniform 17.1
face 16.3
fashion 15.8
model 14.8
religion 14.3
smile 14.3
ancient 13.8
dress 13.5
male 13.5
hair 13.5
happy 13.2
casual 12.7
pretty 12.6
attractive 12.6
history 12.5
art 12.4
lady 12.2
smiling 11.6
lifestyle 11.6
holding 11.6
antique 11.3
monument 11.2
culture 11.1
cute 10.8
one 10.4
religious 10.3
women 10.3
jacket 10.2
figure 10
outdoor 9.9
human 9.7
sexy 9.6
looking 9.6
happiness 9.4
youth 9.4
stone 9.3
marble 8.7
hands 8.7
love 8.7
helmet 8.6
god 8.6
architecture 8.6
child 8.5
city 8.3
single 8.2
outdoors 8.2
style 8.2
detail 8
business 7.9
catholic 7.8
expression 7.7
head 7.6
shirt 7.5
vintage 7.4
tourism 7.4
retro 7.4
20s 7.3
black 7.3
body 7.2
home 7.2
handsome 7.1
family 7.1
posing 7.1
day 7.1
autumn 7

Google
created on 2019-10-08

Microsoft
created on 2019-10-08

person 99.8
clothing 99.1
standing 92.5
human face 89.6
old 86.5
coat 84.9
vintage clothing 83
posing 78.7
boy 75.8
white 68.8
photograph 68.3
retro style 60.3
portrait 57.8
child 52.2
vintage 29.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 73%
Happy 0%
Angry 0%
Sad 0%
Calm 99.9%
Disgusted 0%
Confused 0%
Fear 0%
Surprised 0%

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%

Captions

Microsoft

a vintage photo of a little girl posing for a picture 88.6%
a vintage photo of a little girl posing for a photo 85%
a little boy posing for a photo 84.4%