Human Generated Data

Title

John George Brown (1831-1913)
Date

1860-1871
People

Artist: Unidentified Artist,

Sitter: John George Brown, American 1831 - 1913

Artist: Henry Theodore Tuckerman, American 1813-1871
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.411.17

Human Generated Data

Title

John George Brown (1831-1913)

People

Artist: Unidentified Artist,

Sitter: John George Brown, American 1831 - 1913

Artist: Henry Theodore Tuckerman, American 1813-1871

Date

1860-1871

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.9
Face 99.9
Text 99.1
Person 99
Art 87.1
Beard 84.1
Handwriting 82.8
Drawing 78.2
Photo 69.2
Photography 69.2
Portrait 68.1
Head 59.8
Sketch 59.4

Clarifai
created on 2019-02-18

portrait 97.6
people 97.5
one 95.4
adult 94.7
wear 94.5
art 93.6
retro 92.8
painting 91.3
mustache 90.7
facial hair 90.3
vintage 90
illustration 87.2
man 86.9
music 80.6
picture frame 80
antique 77.7
print 76.6
leader 76.5
engraving 74.6
bill 72.7

Imagga
created on 2019-02-18

sketch 100
drawing 80.1
representation 74.5
portrait 36.3
model 34.2
fashion 33.2
sexy 30.5
hair 30.1
black 28.6
attractive 28
face 24.9
adult 23.9
pretty 22.4
person 22.1
sensual 20.9
style 20.8
people 20.6
book jacket 20
brunette 18.3
studio 18.2
skin 17.8
jacket 17.5
body 16.8
makeup 16.5
dress 16.3
elegance 16
make 15.4
elegant 15.4
close 15.4
hairstyle 15.3
long 14.7
sensuality 14.5
gorgeous 14.5
lady 13
lips 13
cute 12.9
human 12.8
dark 12.5
posing 12.4
eyes 12.1
wrapping 11.8
fashionable 11.4
cosmetics 11.2
looking 11.2
youth 11.1
happy 10.7
love 10.3
expression 10.2
man 10.1
head 10.1
healthy 10.1
reflection 9.8
one 9.7
seductive 9.6
covering 9.5
women 9.5
smile 9.3
stylish 9
creation 9
lovely 8.9
picture 8.8
male 8.5
erotic 8.5
passion 8.5
art 8.4
look 7.9
couple 7.8
money 7.7
feminine 7.5
vintage 7.4
cash 7.3
currency 7.2
romance 7.1

Google
created on 2019-02-18

Photograph 94.8
Moustache 91.9
Hairstyle 84.7
Facial hair 82.6
Gentleman 76.1
Beard 73.3
Portrait 68
Illustration 65.5
Picture frame 65.4
Drawing 65.2
Art 62.5

Microsoft
created on 2019-02-18

black and white 15
picture frame 15
art 13.1
print 7.7
drawing 6
sketch 5
illustration 5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 96.3%
Angry 1.9%
Calm 90.8%
Confused 1.8%
Disgusted 0.2%
Surprised 0.7%
Happy 0.4%
Sad 4.2%

Microsoft Cognitive Services

Age 49
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

an old photo of a person 47.6%
a close up of a person 47.5%
a photo of a person 45.9%

Text analysis

Amazon

Deinr
johne prg Deinr
prg
johne

Google

unu
el
unu el