Human Generated Data

Title

Portrait of George Lillie Craik

Date

1882

People

Artist: Frederick Sandys, British 1829 - 1904

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Melvin R. Seiden, 1991.73

Human Generated Data

Title

Portrait of George Lillie Craik

People

Artist: Frederick Sandys, British 1829 - 1904

Date

1882

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-04-30

Human 98.9
Person 98.9
Art 95.8
Drawing 95.8
Sketch 87.9
Face 81.2
Text 78.5
Photo 62.4
Photography 62.4
Portrait 62.4
Painting 56.7

Clarifai
created on 2020-04-30

portrait 100
people 99.9
one 99.6
adult 99.3
leader 99
man 98
engraving 98
administration 96.9
print 96.1
wear 96
scientist 94.5
facial hair 93.8
writer 93.7
art 93.3
elderly 91.5
old 89.2
politician 88.1
outerwear 86.4
poet 84.9
mustache 84.1

Imagga
created on 2020-04-30

person 45.1
portrait 38.2
man 35.6
adult 32.3
male 30
adolescent 28
face 27
people 26.8
juvenile 23.9
grandma 22.7
looking 22.4
happy 21.9
senior 20.6
smile 20
old 19.5
casual 19.5
handsome 18.7
one 18.7
mug shot 18.6
world 18.1
lifestyle 18.1
expression 17.9
hair 17.4
mature 16.7
model 16.3
elderly 16.3
attractive 15.4
black 15.1
clothing 15.1
photograph 14.4
confident 13.6
fashion 13.6
lady 13
serious 12.4
businessman 12.4
smiling 12.3
representation 12.1
human 12
home 12
alone 11.9
gray 11.7
standing 11.3
guy 11.2
men 11.2
closeup 10.8
retired 10.7
statue 10.6
modern 10.5
shirt 10.4
business 10.3
mother 10.3
happiness 10.2
professional 10.1
suit 10.1
job 9.7
older 9.7
office 9.6
youth 9.4
glasses 9.3
head 9.2
hand 9.1
aged 9.1
style 8.9
indoors 8.8
executive 8.7
retirement 8.6
studio 8.4
color 8.3
camera 8.3
20s 8.2
pose 8.2
life 8.1
sexy 8
blond 8
gray hair 7.9
sitting 7.7
pretty 7.7
beard 7.7
confidence 7.7
formal 7.6
businesspeople 7.6
creation 7.5
smart 7.5
jacket 7.3
child 7.2
family 7.1
posing 7.1
day 7.1

Google
created on 2020-04-30

Photograph 96.2
Portrait 86.3
Forehead 84.6
Art 69.5
Stock photography 65.4
Drawing 63.2
Photography 62.4
Jaw 57.4
Moustache 54.4
Self-portrait 53.7
Sketch 51.1
Picture frame 50.2

Microsoft
created on 2020-04-30

sketch 99.8
drawing 99.7
text 97.8
human face 96.8
person 94.3
man 93.4
old 88.4
portrait 86.9
painting 79.2
white 76.8
gallery 73
child art 58.8
clothing 57.9
picture frame 17.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-67
Gender Male, 91.1%
Sad 0.4%
Confused 1.1%
Angry 0.5%
Disgusted 0.1%
Fear 0%
Surprised 0.2%
Happy 0.6%
Calm 97.1%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a black and white photo of a man 87.6%
a vintage photo of a man 87.5%
an old black and white photo of a man 85.4%

Text analysis

Amazon

Gor
Lilli
Gor Lilli Craik:13z2:
Craik:13z2:
aNS

Google

Caik-1229-
Garge
Jantus
Jantus Garge Lilir Caik-1229-
Lilir