Human Generated Data

Title

Self-Portrait
Date

c. 1800-1825
People

Artist: George Clint, British 1770 - 1854

Artist: John Constable, British 1776 - 1837
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Edwin H. Abbot, 1966.150

Human Generated Data

Title

Self-Portrait

People

Artist: George Clint, British 1770 - 1854

Artist: John Constable, British 1776 - 1837

Date

c. 1800-1825

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Painting 96.6
Art 96.6
Human 95.9
Person 95.9
Text 67.8
Photo 60.5
Portrait 60.5
Photography 60.5
Face 60.5

Clarifai
created on 2020-04-24

people 99.9
portrait 99.9
one 99.8
adult 99.2
art 99.1
painting 96.2
man 95.7
leader 94.9
wear 94.2
administration 87.5
print 85.4
facial hair 84.1
son 83.8
book series 82.4
music 82.3
profile 81.3
veil 79.2
scientist 77.7
sit 77.2
furniture 77.2

Imagga
created on 2020-04-24

portrait 31.7
person 29.6
adult 25.2
elevator 24.3
black 24.2
device 23.6
sexy 23.3
man 22.8
fashion 22.6
people 21.8
lifting device 19.5
model 19.4
male 19.3
dark 18.4
attractive 18.2
hair 17.4
face 17
pretty 16.8
style 16.3
make 14.5
dress 14.5
elegant 13.7
human 13.5
one 13.4
world 12.6
lady 12.2
serious 11.4
brunette 11.3
expression 11.1
cell 11
instrument 11
alone 11
posing 10.7
adolescent 10.6
love 10.3
instrument of execution 10.2
looking 9.6
body 9.6
wall 9.4
youth 9.4
juvenile 9.3
skin 9.3
smile 9.3
studio 9.1
vintage 9.1
sensuality 9.1
old 9.1
blond 9
happy 8.8
look 8.8
art 8.5
grunge 8.5
child 8.5
makeup 8.2
light 8
lifestyle 8
women 7.9
cute 7.9
room 7.9
standing 7.8
sitting 7.7
sad 7.7
hand 7.6
clothes 7.5
suit 7.4
electric chair 7.3
sensual 7.3
gorgeous 7.2
pose 7.2
religion 7.2
bow tie 7.2

Google
created on 2020-04-24

Photograph 95.9
Portrait 90.9
Picture frame 64.5
Art 62.5
Photography 62.4
Stock photography 62.1
Self-portrait 54.6

Microsoft
created on 2020-04-24

painting 98
human face 97.6
text 97.2
drawing 96.8
sketch 95.7
person 95.1
black and white 92
old 82.6
portrait 80.5
clothing 55.8
staring 27.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Male, 64.9%
Fear 0.3%
Disgusted 0.3%
Sad 1.1%
Angry 0.4%
Calm 96.8%
Happy 0.2%
Surprised 0.5%
Confused 0.5%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.6%
Person 95.9%

Captions

Microsoft

an old photo of a man 87.2%
a black and white photo of a man 78.5%
a man sitting in front of a window 63.1%