Human Generated Data

Title

Portrait of a Man in a Blue Coat
Date

18th century
People

Artist: Unidentified Artist,

Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, 1939.106

Human Generated Data

Title

Portrait of a Man in a Blue Coat

People

Artist: Unidentified Artist,

Date

18th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-07-26

Painting 97.6
Art 97.6
Human 91.4
Person 91.4
Apparel 56.3
Clothing 56.3

Clarifai
created on 2019-07-26

people 99.7
painting 99.6
art 98.9
portrait 97.4
adult 97.4
one 96.7
royalty 96.2
print 93.7
queen 93.5
woman 91.6
crown 90.7
famous 89.4
religion 89.3
wear 87.1
illustration 86.9
leader 85.9
monarch 84.2
administration 83.9
Renaissance 82.6
saint 81.9

Imagga
created on 2019-07-26

adult 32.4
person 32.4
attractive 31.5
people 27.3
portrait 25.9
fashion 24.9
happy 23.8
model 21.8
pretty 21.7
face 21.3
sexy 20.1
smile 19.2
smiling 18.8
lifestyle 18.8
lady 18.7
brunette 18.3
expression 17.1
car 16.7
hair 16.6
clothing 15.2
shield 15
human 14.2
one 14.2
cute 13.6
gong 13.3
armor 13.1
percussion instrument 12.5
sitting 12
looking 12
sensuality 11.8
dress 11.7
body 11.2
women 11.1
happiness 11
gorgeous 10.9
male 10.8
hand 10.6
color 10.6
outdoors 10.4
costume 10.4
casual 10.2
protective covering 10.1
elegance 10.1
posing 9.8
cheerful 9.7
look 9.6
musical instrument 9.6
man 9.4
covering 9.4
emotion 9.2
fun 9
style 8.9
working 8.8
black 8.4
head 8.4
inside 8.3
sensual 8.2
lovely 8
work 7.8
youth 7.7
20s 7.3
make 7.3
home 7.2
eye 7.1
to 7.1
interior 7.1
summer 7.1
cover girl 7
princess 7
modern 7

Google
created on 2019-07-26

Lady 96.1
Painting 94.1
Art 82.9
Portrait 79.5
Visual arts 62.5
Oval 54.3

Microsoft
created on 2019-07-26

human face 98.1
person 92.7
clothing 90.4
woman 88.6
art 88
drawing 83
portrait 76.9
text 62.6
painting 23.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 95.4%
Sad 13.5%
Calm 53.5%
Disgusted 3.7%
Happy 4.3%
Surprised 5.2%
Confused 11.8%
Angry 8%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.6%
Person 91.4%

Captions

Microsoft

a painting of a boy 33.4%
a painting of a person 33.3%
a painting of a person 33.2%