Human Generated Data

Title

Colonel Gustav Friedrich von Dachenhausen
Date

1787
People

Artist: John Singleton Copley, American 1738 - 1815
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Gordon Dexter, 1942.178

Human Generated Data

Title

Colonel Gustav Friedrich von Dachenhausen

People

Artist: John Singleton Copley, American 1738 - 1815

Date

1787

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Hat 96.8
Clothing 96.8
Apparel 96.8
Art 93.3
Painting 91.6
Human 86.1
Person 86.1

Clarifai
created on 2018-03-16

people 99.9
painting 99.6
art 99.1
one 98.3
print 98.1
famous 98.1
lid 96.8
portrait 95.6
person 95
illustration 94
adult 90.1
fame 89.6
entertainment 88.4
wear 87.3
pop 83.1
veil 79.9
event 79
vintage 76.8
man 75.4
graffiti 74.4

Imagga
created on 2018-03-16

hat 100
headdress 100
cowboy hat 100
clothing 69
sombrero 37.5
covering 36.2
consumer goods 35.6
portrait 32.4
person 31.2
man 25.5
model 24.9
people 24.5
face 24.2
hair 22.2
male 21.3
sexy 20.9
adult 20.7
cowboy 20.6
attractive 19.6
happy 19.4
fashion 18.1
smile 17.1
black 16.8
guy 15.9
skin 15.2
handsome 15.2
senior 15
pretty 14.7
western 14.5
looking 14.4
one 13.4
posing 13.3
body 12.8
human 12.7
sensual 12.7
outdoors 12.7
old 12.5
wearing 12.4
smiling 12.3
lifestyle 12.3
style 11.9
head 11.8
dark 11.7
blond 11.7
hand 11.4
brunette 11.3
boy 11.3
shirt 11.2
eyes 11.2
pose 10.9
cute 10.8
mysterious 10.7
straw 10.6
fun 10.5
casual 10.2
beach 10.1
eye 9.8
child 9.6
children 9.1
lady 8.9
mystery 8.7
happiness 8.6
hairstyle 8.6
vintage 8.3
retro 8.2
gorgeous 8.2
brown 8.1
close 8
kid 8
women 7.9
elderly 7.7
gesture 7.6
studio 7.6
costume 7.4
water 7.3
make 7.3
summer 7.1

Google
created on 2018-03-16

painting 82.7
portrait 80.8
art 78.8
headgear 63.1
artwork 55
illustration 52.4
visual arts 51.5

Microsoft
created on 2018-03-16

text 97.6
person 93.1
hat 74.8

Face analysis

Amazon

Google

AWS Rekognition

Age 48-68
Gender Male, 72.1%
Calm 77.5%
Disgusted 6.2%
Angry 3.1%
Happy 3.5%
Confused 1.5%
Surprised 3.2%
Sad 5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 96.8%
Painting 91.6%
Person 86.1%

Captions

Microsoft

a person wearing a red hat 55.8%
a person wearing a hat 55.7%
a person wearing a red hat 41.4%