Human Generated Data

Title

Benjamin Clark (1776-1863)
Date

1840
People

Artist: Asahel Lynde Powers, American 1813 - 1843
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. John S. Barss, 1979.315

Human Generated Data

Title

Benjamin Clark (1776-1863)

People

Artist: Asahel Lynde Powers, American 1813 - 1843

Date

1840

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Clothing 95.4
Hat 95.4
Apparel 95.4
Human 94.5
Person 94.5
Art 93
Painting 63.4

Clarifai
created on 2018-03-23

people 99.7
one 99.4
portrait 99.3
lid 99
adult 99
man 97.7
wear 97.5
veil 94.6
music 93.4
mustache 92.6
leader 91.6
cap 91
musician 90.8
retro 87.8
facial hair 86.4
outerwear 85.9
jacket 85.9
outfit 84.9
coat 82.4
theater 80.3

Imagga
created on 2018-03-23

person 40.9
man 32.2
male 24.1
portrait 23.3
black 20.6
adult 20.4
hat 18.2
people 17.8
sax 17.4
face 17
performer 15.6
lady 15.4
expression 15.4
musician 15.3
fashion 15.1
business 14.6
senior 14.1
clothing 13.9
model 13.2
smile 12.8
singer 12.6
style 12.6
guy 12
suit 12
happy 11.9
attractive 11.9
old 11.8
vintage 11.6
holding 11.6
costume 11.3
sexy 11.2
looking 11.2
make 10.9
studio 10.6
musical instrument 10.6
music 10.2
outfit 10.1
professional 10
art 9.8
handsome 9.8
businessman 9.7
ruler 9.7
hair 9.5
elegant 9.4
smiling 9.4
glasses 9.3
head 9.2
indoor 9.1
happiness 8.6
culture 8.5
clothes 8.4
hand 8.4
dark 8.3
traditional 8.3
entertainment 8.3
wind instrument 8.2
gold 8.2
alone 8.2
retro 8.2
dress 8.1
office 8
mask 7.9
standing 7.8
carnival 7.8
mysterious 7.8
golden 7.7
luxury 7.7
artist 7.7
pretty 7.7
musical 7.7
elderly 7.7
money 7.7
tie 7.6
instrument 7.4
playing 7.3
entertainer 7.3
religion 7.2
actor 7.1
job 7.1
interior 7.1
indoors 7

Google
created on 2018-03-23

gentleman 86.5
portrait 86.3
profession 70
monarch 64.8
painting 60.3
art 54.5

Microsoft
created on 2018-03-23

person 99.8
man 97.4
black 71.6
dressed 29.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Male, 99.5%
Angry 2.7%
Surprised 1.1%
Calm 87.5%
Happy 1.5%
Disgusted 1%
Confused 3.3%
Sad 3%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 95.4%
Person 94.5%
Painting 63.4%

Captions

Microsoft

a man wearing a black hat 87.9%
a man wearing a hat 86.7%
a man in a black hat 86.5%

Text analysis

Amazon

oeyincrova