Human Generated Data

Title

Portrait of a Man
Date

1773
People

Artist: Jean-Baptiste-Siméon Chardin, French 1699 - 1779
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.89

Human Generated Data

Title

Portrait of a Man

People

Artist: Jean-Baptiste-Siméon Chardin, French 1699 - 1779

Date

1773

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.89

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Hat 99.5
Apparel 99.5
Clothing 99.5
Art 97.8
Painting 95.9
Human 94.6
Person 94.6

Clarifai
created on 2018-03-23

people 99.9
art 99.7
lid 99.1
painting 99
one 98.9
veil 98
portrait 97.3
adult 96.4
man 96.4
Renaissance 94.9
old 94.7
elderly 94.5
illustration 94.2
print 93.1
famous 90.2
leader 89.8
religion 87.4
facial hair 85.3
engraving 84.3
cape 79.8

Imagga
created on 2018-03-23

hat 88.7
sombrero 41.5
headdress 39
man 34.3
clothing 34
person 32.5
portrait 31.7
male 27
senior 26.3
face 24.2
rustic 23.7
people 22.3
cowboy hat 21
old 20.9
black 19.2
model 18.7
adult 18.2
elderly 16.3
hair 15.9
covering 15.5
cowboy 14.7
looking 14.4
consumer goods 14.3
fashion 14.3
hand 13.7
men 12.9
head 12.6
happy 12.5
one 11.9
expression 11.9
casual 11.9
grandfather 11.7
western 11.6
human 11.2
pretty 11.2
mature 11.2
style 11.1
beard 10.9
handsome 10.7
smile 10.7
guy 10.6
ruler 10.5
attractive 10.5
serious 10.5
outdoors 10.5
shirt 10.3
dark 10
pose 10
eye 9.8
posing 9.8
look 9.6
wearing 9.5
culture 9.4
vintage 9.1
fun 9
mysterious 8.7
straw 8.7
smiling 8.7
smoke 8.4
studio 8.4
traditional 8.3
art 8.2
retro 8.2
costume 8
happiness 7.8
boy 7.8
eyes 7.7
mystery 7.7
retirement 7.7
youth 7.7
gesture 7.6
brown 7.4
lady 7.3
children 7.3
make 7.3
jacket 7.2
cute 7.2
child 7.2

Google
created on 2018-03-23

portrait 90.2
painting 88.5
art 78.4
picture frame 59.1
paint 58.8
gentleman 53.3
self portrait 50.7
stock photography 50.6

Microsoft
created on 2018-03-23

old 70.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Male, 98.1%
Happy 1.2%
Confused 0.7%
Sad 1.3%
Angry 3.4%
Calm 37.1%
Disgusted 55.4%
Surprised 0.9%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.5%
Painting 95.9%
Person 94.6%

Captions

Microsoft
created on 2018-03-23

a man wearing a hat 57.3%
a man wearing a red hat 38.1%
a person wearing a hat 38%