Human Generated Data

Title

Portrait of a Young Man
Date

18th-19th century
People

Artist: Augustin de Saint-Aubin, French 1736 - 1807
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Therese Kuhn Straus in memory of her husband, Herbert N. Straus, Harvard Class of 1903, 1978.55

Human Generated Data

Title

Portrait of a Young Man

People

Artist: Augustin de Saint-Aubin, French 1736 - 1807

Date

18th-19th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-04-26

Human 98.4
Person 98.4
Art 95.3
Painting 78.8
Drawing 78
Pottery 68.3
Porcelain 68.3
Rug 61.2
Doodle 55.9

Clarifai
created on 2020-04-26

one 98.3
illustration 97.8
art 97.8
no person 97.7
people 96.9
retro 95.6
print 94.8
round 94.4
wear 93.2
antique 93
man 92.7
painting 92.6
old 91.8
adult 91.2
veil 90.8
vintage 89.4
desktop 86.4
business 84.6
portrait 84.4
symbol 84.4

Imagga
created on 2020-04-26

ceramic ware 86.3
earthenware 83.8
utensil 59.3
majolica 36.9
china 31.8
tray 29
porcelain 26.1
receptacle 24.4
container 23.9
money 23.8
currency 23.3
old 20.9
finance 19.4
cash 18.3
wealth 17.9
financial 16.9
metal 16.9
close 16.5
bank 16.1
banking 14.7
ancient 14.7
coin 14.3
closeup 14.1
dollar 13.9
one 13.4
business 13.4
bowl 13
paper 12.5
retro 12.3
rich 12.1
art 11.8
pay 11.5
cup 11.4
exchange 11.4
symbol 11.4
antique 11.2
object 11
vintage 10.7
religion 10.7
gold 10.7
shiny 10.3
pattern 10.3
food 9.7
coins 9.6
detail 9.6
savings 9.3
texture 9
color 8.9
healthy 8.8
decoration 8.7
culture 8.5
grunge 8.5
design 8.4
religious 8.4
economy 8.3
time 8.2
silver 8
luxury 7.7
us 7.7
pottery 7.6
plate 7.6
commerce 7.5
brown 7.4
investment 7.3
meal 7.3
history 7.2
market 7.1

Google
created on 2020-04-26

Picture frame 70.2
Oval 69.3
Circle 67.2
Art 58.1
Portrait 56.7
Plate 51.5
Tableware 50.4
Illustration 50.4

Microsoft
created on 2020-04-26

human face 94.8
person 92.4
drawing 69.2
sketch 62
ceramic ware 29.9
porcelain 5.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 98.2%
Angry 0.2%
Disgusted 0.1%
Calm 98.9%
Surprised 0.2%
Sad 0.4%
Fear 0%
Happy 0%
Confused 0.1%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 78.8%
Rug 61.2%

Captions

Microsoft

a piece of paper 42.6%
a close up of a plate 42.5%
a close up of a plate on a table 42.2%