Human Generated Data

Title

Ink holder
Date

19th century
People
Classification

Artists' Tools
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.373

Human Generated Data

Title

Ink holder

People
Date

19th century

Classification

Artists' Tools

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 96.1
Human 96.1
Indoors 89.1
Interior Design 89.1
Art 63
Advertisement 58.6
Label 56.9
Text 56.9
Poster 55.2
Collage 55.2

Clarifai
created on 2018-02-10

no person 95.5
art 94.6
decoration 94.2
painting 94.2
symbol 93.5
one 93.2
pattern 92.4
people 92.3
religion 90.6
illustration 87.3
wear 86.9
veil 85.9
vintage 85.7
shape 85.7
sculpture 84
retro 83.3
adult 82.2
sign 82.1
gold 81.9
design 81.4

Imagga
created on 2018-02-10

bookmark 58.2
necktie 49.9
religion 25.1
garment 25
old 23
church 22.2
art 22.1
vintage 19.8
religious 19.7
clock 19.3
antique 16.6
ancient 15.5
stained 15.4
stamp 14.5
post 14.3
retro 13.9
letter 13.7
postage 13.7
historic 13.7
culture 13.7
symbol 13.5
icon 13.4
painted 13.3
lighter 13.1
timepiece 13
design 12.6
decoration 12.6
holy 12.5
window 12.5
mail 12.4
clothing 12.4
amulet 12.3
black 12
postmark 11.8
glass 11.7
device 11.5
pattern 10.9
architecture 10.9
postal 10.8
colorful 10.7
saint 10.6
cathedral 10.5
bible 9.8
charm 9.7
catholic 9.7
artistic 9.5
paper 9.4
money 9.3
card 9.3
artwork 9.1
traditional 9.1
collection 9
masterpiece 8.9
stamps 8.9
box 8.8
detail 8.8
colors 8.8
casino 8.8
container 8.8
jack 8.8
cards 8.8
yellow 7.9
clubs 7.9
poker 7.8
face 7.8
gambling 7.8
color 7.8
king 7.8
grunge 7.7
faith 7.6
god 7.6
fine 7.6
style 7.4
ornate 7.3
office 7.2
museum 7.2
currency 7.2
history 7.1
love 7.1
interior 7.1

Google
created on 2018-02-10

artifact 64
window 51.5

Microsoft
created on 2018-02-10

indoor 86.2
colorful 66.2
decorated 30.1
colored 10.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Male, 95.5%
Happy 1%
Sad 2.8%
Calm 56.3%
Confused 2.8%
Disgusted 1.9%
Surprised 33.1%
Angry 2.1%

Microsoft Cognitive Services

Age 18
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%

Captions

Microsoft

a close up of a colorful wall 64.2%
a close up of a painted wall 61.8%
close up of a colorful wall 58.3%

Text analysis

Amazon

OO