Human Generated Data

Title

Sweet-meat Seller

Date

c. 1880

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.49.2

Human Generated Data

Title

Sweet-meat Seller

People

Artist: Unidentified Artist,

Date

c. 1880

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Person 98
Human 98
Person 97.5
Art 91.1
Meal 72.6
Food 72.6
Dish 72.6
Painting 59.8
Advertisement 57
Flooring 55.2

Clarifai
created on 2019-11-07

people 99.5
print 98.1
art 97.3
man 97.2
no person 96.9
group 95.9
retro 95.8
portrait 95.4
adult 95.4
nature 95.4
woman 94.9
illustration 93.9
old 92.4
one 91
two 90.1
painting 89.4
vintage 88.9
antique 88.8
medicine 88.7
wear 88.6

Imagga
created on 2019-11-07

stamp 61.6
die 37.6
shaping tool 28.3
envelope 25.1
vintage 23.2
old 19.5
container 19.1
paper 18.8
money 18.7
tool 17.6
mail 17.2
currency 16.2
postage 15.7
letter 15.6
seal 14.9
design 14.6
box 14.5
bank 14.3
retro 13.9
symbol 13.5
bill 13.3
banking 12.9
business 12.8
post 12.4
card 11.9
cash 11.9
finance 11.8
postmark 11.8
postal 11.8
aged 11.8
financial 11.6
blank 11.1
decoration 10.4
antique 10.4
celebration 10.4
gift 10.3
book jacket 10.3
close 10.3
grunge 10.2
dollar 10.2
holiday 10
queen 9.8
banknote 9.7
art 9.4
global 9.1
book 9.1
sign 9
wealth 9
office 8.8
day 8.6
exchange 8.6
united 8.6
culture 8.5
black 8.4
communication 8.4
shopping 8.3
collection 8.1
jacket 8
circa 7.9
ancient 7.8
china 7.7
texture 7.6
england 7.6
greeting 7.4
birthday 7.4
gold 7.4
note 7.4
message 7.3
present 7.3
wrapping 7.1

Google
created on 2019-11-07

Microsoft
created on 2019-11-07

text 96.8
person 90.4
clothing 77.4
gallery 74.4
room 64.3
picture frame 60.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-44
Gender Male, 53.5%
Angry 45%
Disgusted 45%
Confused 45%
Happy 45%
Fear 45%
Sad 45%
Calm 54.9%
Surprised 45%

AWS Rekognition

Age 41-59
Gender Male, 54.9%
Happy 45%
Calm 48.1%
Disgusted 45.1%
Angry 50%
Confused 45.5%
Surprised 45.1%
Sad 46.1%
Fear 45.1%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%

Captions

Microsoft

a room with art on the wall 50.1%

Text analysis

Amazon

atgrayer
Bralrmin tiesk atgrayer Smeetmeat sellers
sellers
tiesk
Smeetmeat
Bralrmin

Google

&Bralmin 8iest at rayer Sueetmeat Sellen
rayer
&Bralmin
at
Sueetmeat
Sellen
8iest