Human Generated Data

Title

Watermelon Seller

Date

c. 1880

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.31.1

Human Generated Data

Title

Watermelon Seller

People

Artist: Unidentified Artist,

Date

c. 1880

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Clothing 99.3
Apparel 99.3
Human 96.8
Person 96.8
Person 80.7
Person 79.7
Soil 77.6
Hat 74.5
Sun Hat 70.4
Art 68.9
Archaeology 67.3
Skin 55.9

Clarifai
created on 2019-11-07

people 99.2
adult 97.9
woman 97.7
art 96.9
one 96.3
man 95
painting 94.5
portrait 94
wear 93.9
illustration 92.1
group 90.2
print 89.2
retro 87.2
two 85
veil 83.4
no person 82.6
facial expression 80.5
vintage 79
desktop 76.8
museum 76.4

Imagga
created on 2019-11-07

sketch 75.5
drawing 65.3
envelope 59.3
representation 52
container 38
paper 25.1
design 17.5
old 17.4
money 17
grunge 16.2
card 16.1
symbol 14.1
vintage 14.1
art 14
currency 13.5
note 12.9
graphic 12.4
bill 12.4
holiday 12.2
celebration 11.2
blank 11.1
cash 11
decorative 10.9
frame 10.8
black 10.8
silhouette 10.8
retro 10.6
antique 10.5
artistic 10.4
texture 10.4
stamp 10.4
business 10.3
gift 10.3
floral 10.2
greeting 10.2
letter 10.1
dirty 9.9
elegance 9.2
mug shot 8.9
photograph 8.9
banking 8.3
element 8.3
pattern 8.2
paint 8.1
decoration 8.1
wealth 8.1
bank 8.1
box 8.1
financial 8
copy 8
space 7.8
scroll 7.6
finance 7.6
savings 7.5
dollar 7.4
page 7.4
gold 7.4
man 7.4
book 7.1
decor 7.1
textured 7

Google
created on 2019-11-07

Text 85.2
Art 75.5
Visual arts 68.6
Drawing 60.7
Modern art 59.2
Picture frame 59.2
Painting 56
Illustration 54.5

Microsoft
created on 2019-11-07

drawing 99.4
room 99.1
scene 98.8
sketch 98
gallery 97
text 83.8
clothing 83.7
painting 80.9
person 78.5
woman 72.1
cartoon 71.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 54.6%
Calm 51.3%
Surprised 45.2%
Angry 45.4%
Disgusted 45.1%
Sad 46.9%
Happy 45.3%
Confused 45.5%
Fear 45.1%

AWS Rekognition

Age 9-19
Gender Female, 51.4%
Sad 45.2%
Confused 45%
Disgusted 45%
Happy 45%
Calm 54.5%
Angry 45%
Fear 45%
Surprised 45.2%

AWS Rekognition

Age 20-32
Gender Female, 51.1%
Disgusted 45%
Fear 45%
Happy 45%
Confused 45%
Angry 45%
Calm 54.8%
Sad 45%
Surprised 45.1%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%

Captions

Microsoft

a room with art on the wall 59.8%
a room with pictures on the wall 59.7%
a room with posters on the wall 53.9%

Text analysis

Amazon

atermelow
atermelow Seller.
Seller.
girls
cartch girls
cartch
16 2

Google

Watermelor Seller tautehginlor 1690
Seller
1690
Watermelor
tautehginlor