Human Generated Data

Title

Emma Dorothy Eliza Nevitte Southworth (1819-1899)
Date

c. 1860
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.9

Human Generated Data

Title

Emma Dorothy Eliza Nevitte Southworth (1819-1899)

People

Artist: Unidentified Artist,

Date

c. 1860

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.9

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.8
Person 98.8
Painting 97.6
Art 97.6
Face 81.7
Photography 66.9
Photo 66.9
Text 66.9
Portrait 65.9
Apparel 59.1
Clothing 59.1
Poster 59.1
Advertisement 59.1
Collage 59.1
Canvas 56.5

Clarifai
created on 2018-02-09

people 99.6
art 99.3
painting 99.2
one 98.9
portrait 98.9
adult 98.1
wear 96.8
museum 95.1
veil 93.9
picture frame 93.7
woman 91.3
decoration 90.5
no person 89.7
illustration 89.6
old 89.4
exhibition 88.5
man 87.7
vintage 87.3
religion 86.3
margin 85.8

Imagga
created on 2018-02-09

vintage 44
old 36.9
paper 30.6
binding 28.1
retro 26.2
post 25.8
grunge 24.7
frame 24.1
blank 24
art 24
mail 23
texture 22.9
postage 22.6
stamp 22.3
letter 22
antique 21.6
empty 20.6
black 20.4
postmark 19.7
chalkboard 19.6
postal 18.6
blackboard 17.5
symbol 17.5
hole 17
note 16.5
ancient 16.4
aged 15.4
museum 14.6
icon 14.3
book 14
message 13.7
wall 13.7
chalk 13.6
business 13.4
board 13.1
stamps 12.8
culture 12.8
money 12.8
paintings 12.7
border 12.7
delivery 12.6
brown 12.5
object 12.5
covering 11.9
finance 11.8
communication 11.8
decorative 11.7
one 11.2
cover 11.1
global 10.9
decoration 10.9
printed 10.8
painter 10.8
school 10.8
history 10.7
design 10.7
envelope 10.7
gold 10.7
reminder 10.7
device 10.6
backgrounds 10.5
office 10.4
unique 10.4
binder 10.1
cash 10.1
collection 9.9
zigzag 9.9
masterpiece 9.9
currency 9.9
shows 9.9
renaissance 9.8
cutting 9.7
text 9.6
communications 9.6
pattern 9.6
painted 9.5
fine 9.5
education 9.5
historic 9.2
sign 9
religion 9
post mail 8.9
fame 8.9
known 8.9
close 8.6
grungy 8.5
wallpaper 8.4
dollar 8.4
page 8.3
jacket 8.3
lighter 8.2
closeup 8.1
bank 8.1
detail 8
nobody 7.8
classroom 7.8
letters 7.7
drawing 7.7
artist 7.7
us 7.7
used 7.7
age 7.6
old fashioned 7.6
write 7.5
writing 7.5
style 7.4
church 7.4
wooden 7

Google
created on 2018-02-09

picture frame 86.5
painting 80.4
art 72.4
antique 62.2
portrait 60.4
artwork 52.9

Microsoft
created on 2018-02-09

wall 98.3
indoor 89.1
case 76.4
accessory 53.9
old 52.9
picture frame 25.6
painting 23

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 63.6%
Confused 8.2%
Sad 12%
Angry 3.2%
Calm 70.7%
Happy 2.3%
Surprised 2.3%
Disgusted 1.3%

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 97.6%

Captions

Microsoft
created on 2018-02-09

a painting hanging on a wall 76.2%
a painting on the wall 75.8%
a painting on a wall 74.8%