Human Generated Data

Title

Untitled (cabinet card of deceased child in white dress)

Date

1880-1900

People

Artist: Victoria Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3617

Human Generated Data

Title

Untitled (cabinet card of deceased child in white dress)

People

Artist: Victoria Studio, American

Date

1880-1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Person 92.3
Human 92.3
Bag 90.5
Clothing 80.6
Apparel 80.6
Shopping Bag 78.4
Wood 78.3
Plywood 62.9
Art 56.4
Tote Bag 55.6

Clarifai
created on 2019-11-09

retro 95.7
paper 94.8
desktop 94.6
empty 94.2
no person 93.9
texture 93.4
old 93.3
antique 93
art 92.8
blank 92.4
dirty 92.3
vintage 92.2
text 91.5
picture frame 90.5
design 89.6
decoration 88.1
cardboard 87.6
ancient 87.4
letter 87.1
wood 87.1

Imagga
created on 2019-11-09

vintage 67.1
old 62.8
paper 59.7
antique 55.5
aged 55.3
ancient 52
dirty 48.9
wallpaper 47.6
texture 47.3
document 46.5
cardboard 45.2
grunge 45.2
retro 43.5
parchment 43.3
empty 42.2
decay 40.6
blank 37.8
board 36.9
letter 36.7
sheet 36.7
rough 35.6
book 34.8
stain 33.7
aging 33.6
backgrounds 33.3
text 32.4
canvas 32.3
pages 31.3
torn 31
age 30.5
weathered 29.5
burnt 29.2
stained 28.9
damaged 27.7
note 27.6
messy 25.2
page 25.1
material 25
poster 24.6
correspondence 24.5
obsolete 24
history 23.3
layers 23.2
brittle 22.7
binding 22.7
burning 22.3
spotted 22.2
scrolls 21.7
letterhead 21.7
stucco 21
worn 20.1
frame 19.2
art 19.2
grime 18.6
design 17.6
crumpled 17.5
card 17.3
old fashioned 17.1
grungy 17.1
ragged 16.6
border 16.3
rusty 16.2
grain 15.7
brown 15.5
decorative 15.1
historic 14.7
fracture 14.6
stains 14.6
textured 14
artistic 13.9
cover 13.9
shabby 13.7
manuscript 13.7
pattern 13.7
scratched 12.7
container 12
tattered 11.9
space 11.7
fiber 11.5
envelope 11.5
insulating material 11.4
textures 11.4
wall 11.1
backdrop 10.7
notebook 10.4
artwork 10.1
building material 9.9
scratch 9.8
ornament 9.5
distressed 8.9
faded 8.8
greeting 8.4
surface 8
abrasion 7.9
pasteboard 7.9
uneven 7.8
mottled 7.8
sepia 7.8
rust 7.7
spot 7.7
device 7.5
symbol 7.4
template 7.4
graphic 7.3
structure 7
leaf 7

Google
created on 2019-11-09

Illustration 76.4
Art 74
Beige 68.9
Paper 61.1
Wood 59.6
Square 57.6
Drawing 55.8
Rectangle 55.7
Painting 53.4

Microsoft
created on 2019-11-09

clothing 94.5
person 93
old 87.1
human face 81.4
drawing 79.1
sign 76
text 74.1
picture frame 65.6
handwriting 56.1
half 35.4

Face analysis

Amazon

Google

AWS Rekognition

Age 5-15
Gender Male, 50%
Happy 45%
Confused 45%
Fear 45%
Disgusted 45%
Sad 45.1%
Angry 45.1%
Calm 54.6%
Surprised 45.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.3%

Captions

Microsoft

an old photo of a box 52.6%
a close up of a box 52.5%
an old photo of a piece of paper 38.7%