Human Generated Data

Title

Commerical Shipping
Date

1844-1857
People

Artist: Toppan Carpenter & Co., American

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21617

Human Generated Data

Title

Commerical Shipping

People

Artist: Toppan Carpenter & Co., American

Date

1844-1857

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Person 99.1
Human 99.1
Art 80
Drawing 73.7
Wood 71.6
People 64.4
Plywood 61.3
Photography 60.4
Photo 60.4
Soil 59.8
Sketch 59
Painting 55.9

Imagga
created on 2022-03-12

envelope 63.6
old 40.4
grunge 39.2
vintage 37.2
container 33.9
texture 33.3
paper 30.6
aged 29
antique 27.7
graffito 26.8
decoration 25.2
retro 23.8
ancient 23.4
dirty 22.6
material 21.4
page 21.3
damaged 20
frame 20
design 19.2
wallpaper 19.1
wall 18.8
grungy 18
textured 17.5
cardboard 17.3
parchment 17.3
flower 16.9
document 16.7
art 16.5
crumpled 15.5
space 15.5
rough 15.5
floral 15.3
worn 15.3
pattern 15
artistic 14.8
book 14.5
old fashioned 14.3
empty 13.7
card 13.7
artwork 13.7
manuscript 13.7
border 13.6
letter 12.8
stains 12.6
rusty 12.4
stucco 11.7
blank 11.1
grain 11.1
shabby 10.8
grime 10.7
ragged 10.7
fracture 10.7
decay 10.6
stain 10.6
backgrounds 10.5
brown 10.3
symbol 10.1
historic 10.1
decorative 10
tattered 9.9
scratched 9.8
surface 9.7
stained 9.6
text 9.6
weathered 9.5
canvas 9.5
leaf 9.3
global 9.1
color 8.9
distressed 8.8
drawing 8.8
graphic 8.8
obsolete 8.6
textures 8.5
map 8.4
cover 8.3
world 8.3
board 8.2
paint 8.1
detail 8
country 8
romantic 8
uneven 7.8
architecture 7.8
ornament 7.8
torn 7.7
beige 7.7
rust 7.7
fiber 7.7
international 7.6
stone 7.6
earth 7.4
exterior 7.4
stamp 7.2
decor 7.1
day 7.1

Google
created on 2022-03-12

Rectangle 85.4
Art 82.1
Picture frame 80.4
Wood 77.9
Tints and shades 77.3
Font 76.7
Painting 75
Paper 68.9
Visual arts 68.6
Paper product 66.6
Illustration 66.4
Vintage clothing 64.9
Drawing 64.6
Room 63.2
Sitting 62.8
Square 59.1
Modern art 51.8

Microsoft
created on 2022-03-12

drawing 98.7
person 97
sketch 95.5
clothing 89.6
text 89.4
indoor 85.4
envelope 80.5
stationary 75.9
man 75.5
white 65
painting 55.4

Face analysis

Amazon

Google

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 55.3%
Sad 33.3%
Fear 5.3%
Disgusted 3.3%
Happy 1%
Confused 0.8%
Angry 0.7%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a close up of a box 51.3%
close up of a box 44.2%
an old photo of a person 37.9%