Human Generated Data

Title

Sir Walter Raleigh

Date

1844-1857

People

Artist: Toppan Carpenter & Co., American

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21558

Human Generated Data

Title

Sir Walter Raleigh

People

Artist: Toppan Carpenter & Co., American

Date

1844-1857

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Human 95.3
Person 95.3
Electrical Device 90.6
Switch 81.2
Electrical Outlet 64.8
Head 62.7

Imagga
created on 2022-03-12

push button 61.8
fire alarm 52.7
old 43.9
alarm 41.8
device 41.3
door 35.2
stucco 33.5
wall 32.5
antique 27.7
ancient 27.7
architecture 27.3
vintage 26.5
building 23.8
grunge 23
texture 21.5
window 19.4
entrance 19.3
house 18.4
aged 18.1
retro 18
hole 17.5
dirty 16.3
wooden 14.9
frame 14.1
history 13.4
worn 13.4
weathered 13.3
metal 12.9
detail 12.9
rough 12.8
stone 12.7
paper 12.5
brown 12.5
rusty 12.4
buzzer 12
safe 11.5
construction 11.1
historic 11
material 10.7
old fashioned 10.5
lock 10.2
wood 10
gate 9.7
style 9.6
rust 9.6
culture 9.4
signaling device 9.4
exterior 9.2
wallpaper 9.2
city 9.1
pattern 8.9
art 8.5
travel 8.5
classic 8.4
town 8.3
security 8.3
border 8.1
open 8.1
close 8
home 8
textured 7.9
design 7.9
doorway 7.9
structure 7.8
arch 7.8
blank 7.7
closed 7.7
stain 7.7
sculpture 7.6
grungy 7.6
sign 7.5
iron 7.5
tourism 7.4
technology 7.4
religion 7.2
brick 7

Google
created on 2022-03-12

Rectangle 88.2
Art 83.9
Wood 77.6
Painting 75.3
Circle 70.7
Beige 69.3
Font 68.8
Visual arts 66.4
Drawing 64.2
Paper 62.5
Room 60.4
Illustration 60.2
Paper product 59.2
Still life photography 57.1
Still life 55.7
Square 55.5
Concrete 53.3
Artwork 51.1

Microsoft
created on 2022-03-12

indoor 95.8
jack 88.2
old 59.3
dirty 37.5

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 100%
Confused 55.8%
Calm 24.1%
Sad 8.3%
Disgusted 6.7%
Surprised 2.9%
Happy 0.9%
Angry 0.7%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%

Captions

Microsoft

a dirty old room 47.4%
a close up of a dirty room 47.3%

Text analysis

Amazon

Raleign

Google

Lalegh
Lalegh