Human Generated Data

Title

"The Fatal Mistake" (343)
Date

c. 1872
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.108

Human Generated Data

Title

"The Fatal Mistake" (343)

People

Artist: Unidentified Artist,

Date

c. 1872

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Coolidge, P1979.108

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 97.7
Human 97.7
Person 97.5
Art 93.7
Painting 90.9
Archaeology 82.8
Sculpture 78.3
Statue 77
Architecture 75.2
Building 75.2
Crypt 63.5
Clothing 55
Apparel 55
Person 47.9
Person 46.4

Clarifai
created on 2023-10-26

people 100
sepia 99.1
art 98.9
adult 98.4
two 98.3
woman 97.5
portrait 96.9
child 95.9
gown (clothing) 95.5
sepia pigment 95.4
group 95
man 93.7
street 93.5
son 92.1
painting 90.2
documentary 89.8
wear 89.2
baby 88.8
print 88.3
vintage 87.9

Imagga
created on 2022-01-22

old 43.9
vintage 39.7
grunge 37.5
ancient 35.5
paper 34.6
texture 34.1
antique 33.2
retro 27.9
aged 27.2
ruler 26.2
dirty 24.4
art 24
empty 22.4
damaged 22
material 21.5
parchment 20.2
frame 19.2
brown 19.2
tile 19.1
page 18.6
document 18.6
rough 18.2
sculpture 17.5
cardboard 17.3
blank 17.2
grungy 17.1
wallpaper 16.9
structure 16.6
crumpled 16.5
history 16.1
architecture 15.9
monument 15.9
design 15.8
historic 15.6
culture 15.4
border 15.4
old fashioned 15.2
stone 15.2
pattern 15.1
sheet 15.1
travel 14.8
wall 14.8
letter 14.7
backgrounds 14.6
decoration 14.5
column 14.3
surface 14.1
textured 14
stains 13.6
worn 13.4
text 13.1
book jacket 13.1
newspaper 13
statue 12.9
book 12.8
grave 12.8
decay 12.5
decorative 12.5
temple 12.5
aging 12.5
tourism 12.4
jacket 12.1
manuscript 11.8
ragged 11.7
religion 11.7
detail 11.3
grime 10.8
backdrop 10.7
fracture 10.7
building 10.6
obsolete 10.5
artistic 10.4
cover 10.2
grain 10.2
product 10
ruin 9.7
style 9.7
canvas 9.5
color 9.5
symbol 9.4
historical 9.4
creation 9.4
famous 9.3
landmark 9
graffito 8.8
faded 8.8
wrapping 8.7
stained 8.7
rusty 8.6
graphic 8
yellow 8
marble 8
daily 7.8
burnt 7.8
sepia 7.8
spot 7.7
weathered 7.6
note 7.4
covering 7

Google
created on 2022-01-22

Art 78.6
Tints and shades 75.5
Vintage clothing 74.5
Classic 70.6
Visual arts 69.7
Room 68
History 66.9
Stock photography 65.8
Holy places 65.7
Antique 60.7
Painting 59.5
Suit 57.2
Retro style 54.8
Illustration 54.2
Collection 53.7
Formal wear 51.3
Monarch 50.8

Microsoft
created on 2022-01-22

text 98.9
clothing 96
person 89.1
old 42.9
posing 37.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 89.7%
Angry 4.6%
Disgusted 3.4%
Confused 0.7%
Sad 0.6%
Surprised 0.5%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 61.8%
Angry 28.2%
Confused 3.4%
Sad 2.3%
Disgusted 1.7%
Surprised 1.1%
Fear 0.7%
Happy 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 90.9%

Categories

Imagga

interior objects 71.7%
paintings art 28.1%

Text analysis

Amazon

according
Entered
of
mistake"
to
in
the
year
"The
by
Congress,
F.
Entered according to Act of Congress, in the year 1872, by F. G DO
"The tatal mistake"
1872,
Act of
Office
Office oftho Librarian of Congress, G 11 schington.
oftho
11
tatal
G
Librarian
schington.
DO

Google

"Ihe Jatal mistake"
Jatal
"Ihe
mistake"