Human Generated Data

Title

Confederate Dead (vignettes of 14 Confederate generals)
Date

1870-1879
People

Artist: Selden & Co., American active 1870s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.92

Human Generated Data

Title

Confederate Dead (vignettes of 14 Confederate generals)

People

Artist: Selden & Co., American active 1870s

Date

1870-1879

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.92

Machine Generated Data

Tags

Amazon
created on 2022-02-19

Person 95.8
Human 95.8
Person 94.9
Person 93.6
Text 87.8
Person 87.7
Person 81.3
Poster 76.8
Advertisement 76.8
Person 76.5
Person 75.7
Person 67.5
Rug 67.2
Accessories 66.2
Accessory 66.2
Collage 57.7
Bead 55.8
Person 49.8

Clarifai
created on 2023-10-28

retro 99.1
vintage 97.5
old 96.7
art 96.2
antique 93
picture frame 90.7
people 88.3
no person 87.6
painting 87
post 86.2
man 83.9
desktop 83.2
paper 81.3
portrait 81.1
one 80.2
museum 79.7
margin 78.7
dirty 77.8
decoration 75.8
nostalgia 74

Imagga
created on 2022-02-19

vintage 54.4
menu 54
old 47.4
fare 43.3
texture 35.4
antique 34.6
grunge 32.4
binding 30.7
paper 30.6
retro 30.3
ancient 28.5
aged 28.1
bookmark 28
empty 23.2
book jacket 22.8
frame 22.5
art 22.2
letter 22
dirty 20.8
blank 20.6
food 19.9
book 19.7
stamp 19.4
covering 19
jacket 18.7
brown 17.7
wallpaper 17.6
cover 17.6
text 17.5
design 17.4
rusty 17.1
rough 16.4
wall 16.3
sheet 16
page 15.8
pattern 15
mail 14.4
grungy 14.2
postmark 13.8
postage 13.8
border 13.6
wrapping 13.5
parchment 13.4
worn 13.4
backgrounds 13
pages 12.7
stained 12.5
post 12.4
weathered 12.4
document 12.1
prayer rug 12
postal 11.8
decorative 11.7
rust 11.6
damaged 11.4
card 11.1
paint 10.9
rug 10.6
aging 10.5
canvas 10.4
binder 10.4
decoration 10.1
global 10
color 10
backdrop 9.9
gold 9.9
material 9.8
scratch 9.8
delivery 9.7
style 9.6
textured 9.6
black 9.6
cardboard 9.6
yellow 9.3
blackboard 9
philately 8.9
surface 8.8
symbol 8.8
burnt 8.7
museum 8.7
stain 8.7
used 8.6
rustic 8.6
note 8.3
philatelic 7.9
ragged 7.8
faded 7.8
packet 7.7
spot 7.7
nation 7.6
word 7.5
write 7.5
historic 7.3
ornate 7.3
message 7.3
floor cover 7.3
national 7.3
detail 7.2
furnishing 7.2
religion 7.2
envelope 7.1
country 7

Google
created on 2022-02-19

Picture frame 93.4
Rectangle 89.3
Font 82.3
Art 77.3
Circle 74.5
Pattern 73.5
Symmetry 64.1
Visual arts 63.3
Square 58.2
Illustration 52.1
Serveware 50

Microsoft
created on 2022-02-19

text 93.6
handwriting 59.5
book 58.2
poster 51
picture frame 17

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 99.8%
Angry 0%
Surprised 0%
Confused 0%
Disgusted 0%
Sad 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Calm 99.4%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Male, 94.6%
Calm 63.4%
Confused 22.3%
Sad 10.7%
Angry 1.3%
Disgusted 0.9%
Happy 0.7%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Calm 87.1%
Sad 10.1%
Angry 1.2%
Confused 0.4%
Fear 0.4%
Disgusted 0.4%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 78.7%
Calm 92.5%
Sad 3%
Angry 1%
Happy 0.9%
Confused 0.9%
Surprised 0.9%
Fear 0.5%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 77.9%
Disgusted 40.7%
Calm 35.7%
Sad 10.6%
Confused 5.3%
Fear 4.8%
Angry 1.3%
Surprised 0.9%
Happy 0.6%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 97.1%
Confused 1%
Sad 0.7%
Angry 0.6%
Happy 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 87.9%
Sad 81.1%
Calm 13.8%
Disgusted 3.2%
Confused 0.6%
Angry 0.6%
Surprised 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 99.4%
Sad 0.3%
Happy 0.2%
Angry 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 68.2%
Sad 11.1%
Fear 9.6%
Confused 5.2%
Surprised 3%
Angry 1.7%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 22-30
Gender Male, 82.4%
Calm 99.9%
Sad 0%
Angry 0%
Surprised 0%
Happy 0%
Fear 0%
Confused 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Rug
Person 95.8%
Person 94.9%
Person 93.6%
Person 87.7%
Person 81.3%
Person 76.5%
Person 75.7%
Person 67.5%
Person 49.8%
Rug 67.2%

Categories

Imagga

paintings art 97.5%
streetview architecture 1.7%

Captions

Microsoft
created on 2022-02-19

a close up of a sign 84.6%
a sign on a pole 56.8%
a sign for a photo 56.7%

Text analysis

Amazon

Polk
Morgan
Branch
Jenkins
Earl
Dorn
Leonidas Polk
AJ Jenkins
Dead
Leonidas
AJ
Confederate Dead
H
Earl Van Dorn
AS.
G.J.Rains
Confederate
AS. Johnston
Johnston
Ben
J H Morgan
Van
W.
ТОВ Branch
Ben M: Callough
J
Ter
W. Barksidale
Callough
M:
J.E.B.
J.E.B. Sluarl
Sluarl
Barksidale
ТОВ
Zalicco Ter
oven
Slonemell Jackson
Zalicco

Google

WOB. Branch Earl Van Dorn JH Morgan W. Barksdale AS. Johnston JEBSluart Slkvenal Jackson. AJ Jenkins Ben M: Cullough Leonidas Polk G J. Rains Confederale Dead
WOB.
Branch
Earl
Van
Dorn
JH
Morgan
W.
Barksdale
AS.
Johnston
JEBSluart
Slkvenal
Jackson.
AJ
Jenkins
Ben
M:
Cullough
Leonidas
Polk
G
J.
Rains
Confederale
Dead