Human Generated Data

Title

Execution of the Conspirators, No. 4

Date

July 7, 1865

People

Artist: Alexander Gardner, American 1821 - 1882

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.53

Human Generated Data

Title

Execution of the Conspirators, No. 4

People

Artist: Alexander Gardner, American 1821 - 1882

Date

July 7, 1865

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-16

Human 99.3
Person 99.3
Person 97.7
Person 96.6
Person 95.9
Person 95.1
Person 94.1
Nature 93.8
Person 93.2
Outdoors 91.5
Person 90.3
Person 89
Person 77.2
Person 76.6
Military Uniform 74.9
Military 74.9
Painting 74.6
Art 74.6
Person 74.5
Person 74.1
Person 73.6
Person 70
Person 68.9
People 66.4
Armored 66.1
Army 66.1
Person 64.6
Person 61.6
Countryside 57.4
Person 54.7
Person 53.6
Person 49.7
Person 49.2

Clarifai
created on 2019-07-16

people 100
many 100
group 99.9
group together 99.7
adult 98.9
military 97.2
man 96.7
print 96.6
war 96.1
vehicle 95.6
crowd 93.7
soldier 93.6
administration 92.7
home 92.5
leader 91.9
cavalry 90.7
several 90
transportation system 85.8
skirmish 85.7
no person 84.6

Imagga
created on 2019-07-16

tool 81.8
plow 71.4
rake 28.6
landscape 26.8
sky 23
old 19.5
sand 17.8
travel 16.2
vintage 14.1
tree 14
outdoor 13.8
grunge 13.6
tourism 13.2
shovel 12.7
rural 12.3
cleaning implement 12.2
antique 12.1
outdoors 11.9
people 11.7
field 11.7
desert 11.2
countryside 11
beach 11
road 10.8
rock 10.4
earth 10.3
paper 10.2
space 10.1
park 9.9
mountain 9.8
building 9.7
country 9.7
brown 9.6
old fashioned 9.5
empty 9.5
man 9.4
winter 9.4
broom 9.3
snow 9.2
handcart 9.1
environment 9.1
scenery 9
farm 8.9
trees 8.9
barrow 8.8
textured 8.8
hand tool 8.6
rustic 8.6
architecture 8.6
dirt 8.6
wall 8.6
house 8.4
texture 8.3
frame 8.3
grain 8.3
ocean 8.3
land 8.3
vacation 8.2
water 8
grass 7.9
destruction 7.8
sepia 7.8
cold 7.8
fog 7.7
summer 7.7
industry 7.7
silhouette 7.5
retro 7.4
industrial 7.3
sun 7.2
black 7.2
horizon 7.2
sunset 7.2
male 7.1
vehicle 7.1
work 7.1
sea 7
autumn 7
scenic 7

Google
created on 2019-07-16

Snapshot 82
History 64.5
Visual arts 59.3
Art 58.1

Microsoft
created on 2019-07-16

grass 97.7
outdoor 97
horse 76.2
old 71.7
farm building 27.5

Face analysis

Amazon

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Sad 50.2%
Happy 49.6%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Calm 49.6%
Surprised 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.6%
Angry 49.6%
Happy 50.1%
Sad 49.6%
Disgusted 49.6%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.5%
Calm 49.6%
Confused 49.6%
Sad 50.1%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 48-68
Gender Male, 50.3%
Angry 49.6%
Sad 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Disgusted 49.6%
Happy 49.9%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.8%
Calm 49.6%
Surprised 49.6%
Happy 49.6%
Disgusted 49.7%
Angry 49.7%
Confused 49.6%

Feature analysis

Amazon

Person 99.3%
Painting 74.6%

Captions

Microsoft

a vintage photo of an old building 82.4%
a vintage photo of a building 80%
a vintage photo of a barn 79.9%

Text analysis

Google

$.
3
$. 3 FN
FN