Human Generated Data

Title

Franklin Street (after)
Date

1872
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.10.7.2

Human Generated Data

Title

Franklin Street (after)

People

Artist: Unidentified Artist,

Date

1872

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.10.7.2

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.4
Person 99.4
Person 99.1
Person 98.8
Soil 98.8
Person 98.7
Person 94.5
Person 94.2
Person 90.5
Person 89.3
Nature 88.8
Person 86.9
Person 86.8
Person 85.3
Archaeology 83.1
Building 80
Outdoors 78.2
Person 78.1
Urban 74.8
Person 73.4
Person 72.5
Person 68.5
People 67.4
Architecture 65.6
Wood 63.9
Person 62.3
Person 59
Person 58.3
Ground 58.1
Transportation 57
Ruins 56
Dome 55.9
Person 48.6

Clarifai
created on 2019-11-06

people 99.9
print 99.6
group 99.4
adult 98.1
many 97.5
lithograph 96.1
illustration 96
vehicle 95.5
home 95.3
no person 93.5
military 92.2
man 92.1
cavalry 91.3
building 91.1
town 90.5
art 90
engraving 89.7
war 89.4
group together 87
street 86.5

Imagga
created on 2019-11-06

sky 33.3
structure 33
architecture 27.6
building 27.5
cemetery 26.9
mosque 24.3
city 24.1
landscape 23.8
tower 21.5
travel 21.1
tourism 19.8
grunge 19.6
place of worship 19.6
old 18.1
desert 18
antique 17.1
energy 16
industrial 15.5
landmark 15.4
industry 14.5
turbine 14.5
power 14.3
vintage 14.1
ancient 13.8
grungy 13.3
town 13
texture 12.5
electricity 12.3
historic 11.9
scenic 11.4
skyline 11.4
urban 11.4
field 10.9
aged 10.9
dirty 10.9
bridge 10.8
environment 10.7
water 10.7
old fashioned 10.5
cityscape 10.4
scene 10.4
wind 10.3
sand 10.3
construction 10.3
famous 10.2
clouds 10.1
rough 10
factory 9.9
silhouette 9.9
sunset 9.9
history 9.8
vacation 9.8
stone 9.8
sea 9.7
obsolete 9.6
hill 9.4
space 9.3
retro 9
rustic 8.6
ocean 8.6
worn 8.6
snow 8.6
culture 8.6
buildings 8.5
nuclear reactor 8.5
tree 8.5
mountains 8.3
grain 8.3
brick 8.3
exterior 8.3
scenery 8.1
river 8.1
wall 8.1
weather 8.1
rural 7.9
paper 7.8
pollution 7.7
downtown 7.7
stain 7.7
wallpaper 7.7
outdoor 7.7
panorama 7.6
frame 7.5
electric 7.5
antenna 7.5
metal 7.2
color 7.2
holiday 7.2
mountain 7.1

Google
created on 2019-11-06

History 68.8
Adaptation 67
Illustration 66.9
Art 65.5
Architecture 65.5
Photography 62.4
Stock photography 62.1
City 56.2

Microsoft
created on 2019-11-06

text 100
old 74.9
vintage 32.2
sale 23.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 42-60
Gender Female, 50.2%
Fear 50%
Happy 49.5%
Calm 49.5%
Disgusted 49.5%
Sad 49.9%
Surprised 49.5%
Angry 49.5%
Confused 49.5%

Feature analysis

Amazon

Person 99.4%

Categories

Imagga

paintings art 96.9%
interior objects 2.6%

Captions

Microsoft
created on 2019-11-06

a vintage photo of a sign 70.9%
a vintage photo of some people 57.2%
a vintage photo of a store 53.4%

Text analysis

Amazon

AFTER
AND
THE
9
10,
1872,
FiRE. BEFore AFTER THE AND
AND 10, 1872, 9 BOSTON, Nov,
BEFore
BOSTON,
Nov,
FiRE.

Google

BEFORE AND AFTER THE FIRE. BosTON, Nov. 9 AND 10, 1872.
BEFORE
AND
AFTER
THE
FIRE.
BosTON,
Nov.
9
10,
1872.