Human Generated Data

Title

Social Settlements: United States. New York. New York City. Union Settlement: Union Settlement, New York City: The Boys' Playground.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.178.4

Human Generated Data

Title

Social Settlements: United States. New York. New York City. Union Settlement: Union Settlement, New York City: The Boys' Playground.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 99.4
Person 99
Person 99
Person 98.9
Person 98.9
Person 98.5
Person 98.1
Person 95.2
Person 94.9
Text 94.4
Person 93.1
Person 91.1
Person 89.1
Person 85.8
Person 72.6
Mail 71.8
Envelope 71.8
Person 69.2
People 67.8
Person 65.7
Person 62.5
Postcard 59.8
Outdoors 59.8
Pedestrian 56.9
Person 42.3

Clarifai
created on 2019-06-05

group 99.5
people 99.4
print 99.3
many 99.2
mammal 97.6
lithograph 97.5
camel 96.9
adult 96.5
man 96.4
art 94.3
illustration 94
wear 91.7
cavalry 90.9
painting 87
livestock 85.8
several 84.9
text 83.6
group together 82.1
dog 81.9
document 80.1

Imagga
created on 2019-06-05

old 34.1
sketch 33.8
ancient 31.1
drawing 28.9
sand 27.8
antique 25.2
grunge 24.7
architecture 24.2
travel 23.9
vintage 22.3
tourism 22.3
aged 20.8
history 20.6
representation 20.4
paper 20.4
historic 20.2
texture 20.1
sky 19.8
desert 19.3
landmark 18.1
structure 17.7
city 16.1
wall 15.3
snow 14.9
stone 14.8
retro 14.7
dirty 14.5
brown 14
building 13.8
crumpled 13.6
tower 13.4
damaged 13.3
art 13
culture 12.8
parchment 12.5
old fashioned 12.4
vacation 12.3
famous 12.1
empty 12
landscape 11.9
material 11.6
worn 11.5
book jacket 11.4
textured 11.4
grain 11.1
soil 11
rough 10.9
grave 10.8
artistic 10.4
historical 10.3
monument 10.3
sea 10.2
tourist 10.1
frame 10
fortress 9.9
castle 9.9
jacket 9.8
grime 9.8
summer 9.6
decay 9.6
rock 9.5
blank 9.4
water 9.3
camel 9.2
wallpaper 9.2
surface 8.8
fracture 8.8
sepia 8.7
stain 8.6
construction 8.6
grungy 8.5
design 8.4
place 8.4
page 8.3
town 8.3
beach 8.3
street 8.3
earth 8
scenic 7.9
fort 7.8
ruin 7.8
stains 7.8
medieval 7.7
hound 7.5
brick 7.5
border 7.2
scenery 7.2
weather 7.1

Google
created on 2019-06-05

Photograph 95.7
Text 90.8
Snapshot 84.3
Art 67.7
Room 65.7
Paper product 64.3
Photography 62.4
Illustration 62.3
Stock photography 59.4
Visual arts 55

Microsoft
created on 2019-06-05

person 78.6
handwriting 74.2
people 71.5
horse 53.5

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.6%
Sad 49.7%
Surprised 49.6%
Happy 49.6%
Calm 50%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 15-25
Gender Male, 50.1%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Sad 50.3%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.5%
Calm 50.3%
Disgusted 49.5%
Surprised 49.5%
Sad 49.6%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.3%
Sad 50%
Confused 49.5%
Angry 49.6%
Calm 49.6%
Surprised 49.5%
Happy 49.7%
Disgusted 49.6%

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a building 59.4%
a group of people standing outside of a building 58.5%
a group of people standing next to a building 57.4%

Text analysis

Amazon

Boys'
The Boys'
The
ound

Google

The Boys' Ployground
Boys'
Ployground
The