Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3575.3

Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 96.6
Person 96.6
Person 92.3
Art 89.9
Floor 85.9
Painting 74.9
People 66.9
Drawing 62.2
Sketch 62.2
Flagstone 60
Slate 57.5

Clarifai
created on 2019-06-05

people 99.7
adult 98.1
one 96.1
man 96.1
wear 94.8
group 94
child 93
art 92.9
print 90.3
painting 88.4
two 87.1
veil 86.3
woman 84.5
illustration 84.2
old 79.4
military 79.3
wall 77.7
street 77.6
war 77.5
building 77.2

Imagga
created on 2019-06-05

architecture 30.2
sculpture 29.9
grave 24.4
statue 24.1
travel 21.8
ancient 21.6
monument 21.5
old 20.9
building 20.6
stone 19.9
art 19.6
structure 18
wall 16.6
city 16.6
landmark 15.3
history 15.2
stucco 15.1
fountain 15
tourism 14.9
culture 14.5
religion 14.3
tourist 14.1
historical 13.2
historic 12.8
column 12.2
famous 12.1
marble 12
grunge 11.9
memorial 11.9
detail 11.3
texture 9.7
temple 9.6
antique 9.5
dirty 9
people 8.4
church 8.3
brass 7.9
rock 7.8
crutch 7.8
decoration 7.8
construction 7.7
religious 7.5
man 7.4
color 7.2
facade 7.2
face 7.1
world 7.1
sky 7
textured 7

Google
created on 2019-06-05

Photograph 96.1
Snapshot 83.6
Vintage clothing 62.5
Art 50.2

Microsoft
created on 2019-06-05

clothing 95.8
outdoor 95.8
person 95
old 71.1
black 66.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 84.6%
Surprised 0.9%
Happy 2.1%
Angry 2.5%
Calm 0.8%
Confused 1.2%
Sad 91.7%
Disgusted 0.8%

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Painting 74.9%

Captions

Microsoft

an old photo of a person 82.5%
a person riding on the back of an old building 63%
a person standing in front of a building 62.9%