Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.: Glimpses of the Vacation Playgrounds
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3573.7

Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.: Glimpses of the Vacation Playgrounds

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.3
Person 98.3
People 95.2
Banister 94.2
Handrail 94.2
Person 93.7
Person 90.6
Person 88.6
Person 88.3
Art 86.7
Painting 86.7
Person 78.6
Person 78.1
Person 75.5
Person 71.2
Family 68
Staircase 66.8
Porch 62.3
Person 61.7

Clarifai
created on 2019-06-05

people 99.8
many 99.1
group 99
war 98.8
military 98.7
soldier 98.2
weapon 97.3
adult 97.2
man 96.6
group together 95.4
vehicle 94.7
army 94.6
gun 94.2
skirmish 93.7
transportation system 91.4
uniform 89.5
battle 88.4
wear 83.1
art 82.8
no person 80.4

Imagga
created on 2019-06-05

architecture 41.1
vehicle 34
building 31.1
graffito 28.7
old 27.9
history 26.8
military vehicle 26
city 25.8
tracked vehicle 25.4
stone 23.8
travel 22.5
ancient 22.5
decoration 19
monument 18.7
wheeled vehicle 18.6
tank 18.2
wall 17.5
tourism 17.3
sculpture 17.2
town 16.7
landmark 16.3
culture 16.2
street 15.6
cannon 15.6
historic 15.6
conveyance 15.5
half track 15.2
house 14.3
famous 14
armored vehicle 13.2
urban 13.1
construction 12.8
religion 12.5
brick 12.2
artillery 12.2
structure 12
statue 11.8
medieval 11.5
buildings 10.4
antique 10.4
historical 10.4
vintage 9.9
weaponry 9.8
scene 9.5
place 9.3
gun 9.3
church 9.2
armament 9.2
palace 9.2
field artillery 9
tower 9
sky 8.9
ruin 8.8
houses 8.7
art 8.5
high-angle gun 8.3
exterior 8.3
road 8.1
temple 8
weapon 7.9
heritage 7.7
grunge 7.7
cityscape 7.6
memorial 7.5
transportation 7.2
center 7.1
day 7.1
stairs 7.1

Google
created on 2019-06-05

Photograph 94.8
People 93.9
Soldier 71.9
Uniform 70.8
Military organization 70.3
Troop 68.4
Infantry 62.5
History 57.6
Military uniform 55.4
Paper product 50.3

Microsoft
created on 2019-06-05

building 99.4
old 96
person 95.1
clothing 94
military vehicle 92.1
outdoor 90.4
posing 44.4
vintage 28.1
several 11.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 54.8%
Sad 45.6%
Happy 47.1%
Disgusted 45.9%
Surprised 45.4%
Calm 50.2%
Confused 45.3%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Male, 51.6%
Confused 45.1%
Disgusted 45.2%
Calm 45.3%
Angry 45.1%
Happy 46.2%
Surprised 45.1%
Sad 53%

AWS Rekognition

Age 14-25
Gender Male, 51.8%
Confused 45%
Happy 54.8%
Angry 45%
Sad 45%
Calm 45.1%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 23-38
Gender Female, 54.6%
Disgusted 45.1%
Angry 46.7%
Surprised 45.1%
Happy 45.3%
Sad 51%
Calm 46.8%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Disgusted 45.3%
Confused 45.1%
Angry 45.5%
Sad 50.9%
Surprised 45.2%
Happy 45.6%
Calm 47.3%

AWS Rekognition

Age 30-47
Gender Male, 53.3%
Calm 45.6%
Surprised 45.3%
Disgusted 45.7%
Angry 46.9%
Happy 45.9%
Sad 49.6%
Confused 45.9%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Calm 51.1%
Sad 45.3%
Surprised 45.5%
Happy 46.6%
Disgusted 45.7%
Confused 45.3%
Angry 45.5%

AWS Rekognition

Age 17-27
Gender Female, 54.1%
Disgusted 45.1%
Surprised 45%
Happy 45.1%
Calm 45.4%
Angry 45.7%
Sad 53.7%
Confused 45%

AWS Rekognition

Age 17-27
Gender Female, 52.4%
Happy 45.2%
Confused 45.1%
Calm 51%
Surprised 45.2%
Sad 46.6%
Disgusted 45.4%
Angry 46.5%

AWS Rekognition

Age 15-25
Gender Female, 53.3%
Confused 45%
Sad 54.2%
Calm 45.3%
Happy 45.1%
Angry 45.2%
Surprised 45%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52.3%
Sad 45.2%
Angry 45.2%
Calm 53.9%
Confused 45.1%
Happy 45.2%
Surprised 45.1%
Disgusted 45.2%

AWS Rekognition

Age 30-47
Gender Female, 53.2%
Calm 48.4%
Sad 46.8%
Confused 45.1%
Happy 46.8%
Angry 47.2%
Disgusted 45.3%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Female, 55%
Disgusted 46.8%
Calm 47%
Confused 45.5%
Surprised 45.3%
Happy 46%
Angry 46.8%
Sad 47.5%

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Disgusted 45.1%
Happy 46.2%
Surprised 45.6%
Calm 49.5%
Angry 45.5%
Confused 45.6%
Sad 47.5%

AWS Rekognition

Age 23-38
Gender Female, 54.2%
Sad 54.8%
Surprised 45%
Confused 45%
Disgusted 45%
Happy 45%
Calm 45.1%
Angry 45%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Calm 45.3%
Surprised 45.1%
Disgusted 45.3%
Confused 45.2%
Happy 53.9%
Angry 45.1%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Surprised 45.5%
Angry 45.5%
Calm 48.3%
Disgusted 47.6%
Confused 45.2%
Happy 46.9%
Sad 46%

AWS Rekognition

Age 20-38
Gender Female, 53.2%
Disgusted 46.6%
Surprised 45.5%
Angry 45.9%
Confused 45.2%
Sad 45.6%
Calm 50.9%
Happy 45.4%

AWS Rekognition

Age 23-38
Gender Male, 51.1%
Surprised 45.7%
Sad 48%
Angry 45.7%
Disgusted 45.3%
Calm 49.2%
Happy 45.6%
Confused 45.4%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Painting 86.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 83%
a vintage photo of a group of people posing for a picture 82.9%
a vintage photo of an old building 82.8%