Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.: Playground Glimpses

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3571.4

Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.: Playground Glimpses

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3571.4

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.9
Person 99.9
Person 99.8
Person 98.9
Person 98.8
Person 98.5
Person 96.5
Person 96.1
Person 94.8
Person 93.2
Person 89.8
Person 85.1
People 84.5
Military 83.2
Art 78
Painting 78
Military Uniform 76.7
Armored 69.3
Army 69.3
Crowd 66.9
Officer 59.4
Troop 55.9
Person 44.4

Clarifai
created on 2019-06-05

people 100
group 99.8
child 99.7
many 99.5
group together 99.1
adult 98.5
wear 96.6
man 95.2
woman 94.6
boy 94.5
uniform 94.1
military 94.1
several 92.9
administration 92.6
recreation 92.2
sit 89.7
war 87.7
education 87.4
family 86.7
outfit 85.1

Imagga
created on 2019-06-05

military uniform 50.3
kin 49.1
uniform 48.2
clothing 35.5
person 22.9
man 21.5
military 21.2
male 20.6
soldier 20.5
consumer goods 20.2
covering 19.3
people 17.3
danger 15.5
statue 15.2
sport 14.9
army 14.6
protection 14.5
gun 14.4
adult 13.7
player 13
war 12.6
weapon 12.2
ancient 12.1
men 12
old 11.8
sculpture 11.5
camouflage 10.8
mask 10.5
commodity 10.1
history 9.8
helmet 9.8
battle 9.8
historical 9.4
athlete 9.3
child 9.2
religion 9
family 8.9
warrior 8.8
architecture 8.6
travel 8.4
stretcher 8.4
outdoor 8.4
vintage 8.3
industrial 8.2
dirty 8.1
rifle 8.1
activity 8.1
destruction 7.8
toxic 7.8
accident 7.8
protective 7.8
portrait 7.8
nuclear 7.8
play 7.8
death 7.7
stone 7.6
equipment 7.6
human 7.5
fun 7.5
monument 7.5
outdoors 7.5
symbol 7.4
training 7.4
recreation 7.2
art 7.2
ballplayer 7.1
world 7.1
love 7.1
to 7.1

Google
created on 2019-06-05

People 95.4
Family 63.5
Child 52
Vintage clothing 50.7

Microsoft
created on 2019-06-05

person 99.6
clothing 99
old 95.7
posing 95.4
group 94.1
military uniform 93.5
outdoor 90.6
man 90.2
child 63
team 49.9
clothes 22.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 60.9%
Confused 0.8%
Disgusted 1%
Calm 0.3%
Angry 1.1%
Happy 90.8%
Surprised 1.4%
Sad 4.5%

AWS Rekognition

Age 38-59
Gender Male, 59.3%
Surprised 2.8%
Confused 4.1%
Sad 58.5%
Calm 1.4%
Happy 3.3%
Disgusted 21.1%
Angry 8.8%

AWS Rekognition

Age 10-15
Gender Female, 94.3%
Sad 2.1%
Surprised 1.4%
Angry 1.3%
Calm 1.5%
Happy 91.9%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 20-38
Gender Male, 76.3%
Disgusted 0.3%
Calm 0.1%
Confused 0.3%
Surprised 0.4%
Happy 97%
Angry 0.4%
Sad 1.4%

AWS Rekognition

Age 10-15
Gender Male, 53.3%
Happy 50.6%
Angry 45.7%
Sad 47.5%
Calm 45.4%
Confused 45.2%
Disgusted 45.2%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 54.9%
Disgusted 45.7%
Surprised 45.5%
Sad 48.3%
Calm 45.7%
Angry 45.5%
Happy 48.9%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Sad 51.2%
Surprised 45.2%
Happy 47.8%
Angry 45.3%
Confused 45.2%
Disgusted 45.1%
Calm 45.4%

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Surprised 45.1%
Confused 45.1%
Sad 45.1%
Calm 45.3%
Happy 54.1%
Disgusted 45.2%
Angry 45.1%

AWS Rekognition

Age 10-15
Gender Male, 92.5%
Confused 1.3%
Calm 4.5%
Sad 2.4%
Disgusted 1.1%
Angry 0.9%
Surprised 1.5%
Happy 88.3%

AWS Rekognition

Age 9-14
Gender Male, 51%
Surprised 45.4%
Happy 48.2%
Sad 50.3%
Angry 45.4%
Disgusted 45.3%
Calm 45.2%
Confused 45.3%

AWS Rekognition

Age 14-23
Gender Female, 84.1%
Disgusted 59.5%
Surprised 5%
Calm 6.3%
Angry 9.6%
Happy 9.2%
Sad 4.5%
Confused 5.9%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Calm 53%
Disgusted 45.4%
Sad 45.3%
Angry 45.5%
Happy 45.2%
Surprised 45.4%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Confused 45.2%
Sad 45.6%
Calm 52.9%
Happy 45.2%
Angry 45.3%
Surprised 45.3%
Disgusted 45.4%

AWS Rekognition

Age 30-47
Gender Female, 50.2%
Confused 45.2%
Surprised 45.4%
Angry 45.5%
Calm 51.6%
Sad 46.8%
Happy 45.3%
Disgusted 45.3%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Painting 78%