Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3574.1

Human Generated Data

Title

Recreation, Parks and Playgrounds: United States. Missouri. St. Louis. Vacation Playgrounds: Vacation Playgrounds, St. Louis, Mo.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3574.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.5
Person 98.5
Person 95.2
Person 93.3
Person 91.4
Painting 91.4
Art 91.4
Person 90.9
People 88.7
Person 86.9
Person 86.1
Person 84.6
Person 71.1
Person 65.8

Clarifai
created on 2019-06-05

people 96.4
many 95.7
art 93.7
no person 91.9
adult 88.9
group 88.9
stone 87.7
man 87.5
old 86.6
sculpture 86.1
travel 85.8
outdoors 83.3
nature 82.3
desktop 80.5
winter 79.7
rock 79.4
mammal 79.2
snow 77.6
image 77
ancient 77

Imagga
created on 2019-06-05

barnacle 33.5
crustacean 26.7
arthropod 20.1
landscape 20.1
stone 19.8
texture 19.4
old 18.1
invertebrate 17.6
grunge 16.2
snow 15.2
rock 14.8
animal 14.7
tree 13.7
dirty 13.5
wall 13.2
aged 12.7
pattern 12.3
textured 12.3
travel 12
outdoors 11.9
park 11.5
surface 11.5
structure 11.4
brown 11
vintage 10.7
material 10.7
gravestone 10.7
sand 10.5
antique 10.4
mountain 9.8
rural 9.7
detail 9.6
forest 9.6
sky 9.6
conch 9.6
weathered 9.5
natural 9.4
winter 9.4
exterior 9.2
rough 9.1
memorial 9
architecture 8.6
flower 8.6
wallpaper 8.4
outdoor 8.4
mountains 8.3
backdrop 8.2
water 8
gastropod 7.9
wild 7.8
ancient 7.8
cold 7.7
outside 7.7
desert 7.5
closeup 7.4
decoration 7.4
lake 7.3
bouquet 7.3
fence 7.2
paper 7.2
sea 7
country 7
scenic 7
agriculture 7

Google
created on 2019-06-05

Photograph 95
Vintage clothing 53.5
Art 50.2

Microsoft
created on 2019-06-05

person 97
clothing 95.2
old 88.3
outdoor 88.2
man 73.5
woman 65.4
posing 61
stone 6.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Sad 45.4%
Happy 46.1%
Disgusted 50.3%
Calm 47.2%
Angry 45.2%
Confused 45.4%
Surprised 45.3%

AWS Rekognition

Age 30-47
Gender Female, 52%
Disgusted 45.1%
Surprised 45%
Happy 45.1%
Calm 45.1%
Angry 45%
Sad 54.7%
Confused 45%

AWS Rekognition

Age 35-52
Gender Female, 54.7%
Calm 47.4%
Sad 47.6%
Confused 45.4%
Angry 45.6%
Disgusted 48.4%
Happy 45.3%
Surprised 45.3%

AWS Rekognition

Age 10-15
Gender Female, 52.4%
Surprised 45.2%
Happy 45.8%
Disgusted 45.2%
Calm 49.4%
Sad 48%
Angry 46.1%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Female, 54.7%
Angry 45.3%
Happy 45%
Surprised 45%
Calm 45.2%
Confused 45.1%
Sad 54.3%
Disgusted 45%

AWS Rekognition

Age 6-13
Gender Female, 53.4%
Calm 47.8%
Confused 45.2%
Disgusted 45.5%
Angry 45.6%
Happy 45.2%
Surprised 45.3%
Sad 50.3%

AWS Rekognition

Age 14-25
Gender Female, 54.4%
Sad 47.2%
Disgusted 45.1%
Angry 45.2%
Surprised 45.1%
Calm 52.1%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 38-57
Gender Female, 52.2%
Surprised 45.2%
Happy 45.3%
Confused 45.1%
Calm 47%
Disgusted 51.9%
Angry 45.2%
Sad 45.2%

AWS Rekognition

Age 26-44
Gender Female, 51.9%
Disgusted 45%
Happy 45%
Surprised 45%
Angry 45.1%
Confused 45%
Calm 45%
Sad 54.7%

AWS Rekognition

Age 26-44
Gender Female, 54%
Calm 45.3%
Sad 52.5%
Disgusted 45.4%
Happy 46%
Surprised 45.1%
Angry 45.5%
Confused 45.2%

AWS Rekognition

Age 14-25
Gender Female, 50.9%
Sad 53.5%
Happy 45.1%
Disgusted 45.1%
Surprised 45.1%
Calm 46%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 11-18
Gender Female, 52.4%
Disgusted 45.4%
Surprised 45.3%
Calm 48.5%
Angry 45.5%
Happy 45.2%
Sad 49.9%
Confused 45.2%

AWS Rekognition

Age 17-27
Gender Female, 54.8%
Sad 51.1%
Disgusted 45.8%
Angry 46%
Happy 45.9%
Confused 45.2%
Calm 45.6%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Disgusted 46.4%
Happy 46.7%
Surprised 45.5%
Calm 47.1%
Angry 45.5%
Confused 45.8%
Sad 48.1%

AWS Rekognition

Age 45-63
Gender Female, 52.3%
Happy 45.2%
Disgusted 45.1%
Angry 45.8%
Surprised 45%
Calm 45.1%
Sad 53.7%
Confused 45.1%

AWS Rekognition

Age 45-65
Gender Male, 54.4%
Disgusted 45.4%
Angry 45.9%
Confused 45.6%
Surprised 45.5%
Calm 47.7%
Sad 49.1%
Happy 45.8%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Sad 54.3%
Surprised 45.1%
Angry 45.2%
Disgusted 45.1%
Confused 45.2%
Happy 45.1%
Calm 45.2%

AWS Rekognition

Age 26-44
Gender Female, 52.9%
Calm 45%
Disgusted 45%
Sad 54.3%
Angry 45.6%
Happy 45%
Surprised 45%
Confused 45%

AWS Rekognition

Age 26-43
Gender Female, 53.9%
Surprised 45.1%
Sad 54.1%
Calm 45.1%
Happy 45.5%
Confused 45.1%
Angry 45.1%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.3%
Confused 45.1%
Sad 53.2%
Calm 45.6%
Happy 45.2%
Angry 45.5%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 4-9
Gender Female, 54.6%
Sad 53%
Confused 45.1%
Happy 45.9%
Surprised 45.1%
Disgusted 45.2%
Angry 45.7%
Calm 45.1%

AWS Rekognition

Age 48-68
Gender Male, 54%
Happy 45.2%
Angry 45.3%
Surprised 45.1%
Calm 45.4%
Sad 46.1%
Confused 45.2%
Disgusted 52.7%

AWS Rekognition

Age 11-18
Gender Female, 50.7%
Surprised 45.3%
Angry 45.5%
Calm 45.5%
Disgusted 51.8%
Confused 45.3%
Happy 45.5%
Sad 46.1%

AWS Rekognition

Age 19-36
Gender Female, 54.8%
Angry 46.3%
Sad 47.3%
Happy 49.2%
Disgusted 45.3%
Calm 46.2%
Surprised 45.4%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Confused 45.2%
Disgusted 45.1%
Angry 45.3%
Sad 51.7%
Surprised 45.1%
Happy 47.5%
Calm 45.1%

AWS Rekognition

Age 12-22
Gender Female, 54.9%
Sad 54.2%
Confused 45%
Happy 45.1%
Surprised 45.1%
Disgusted 45%
Angry 45.2%
Calm 45.3%

AWS Rekognition

Age 19-36
Gender Male, 50%
Disgusted 49.6%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%
Calm 49.5%
Sad 50.3%

AWS Rekognition

Age 19-36
Gender Female, 50.4%
Surprised 45.1%
Happy 45.1%
Disgusted 45.2%
Calm 45.3%
Sad 54%
Angry 45.2%
Confused 45.1%

AWS Rekognition

Age 57-77
Gender Female, 50.9%
Angry 45.3%
Sad 50.6%
Disgusted 47.3%
Calm 45.9%
Happy 45.7%
Confused 45.2%
Surprised 45.1%

AWS Rekognition

Age 16-27
Gender Female, 53.4%
Confused 45.2%
Happy 45.4%
Sad 46.7%
Surprised 45.3%
Angry 45.7%
Disgusted 45.3%
Calm 51.4%

AWS Rekognition

Age 45-63
Gender Female, 54.6%
Disgusted 49.8%
Happy 45.7%
Surprised 45.5%
Calm 45.5%
Angry 45.7%
Confused 45.3%
Sad 47.6%

AWS Rekognition

Age 45-63
Gender Male, 50.3%
Disgusted 45.3%
Confused 45.2%
Surprised 45.1%
Calm 45.4%
Happy 45.3%
Angry 46.3%
Sad 52.4%

AWS Rekognition

Age 17-27
Gender Female, 50.6%
Angry 45.7%
Calm 47.6%
Confused 46.7%
Sad 46.9%
Happy 45.8%
Disgusted 46.3%
Surprised 46.1%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Sad 50.3%
Happy 48.4%
Angry 45.3%
Calm 45.3%
Disgusted 45.2%
Confused 45.2%
Surprised 45.2%

AWS Rekognition

Age 38-57
Gender Male, 53.7%
Surprised 45.3%
Happy 46.5%
Angry 45.9%
Calm 50.3%
Confused 45.7%
Sad 45.8%
Disgusted 45.5%

AWS Rekognition

Age 26-44
Gender Female, 52.3%
Calm 53.4%
Disgusted 45.1%
Sad 45.6%
Angry 45.1%
Happy 45.5%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Female, 53.9%
Sad 45.3%
Calm 45.3%
Disgusted 51.2%
Happy 47.3%
Confused 45.2%
Angry 45.3%
Surprised 45.3%

AWS Rekognition

Age 20-38
Gender Female, 53.4%
Calm 47.1%
Angry 45.5%
Happy 45.7%
Surprised 45.6%
Confused 45.7%
Disgusted 45.4%
Sad 50.1%

AWS Rekognition

Age 26-43
Gender Female, 50.7%
Sad 46.3%
Surprised 45.3%
Angry 46.5%
Calm 50.8%
Happy 45.3%
Confused 45.3%
Disgusted 45.5%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Sad 49.9%
Calm 49.7%
Surprised 49.6%
Confused 49.5%
Angry 49.6%
Disgusted 49.6%
Happy 49.6%

AWS Rekognition

Age 60-90
Gender Female, 50.4%
Happy 45.1%
Disgusted 45.2%
Confused 45.8%
Surprised 45.5%
Sad 49.6%
Angry 45.4%
Calm 48.3%

AWS Rekognition

Age 35-52
Gender Male, 50%
Confused 49.5%
Calm 49.9%
Angry 49.6%
Surprised 49.5%
Sad 49.8%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 49.5%
Angry 49.5%
Calm 50.1%
Happy 49.5%
Confused 49.5%
Disgusted 49.7%
Surprised 49.5%

AWS Rekognition

Age 23-38
Gender Female, 52.3%
Sad 48.2%
Happy 45.6%
Angry 46.2%
Calm 47.3%
Disgusted 46.6%
Confused 45.4%
Surprised 45.6%

AWS Rekognition

Age 35-53
Gender Female, 50.1%
Happy 49.6%
Sad 49.6%
Surprised 49.6%
Confused 49.5%
Calm 50.3%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Confused 45.2%
Happy 51.5%
Calm 45.2%
Angry 45.2%
Sad 47.6%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Surprised 49.5%
Angry 49.6%
Confused 49.6%
Disgusted 49.7%
Calm 49.9%
Happy 49.5%
Sad 49.7%

AWS Rekognition

Age 4-9
Gender Female, 54.3%
Calm 45.3%
Sad 45.1%
Confused 45.1%
Happy 45.1%
Angry 45.1%
Disgusted 54.2%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 53.6%
Disgusted 45.2%
Confused 45.2%
Surprised 45.4%
Calm 50.4%
Happy 46.1%
Angry 45.5%
Sad 47.2%

AWS Rekognition

Age 17-27
Gender Female, 51.2%
Happy 48.7%
Disgusted 45.9%
Surprised 46.1%
Angry 45.9%
Sad 46.5%
Confused 45.5%
Calm 46.5%

AWS Rekognition

Age 26-43
Gender Female, 53.2%
Sad 48%
Disgusted 45.5%
Angry 45.8%
Surprised 45.4%
Calm 49%
Confused 45.3%
Happy 46.2%

AWS Rekognition

Age 23-38
Gender Female, 52.1%
Disgusted 46.2%
Surprised 45.3%
Sad 50.6%
Calm 46.9%
Angry 45.5%
Happy 45.3%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Female, 50.3%
Angry 45.6%
Sad 50.1%
Happy 47.1%
Disgusted 46.1%
Calm 45.1%
Surprised 45.7%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51%
Angry 45.5%
Sad 46.9%
Confused 45.5%
Disgusted 45.7%
Calm 51.1%
Surprised 45.2%
Happy 45%

AWS Rekognition

Age 30-47
Gender Male, 51.9%
Sad 48.8%
Disgusted 45.4%
Angry 45.6%
Surprised 45.7%
Calm 48.7%
Confused 45.5%
Happy 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Calm 46.3%
Confused 45.3%
Sad 50.4%
Surprised 45.4%
Happy 47.2%
Disgusted 45.2%
Angry 45.4%

AWS Rekognition

Age 35-52
Gender Female, 53.8%
Calm 45.3%
Confused 45.7%
Happy 45.2%
Disgusted 45.2%
Angry 45.4%
Surprised 45.3%
Sad 53%

AWS Rekognition

Age 26-43
Gender Female, 54%
Surprised 47%
Disgusted 45.4%
Confused 46.5%
Sad 46.3%
Calm 48.6%
Happy 45.4%
Angry 45.8%

AWS Rekognition

Age 35-52
Gender Male, 50%
Sad 49%
Disgusted 45.3%
Happy 45.4%
Angry 45.8%
Surprised 45.2%
Calm 48.9%
Confused 45.3%

AWS Rekognition

Age 14-25
Gender Female, 53.2%
Sad 45.5%
Disgusted 45.4%
Calm 51.9%
Confused 45.3%
Angry 45.5%
Surprised 45.6%
Happy 45.8%

AWS Rekognition

Age 19-36
Gender Male, 54%
Confused 45.1%
Sad 45%
Calm 45.6%
Happy 45.2%
Angry 45.2%
Surprised 45.2%
Disgusted 53.6%

AWS Rekognition

Age 16-27
Gender Female, 50.8%
Calm 49.2%
Angry 46.1%
Happy 45.1%
Surprised 45.9%
Confused 46%
Disgusted 46.3%
Sad 46.4%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 91.4%

Categories

Imagga

beaches seaside 75.9%
streetview architecture 15.4%
nature landscape 5.9%
paintings art 1.4%