Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Little Neighbors.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2881.1

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "Neighborhood House": Neighborhood House, Chicago, Ill.: Little Neighbors.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 98.8
Human 98.8
Person 98.8
Person 98.7
Person 98.6
Person 98.4
Person 98
Person 97.9
Person 97.8
Person 97.8
Person 97.4
Person 96.3
Person 95.9
Person 95.6
Person 94
School 93
Person 90.2
Indoors 88.8
Classroom 88.8
Room 88.8
Person 87.7
Kindergarten 87.6
Person 87.2
People 86
Person 85.7
Person 77.8
Person 73
Person 72.5
Porch 69.3
Person 67.7
Person 66.6
Person 63.6
Person 63.5
Person 42.9

Clarifai
created on 2019-06-05

people 100
many 99.7
group 99.6
child 99.3
group together 97.7
adult 94.7
man 93.2
administration 91.9
several 90.2
wear 88.3
education 87.9
boy 86.6
home 85.5
woman 85.3
military 83.9
war 81.1
sit 81
crowd 79.9
leader 79.5
elementary school 77.5

Imagga
created on 2019-06-05

kin 100
man 19.5
old 18.8
people 18.4
statue 18
male 15
sculpture 14.3
outdoor 13.8
person 13.5
child 12.1
sepia 11.6
religion 11.6
history 11.6
adult 11.2
stone 11
sport 10.4
culture 10.2
historic 10.1
world 10
portrait 9.7
outdoors 9.7
death 9.6
antique 9.5
architecture 9.4
grunge 9.4
monument 9.3
art 9.1
vintage 9.1
black 9
mother 8.7
historical 8.5
decoration 8.4
silhouette 8.3
building 8.3
dress 8.1
family 8
love 7.9
sand 7.8
travel 7.7
men 7.7
summer 7.7
beach 7.6
athlete 7.6
dark 7.5
religious 7.5
traditional 7.5
city 7.5
park 7.4
street 7.4
dirty 7.2
lifestyle 7.2
sunset 7.2
women 7.1

Google
created on 2019-06-05

People 95.3
Photograph 94.8
Child 80.7
Vintage clothing 64.7
State school 64.2
Monochrome 60.1
Family 59.7
History 54.1

Microsoft
created on 2019-06-05

posing 99.5
person 99.2
clothing 98.1
group 94.1
old 93.5
boy 91.9
child 88.5
outdoor 87.2
toddler 86.5
human face 85.9
baby 76.7
black 74.6
smile 69.1
house 54.6
footwear 53.8
team 52.7
vintage 27.4
family 18.3
clothes 16.9

Face analysis

Amazon

AWS Rekognition

Age 45-66
Gender Female, 52.9%
Calm 45.1%
Disgusted 45.1%
Confused 45.1%
Happy 54.2%
Angry 45.1%
Surprised 45.1%
Sad 45.3%

AWS Rekognition

Age 20-38
Gender Female, 53.6%
Disgusted 46.8%
Surprised 45.3%
Angry 45.8%
Confused 45.3%
Sad 45.6%
Calm 50.1%
Happy 46.1%

AWS Rekognition

Age 35-52
Gender Female, 54.3%
Angry 46.7%
Disgusted 45.2%
Confused 45.4%
Calm 45.7%
Happy 45.2%
Surprised 45.1%
Sad 51.7%

AWS Rekognition

Age 27-44
Gender Female, 51%
Calm 45.1%
Disgusted 45.1%
Confused 45.1%
Angry 45.1%
Happy 46.2%
Sad 53.5%
Surprised 45%

AWS Rekognition

Age 9-14
Gender Male, 53.5%
Calm 45.8%
Confused 45.3%
Sad 52.5%
Surprised 45.1%
Happy 45.1%
Disgusted 45.2%
Angry 45.9%

AWS Rekognition

Age 4-9
Gender Male, 53.9%
Angry 45.5%
Disgusted 45.3%
Confused 45.4%
Calm 45.3%
Happy 45.2%
Surprised 45.2%
Sad 53.1%

AWS Rekognition

Age 19-36
Gender Male, 50.6%
Angry 45.7%
Surprised 45.1%
Confused 45.3%
Sad 49.9%
Disgusted 46.7%
Happy 45.8%
Calm 46.5%

AWS Rekognition

Age 35-52
Gender Female, 54.1%
Surprised 45.1%
Angry 45.1%
Disgusted 45%
Sad 45.2%
Happy 54.4%
Confused 45.1%
Calm 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Surprised 45.2%
Confused 45.2%
Sad 46.2%
Disgusted 45.2%
Calm 52.3%
Angry 45.3%
Happy 45.5%

AWS Rekognition

Age 9-14
Gender Female, 51.7%
Sad 48.5%
Confused 45.2%
Calm 46.8%
Disgusted 45.1%
Happy 49.2%
Angry 45.2%
Surprised 45.2%

AWS Rekognition

Age 4-7
Gender Female, 54.7%
Disgusted 45.1%
Calm 45.1%
Confused 45.1%
Surprised 45.1%
Happy 45.1%
Angry 45.2%
Sad 54.3%

AWS Rekognition

Age 6-13
Gender Female, 51.7%
Surprised 45.2%
Happy 45.6%
Sad 47.3%
Calm 46.3%
Confused 45.4%
Disgusted 45.1%
Angry 50.1%

AWS Rekognition

Age 20-38
Gender Female, 51.4%
Happy 45.4%
Calm 46%
Sad 50.8%
Angry 46.8%
Confused 45.5%
Surprised 45.2%
Disgusted 45.2%

AWS Rekognition

Age 38-57
Gender Male, 54.4%
Sad 52.5%
Angry 45.6%
Happy 45.1%
Confused 45.2%
Surprised 45.2%
Disgusted 45.8%
Calm 45.5%

AWS Rekognition

Age 14-23
Gender Female, 54%
Sad 45.8%
Disgusted 45.1%
Surprised 45.4%
Happy 45.3%
Confused 45.1%
Angry 48.2%
Calm 50.2%

AWS Rekognition

Age 4-9
Gender Female, 51.4%
Sad 53.1%
Disgusted 45.1%
Confused 45.4%
Angry 45.5%
Happy 45.4%
Surprised 45.2%
Calm 45.2%

AWS Rekognition

Age 26-44
Gender Female, 50.3%
Surprised 50.2%
Confused 45.1%
Sad 45.1%
Disgusted 45%
Calm 49.4%
Angry 45.2%
Happy 45%

AWS Rekognition

Age 6-13
Gender Female, 51.2%
Calm 45.2%
Surprised 45.2%
Disgusted 45.4%
Confused 45.4%
Happy 46.6%
Angry 45.6%
Sad 51.7%

AWS Rekognition

Age 12-22
Gender Female, 51%
Calm 46.7%
Confused 45.4%
Sad 50.6%
Surprised 45.1%
Happy 46.6%
Disgusted 45.1%
Angry 45.4%

AWS Rekognition

Age 11-18
Gender Female, 54.9%
Calm 47%
Disgusted 45.2%
Confused 45.5%
Angry 45.4%
Happy 49.7%
Sad 46.9%
Surprised 45.3%

AWS Rekognition

Age 6-13
Gender Female, 50.2%
Sad 45.6%
Angry 50.4%
Happy 45.3%
Confused 45.5%
Surprised 45.6%
Disgusted 45.7%
Calm 46.9%

AWS Rekognition

Age 26-43
Gender Female, 50%
Happy 45%
Surprised 45.1%
Angry 45.2%
Sad 45.1%
Confused 45%
Disgusted 45%
Calm 54.5%

AWS Rekognition

Age 9-14
Gender Female, 50.5%
Calm 45%
Sad 54.4%
Happy 45.1%
Angry 45.3%
Disgusted 45%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 10-15
Gender Female, 53.4%
Calm 45%
Disgusted 45%
Confused 45%
Angry 45.1%
Happy 52.4%
Sad 47.4%
Surprised 45%

AWS Rekognition

Age 17-27
Gender Female, 54.5%
Sad 45%
Happy 54.9%
Surprised 45%
Disgusted 45%
Angry 45%
Calm 45%
Confused 45%

AWS Rekognition

Age 10-15
Gender Female, 50.3%
Sad 49.5%
Disgusted 46.5%
Surprised 45.3%
Angry 45.7%
Happy 46.2%
Calm 45.9%
Confused 46%

AWS Rekognition

Age 10-15
Gender Female, 52.9%
Angry 45%
Surprised 45.1%
Confused 45%
Sad 45.2%
Disgusted 45%
Happy 54.6%
Calm 45%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Sad 45.6%
Confused 46.2%
Calm 48.7%
Disgusted 45.6%
Happy 46.1%
Angry 47%
Surprised 45.8%

AWS Rekognition

Age 15-25
Gender Male, 53.3%
Happy 46.7%
Disgusted 45.2%
Confused 45.4%
Surprised 45.3%
Sad 51%
Angry 46.2%
Calm 45.1%

AWS Rekognition

Age 23-38
Gender Female, 51.2%
Sad 51.5%
Disgusted 45.4%
Confused 45.7%
Angry 45.7%
Happy 46.2%
Surprised 45.3%
Calm 45.3%

AWS Rekognition

Age 4-7
Gender Female, 51.5%
Angry 47.5%
Happy 45.5%
Disgusted 45.4%
Confused 46.2%
Surprised 45.2%
Sad 49.5%
Calm 45.7%

AWS Rekognition

Age 19-36
Gender Female, 54.3%
Angry 46.1%
Happy 45.6%
Disgusted 45.5%
Confused 45.5%
Surprised 45.6%
Sad 49.3%
Calm 47.4%

AWS Rekognition

Age 11-18
Gender Male, 53.7%
Sad 53.2%
Confused 45.4%
Angry 45.4%
Surprised 45.1%
Happy 45.1%
Calm 45.8%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Angry 45.8%
Calm 48.3%
Disgusted 46.4%
Happy 46.8%
Surprised 45.5%
Sad 46.7%
Confused 45.6%

AWS Rekognition

Age 4-7
Gender Female, 51.9%
Sad 54.6%
Happy 45.1%
Surprised 45%
Disgusted 45%
Angry 45.1%
Calm 45.1%
Confused 45.1%

AWS Rekognition

Age 6-13
Gender Female, 50.1%
Disgusted 45.1%
Confused 45.2%
Angry 45.8%
Happy 45.1%
Calm 45.1%
Surprised 45.1%
Sad 53.6%

AWS Rekognition

Age 4-9
Gender Female, 54.8%
Surprised 45%
Happy 45%
Sad 54.8%
Calm 45%
Confused 45%
Disgusted 45%
Angry 45.1%

AWS Rekognition

Age 45-63
Gender Female, 55%
Angry 45%
Surprised 45%
Confused 45%
Sad 45.1%
Disgusted 45%
Happy 54.8%
Calm 45%

AWS Rekognition

Age 19-36
Gender Female, 54.9%
Disgusted 45.1%
Confused 45%
Angry 45.1%
Sad 45.5%
Surprised 45.1%
Happy 54.1%
Calm 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50%
Sad 52.4%
Happy 45.1%
Surprised 45.3%
Disgusted 45.2%
Angry 45.5%
Calm 45.2%
Confused 46.4%

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people posing for a photo 98.6%
a vintage photo of a group of people posing for the camera 97.7%
a vintage photo of a group of people posing for a picture 97.6%

Text analysis

Amazon

5.7

Google

$.7
$.7