Human Generated Data

Title

Social Settlements: United States. New York. Brooklyn. "Greenpoint Settlement": Greenpoint Settlement, Brooklyn, N.Y.: Where the children enjoy themselves during the summer months.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3132.2

Human Generated Data

Title

Social Settlements: United States. New York. Brooklyn. "Greenpoint Settlement": Greenpoint Settlement, Brooklyn, N.Y.: Where the children enjoy themselves during the summer months.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3132.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.5
Person 99.5
Person 99.5
Person 99.4
Person 99.2
Person 99.1
Person 98.9
People 98.7
Person 98.3
Person 98.2
Person 97.4
Person 97
Person 96.7
Person 94.9
Family 94.1
Person 91.7
Person 91.6
Poster 90.7
Advertisement 90.7
Person 89.4
Person 89.2
Person 87.2
Person 81.2
Person 75.6
Painting 73.7
Art 73.7
Person 57.9

Clarifai
created on 2019-06-06

people 100
group 99.9
many 99.5
child 98.1
adult 97.6
man 96
woman 94.5
several 91.6
leader 91.1
group together 90.4
print 90.3
art 89.6
crowd 89.5
son 86.5
administration 86.4
wear 85.2
lithograph 84.2
illustration 83.1
boy 81.3
sit 78.4

Imagga
created on 2019-06-06

statue 52.9
sculpture 40.7
architecture 34.4
monument 33.6
history 31.3
building 29.3
old 27.9
stone 27.5
art 26.2
daily 25.7
religion 25.1
landmark 24.4
ancient 24.2
tourism 23.9
travel 22.5
marble 21.3
city 20
historic 19.3
column 18.5
temple 18.5
cemetery 18.4
god 18.2
famous 17.7
memorial 17.1
fountain 16
church 15.7
structure 15.4
culture 15.4
historical 15.1
tourist 14.7
religious 13.1
detail 12.9
catholic 12.8
classroom 12.3
antique 12.2
private 11.6
heritage 11.6
room 11.1
kin 10.9
palace 10.7
cathedral 10.2
symbol 10.1
statues 9.8
soldier 9.8
roman 9.7
obelisk 9.6
arch 9.4
traditional 9.1
vintage 9.1
newspaper 8.9
army 8.8
helmet 8.7
holy 8.7
spirituality 8.6
cross 8.5
people 8.4
decoration 8
day 7.8
world 7.7
sky 7.7
attraction 7.6
grave 7.5
figure 7.4
water 7.3

Google
created on 2019-06-06

Photograph 95.8
People 94.7
Snapshot 83.3
History 72.6
Adaptation 67
Family 58
Art 50.2

Microsoft
created on 2019-06-06

building 99.7
person 94.9
clothing 93.7
black 86.7
old 80.5
white 71.1
posing 68.2
woman 67.8
vintage 29.1
several 10.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 51.6%
Disgusted 45%
Happy 54.1%
Angry 45.1%
Surprised 45%
Sad 45.7%
Confused 45%
Calm 45%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Disgusted 45.4%
Confused 45.1%
Surprised 45.1%
Calm 45.5%
Happy 45.1%
Angry 45.2%
Sad 53.5%

AWS Rekognition

Age 10-15
Gender Female, 52.9%
Surprised 45%
Happy 45.1%
Calm 45.1%
Disgusted 45%
Confused 45.1%
Sad 54.4%
Angry 45.3%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Calm 53.5%
Sad 45.8%
Confused 45.1%
Angry 45.1%
Disgusted 45.1%
Surprised 45.2%
Happy 45.2%

AWS Rekognition

Age 48-68
Gender Female, 51%
Calm 48.2%
Happy 45.5%
Sad 49.8%
Angry 45.7%
Disgusted 45.4%
Confused 45.2%
Surprised 45.2%

AWS Rekognition

Age 38-59
Gender Female, 52.7%
Surprised 45.2%
Calm 45.4%
Happy 45.5%
Angry 47.1%
Sad 51.4%
Disgusted 45.1%
Confused 45.4%

AWS Rekognition

Age 38-59
Gender Male, 52.3%
Calm 45.2%
Happy 45.2%
Sad 49.4%
Angry 49.7%
Confused 45.2%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 10-15
Gender Female, 54.4%
Confused 45.1%
Surprised 45.1%
Angry 47.3%
Happy 45.1%
Sad 51.9%
Calm 45.4%
Disgusted 45.2%

AWS Rekognition

Age 9-14
Gender Female, 51.8%
Calm 45.2%
Surprised 45.2%
Happy 45.2%
Disgusted 45.2%
Angry 51.1%
Sad 47.9%
Confused 45.2%

AWS Rekognition

Age 10-15
Gender Female, 52.1%
Happy 45.1%
Sad 52.6%
Confused 45.2%
Calm 46.3%
Angry 45.4%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 4-9
Gender Female, 52%
Disgusted 45.4%
Confused 45.1%
Happy 45.1%
Sad 54.2%
Surprised 45%
Calm 45.1%
Angry 45.2%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Confused 45%
Disgusted 45.1%
Calm 45.1%
Sad 46.3%
Angry 53.4%
Happy 45.1%
Surprised 45%

AWS Rekognition

Age 10-15
Gender Female, 52.1%
Calm 46.8%
Disgusted 46.9%
Surprised 45.3%
Confused 45.4%
Angry 46.1%
Sad 47.1%
Happy 47.4%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Surprised 45%
Happy 45%
Confused 45%
Calm 45%
Disgusted 45%
Sad 54.4%
Angry 45.5%

AWS Rekognition

Age 16-27
Gender Male, 50.5%
Confused 45.1%
Angry 45%
Disgusted 45%
Calm 45.2%
Happy 45.1%
Surprised 45%
Sad 54.6%

AWS Rekognition

Age 20-38
Gender Female, 53.7%
Confused 45.2%
Happy 45.1%
Sad 50.2%
Disgusted 45.2%
Angry 45.4%
Calm 48.2%
Surprised 45.7%

AWS Rekognition

Age 10-15
Gender Male, 53%
Calm 45.1%
Disgusted 45.2%
Surprised 45.1%
Angry 47.1%
Sad 52.3%
Confused 45.1%
Happy 45.2%

AWS Rekognition

Age 16-27
Gender Male, 52.6%
Happy 45.2%
Angry 45.6%
Calm 46.1%
Sad 52.8%
Surprised 45.1%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 38-57
Gender Male, 54.1%
Disgusted 45%
Confused 45%
Calm 45%
Surprised 45%
Happy 45%
Sad 55%
Angry 45%

AWS Rekognition

Age 4-9
Gender Female, 51%
Sad 54.7%
Happy 45.1%
Surprised 45%
Disgusted 45%
Confused 45%
Calm 45%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52%
Happy 45.4%
Disgusted 46.6%
Angry 45.5%
Confused 45.3%
Calm 50.8%
Surprised 45.5%
Sad 45.9%

AWS Rekognition

Age 20-38
Gender Female, 54.3%
Confused 45.1%
Disgusted 45.1%
Surprised 45%
Sad 53.5%
Angry 46.2%
Happy 45%
Calm 45.1%

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 90.7%
Painting 73.7%

Categories

Imagga

paintings art 99%

Text analysis

Amazon

uring
the
months.
children
Where the children enjoy
themselves uring the summer months.
summer
Where
enjoy
themselves
2
SA

Google

2 Where the children enoy e/ves during the summer months. them
2
Where
the
children
enoy
e/ves
during
summer
months.
them