Human Generated Data

Title

Social Settlements: United States. New Jersey. Newark. "Newark Social Settlement Association": The Newark Social Settlement Association, Newark, N.J.: Cortelyou Club (Italian boys)

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3127.4

Human Generated Data

Title

Social Settlements: United States. New Jersey. Newark. "Newark Social Settlement Association": The Newark Social Settlement Association, Newark, N.J.: Cortelyou Club (Italian boys)

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3127.4

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.7
Human 99.7
Person 99.1
Person 99.1
Person 98.6
Person 98.5
Person 98.3
Poster 97.4
Advertisement 97.4
Person 97.4
Person 97.1
Person 95.4
People 92.3
Apparel 89.8
Clothing 89.8
Family 74
Sitting 65.8
Text 65.2
Face 64.7
Food 64.7
Meal 64.7
Vacation 57.9
Picnic 57.3
Leisure Activities 57.3
Photo 56.7
Photography 56.7
Person 46.1

Clarifai
created on 2019-06-06

people 99.9
group 99.6
child 98.4
many 98.1
adult 96
group together 94.6
man 93.8
wear 93.6
portrait 93.6
son 93.2
woman 92.9
retro 91.4
sit 91.3
five 90.6
several 90.3
four 88.1
military 88.1
music 87.7
war 87.2
nostalgia 85.8

Imagga
created on 2019-06-06

kin 100
statue 38.2
sculpture 32.6
ancient 25.9
old 25.1
architecture 23.4
monument 22.4
religion 22.4
stone 19.5
history 18.8
art 15.7
travel 14.8
antique 14.7
building 14.4
vintage 14.1
religious 14.1
culture 13.7
tourism 13.2
people 12.3
historical 12.2
man 12.1
landmark 11.7
temple 11.6
historic 11
city 10
catholic 9.7
love 9.5
symbol 9.4
head 9.2
face 9.2
grave 9.2
traditional 9.1
aged 9
memorial 8.9
marble 8.7
couple 8.7
god 8.6
male 8.5
famous 8.4
retro 8.2
figure 8.2
detail 8
family 8
decoration 8
sepia 7.8
portrait 7.8
museum 7.8
heritage 7.7
holy 7.7
person 7.7
outdoor 7.6
two 7.6
cross 7.5
closeup 7.4
church 7.4
world 7.3
home 7.2
day 7.1
happiness 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

clothing 98.6
text 97.2
smile 96.4
person 95.8
old 95.3
human face 94.5
posing 88.9
woman 77.5
player 77.3
vintage 70.7
man 69.3
boy 64.2
footwear 60.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 95.3%
Angry 4.3%
Surprised 1.6%
Sad 85.9%
Confused 1%
Calm 3.5%
Disgusted 2.1%
Happy 1.5%

AWS Rekognition

Age 20-38
Gender Male, 97.7%
Sad 21.3%
Disgusted 2.1%
Calm 67.9%
Confused 3.8%
Happy 1.6%
Surprised 0.9%
Angry 2.4%

AWS Rekognition

Age 16-27
Gender Female, 70.6%
Angry 67.7%
Confused 2.6%
Calm 14.6%
Disgusted 0.9%
Happy 1.1%
Surprised 2.5%
Sad 10.6%

AWS Rekognition

Age 20-38
Gender Male, 98%
Disgusted 2.4%
Happy 2.8%
Angry 8.1%
Calm 55.2%
Surprised 3.2%
Confused 21.7%
Sad 6.6%

AWS Rekognition

Age 26-43
Gender Male, 96.2%
Angry 3.1%
Disgusted 6.3%
Confused 2.8%
Calm 1.5%
Happy 81.2%
Surprised 2.4%
Sad 2.9%

AWS Rekognition

Age 20-38
Gender Male, 71.6%
Surprised 4.1%
Happy 5.2%
Confused 3.6%
Calm 65.7%
Disgusted 3.9%
Angry 7.8%
Sad 9.7%

AWS Rekognition

Age 23-38
Gender Male, 51.9%
Disgusted 45.1%
Calm 45%
Confused 45.1%
Happy 45.1%
Surprised 45.1%
Angry 54%
Sad 45.6%

AWS Rekognition

Age 35-52
Gender Female, 54.2%
Angry 45.5%
Surprised 45.3%
Sad 52.9%
Confused 45.4%
Calm 45.2%
Disgusted 45.3%
Happy 45.3%

AWS Rekognition

Age 10-15
Gender Male, 54%
Calm 45.2%
Surprised 45.2%
Happy 45.3%
Disgusted 46.5%
Angry 46.6%
Sad 50.1%
Confused 46.1%

AWS Rekognition

Age 23-38
Gender Female, 54.9%
Calm 45.6%
Confused 45.2%
Happy 45.3%
Disgusted 45.3%
Sad 52.4%
Angry 45.8%
Surprised 45.4%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Poster 97.4%

Categories

Text analysis

Amazon

cortelyou
boys)
cortelyou Clb (Itolon boys)
Clb
(Itolon

Google

Cortelyou Club (tohon boys)
Cortelyou
Club
(tohon
boys)