Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "Eighth Ward Settlement": The Eighth Ward Settlement, Philadelphia, Pa.: Little Citizens. Jews and one Negro.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3219.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "Eighth Ward Settlement": The Eighth Ward Settlement, Philadelphia, Pa.: Little Citizens. Jews and one Negro.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3219.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99.8
Person 99.8
Person 99.7
Person 99.1
Person 98.8
Person 98.8
Person 98.1
Person 97
People 94.6
Clothing 80.7
Apparel 80.7
Person 78.3
Person 77.4
Text 73
Brick 59.7
Door 59.1
Family 58.2
Person 45.9

Clarifai
created on 2019-06-07

people 99.8
adult 98.7
group 98.1
man 95.4
administration 92.7
one 92.5
child 92.1
woman 91.9
wear 90.4
group together 90
education 89.3
two 88.6
portrait 87.1
military 86.6
home 86.5
leader 86.1
war 86
street 85.7
offense 85.4
music 83.7

Imagga
created on 2019-06-07

kin 49.9
newspaper 49.5
product 38.3
creation 31.8
architecture 20.3
monument 19.6
old 18.8
building 18.8
statue 18.2
art 17.6
ancient 17.3
sculpture 16.3
tourism 15.7
culture 13.7
stone 13.6
landmark 13.5
man 13.4
city 13.3
famous 13
history 12.5
world 12.1
travel 12
historic 11.9
religion 11.7
daily 11.5
historical 11.3
mother 10.8
male 10.7
marble 10.7
retro 10.7
groom 10.6
people 10.6
antique 10.4
decoration 10.4
dress 9.9
vintage 9.9
love 9.5
arch 8.7
paper 8.6
structure 8.5
church 8.3
window 8.2
parent 8.1
detail 8
memorial 8
couple 7.8
happiness 7.8
sepia 7.8
tourist 7.7
heritage 7.7
wall 7.7
bride 7.7
grunge 7.7
buildings 7.6
traditional 7.5
color 7.2
black 7.2
face 7.1
facade 7

Google
created on 2019-06-07

Photograph 97.2
People 96.1
Snapshot 88.4
Text 85.2
Picture frame 74.7
Photography 67.8
History 67.6
Adaptation 67
Family 66.3
Room 65.7
Vintage clothing 62.5
Photographic paper 53.6
Paper product 50.3

Microsoft
created on 2019-06-07

outdoor 98.8
person 95.9
clothing 95.5
woman 92.3
human face 90.3
smile 87.6
handwriting 85.2
old 71.2
black 70.6
posing 66.8
vintage 30.9
family 15.6

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 16-27
Gender Female, 51.8%
Disgusted 45.4%
Sad 52%
Angry 45.9%
Calm 45.8%
Confused 45.3%
Surprised 45.2%
Happy 45.5%

AWS Rekognition

Age 20-38
Gender Male, 52%
Disgusted 45.5%
Surprised 45.3%
Confused 45.3%
Sad 51.1%
Happy 46.9%
Calm 45.5%
Angry 45.4%

AWS Rekognition

Age 10-15
Gender Female, 51.8%
Happy 45.1%
Angry 45.1%
Calm 45.1%
Surprised 45%
Disgusted 45.3%
Sad 54.3%
Confused 45.1%

AWS Rekognition

Age 16-27
Gender Male, 51.4%
Sad 53.5%
Calm 45.1%
Angry 45.4%
Disgusted 45.2%
Confused 45.4%
Surprised 45.2%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53%
Calm 45.2%
Disgusted 45.2%
Angry 45.3%
Sad 53.5%
Surprised 45.1%
Confused 45.2%
Happy 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Disgusted 45.3%
Angry 45.5%
Sad 52.9%
Happy 45.1%
Calm 45.6%
Surprised 45.1%
Confused 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Happy 45.1%
Disgusted 45.1%
Sad 53.7%
Angry 45.6%
Confused 45.1%
Calm 45.3%
Surprised 45.1%

Microsoft Cognitive Services

Age 17
Gender Male

Feature analysis

Amazon

Person 99.8%

Categories

Imagga

paintings art 56.7%
streetview architecture 41.9%

Text analysis

Amazon

ews
CIGA
Little
ond
GR
MANUFACTU
ews ond Negro.
JLEV
HIGH. GR
5377
Little citizens.
Negro.
HIGH.
citizens.
one
oBo

Google

377 LEV MANUFACTU HIGH GR CIGA BO TRADE LiH1le Cidizens. Jews ondone Nagro.
377
LEV
HIGH
GR
CIGA
BO
TRADE
LiH1le
Cidizens.
Jews
ondone
MANUFACTU
Nagro.