Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The College Settlement": Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Jewish Family.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3214.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The College Settlement": Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Jewish Family.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3214.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.7
Human 99.7
Person 99.7
Person 99
People 98.6
Person 98.6
Family 97.9
Person 96.3
Person 96.2
Advertisement 91.7
Poster 91.7
Clothing 68.5
Apparel 68.5

Clarifai
created on 2019-06-06

people 99.9
child 99.8
group 98.7
son 97.2
family 96.4
offspring 96.2
boy 94.9
portrait 94.9
sibling 92.4
four 91.8
adult 91.5
three 91.4
wear 89.4
administration 89.2
man 89.2
five 88.7
war 87
group together 86.6
two 85.6
military 82.8

Imagga
created on 2019-06-06

kin 100
statue 37.9
sculpture 26
old 23
art 21.6
religion 19.7
monument 18.7
ancient 17.3
architecture 17.2
stone 16.2
history 16.1
man 15.5
religious 15
detail 14.5
god 12.4
culture 12
historic 11.9
people 11.7
marble 11.6
historical 11.3
antique 11.3
famous 11.2
building 11.1
head 10.9
city 10.8
person 10.7
mask 10.5
world 10.5
catholic 10
face 9.9
travel 9.9
soldier 9.8
decoration 9.6
cemetery 9.3
traditional 9.2
tourism 9.1
symbol 8.8
war 8.7
male 8.6
church 8.3
vintage 8.3
landmark 8.1
carving 7.9
uniform 7.8
pray 7.8
military 7.7
holy 7.7
cross 7.5
human 7.5
closeup 7.4
figure 7.3
color 7.2
dress 7.2
body 7.2
adult 7.1
portrait 7.1
temple 7
look 7

Google
created on 2019-06-06

People 97.1
Photograph 96.4
Snapshot 84.7
Vintage clothing 81.5
Family 71.6
Child 69.3
Adaptation 67
Photography 62.4
Retro style 55.3

Microsoft
created on 2019-06-06

person 99.5
clothing 99.5
smile 97.3
human face 97.1
toddler 96.8
baby 96.4
ground 96.2
child 95.7
posing 92.4
boy 90.3
outdoor 86.2
standing 78.7
footwear 75.9
old 68.3
photograph 60.2
girl 58.8
group 58

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Female, 54.7%
Angry 51.8%
Disgusted 45%
Calm 45%
Surprised 45.1%
Happy 45.2%
Sad 47.8%
Confused 45.1%

AWS Rekognition

Age 4-9
Gender Male, 52.3%
Angry 48.7%
Calm 45%
Confused 45.1%
Happy 45.3%
Sad 50.6%
Disgusted 45.2%
Surprised 45.1%

AWS Rekognition

Age 9-14
Gender Female, 52.3%
Angry 50.1%
Calm 45%
Disgusted 45%
Surprised 45%
Sad 49.6%
Happy 45.1%
Confused 45%

AWS Rekognition

Age 35-52
Gender Male, 98.3%
Surprised 1.2%
Disgusted 1.3%
Angry 4.7%
Sad 71.1%
Happy 1%
Confused 2.2%
Calm 18.4%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Disgusted 45.1%
Calm 45.3%
Confused 45.1%
Happy 45.3%
Surprised 45.1%
Angry 45.2%
Sad 53.9%

AWS Rekognition

Age 26-44
Gender Female, 52.1%
Happy 45.2%
Sad 45.5%
Disgusted 47%
Calm 50.5%
Surprised 45.4%
Confused 45.2%
Angry 46.3%

Microsoft Cognitive Services

Age 53
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Poster 91.7%

Categories

Imagga

paintings art 87.6%
people portraits 7.4%
streetview architecture 4.3%

Text analysis

Amazon

Jewish
Jewish Family.
Family.

Google

Family
Jewish Family
Jewish