Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The College Settlement": Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Typical, both of people and surroundings.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3213.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The College Settlement": Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Typical, both of people and surroundings.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3213.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.2
Person 99.2
Person 98.6
Person 97.9
Person 96.1
People 94.2
Family 80.6
Clothing 75.2
Apparel 75.2
Building 71.4
Advertisement 65.6
Poster 65.6
Urban 65
Art 64.7
Painting 64.7
Photography 62.3
Photo 62.3
Archaeology 57.7
Standing 57

Clarifai
created on 2019-06-06

people 99.8
adult 98.5
art 98.1
print 97.2
group 96.4
man 96.4
one 95.1
wear 94.6
illustration 91.8
woman 90.7
painting 90.4
two 90.3
veil 90.1
lithograph 84.6
retro 83.5
old 83.5
vintage 82.8
child 81.9
antique 80.7
portrait 80.6

Imagga
created on 2019-06-06

column 66.3
statue 65.7
sculpture 59.1
monument 41.2
architecture 40.8
stone 37.8
art 36.4
old 31.4
history 31.4
ancient 31.2
landmark 30.8
religion 26.9
building 26.3
famous 26.1
temple 24.6
carving 24.1
tourism 24
marble 23.3
culture 22.3
historic 22
historical 21.7
travel 21.2
city 20.8
structure 20.3
tourist 18.3
detail 17.7
cemetery 17.7
antique 15.7
god 15.3
memorial 14.8
arch 14.7
traditional 14.2
religious 14.1
church 13.9
catholic 13.6
spirituality 13.5
attraction 13.4
facade 13.2
decoration 12.6
palace 12.2
exterior 12
statues 11.8
heritage 11.6
symbol 11.5
artistic 10.4
cross 10.4
grave 10.3
fountain 10.2
figure 9.9
baroque 9.8
roman 9.1
holy 8.7
saint 8.7
ornamental 8.6
capital 8.6
vintage 8.3
sculptures 7.9
mythology 7.9
arc 7.9
carved 7.8
king 7.8
golden 7.8
world 7.6
place 7.5
style 7.4
ornate 7.3
museum 7

Google
created on 2019-06-06

Photograph 95.1
Snapshot 83.3
Vintage clothing 76.6
Art 70.9
Stock photography 68.5
Adaptation 67
Visual arts 62.5
Collection 58.5
Antique 57.3
Retro style 55.3
Illustration 50.4

Microsoft
created on 2019-06-06

clothing 96.7
person 94.8
human face 88
old 77.4
child 72.6
toddler 58.2
woman 57.3
baby 52.1
stone 24.6
clothes 20.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Female, 81.9%
Calm 7.6%
Angry 26.8%
Happy 5.9%
Sad 51.1%
Surprised 1.9%
Confused 5.1%
Disgusted 1.6%

AWS Rekognition

Age 30-47
Gender Female, 55%
Confused 45.2%
Disgusted 45.3%
Angry 45.2%
Calm 47.1%
Sad 46.6%
Happy 50.7%
Surprised 45.1%

AWS Rekognition

Age 1-5
Gender Female, 54%
Confused 45.5%
Happy 45.5%
Sad 51.2%
Disgusted 45.5%
Angry 46.1%
Calm 45.9%
Surprised 45.5%

AWS Rekognition

Age 4-9
Gender Female, 54.9%
Confused 45.2%
Happy 45.3%
Sad 46.6%
Disgusted 45.3%
Angry 45.4%
Calm 51.1%
Surprised 46.1%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Poster 65.6%
Painting 64.7%

Categories

Imagga

streetview architecture 48.6%
paintings art 44.7%
interior objects 6.4%

Captions

Microsoft
created on 2019-06-06

a vintage photo of a person 72.3%
an old photo of a person 72.2%
a vintage photo of an old building 63%

Text analysis

Amazon

people
surroundings.
of
Typical,
both
Typical, both of people ond surroundings.
ond
7
56 7
56

Google

Typical, both of people surroundings
Typical,
both
of
people
surroundings