Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The College Settlement": Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Jewish Family.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3214.2

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The College Settlement": Environment After Immigration. Perpetuation of European Standards in America. The College Settlement, Philadelphia, Pa.: Jewish Family.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3214.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.8
Person 99.8
Person 99.4
Person 99
People 98.7
Person 98.6
Person 98.6
Family 97.7
Person 97.4
Person 97.1
Person 93.7
Clothing 78.4
Apparel 78.4
Painting 70.1
Art 70.1
Photo 56.5
Photography 56.5

Clarifai
created on 2019-06-06

people 100
child 100
group 99.6
family 98
sibling 97.6
son 97.1
boy 97
offspring 96.7
wear 94.8
group together 94.2
baby 93.5
portrait 93
five 92.9
several 92.7
elementary school 91.7
four 91.5
three 90.9
education 89.1
adult 88.4
war 87.6

Imagga
created on 2019-06-06

kin 100
child 24
family 20.5
portrait 20.1
people 17.8
happiness 16.4
man 15.5
person 15.4
old 15.3
mother 14.4
statue 14.3
culture 13.7
dress 13.5
face 13.5
father 13.2
happy 13.2
ancient 13
parent 12.7
daughter 11.8
religion 11.6
male 11.6
love 11
decoration 11
traditional 10.8
sculpture 10.5
world 10.5
dad 10.4
historical 10.3
adult 10.3
black 10.2
stone 10.1
head 10.1
girls 10
brother 10
vintage 9.9
bride 9.6
antique 9.5
smile 9.3
sibling 9.2
historic 9.2
childhood 9
sepia 8.7
couple 8.7
smiling 8.7
married 8.6
architecture 8.6
costume 8.6
fashion 8.3
wedding 8.3
fun 8.2
history 8
romantic 8
kid 8
cute 7.9
scene 7.8
eyes 7.7
building 7.7
religious 7.5
city 7.5
church 7.4
tradition 7.4
home 7.2
art 7.2
hair 7.1
little 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

clothing 99.4
human face 98.8
baby 98.3
toddler 98
smile 97.1
person 96.7
child 96.6
boy 85
old 72.2
family 69.1
photograph 59.1
posing 43

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Female, 99.9%
Disgusted 24.5%
Happy 9%
Angry 17.3%
Calm 22.3%
Surprised 7.5%
Confused 5.6%
Sad 13.8%

AWS Rekognition

Age 10-15
Gender Female, 57%
Confused 2%
Disgusted 1.9%
Sad 31.3%
Angry 3.1%
Surprised 4%
Happy 9%
Calm 48.8%

AWS Rekognition

Age 20-38
Gender Female, 94.8%
Calm 53.3%
Sad 11%
Angry 3.8%
Surprised 7%
Disgusted 10%
Confused 2.3%
Happy 12.7%

AWS Rekognition

Age 4-7
Gender Female, 93.6%
Surprised 2.7%
Sad 17.2%
Disgusted 7.8%
Calm 33.5%
Happy 2.4%
Angry 32.6%
Confused 3.7%

AWS Rekognition

Age 35-52
Gender Male, 94.6%
Sad 8.9%
Angry 6%
Calm 41.1%
Confused 4.4%
Happy 11.7%
Disgusted 26.2%
Surprised 1.6%

AWS Rekognition

Age 4-9
Gender Female, 92.9%
Sad 1.4%
Confused 0.8%
Surprised 2%
Happy 90.2%
Angry 1.4%
Disgusted 1.8%
Calm 2.3%

AWS Rekognition

Age 29-45
Gender Female, 54%
Sad 49.7%
Happy 45.2%
Surprised 45.1%
Disgusted 45.5%
Confused 45.1%
Calm 49.2%
Angry 45.1%

AWS Rekognition

Age 2-5
Gender Male, 51.2%
Angry 45.6%
Surprised 45.4%
Disgusted 45.3%
Sad 50.5%
Happy 46.1%
Confused 45.6%
Calm 46.5%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 70.1%

Text analysis

Amazon

Jewish
Jewish Fomily.
Fomily.
Francis

Google

Franci's Jewish Fomily.
Franci's
Jewish
Fomily.