Human Generated Data

Title

Social Settlements: United States. Michigan. Detroit. "Franklin Street Settlement": The Franklin Street Settlement, Detroit, Mich.: Neighbors

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3100.2

Human Generated Data

Title

Social Settlements: United States. Michigan. Detroit. "Franklin Street Settlement": The Franklin Street Settlement, Detroit, Mich.: Neighbors

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3100.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Handrail 99.8
Banister 99.8
Clothing 99.3
Apparel 99.3
Person 96.5
Human 96.5
Person 94.5
Wood 74.6
Railing 71.3
Overcoat 70.5
Hat 64.2
Sitting 60.6
Home Decor 59
Face 58.3
Senior Citizen 58
Coat 57
Porch 55.8

Clarifai
created on 2019-06-06

people 99.9
adult 97.4
portrait 96.8
one 96.7
two 95.5
man 94.7
administration 93.2
elderly 90.4
woman 89.8
leader 89.8
street 87.8
home 87.7
wear 85.8
group 82.8
child 78.2
family 78.2
facial expression 75.1
three 74.4
step 73.2
outfit 71.5

Imagga
created on 2019-06-06

kin 32.5
man 28.9
world 28.4
people 26.8
prison 22.6
person 22.4
male 22
portrait 17.5
correctional institution 17.4
old 16.7
clothing 15.5
building 15.3
adult 14.5
military uniform 14.1
casual 13.5
penal institution 13
outdoors 12.7
statue 12.6
religion 12.5
boy 12.2
standing 12.2
happy 11.9
uniform 11.7
family 11.6
couple 11.3
one 11.2
outdoor 10.7
school 10.5
religious 10.3
handsome 9.8
businessman 9.7
institution 9.7
looking 9.6
walking 9.5
monument 9.3
smile 9.3
face 9.2
vintage 9.1
fashion 9
history 8.9
smiling 8.7
happiness 8.6
men 8.6
sibling 8.5
room 8.4
jacket 8.3
human 8.2
home 8
child 8
architecture 7.9
business 7.9
antique 7.9
wall 7.8
culture 7.7
youth 7.7
two 7.6
office 7.6
tourism 7.4
black 7.4
lifestyle 7.2
grandfather 7.1
travel 7

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

person 99.3
building 99.3
clothing 98.3
smile 91.7
man 91.5
outdoor 90
human face 84.9
standing 83
coat 80.9
old 78.2
posing 45.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 95.7%
Sad 31.1%
Surprised 3.3%
Confused 5.2%
Angry 8.1%
Happy 1.6%
Calm 49.6%
Disgusted 1.1%

AWS Rekognition

Age 48-68
Gender Male, 99.4%
Calm 42.8%
Confused 4.6%
Happy 5.1%
Disgusted 4.6%
Sad 33.5%
Angry 5%
Surprised 4.4%

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.5%
Coat 57%

Categories

Imagga

people portraits 96.9%
paintings art 1.2%

Text analysis

Amazon

Neighbors
SF