Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.7

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.7

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.5
Person 99.5
Person 99
Person 98.9
Person 98.2
Person 98.2
Apparel 94.4
Clothing 94.4
People 88.4
Suit 68.9
Overcoat 68.9
Coat 68.9
Baby 68.8
Accessories 61.8
Accessory 61.8
Tie 61.8
Kid 61.5
Child 61.5
Face 59.8
Standing 57.4
Boy 56.2
Sailor Suit 55.6

Clarifai
created on 2019-06-05

people 99.9
group 99.6
child 98.5
group together 96.2
adult 94.8
wear 94.8
many 93.6
administration 92
man 90.6
several 90.2
military 88.9
portrait 87.1
five 85.9
war 85.9
education 84.6
leader 84.4
family 83.7
boy 82.7
music 82.3
four 81.7

Imagga
created on 2019-06-05

blackboard 37.9
kin 24.9
man 22.2
people 20.6
person 18.6
male 18.6
child 16.7
human 14.2
black 13.8
happy 13.8
classroom 13.5
vintage 13.2
adult 12.8
old 12.5
sibling 12.1
men 12
wall 12
portrait 11.6
art 11.2
room 11.1
grunge 11.1
dirty 10.8
ancient 10.4
dark 10
world 9.9
retro 9.8
family 9.8
group 9.7
teacher 9.6
looking 9.6
boy 9.6
brother 9.2
couple 8.7
light 8.7
business 8.5
fashion 8.3
one 8.2
body 8
women 7.9
smile 7.8
standing 7.8
school 7.8
grandfather 7.8
building 7.6
mother 7.5
student 7.4
aged 7.2
smiling 7.2
modern 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

clothing 99.4
person 99.1
human face 98.2
posing 96.9
toddler 93.6
smile 93.1
baby 88.3
old 87.7
text 85.5
group 82.4
child 80.8
boy 78.7
girl 51.9

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 4-7
Gender Female, 69.7%
Sad 96%
Calm 0.5%
Disgusted 0.3%
Happy 0.3%
Confused 0.4%
Angry 2.3%
Surprised 0.3%

AWS Rekognition

Age 38-59
Gender Male, 54.4%
Happy 6.2%
Angry 5.7%
Disgusted 11.8%
Confused 6.3%
Sad 6.3%
Calm 61.2%
Surprised 2.5%

AWS Rekognition

Age 4-9
Gender Female, 72.5%
Confused 6.5%
Happy 16.3%
Angry 8.6%
Sad 19.6%
Calm 22.3%
Disgusted 17.9%
Surprised 8.8%

AWS Rekognition

Age 23-38
Gender Female, 99.5%
Disgusted 1.4%
Confused 2.2%
Surprised 1.4%
Calm 1.3%
Happy 3.9%
Angry 2.7%
Sad 87.1%

AWS Rekognition

Age 10-15
Gender Female, 73.7%
Sad 68%
Happy 9.6%
Disgusted 4.6%
Calm 6.2%
Angry 4.1%
Confused 2.1%
Surprised 5.5%

Microsoft Cognitive Services

Age 4
Gender Male

Feature analysis

Amazon

Person 99.5%
Tie 61.8%

Categories

Imagga

paintings art 99.5%

Text analysis

Amazon

Srg
emm

Google

o4/2
E
:9-FAM o4/2 ST E
:9-FAM
ST