Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.7

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.5
Human 99.5
Person 99
Person 98.9
Person 98.2
Person 98.2
Apparel 94.4
Clothing 94.4
People 88.4
Overcoat 68.9
Suit 68.9
Coat 68.9
Baby 68.8
Accessory 61.8
Accessories 61.8
Tie 61.8
Kid 61.5
Child 61.5
Face 59.8
Standing 57.4
Boy 56.2
Sailor Suit 55.6

Clarifai
created on 2019-06-05

people 99.9
group 99.6
child 98.5
group together 96.2
adult 94.8
wear 94.8
many 93.6
administration 92
man 90.6
several 90.2
military 88.9
portrait 87.1
five 85.9
war 85.9
education 84.6
leader 84.4
family 83.7
boy 82.7
music 82.3
four 81.7

Imagga
created on 2019-06-05

blackboard 37.9
kin 24.9
man 22.2
people 20.6
person 18.6
male 18.6
child 16.7
human 14.2
black 13.8
happy 13.8
classroom 13.5
vintage 13.2
adult 12.8
old 12.5
sibling 12.1
men 12
wall 12
portrait 11.6
art 11.2
room 11.1
grunge 11.1
dirty 10.8
ancient 10.4
dark 10
world 9.9
retro 9.8
family 9.8
group 9.7
teacher 9.6
looking 9.6
boy 9.6
brother 9.2
couple 8.7
light 8.7
business 8.5
fashion 8.3
one 8.2
body 8
women 7.9
smile 7.8
standing 7.8
school 7.8
grandfather 7.8
building 7.6
mother 7.5
student 7.4
aged 7.2
smiling 7.2
modern 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

clothing 99.4
person 99.1
human face 98.2
posing 96.9
toddler 93.6
smile 93.1
baby 88.3
old 87.7
text 85.5
group 82.4
child 80.8
boy 78.7
girl 51.9

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 4-7
Gender Female, 69.7%
Sad 96%
Calm 0.5%
Disgusted 0.3%
Happy 0.3%
Confused 0.4%
Angry 2.3%
Surprised 0.3%

AWS Rekognition

Age 38-59
Gender Male, 54.4%
Happy 6.2%
Angry 5.7%
Disgusted 11.8%
Confused 6.3%
Sad 6.3%
Calm 61.2%
Surprised 2.5%

AWS Rekognition

Age 4-9
Gender Female, 72.5%
Confused 6.5%
Happy 16.3%
Angry 8.6%
Sad 19.6%
Calm 22.3%
Disgusted 17.9%
Surprised 8.8%

AWS Rekognition

Age 23-38
Gender Female, 99.5%
Disgusted 1.4%
Confused 2.2%
Surprised 1.4%
Calm 1.3%
Happy 3.9%
Angry 2.7%
Sad 87.1%

AWS Rekognition

Age 10-15
Gender Female, 73.7%
Sad 68%
Happy 9.6%
Disgusted 4.6%
Calm 6.2%
Angry 4.1%
Confused 2.1%
Surprised 5.5%

Microsoft Cognitive Services

Age 4
Gender Male

Feature analysis

Amazon

Person 99.5%
Tie 61.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 96.3%
a vintage photo of a group of people posing for a picture 96.2%
a group of people posing for a photo 96.1%

Text analysis

Amazon

Srg
emm

Google

:9-FAM o4/2 ST E
o4/2
ST
E
:9-FAM