Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.8

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.2
Person 99.2
Person 98.8
Person 95.1
Plant 87.4
Flower 78.3
Blossom 78.3
Flower Arrangement 72.9
Flower Bouquet 68.4
Clothing 65.2
Apparel 65.2
Funeral 64.1
Female 56

Clarifai
created on 2019-06-05

people 99.9
group 98.7
adult 97.4
many 97.2
man 95.3
group together 95.1
art 93.3
wear 91.6
woman 91.5
several 91.1
vehicle 87.3
child 86.2
illustration 85.5
retro 84
war 81.8
music 81.6
military 81.3
outfit 79.8
print 78.7
administration 77.7

Imagga
created on 2019-06-05

cemetery 89
art 23
old 20.9
sculpture 18.5
ancient 18.2
grunge 17.9
vintage 17.4
statue 17
monument 15.9
antique 15.6
memorial 15.1
history 14.3
decoration 13.7
architecture 13.3
aged 12.7
column 12.6
retro 12.3
stone 12
religion 11.6
man 11.5
symbol 11.4
wall 11.4
texture 11.1
culture 11.1
travel 10.6
city 10
structure 9.7
pattern 9.6
decorative 9.2
historic 9.2
design 9.1
dirty 9
people 8.9
style 8.9
color 8.9
building 8.7
light 8.7
black 8.4
famous 8.4
person 8.2
negative 8.2
paper 8
detail 8
textured 7.9
text 7.9
artistic 7.8
marble 7.7
modern 7.7
god 7.7
card 7.7
dark 7.5
religious 7.5
backgrounds 7.3
graphic 7.3
world 7.2
face 7.1
gravestone 7.1

Google
created on 2019-06-05

History 54.1

Microsoft
created on 2019-06-05

clothing 95.4
flower 93.5
person 92.8
old 83.4
black 66.1
woman 66
posing 56.8
smile 53.5
dress 53

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 55.5%
Angry 0.9%
Calm 0.4%
Disgusted 1.6%
Happy 93.7%
Surprised 1.2%
Sad 1.4%
Confused 0.8%

AWS Rekognition

Age 26-43
Gender Female, 92.2%
Angry 4.2%
Happy 2.2%
Disgusted 4.3%
Confused 1.4%
Surprised 2.5%
Sad 27.7%
Calm 57.9%

AWS Rekognition

Age 26-43
Gender Female, 89.9%
Confused 2.7%
Sad 9.9%
Angry 17.1%
Disgusted 6.2%
Calm 36%
Surprised 4.6%
Happy 23.4%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people posing for a photo 87.9%
a group of people posing for a picture 87.8%
a group of people posing for the camera 87.7%

Text analysis

Amazon

NBROO'

Google

S
M S RAVTES HROOF
HROOF
RAVTES
M