Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2693.1

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "St. Margaret's House": St. Margaret's House, London, Eng.: Bethnal Green.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Apparel 98.9
Clothing 98.9
Person 95
Human 95
Door 93
Sleeve 85.5
Female 75.2
Fashion 69.9
Robe 69.9
Gown 69.9
Evening Dress 69.9
Face 68.3
Photography 66.3
Photo 66.3
Portrait 66.3
Outdoors 62.8
Woman 60.9
Home Decor 59.5
Crypt 58.5
Building 57.8
Architecture 57
Monk 56.5
Costume 55.6

Clarifai
created on 2019-06-05

people 99.9
one 99.1
portrait 98.3
adult 97.1
wear 96.3
child 95.7
woman 91.1
two 89.5
indoors 89
gown (clothing) 88
man 86
sit 83.2
dress 83.2
step 82.2
veil 81.7
religion 81.3
facial expression 81
son 80.5
administration 80.4
retro 79.5

Imagga
created on 2019-06-05

statue 78.6
sculpture 47.2
ancient 38.1
architecture 36.2
column 35
monument 34.6
religion 31.4
history 28.6
old 28.6
art 26.8
groom 25.8
stone 24.5
historical 24.5
god 23
historic 22.9
landmark 22.6
temple 22.6
building 21.5
marble 21
tourism 20.6
church 20.4
city 19.1
travel 19
culture 18.8
religious 18.8
catholic 18.7
antique 18.5
famous 17.7
cathedral 13.4
tourist 12.9
holy 12.5
saint 12.5
faith 12.5
ruler 11.9
pray 11.6
prayer 11.6
spirituality 11.5
detail 11.3
carving 11
arch 9.8
heritage 9.7
decoration 9.4
roman 9.2
portrait 9.1
person 9
spiritual 8.6
medieval 8.6
capital 8.5
cross 8.5
traditional 8.3
grave 8.3
gown 8.2
symbol 8.1
statues 7.9
angel 7.8
face 7.8
sacred 7.8
color 7.8
ruin 7.8
worship 7.7
facade 7.7
figure 7.7
classical 7.7
mother 7.6
people 7.3
memorial 7.1

Google
created on 2019-06-05

Photograph 96.7
Standing 85.3
Snapshot 83.6
Vintage clothing 79.6
History 57.6
Gentleman 54.5
Art 50.2

Microsoft
created on 2019-06-05

building 99.6
person 99.4
clothing 98.2
human face 97.7
outdoor 96.9
smile 94.2
man 91.6
standing 91
white 73.9
black 68.5
dress 58.7
posing 54.6
old 53.1
doorway 35.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 77.8%
Calm 0.2%
Disgusted 0.5%
Angry 0.9%
Sad 0.5%
Happy 96.2%
Confused 0.6%
Surprised 1%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95%
Door 93%

Captions

Microsoft

a man standing in front of a door 95.2%
a man standing in front of a brick building 92.1%
a man standing in front of a brick wall 91.7%