Human Generated Data

Title

Social Settlements: United States. Indiana. Indianapolis. "Flanner Guild": Flanner Guild, Indianapolis, Ind.: Willing Workers"

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2908.4

Human Generated Data

Title

Social Settlements: United States. Indiana. Indianapolis. "Flanner Guild": Flanner Guild, Indianapolis, Ind.: Willing Workers"

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99
Person 99
Person 95.7
Person 95.2
Person 92.4
Person 91.1
Person 90.3
Painting 88.7
Art 88.7
Person 86.1
Person 80.3
Person 77.1
Text 70.6
Person 68.1
People 62.1
Game 57
Jigsaw Puzzle 57
Drawing 56.2

Clarifai
created on 2019-06-05

people 100
group 99.9
print 99.7
adult 99.7
many 98.5
illustration 98.3
man 98.2
several 97.6
art 97.6
wear 96.8
leader 96.8
administration 95.9
five 94.5
four 93.8
three 93.4
engraving 93
woman 93
group together 92.1
two 91.1
military 90.8

Imagga
created on 2019-06-05

cemetery 100
sculpture 34.4
statue 32.3
art 31.9
architecture 31.3
stone 27.8
monument 26.2
history 25.1
landmark 23.5
ancient 23.4
old 23
culture 22.2
building 21.4
famous 21.4
religion 19.7
memorial 19.6
decoration 19
city 18.3
travel 17.6
historical 16.9
historic 16.5
tourism 16.5
antique 16.5
graffito 16.4
god 16.3
vintage 15.7
detail 15.3
structure 14.9
artistic 14.8
carving 14.7
marble 14.5
grunge 13.6
gravestone 13.1
texture 12.5
column 12.4
wall 12
religious 11.2
figure 10.9
temple 10.6
symbol 10.1
decorative 10
traditional 10
catholic 9.7
palace 9.6
old fashioned 9.5
paper 9.4
church 9.3
ornate 9.2
aged 9.1
design 9
romantic 8.9
carved 8.8
text 8.7
facade 8.7
spirituality 8.6
holiday 8.6
face 8.5
destination 8.4
element 8.3
tourist 8.2
fountain 8
arch 7.9
baroque 7.8
color 7.8
golden 7.7
architectural 7.7
cathedral 7.7
cross 7.5
pattern 7.5
outdoors 7.5
exterior 7.4
retro 7.4

Google
created on 2019-06-05

People 95.7
Art 72.1
History 66.1
Family 61.4
Vintage clothing 60
Illustration 50.4

Microsoft
created on 2019-06-05

clothing 99
person 99
text 94.6
woman 90.1
human face 80.1
man 72.1
vintage clothing 66.5
smile 65.5
photograph 63.8
retro style 50.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 71.5%
Calm 88.6%
Sad 1.4%
Confused 0.5%
Happy 6.9%
Angry 1%
Disgusted 0.5%
Surprised 1.1%

AWS Rekognition

Age 35-52
Gender Female, 79.2%
Confused 3.8%
Disgusted 2%
Sad 54.7%
Surprised 2.3%
Calm 23%
Happy 8.5%
Angry 5.6%

AWS Rekognition

Age 26-43
Gender Female, 99%
Sad 63.5%
Disgusted 0.5%
Confused 0.6%
Surprised 1.2%
Calm 15.6%
Happy 17.1%
Angry 1.5%

AWS Rekognition

Age 48-68
Gender Female, 81.2%
Sad 84.4%
Disgusted 1.2%
Confused 1.4%
Surprised 1%
Calm 3.6%
Happy 1.9%
Angry 6.4%

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 47
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 88.7%

Captions

Microsoft

a close up of text on a black background 54.2%
a close up of text on a white background 54.1%
close up of text on a black background 51.5%