Human Generated Data

Title

Bottles of Soap

Date

19th century

People

Artist: François Forster, Swiss 1790 - 1872

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12116

Human Generated Data

Title

Bottles of Soap

People

Artist: François Forster, Swiss 1790 - 1872

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12116

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 99.1
Human 99.1
Person 98
Painting 95.9
Art 95.9
Photo 60.9
Photography 60.9

Clarifai
created on 2019-11-10

people 99.9
child 99
portrait 97.4
two 95.9
adult 95.5
group 95.4
art 95.3
one 94.2
son 93.5
baby 92.9
print 91.6
painting 90
illustration 88
man 87.6
sit 86.4
wear 86.1
family 85.6
music 84.5
three 83.3
book bindings 82.1

Imagga
created on 2019-11-10

sculpture 46.8
statue 41.7
religion 35.9
ancient 35.5
architecture 32
art 31.4
history 30.4
temple 27.5
old 27.2
historic 26.6
culture 26.5
stone 26.5
monument 25.2
travel 23.3
god 23
historical 22.6
throne 22.3
famous 21.4
religious 20.6
antique 20.5
structure 19.7
building 19.3
carving 18.5
chair of state 17.8
church 16.7
holy 16.4
spirituality 16.3
spiritual 16.3
city 15.8
column 15.2
fireplace 14.9
tourism 14.9
pray 14.6
heritage 14.5
chair 14.5
landmark 14.5
prayer 13.5
worship 12.6
marble 11.8
figure 11.8
face 11.4
east 11.2
altar 11.1
decoration 10.9
vintage 10.8
catholic 10.7
gold 10.7
oriental 10.4
fountain 10.2
traditional 10
palace 9.9
statues 9.9
carved 9.8
museum 9.7
seat 9.6
symbol 9.4
detail 8.9
mythology 8.9
sacred 8.8
architectural 8.7
meditation 8.6
faith 8.6
tourist 8.2
memorial 8.1
design 7.9
cathedral 7.8
furniture 7.6
capital 7.6
one 7.5

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 99.5
wall 96.4
person 95.4
painting 95.3
clothing 92.4
indoor 91.8
drawing 91.1
human face 90.9
window 83.4
old 82.9
sketch 72.6
cartoon 51.2
posing 45.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 86%
Angry 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Calm 78.3%
Fear 0.1%
Sad 21.2%
Confused 0.1%

AWS Rekognition

Age 48-66
Gender Female, 78.1%
Calm 85.1%
Disgusted 0.4%
Sad 10.6%
Fear 0.2%
Confused 0.5%
Happy 0.9%
Surprised 0.8%
Angry 1.4%

Microsoft Cognitive Services

Age 69
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 95.9%

Categories

Captions

Microsoft
created on 2019-11-10

a vintage photo of a person 89.2%
a vintage photo of a person 89.1%
a vintage photo of a boy 71.3%

Text analysis

Amazon

DE
SAVON.
LES BOUTEILLES DE SAVON.
LES
BOUTEILLES
Drrine
Gnmme
Fherrimni
Hellamisre
Hellamisre Drrine Gnmme Finntoy
Finntoy

Google

oole Mollandasce Grae par Foratr ine par Wior LES BOUTEILLES DE SAVON.
oole
Mollandasce
Grae
par
Foratr
ine
Wior
LES
BOUTEILLES
DE
SAVON.