Human Generated Data

Title

The Fortune Teller

Date

19th century

People

Artist: Johann Heinrich Stürmer, German 1774 or 1775 - 1855

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.234

Human Generated Data

Title

The Fortune Teller

People

Artist: Johann Heinrich Stürmer, German 1774 or 1775 - 1855

Date

19th century

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Painting 99.7
Art 99.7
Human 98.1
Person 98.1
Person 96.5
Person 86.1

Clarifai
created on 2019-05-30

people 99.8
art 99.4
religion 99.4
painting 99.3
adult 99.2
saint 99.2
two 98.6
veil 98.2
woman 97.8
Renaissance 97.7
gown (clothing) 97.5
seat 97.3
wear 97.3
baby 97.2
Mary 97.2
man 95.5
god 95.4
furniture 94.6
one 94.5
aura 94.3

Imagga
created on 2019-05-30

metropolitan 100
religion 38.5
religious 26.2
art 25.6
holy 22.1
temple 21.8
sculpture 21.7
face 21.3
church 21.3
old 20.9
spiritual 20.2
culture 19.7
god 19.1
ancient 18.2
statue 18.1
pray 17.4
prayer 17.4
gold 15.6
faith 15.3
historical 14.1
decoration 13.9
antique 13.8
golden 13.8
portrait 13.6
worship 13.5
travel 13.4
traditional 13.3
historic 12.8
mask 12.7
belief 12.7
saint 12.5
costume 11.6
tourism 11.5
bible 10.8
colorful 10.7
color 10.6
spirituality 10.6
ruler 10.5
monument 10.3
head 10.1
lady 9.7
people 9.5
architecture 9.4
famous 9.3
tourist 9.1
sacred 8.8
carnival 8.8
man 8.7
mother 8.4
figure 8.3
vintage 8.3
dress 8.1
disguise 8.1
catholic 8.1
history 8
design 8
look 7.9
virgin 7.9
mysterious 7.8
cathedral 7.7
stone 7.6
fashion 7.5
tradition 7.4
makeup 7.3
icon 7.1
interior 7.1

Google
created on 2019-05-30

Microsoft
created on 2019-05-30

painting 99
person 98.4
text 97.6
human face 92.2
art 84
clothing 72.7
drawing 70.2
woman 65.5
museum 54.5
old 53.5
older 34.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 92.6%
Disgusted 3.3%
Confused 0.4%
Surprised 1%
Calm 92.3%
Happy 0.7%
Angry 1.3%
Sad 1%

AWS Rekognition

Age 20-38
Gender Female, 97.3%
Sad 66.9%
Angry 3%
Disgusted 0.9%
Confused 4.2%
Happy 1.4%
Calm 22.1%
Surprised 1.4%

AWS Rekognition

Age 26-43
Gender Female, 92.6%
Happy 76.5%
Surprised 3.1%
Sad 10.2%
Calm 4.1%
Angry 2.1%
Disgusted 1.6%
Confused 2.4%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.7%
Person 98.1%

Captions

Microsoft

a man and woman sitting next to a book 41.7%
a man and a woman sitting on a book 38.8%
a man and woman sitting on a book 34%