Human Generated Data

Title

Madonna and Child with Saint John

Date

19th century

People

Artist: Jean Nicholas Laugier, French 1785 - 1875

Artist after: Simon Vouet, French 1590 - 1649

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R9224

Human Generated Data

Title

Madonna and Child with Saint John

People

Artist: Jean Nicholas Laugier, French 1785 - 1875

Artist after: Simon Vouet, French 1590 - 1649

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Art 97.9
Human 97.1
Person 97.1
Painting 96.4
Person 92.6
Person 82.1

Clarifai
created on 2019-11-10

people 99.9
art 99.7
two 99.6
portrait 99.5
adult 99.5
baby 99.5
woman 99.4
print 99.2
child 98.8
man 98.6
illustration 98.1
group 97.7
painting 97.4
affection 96.7
facial expression 96.2
offspring 96
one 95.8
son 95.7
furniture 95.3
love 94

Imagga
created on 2019-11-10

book jacket 58.9
jacket 45.8
wrapping 34.8
covering 25.7
sketch 19.6
money 19.6
cash 19.2
currency 18.8
black 18.6
one 17.2
sexy 16.9
portrait 16.8
bank 16.1
close 16
product 16
face 15.6
newspaper 14.6
people 14.5
body 14.4
dollar 13.9
painter 13.9
banking 13.8
art 13.7
culture 13.7
hair 13.5
wealth 13.5
drawing 13.5
love 13.4
business 13.4
attractive 13.3
vintage 13.2
fashion 12.8
paper 12.7
finance 12.7
creation 12.6
dollars 12.6
financial 12.5
bill 12.4
man 12.2
representation 11.9
model 11.7
adult 11.6
exchange 11.5
savings 11.2
skin 11
person 10.9
finances 10.6
sensuality 10
male 9.9
printed 9.8
pretty 9.8
banknotes 9.8
human 9.7
banknote 9.7
museum 9.7
states 9.7
pay 9.6
painted 9.5
fine 9.5
women 9.5
cute 9.3
rich 9.3
economy 9.3
masterpiece 8.9
known 8.9
market 8.9
postage 8.8
renaissance 8.8
paintings 8.8
symbol 8.8
couple 8.7
brunette 8.7
stamp 8.7
us 8.7
sexual 8.7
mail 8.6
unique 8.5
erotic 8.5
passion 8.5
kin 8.4
makeup 8.2
sensual 8.2
envelope 8
office 8
icon 7.9
post mail 7.9
zigzag 7.9
fame 7.9
postmark 7.9
shows 7.9
postal 7.9
funds 7.8
antique 7.8
sex 7.8
delivery 7.8
bills 7.8
economic 7.7
cutting 7.7
artist 7.7
communications 7.7
post 7.6
united 7.6
capital 7.6
closeup 7.4
decoration 7.4
letter 7.3
lady 7.3
global 7.3
gorgeous 7.2
child 7.1

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

text 99.7
human face 96.2
baby 94.2
person 92.3
drawing 85.8
clothing 82.4
art 71.1
woman 54.8
sketch 54.4
posing 47.6
painting 17.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 99.3%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%
Confused 0%
Calm 99.6%
Happy 0.3%
Sad 0%

AWS Rekognition

Age 0-3
Gender Female, 97.5%
Happy 1.6%
Sad 3.2%
Confused 0.6%
Surprised 2.2%
Angry 1.4%
Disgusted 0.3%
Fear 1.6%
Calm 89.2%

AWS Rekognition

Age 8-18
Gender Male, 62.6%
Calm 19.6%
Surprised 1.7%
Angry 0.8%
Sad 65.7%
Happy 0.2%
Fear 10.1%
Confused 1.8%
Disgusted 0.2%

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Painting 96.4%

Captions

Microsoft

a painting of a person 79.4%
a painting of a person 70.2%
a painting of a book 52.6%

Text analysis

Amazon

DE
SIMON
LA
LA VIERGE DE SIMON VOUET.
VOUET.
VIERGE

Google

LOGE SCULPT SIMON VOURT PI LA VIERGE DE SIMON VOUET.
LOGE
SIMON
VOURT
SCULPT
LA
VIERGE
VOUET.
PI
DE