Human Generated Data

Title

Madonna
Date

19th century
People

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3537

Human Generated Data

Title

Madonna

People

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3537

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.1
Human 99.1
Person 99
Person 98.8
Art 97.6
Painting 97.6
Person 57.4

Clarifai
created on 2019-11-16

people 99.5
portrait 99.3
child 99.2
group 98.4
baby 98.1
art 97.8
woman 97.2
two 96.9
girl 96.6
family 96.2
adult 96
son 94.8
love 93.4
three 92.5
man 90.1
monochrome 89.2
four 87.9
offspring 87.4
music 86.6
retro 82.8

Imagga
created on 2019-11-16

kin 90
portrait 22
money 18.7
face 17
currency 17
people 15.6
dollar 14.8
cash 14.6
man 14.1
old 13.9
sculpture 12.8
culture 12.8
one 12.7
finance 12.7
statue 12.6
head 12.6
person 12.5
bank 11.6
dollars 11.6
financial 11.6
business 11.5
closeup 11.5
close 11.4
male 11.4
world 11.3
savings 11.2
art 11
adult 11
decoration 10.8
wealth 10.8
bill 10.5
child 10.4
rich 10.2
paper 10.2
banking 10.1
vintage 9.9
lady 9.7
bills 9.7
sexy 9.6
black 9.6
antique 9.5
hair 9.5
capital 9.5
love 9.5
happy 9.4
human 9
family 8.9
banknotes 8.8
body 8.8
payment 8.7
eyes 8.6
historical 8.5
attractive 8.4
economy 8.3
makeup 8.2
dress 8.1
religion 8.1
detail 8
franklin 7.9
brunette 7.8
smile 7.8
banknote 7.8
hundred 7.7
luxury 7.7
finances 7.7
pretty 7.7
mother 7.6
united 7.6
fashion 7.5
famous 7.4
historic 7.3
home 7.2
history 7.2
look 7

Google
created on 2019-11-16

Painting 92.5
Picture frame 90.2
Art 83.4
Visual arts 68.6
Illustration 65.5
Stock photography 65.4
Photography 62.4
Drawing 59.3
Artwork 56
Fictional character 52.8

Microsoft
created on 2019-11-16

wall 97.9
painting 97.1
baby 96.8
human face 96.5
gallery 93
person 92.2
text 89.4
art 86.2
drawing 85.6
indoor 85
room 82.5
clothing 70.4
posing 63.6
sketch 57.7
picture frame 52.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 97.9%
Angry 0.5%
Surprised 0.6%
Sad 0.7%
Happy 4.1%
Calm 93.3%
Fear 0.1%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 21-33
Gender Female, 99.1%
Angry 0.9%
Fear 0.1%
Calm 94.8%
Sad 1.5%
Disgusted 1.6%
Happy 0.4%
Confused 0.3%
Surprised 0.4%

AWS Rekognition

Age 8-18
Gender Female, 92.3%
Happy 1.3%
Sad 0.5%
Disgusted 0.3%
Fear 0.2%
Calm 95.7%
Angry 0.5%
Confused 0.3%
Surprised 1.2%

AWS Rekognition

Age 1-7
Gender Female, 54%
Happy 47%
Confused 45.2%
Calm 49.9%
Angry 47%
Disgusted 45.2%
Surprised 45.4%
Fear 45.1%
Sad 45.2%

AWS Rekognition

Age 32-48
Gender Male, 57.7%
Surprised 0%
Sad 1.6%
Calm 87.8%
Happy 10.5%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 97.6%

Categories

Imagga

pets animals 99.7%