Human Generated Data

Title

Virgin in the Meadow

Date

1810

People

Artist: Pietro Anderloni, Italian 1784 - 1849

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R11808

Human Generated Data

Title

Virgin in the Meadow

People

Artist: Pietro Anderloni, Italian 1784 - 1849

Artist after: Raphael, Italian 1483 - 1520

Date

1810

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.9
Human 98.9
Person 98.4
Art 96.5
Painting 71.4
Advertisement 58.6
Poster 58.6

Clarifai
created on 2019-10-29

people 99.8
art 98.7
child 98.4
portrait 97.9
painting 97.7
adult 97.1
baby 95.6
print 95.2
woman 95
album 94.9
one 94.5
illustration 94.4
group 94.3
two 93.6
man 93
antique 90
sit 89.8
wear 89.7
picture frame 89
retro 88.9

Imagga
created on 2019-10-29

newspaper 88.8
product 68.6
creation 53.8
child 21.5
portrait 18.1
mother 17.1
people 16.7
man 16.1
male 15
parent 13.6
money 13.6
happy 13.2
daily 12.8
cash 12.8
family 12.4
face 12.1
culture 12
one 11.9
old 11.8
love 11.8
vintage 11.6
black 11.4
currency 10.8
person 10.5
attractive 10.5
kin 10.5
art 10.4
banking 10.1
house 10
business 9.7
adult 9.7
couple 9.6
home 9.6
happiness 9.4
cute 9.3
savings 9.3
financial 8.9
daughter 8.9
kid 8.9
postage 8.8
banknotes 8.8
looking 8.8
stamp 8.7
smiling 8.7
us 8.7
paper 8.6
mail 8.6
close 8.6
dollar 8.3
symbol 8.1
wealth 8.1
postmark 7.9
postal 7.8
envelope 7.8
ancient 7.8
sitting 7.7
sculpture 7.6
finance 7.6
rich 7.4
letter 7.3
lady 7.3
aged 7.2
sexy 7.2
religion 7.2
bank 7.2
childhood 7.2
hair 7.1
smile 7.1
together 7

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

gallery 99.1
room 95.9
painting 93.8
person 93.6
text 93.4
scene 91.9
human face 90.9
clothing 85.6
picture frame 82.2
art 76.1
woman 74.4
old 62
smile 55.1
posing 41.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 53.4%
Surprised 45%
Calm 50.4%
Angry 45%
Disgusted 45%
Fear 45%
Happy 49.5%
Sad 45%
Confused 45%

AWS Rekognition

Age 15-27
Gender Female, 54.8%
Fear 45%
Happy 45%
Disgusted 45%
Angry 45%
Calm 54.9%
Confused 45%
Surprised 45%
Sad 45%

AWS Rekognition

Age 1-7
Gender Female, 52.5%
Confused 45%
Angry 45.1%
Fear 45%
Sad 45%
Surprised 45%
Disgusted 45%
Happy 45.1%
Calm 54.8%

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Painting 71.4%
Poster 58.6%

Captions

Microsoft

an old photo of a person 77.8%
old photo of a person 74%
an old photo of a person in a room 73.9%

Text analysis

Amazon

Dlapoteonte
at
e
ngrnio
men:
iate
:kiiap ngrnio Dlapoteonte men: J nz at
ettame
J
rreamerthen sh iate ettame Famaforte
e Venegra
ton
iilauchhe
Hrtrgee
rreamerthen
Famaforte
inna
ee
:kiiap
Oginah iilauchhe atlerns Impo inna
Impo
atlerns
sh
hest ton Hamn
nz
hest
Oginah
Venegra
Hamn
1
eg 1 ee .0
ar Hrtrgee
26:
.0
eg
ar

Google

nae
Aricanedlee
Sat
lla Gallerra Snp t nae Riapotcon ingengae Aricanedlee d Sat dllmpere jaioe Feneipe Ceeditarderanefere 26
lla
Gallerra
Snp
ingengae
jaioe
Feneipe
Ceeditarderanefere
t
Riapotcon
d
dllmpere
26