Human Generated Data

Title

Holy Family of the House of Canigiani

Date

19th century

People

Artist: Samuel Amsler, German 1791 - 1849

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G41

Human Generated Data

Title

Holy Family of the House of Canigiani

People

Artist: Samuel Amsler, German 1791 - 1849

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.6
Human 99.6
Person 96.5
Art 96.2
Painting 93.7
Person 92.1
Person 91.1
Face 61.4
Photography 61.4
Photo 61.4
Portrait 61.4

Imagga
created on 2022-02-26

child 24.9
mother 20.9
man 20.8
parent 20.4
statue 19.6
people 19.5
kin 18.7
art 16.7
sculpture 16.6
portrait 16.2
love 15.8
face 15.6
male 15.4
culture 15.4
old 15.3
person 14.9
father 14.5
happy 14.4
family 13.3
happiness 13.3
black 13.2
cute 12.9
baby 12.7
vintage 12.4
adult 12.3
antique 12.1
dad 12.1
hair 11.9
religion 11.6
smiling 11.6
kid 11.5
daughter 11
smile 10.7
attractive 9.8
lady 9.7
one 9.7
together 9.6
boy 9.6
ancient 9.5
model 9.3
historic 9.2
girls 9.1
human 9
carving 9
history 8.9
couple 8.7
decoration 8.5
pretty 8.4
symbol 8.1
life 8
body 8
close 8
women 7.9
postmark 7.9
postage 7.9
postal 7.8
brunette 7.8
architecture 7.8
museum 7.8
stamp 7.7
men 7.7
youth 7.7
mail 7.7
two 7.6
unique 7.6
letter 7.3
group 7.2
aged 7.2
sexy 7.2
looking 7.2
childhood 7.2
figure 7.1

Google
created on 2022-02-26

Art 82.8
Knee 80
Painting 76
Visual arts 69.7
Drawing 68.3
Illustration 66.2
Wood 63.3
Boot 63
Vintage clothing 61.1
Artwork 61
Room 57.8
Figure drawing 57.3
Sitting 54.2
Printmaking 53.9
Modern art 53.4
Mythology 52.7
Flesh 50.5

Microsoft
created on 2022-02-26

person 96.5
baby 93.5
room 92.2
clothing 92.2
text 90.7
human face 89.7
scene 85.8
gallery 76.8
man 60.7
toddler 59.7
painting 51.1
boy 50.1

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 96.7%
Calm 98.5%
Sad 0.5%
Confused 0.3%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 6-12
Gender Female, 100%
Calm 78.6%
Sad 13.7%
Confused 2.7%
Angry 2.5%
Surprised 0.7%
Happy 0.7%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 20-28
Gender Male, 61.5%
Calm 54%
Angry 23.8%
Fear 7.3%
Happy 6.8%
Surprised 3.2%
Confused 2.2%
Sad 2%
Disgusted 0.8%

AWS Rekognition

Age 61-71
Gender Male, 100%
Calm 95.1%
Sad 3.1%
Surprised 0.4%
Happy 0.3%
Confused 0.3%
Angry 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 30-40
Gender Female, 83.9%
Angry 98.7%
Sad 0.6%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%
Happy 0.1%
Calm 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 93.7%

Captions

Microsoft

an old photo of a person 70%
a person sitting in a room 58.8%
old photo of a person 58.7%

Text analysis

Amazon

Unterthinigkeit
HEILIGE
-
FAMILIE
Unterthinigkeit geridmet
DOM
KOENIG
DUR
KOENIG DOM Santen
Straw
artist
for
geridmet
LUDWIGI
in
in allertisfater
- be Straw artist Aertale to Mundon
allertisfater
to
be
Santen
met
Aertale
Mundon

Google

Sajestit LU IN WIGI KOENIG Don anern. i allertiefater Unterthinigkeit geridmet der htr ti di Me g im
ti
g
Sajestit
Don
geridmet
im
allertiefater
Unterthinigkeit
der
htr
di
Me
IN
WIGI
LU
KOENIG
anern.
i