Human Generated Data

Title

Madonna and Child with Two Saints

Date

19th century

People

Artist: Joseph Steinmüller, German 1795 - 1841

Artist after: Perugino (Pietro Vannucci), Italian c. 1450 - 1523

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R9563

Human Generated Data

Title

Madonna and Child with Two Saints

People

Artist: Joseph Steinmüller, German 1795 - 1841

Artist after: Perugino (Pietro Vannucci), Italian c. 1450 - 1523

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.3
Person 98.4
People 94.9
Painting 93.6
Art 93.6
Poster 91.1
Advertisement 91.1
Family 81.7
Person 68.2
Photography 65.4
Photo 65.4
Face 63
Portrait 63

Imagga
created on 2022-02-26

kin 100
family 55.2
child 43.1
mother 39.3
love 38.7
happy 37.6
people 35.7
male 32.5
home 31.1
happiness 29
together 28.9
couple 28.7
man 27.6
boy 27
father 26.6
smiling 25.3
portrait 25.2
parent 24.9
daughter 24.4
kid 23.9
casual 22.9
adult 22.6
person 22
cute 20.8
lifestyle 20.2
fun 20.2
children 20
smile 20
cheerful 19.5
husband 19.1
childhood 18.8
loving 18.1
couch 17.4
two 16.9
face 16.3
kids 16
interior 15.9
son 15.7
wife 15.2
togetherness 15.1
group 14.5
joy 14.2
parents 13.7
playing 13.7
youth 13.6
baby 13.6
little 13.3
brother 13.1
relationship 13.1
sitting 12.9
grandma 12.8
relaxing 12.7
dad 12.2
old 11.8
house 11.7
handsome 11.6
laughing 11.3
expression 11.1
blond 11
room 10.9
parenthood 10.7
lady 10.6
indoors 10.5
life 10.2
girls 10
attractive 9.8
bonding 9.8
human 9.7
mom 9.7
hug 9.7
looking 9.6
married 9.6
brunette 9.6
women 9.5
men 9.4
sibling 9.3
indoor 9.1
lovely 8.9
sister 8.8
hugging 8.8
boys 8.7
30s 8.7
four 8.6
laugh 8.6
sofa 8.6
living 8.5
modern 8.4
pretty 8.4
adorable 8.3
holding 8.3
domestic 8.1
dress 8.1
grandmother 7.8
affectionate 7.7
affection 7.7
elderly 7.7
jeans 7.6
horizontal 7.5
one 7.5
vintage 7.4
black 7.2
romance 7.1
hair 7.1

Google
created on 2022-02-26

Art 81.6
Vintage clothing 72.3
Baby 71.3
Visual arts 67.5
Room 65.8
Painting 65.4
Event 64.3
Toddler 63.1
Stock photography 63
Child 59.9
History 59.3
Sitting 56.9
Portrait 51.3
Monochrome 51.2
Classic 51.2
Retro style 51.1

Microsoft
created on 2022-02-26

text 99.3
wall 99.2
baby 98.1
human face 97.8
clothing 97.3
person 97.1
posing 95.8
toddler 92.2
smile 82.9
woman 79.2
gallery 75.9
art 70.7
room 70.4
old 61.5
picture frame 28.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Calm 87.2%
Sad 3.3%
Angry 3.3%
Surprised 2.7%
Happy 1.7%
Confused 0.9%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 93.6%
Surprised 2.5%
Sad 1.6%
Confused 0.6%
Fear 0.6%
Happy 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 21-29
Gender Female, 99.8%
Calm 99.1%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Confused 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 10-18
Gender Female, 99.9%
Calm 91.8%
Sad 2.6%
Fear 1.6%
Disgusted 1.1%
Surprised 1.1%
Confused 1%
Angry 0.6%
Happy 0.3%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 93.6%
Poster 91.1%

Captions

Microsoft

a group of people posing for a photo 94.8%
a vintage photo of a group of people posing for the camera 92.4%
a vintage photo of a group of people posing for a picture 92.3%

Text analysis

Amazon

DEN
DES
DER
IN
ZUR
1834.
DEN MITCLIEDERN DES VEREINE
MITCLIEDERN
ZUR beforberung DER BILDEDELY KÜNSTE IN WIEN.
VEREINE
KÜNSTE
Dritte Yeslowung 1834.
BILDEDELY
WIEN.
4
Dritte
beforberung
Yeslowung
Shopp Smith 4
Shopp
the
Smith

Google

BEFÖRDERUNG
WIEN.
Yorlosung
DEN
YEREINS
KÜNSTE
DEN MITCLIEDERLIN DES YEREINS ZUR BEFÖRDERUNG DER BILDEINDEN KÜNSTE IN WIEN. Dritte Yorlosung 1834.
MITCLIEDERLIN
DES
ZUR
DER
BILDEINDEN
IN
Dritte
1834.