Human Generated Data

Title

Saint Mary
Date

19th century
People

Artist: Johann Michael Enzing-Müller, German 1804 - after 1855

Artist after: Johann van Schraudolph, German 1808-1879
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12014

Human Generated Data

Title

Saint Mary

People

Artist: Johann Michael Enzing-Müller, German 1804 - after 1855

Artist after: Johann van Schraudolph, German 1808-1879

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Person 97.3
Human 97.3
Art 97.1
Painting 97.1
Person 94.3
Photography 60.1
Face 60.1
Photo 60.1
Portrait 60.1

Clarifai
created on 2019-08-10

people 99.8
baby 99.7
child 99.4
two 99.1
love 98.1
portrait 97.1
family 96.8
woman 96.4
son 96.4
adult 95.7
affection 95.6
offspring 94.1
newborn 92.1
art 90.8
birth 90.6
one 89.2
man 86.4
girl 86.2
togetherness 85.7
little 84

Imagga
created on 2019-08-10

child 60.7
parent 42.8
mother 37.4
grandma 34.3
family 33.8
baby 33.7
happy 31.3
father 30.9
love 29.2
male 28.3
people 27.3
happiness 26.6
kid 25.7
dad 25.1
portrait 24.6
man 24.2
couple 23.5
cute 23
daughter 22.8
smile 22.8
boy 21.7
childhood 21.5
home 20.7
lifestyle 20.2
fun 19.5
smiling 18.8
adult 18.8
together 18.4
kin 18
little 17.7
person 17.1
face 17
two 16.9
cheerful 15.4
casual 15.3
joy 15
holding 14.9
old 14.6
blond 14.4
husband 14.3
life 14.2
black 13.8
youth 13.6
adorable 12.9
wife 12.3
senior 12.2
human 12
playing 11.9
one 11.2
grandfather 10.8
interior 10.6
elderly 10.5
looking 10.4
relationship 10.3
mature 10.2
children 10
attractive 9.8
newborn 9.7
retired 9.7
infant 9.7
fetus 9.6
married 9.6
expression 9.4
joyful 9.2
leisure 9.1
indoor 9.1
girls 9.1
modern 9.1
son 8.8
innocence 8.7
retirement 8.6
play 8.6
eyes 8.6
toddler 8.6
laughing 8.5
togetherness 8.5
hand 8.4
lady 8.1
offspring 8.1
couch 7.7
sitting 7.7
pretty 7.7
health 7.6
pair 7.6
house 7.5
enjoyment 7.5
vertebrate 7.2
sweet 7.1
innocent 7.1
day 7.1
indoors 7

Google
created on 2019-08-10

Photograph 95.6
Picture frame 94.1
Painting 85.6
Mother 74.1
Art 67.7
Child 64.5
Portrait 62.5
Photography 62.4
Stock photography 59.4
Baby 50.9

Microsoft
created on 2019-08-10

gallery 99.1
baby 98.9
room 97.7
wall 97.3
toddler 95.2
art 92.5
human face 92.4
scene 90.1
museum 85.8
picture frame 82.1
text 78.4
person 74.5
clothing 63.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 98.1%
Angry 0.1%
Disgusted 0.1%
Sad 2.4%
Surprised 0%
Fear 0%
Calm 97.1%
Happy 0.2%
Confused 0%

AWS Rekognition

Age 0-4
Gender Male, 89.3%
Surprised 0%
Sad 0.2%
Disgusted 0%
Angry 0.1%
Confused 0%
Calm 99.2%
Happy 0.4%
Fear 0%

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Painting 97.1%

Captions

Microsoft

a vintage photo of a person 76.9%
a vintage photo of a person in a room 76.8%
a vintage photo of a person in a white room 74.7%

Text analysis

Amazon

MARIA.
SY MARIA.
SY

Google

y
mn
MARIA.
Verla
y mn S MARIA. Verla
S