Human Generated Data

Title

Virgin Adoring the Infant Christ

Date

19th-20th century

People

Artist: Timothy Cole, American 1852 - 1931

Artist after: Filippo Lippi, Italian c. 1406 - 1469

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gray Collection of Engravings Fund, G7144

Human Generated Data

Title

Virgin Adoring the Infant Christ

People

Artist: Timothy Cole, American 1852 - 1931

Artist after: Filippo Lippi, Italian c. 1406 - 1469

Date

19th-20th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.4
Person 99.4
Art 98.6
Painting 98.6
Person 96.6
Person 92.7
Face 59.2
Portrait 59.2
Photo 59.2
Photography 59.2

Imagga
created on 2022-02-26

mother 48
parent 43.2
child 39.9
kin 37.2
family 32.9
people 31.2
love 27.6
home 27.1
happy 26.9
portrait 25.9
man 25.5
male 25.4
old 25.1
adult 23.3
senior 22.5
face 20.6
couple 20
grandfather 19.8
smiling 19.5
father 19.5
smile 19.2
lifestyle 18.8
kid 18.6
person 18.3
elderly 18.2
grandma 16.7
mature 16.7
retired 16.5
happiness 16.5
casual 16.1
cute 15.8
together 15.8
one 15.7
boy 15.6
life 15.5
baby 15.2
daughter 15.1
retirement 14.4
husband 14.3
human 14.2
little 14.1
dad 14.1
affectionate 12.6
childhood 12.5
joy 12.5
cheerful 12.2
fun 12
aged 11.8
grandmother 11.7
loving 11.4
wife 11.4
sitting 11.2
son 10.9
black 10.8
vintage 10.8
holding 10.7
older 10.7
lady 10.5
indoors 10.5
age 10.5
looking 10.4
women 10.3
culture 10.3
adorable 10.1
head 10.1
pensioner 10
care 9.9
antique 9.7
laughing 9.5
children 9.1
relaxing 9.1
world 9
hair 8.7
day 8.6
men 8.6
close 8.6
togetherness 8.5
two 8.5
house 8.4
hand 8.4
joyful 8.3
sculpture 8.2
religion 8.1
sibling 8
art 8
interior 8
embracing 7.8
hugging 7.8
hug 7.7
affection 7.7
blond 7.7
expression 7.7
married 7.7
statue 7.6
clothing 7.5
religious 7.5
brother 7.4
alone 7.3
girls 7.3
room 7.3
playing 7.3
gray 7.2

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wall 98.4
gallery 96.2
drawing 93.9
room 92
person 91.8
clothing 88.9
human face 86.1
sketch 82.2
painting 82
scene 76.4
old 76.2
text 67.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 59.6%
Sad 38.4%
Confused 0.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 99.7%
Surprised 0.1%
Sad 0%
Calm 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 6-12
Gender Male, 99.7%
Calm 86.1%
Sad 9.4%
Angry 1.4%
Confused 1.3%
Disgusted 0.7%
Fear 0.5%
Surprised 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 98.6%

Captions

Microsoft

a vintage photo of a person 77.1%
a vintage photo of a person in a room 77%
a vintage photo of a person in front of a mirror 59.9%

Text analysis

Amazon

Cole
Timothy Cole
Timothy

Google

Cole
Cole