Human Generated Data

Title

The Holy Family
Date

19th century
People

Artist: George Baxter, British 1804 - 1867

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles H. Taylor, M3223

Human Generated Data

Title

The Holy Family

People

Artist: George Baxter, British 1804 - 1867

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Art 96.3
Painting 96.3
Human 91.6
Person 91.6
Person 89

Clarifai
created on 2019-08-08

people 99.5
adult 98.6
religion 97.8
one 97.6
woman 97.4
art 97.2
painting 96.2
two 94.3
veil 94.2
wear 93.6
baby 92.5
furniture 92.2
Mary 92
portrait 91.8
seat 91.7
son 91.7
Renaissance 91.4
child 91.2
saint 90.2
god 88.8

Imagga
created on 2019-08-08

armchair 40.3
man 32.3
family 32
home 31.9
couch 31.9
love 28.4
adult 27.2
male 26.5
mother 26.5
happy 26.3
people 25.1
couple 24.4
child 23.3
casual 22.9
together 22.8
sofa 21.5
lifestyle 20.9
father 19.7
smiling 18.8
room 17.5
relaxing 17.3
happiness 17.2
sitting 17.2
attractive 16.8
person 16.1
fun 15.7
portrait 15.5
handsome 15.1
interior 15
smile 15
pretty 14.7
two 14.4
bed 13.7
daughter 13.5
jeans 13.4
living 13.3
indoors 13.2
furniture 13.2
cute 12.9
indoor 12.8
affectionate 12.6
baby 12.5
husband 12.4
sit 12.3
boy 12.2
lady 12.2
face 12.1
looking 12
women 11.9
old 11.8
son 11.7
religion 11.6
leisure 11.6
cheerful 11.4
togetherness 11.3
playing 10.9
parent 10.9
joy 10.9
clothing 10.6
god 10.5
loving 10.5
sexy 10.4
relationship 10.3
relax 10.1
romantic 9.8
parents 9.8
kid 9.7
comfortable 9.5
seat 9.5
rest 9.5
wife 9.5
enjoy 9.4
dad 9.4
religious 9.4
mature 9.3
house 9.2
children 9.1
fashion 9
pajama 8.8
sculpture 8.8
saint 8.7
faith 8.6
chair 8.3
art 8.2
childhood 8.1
romance 8
bible 7.8
living room 7.8
parenthood 7.8
black 7.8
model 7.8
pray 7.8
play 7.8
men 7.7
prayer 7.7
affection 7.7
holy 7.7
spiritual 7.7
expression 7.7
laughing 7.6
senior 7.5
holding 7.4
church 7.4
joyful 7.3
20s 7.3
carving 7.3
sensual 7.3
color 7.2
covering 7.2
design 7.1
antique 7.1
maraca 7

Google
created on 2019-08-08

Painting 93.4
Art 86
Mother 71.7
Stock photography 62.1
Middle ages 54.4
Child 52
Miniature 50.6

Microsoft
created on 2019-08-08

painting 99.4
person 93.8
baby 91.8
indoor 91.4
art 88.4
human face 86.8
text 85.4
drawing 83.8
museum 57.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-7
Gender Female, 94.3%
Happy 14.9%
Angry 9.4%
Surprised 7.5%
Calm 32.6%
Sad 19.1%
Confused 14.3%
Disgusted 2.3%

AWS Rekognition

Age 14-23
Gender Female, 85.2%
Happy 2.8%
Calm 76.7%
Disgusted 1.1%
Angry 4.5%
Sad 7.4%
Surprised 2.1%
Confused 5.5%

AWS Rekognition

Age 29-45
Gender Female, 92.7%
Confused 6.5%
Sad 37.4%
Calm 25.7%
Disgusted 2.3%
Happy 3%
Angry 8.9%
Surprised 16.2%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.3%
Person 91.6%

Captions

Microsoft

a person sitting on a couch 54.5%
a man and a woman sitting on a couch 29.6%
a girl sitting on a couch 29.5%

Text analysis

Amazon

AVGOAXTERPATENTEE