Human Generated Data

Title

Holy Family

Date

18th-19th century

People

Artist: Giuseppe Longhi, Italian 1766 - 1831

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the heirs of Mrs. Mary Hemenway, M853

Human Generated Data

Title

Holy Family

People

Artist: Giuseppe Longhi, Italian 1766 - 1831

Artist after: Raphael, Italian 1483 - 1520

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the heirs of Mrs. Mary Hemenway, M853

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 98.7
Human 98.7
Person 97.7
Person 97.6
Art 96.5
Painting 94.9
Person 92.5
Person 76.3
Photography 58.9
Photo 58.9
Face 55.8
Portrait 55.8

Clarifai
created on 2019-10-29

people 99.8
portrait 98.8
child 98.7
art 97.6
two 97.5
adult 97.5
baby 96.8
woman 96.7
painting 95.8
family 95.7
group 95.4
one 95.1
man 94.6
love 90.3
indoors 89.4
son 88.7
furniture 88.4
offspring 87.9
monochrome 87.7
sit 87.5

Imagga
created on 2019-10-29

mother 60.3
parent 57.1
kin 51.7
child 44.3
family 37.4
happy 28.8
love 28.4
people 27.3
daughter 26.7
father 25.9
home 24.7
happiness 24.3
smiling 23.9
man 23.5
portrait 23.3
male 21
dad 20.9
cute 19.4
baby 18.9
kid 18.6
grandma 17.6
together 17.5
adult 17.5
couple 17.4
childhood 17
boy 15.7
face 15.6
old 15.3
husband 15.3
lifestyle 15.2
smile 15
relationship 14.1
sitting 13.7
children 13.7
joy 13.4
wife 13.3
fun 12.7
little 12.4
togetherness 12.3
life 11.9
room 11.9
cheerful 11.4
antique 11.3
girls 10.9
care 10.7
affectionate 10.7
couch 10.6
interior 10.6
infant 10.6
senior 10.3
women 10.3
adorable 10.2
caring 9.8
lady 9.7
affection 9.7
loving 9.5
decoration 9.5
hair 9.5
play 9.5
expression 9.4
two 9.3
close 9.1
playing 9.1
vintage 9.1
relaxing 9.1
dress 9
newborn 8.8
sofa 8.7
hug 8.7
men 8.6
person 8.6
son 8.5
casual 8.5
relaxed 8.5
black 8.4
head 8.4
mature 8.4
one 8.2
looking 8
indoors 7.9
ancient 7.8
sepia 7.8
attractive 7.7
innocence 7.7
culture 7.7
elderly 7.7
enjoying 7.6
laughing 7.6
kids 7.5
house 7.5
enjoyment 7.5
toy 7.4
brother 7.3
aged 7.2
religion 7.2
handsome 7.1

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

gallery 96.8
baby 96.8
human face 96.7
wall 96.6
person 96.1
room 95.4
clothing 94.8
art 87.4
scene 84.6
toddler 79.5
smile 78.5
old 69.9
text 59
posing 47.2
picture frame 36.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 84.6%
Angry 0.3%
Happy 0.4%
Fear 0.2%
Disgusted 0.6%
Surprised 0.6%
Calm 87.4%
Confused 3%
Sad 7.5%

AWS Rekognition

Age 13-23
Gender Female, 95.6%
Disgusted 0.3%
Sad 1.9%
Fear 0%
Surprised 0.1%
Happy 0.8%
Calm 96.1%
Confused 0.2%
Angry 0.6%

AWS Rekognition

Age 12-22
Gender Female, 54.5%
Sad 53.5%
Happy 45%
Angry 45%
Confused 45%
Disgusted 45%
Calm 46.5%
Surprised 45%
Fear 45%

AWS Rekognition

Age 15-27
Gender Female, 53.8%
Happy 45%
Sad 45.1%
Calm 54.1%
Disgusted 45%
Surprised 45%
Confused 45%
Angry 45.7%
Fear 45%

AWS Rekognition

Age 25-39
Gender Male, 53.5%
Disgusted 45%
Calm 53.3%
Surprised 45.5%
Confused 45.1%
Fear 45.2%
Happy 45.1%
Angry 45.4%
Sad 45.5%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 94.9%

Categories

Imagga

paintings art 81.4%
people portraits 15.6%
pets animals 2.3%