Human Generated Data

Title

Holy Family

Date

16th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. Morton D. Mitchell in memory of her husband, 1918.41

Human Generated Data

Title

Holy Family

People

Artist: Unidentified Artist,

Date

16th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. Morton D. Mitchell in memory of her husband, 1918.41

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 99.4
Person 99.4
Person 98.8
Person 96.9
Art 95.8
Photo 68.9
Portrait 68.9
Face 68.9
Photography 68.9
People 68.1
Painting 64.6
Female 61.5
Girl 61.5
Child 60.7
Kid 60.7

Clarifai
created on 2020-04-24

people 100
adult 99.2
group 98.5
two 96.8
child 96.4
man 95.8
wear 95.3
woman 94.3
group together 93.5
three 93.2
portrait 93
four 90.8
administration 90.4
furniture 90.3
military 87.6
sit 87.1
royalty 87
leader 86.9
offspring 86
several 84.6

Imagga
created on 2020-04-24

fountain 29.3
adult 23.3
body 23.2
structure 22.4
kin 22.2
person 21.6
man 19.5
sexy 19.3
people 19
fashion 18.8
model 18.7
portrait 17.5
attractive 16.8
one 16.4
lifestyle 15.9
male 15.3
hair 15.1
human 15
world 14.9
sensuality 14.5
black 14.4
child 12.8
face 12.8
wet 12.5
art 12.4
water 12
skin 11.8
old 11.8
statue 11.6
relaxation 10.9
sculpture 10.7
posing 10.7
lady 10.5
muscular 10.5
pretty 10.5
leisure 10
mother 9.9
style 9.6
serene 9.4
smile 9.3
sensual 9.1
sport 9.1
fitness 9
health 9
happy 8.8
women 8.7
men 8.6
city 8.3
slim 8.3
vintage 8.3
dress 8.1
religion 8.1
building 7.9
love 7.9
architecture 7.8
torso 7.8
ancient 7.8
shower 7.8
sitting 7.7
summer 7.7
expression 7.7
youth 7.7
passion 7.5
dark 7.5
training 7.4
historic 7.3
sibling 7.2
history 7.2
happiness 7.1

Google
created on 2020-04-24

Photograph 96.4
People 93.9
Snapshot 85.8
Black-and-white 74.4
Stock photography 73.4
Child 71.2
Photography 67.8
Art 58.1
Family 55.3
Monochrome 54.4
Style 51

Microsoft
created on 2020-04-24

human face 99.4
text 95.3
sitting 95.2
clothing 94
baby 92
person 88.7
smile 87.2
man 82.1
old 68.2
toddler 55.8
posing 35.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Female, 84.6%
Happy 0.8%
Disgusted 29.1%
Angry 1%
Calm 53.1%
Sad 13.1%
Fear 0.4%
Confused 1.4%
Surprised 1%

AWS Rekognition

Age 51-69
Gender Male, 92.8%
Confused 0.9%
Angry 1.3%
Calm 12.4%
Happy 0.1%
Fear 0.2%
Disgusted 0.1%
Sad 85%
Surprised 0.1%

AWS Rekognition

Age 12-22
Gender Female, 54%
Confused 0%
Sad 0.1%
Calm 99.2%
Fear 0%
Happy 0.4%
Disgusted 0%
Angry 0%
Surprised 0.1%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 12
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 64.6%

Categories