Human Generated Data

Title

Children of the Earl of Clarendon
Date

c.1710
People

Artist: Unidentified Artist,

Artist: Sir Godfrey Kneller, British 1646 - 1723
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.196

Human Generated Data

Title

Children of the Earl of Clarendon

People

Artist: Unidentified Artist,

Artist: Sir Godfrey Kneller, British 1646 - 1723

Date

c.1710

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.196

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 99.2
Human 99.2
Person 99.2
Person 98.8
Art 92.9
Painting 90.2
People 75.9

Clarifai
created on 2020-04-24

people 100
child 99.8
group 99.8
portrait 99.1
son 99
family 99
adult 98.9
baby 98.6
sibling 98.4
monochrome 98.3
three 98.2
offspring 98.1
art 96.4
four 96.3
two 95.8
woman 95.6
princess 95.6
interaction 94.7
man 94.6
wear 94.5

Imagga
created on 2020-04-24

kin 33.4
mother 32.8
child 30.7
male 28.2
brother 26.2
people 25.7
man 25.5
family 24.9
portrait 22.6
happy 22.6
parent 22.2
person 19.6
love 18.9
adult 18.8
world 18.2
happiness 16.5
couple 15.7
father 15.3
lifestyle 15.2
daughter 14.5
smiling 14.5
smile 14.2
attractive 14
sexy 13.6
black 13.2
room 13.1
boy 13
body 12.8
youth 12.8
human 12.7
face 12.1
fashion 12.1
home 12
dress 11.7
casual 11
model 10.9
childhood 10.7
posing 10.7
kid 10.6
pretty 10.5
sibling 10.1
cute 10
son 9.9
husband 9.8
handsome 9.8
lady 9.7
one 9.7
together 9.6
clothing 9.6
women 9.5
sitting 9.4
men 9.4
joy 9.2
dark 9.2
old 9.1
fun 9
baby 8.9
interior 8.8
wife 8.5
togetherness 8.5
life 8.2
girls 8.2
cheerful 8.1
little 7.9
antique 7.8
married 7.7
studio 7.6
enjoy 7.5
sport 7.5
decoration 7.5
holding 7.4
fitness 7.2
looking 7.2
hair 7.1

Google
created on 2020-04-24

Photograph 96.3
Picture frame 83.3
Snapshot 82.9
Child 75.4
Photography 67.8
Stock photography 67.6
Family 58
Painting 57.1
Art 50.2

Microsoft
created on 2020-04-24

baby 98.2
person 97.2
text 96.8
human face 96.3
clothing 95.7
window 95.7
posing 93.4
toddler 93.1
old 85.3
smile 82.3
painting 60.3
vintage 26
picture frame 13.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 75.5%
Sad 0.9%
Surprised 0.2%
Calm 97.9%
Angry 0.2%
Fear 0.1%
Confused 0.3%
Disgusted 0.5%
Happy 0%

AWS Rekognition

Age 12-22
Gender Female, 99.1%
Disgusted 3.7%
Fear 1%
Sad 6%
Happy 0.4%
Angry 4.4%
Surprised 1.4%
Calm 79.9%
Confused 3.2%

AWS Rekognition

Age 13-23
Gender Female, 98.9%
Surprised 0.8%
Angry 22.4%
Happy 0.6%
Fear 1.4%
Calm 52.3%
Sad 18.8%
Disgusted 1.5%
Confused 2.1%

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 90.2%

Categories

Imagga

people portraits 98.5%
paintings art 1.4%