Human Generated Data

Title

Children of the Earl of Clarendon

Date

c.1710

People

Artist: Unidentified Artist,

Artist: Sir Godfrey Kneller, British 1646 - 1723

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.196

Human Generated Data

Title

Children of the Earl of Clarendon

People

Artist: Unidentified Artist,

Artist: Sir Godfrey Kneller, British 1646 - 1723

Date

c.1710

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.196

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 99.2
Human 99.2
Person 99.2
Person 98.8
Art 92.9
Painting 90.2
People 75.9

Clarifai
created on 2020-04-24

people 100
child 99.8
group 99.8
portrait 99.1
son 99
family 99
adult 98.9
baby 98.6
sibling 98.4
monochrome 98.3
three 98.2
offspring 98.1
art 96.4
four 96.3
two 95.8
woman 95.6
princess 95.6
interaction 94.7
man 94.6
wear 94.5

Imagga
created on 2020-04-24

kin 33.4
mother 32.8
child 30.7
male 28.2
brother 26.2
people 25.7
man 25.5
family 24.9
portrait 22.6
happy 22.6
parent 22.2
person 19.6
love 18.9
adult 18.8
world 18.2
happiness 16.5
couple 15.7
father 15.3
lifestyle 15.2
daughter 14.5
smiling 14.5
smile 14.2
attractive 14
sexy 13.6
black 13.2
room 13.1
boy 13
body 12.8
youth 12.8
human 12.7
face 12.1
fashion 12.1
home 12
dress 11.7
casual 11
model 10.9
childhood 10.7
posing 10.7
kid 10.6
pretty 10.5
sibling 10.1
cute 10
son 9.9
husband 9.8
handsome 9.8
lady 9.7
one 9.7
together 9.6
clothing 9.6
women 9.5
sitting 9.4
men 9.4
joy 9.2
dark 9.2
old 9.1
fun 9
baby 8.9
interior 8.8
wife 8.5
togetherness 8.5
life 8.2
girls 8.2
cheerful 8.1
little 7.9
antique 7.8
married 7.7
studio 7.6
enjoy 7.5
sport 7.5
decoration 7.5
holding 7.4
fitness 7.2
looking 7.2
hair 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

baby 98.2
person 97.2
text 96.8
human face 96.3
clothing 95.7
window 95.7
posing 93.4
toddler 93.1
old 85.3
smile 82.3
painting 60.3
vintage 26
picture frame 13.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 75.5%
Sad 0.9%
Surprised 0.2%
Calm 97.9%
Angry 0.2%
Fear 0.1%
Confused 0.3%
Disgusted 0.5%
Happy 0%

AWS Rekognition

Age 12-22
Gender Female, 99.1%
Disgusted 3.7%
Fear 1%
Sad 6%
Happy 0.4%
Angry 4.4%
Surprised 1.4%
Calm 79.9%
Confused 3.2%

AWS Rekognition

Age 13-23
Gender Female, 98.9%
Surprised 0.8%
Angry 22.4%
Happy 0.6%
Fear 1.4%
Calm 52.3%
Sad 18.8%
Disgusted 1.5%
Confused 2.1%

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 90.2%

Categories

Imagga

people portraits 98.5%
paintings art 1.4%

Captions

Azure OpenAI

Created on 2024-12-04

The image is a black and white photo of what appears to be a classical-style painting. The painting is of three figures draped in robes, seated with classical architectural elements, such as columns and checkered flooring, in the background. The left and right figures are barefoot, and they are sitting with relaxed postures. The central figure is also seated and holds a small dog in their lap, a common element suggesting companionship or loyalty in historical art. Below the central figure is another small dog looking upwards. The painting shows a strong use of light and shadow, typical of classical or baroque period artworks. Unfortunately, key parts of the image are covered, obscuring a full appreciation of the painting's details.

Anthropic Claude

Created on 2024-11-27

The image appears to be a black and white portrait of a woman with two children. The woman is wearing an ornate, long dress with decorative elements, and she has an elaborate hairstyle. The two children are seated next to her, one older boy and one younger child. The painting has a classical, historical style and seems to depict an upper-class family from a past era.

Meta Llama

Created on 2024-11-25

The image is a black-and-white photograph of an oil painting depicting a woman and two children, accompanied by a dog and a lion. The woman sits in the center, wearing a long dress with a low neckline and a large bow at the shoulder. She has short, curly hair and holds a small dog in her lap. The dog is white with brown spots and has a long tail. The woman's left hand rests on the dog's back, while her right hand gently touches the shoulder of the child on her right. To the left of the woman sits a boy, who appears to be around 4 or 5 years old. He is barefoot and wears a tunic that is draped over his left shoulder. His right arm is around the woman's waist, and he looks directly at the viewer with a serious expression. On the right side of the woman sits a girl, who also appears to be around 4 or 5 years old. She wears a dress and has her left arm around the woman's waist. Her right arm is extended, and she holds a small object in her hand. In front of the woman lies a small lion, which appears to be made of metal or stone. It is positioned on its hind legs, with its front paws raised in the air. The lion is facing the woman and seems to be looking up at her. The background of the painting is dark, with a few objects visible behind the subjects. There is a large urn on a pedestal to the left of the woman, and a curtain or tapestry hangs behind her. The overall atmosphere of the painting is one of elegance and refinement, with the subjects dressed in formal attire and posed in a dignified manner.