Human Generated Data

Title

The Robinson Children of Newport, Rhode Island

Date

c. 1835

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Burton and Jacqueline Cumming in memory of Professor Paul J. Sachs, 1968.81

Human Generated Data

Title

The Robinson Children of Newport, Rhode Island

People

Artist: Unidentified Artist,

Date

c. 1835

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Burton and Jacqueline Cumming in memory of Professor Paul J. Sachs, 1968.81

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 98.6
Painting 96.9
Human 94.7
Person 94.7
Person 91.4
Person 90.3
Musical Instrument 61.2
Guitar 61.2
Leisure Activities 61.2

Clarifai
created on 2018-03-16

people 99.8
child 99.5
painting 98.8
baby 98.6
son 96.6
art 96
two 95.7
one 95.6
group 94.9
adult 94.9
religion 93.8
portrait 93.5
woman 92.7
wear 92.6
veil 88.9
three 86.1
family 83.5
offspring 83.5
Christmas 83.2
lid 80.6

Imagga
created on 2018-03-16

child 29.8
man 29.5
male 27.7
people 27.3
family 26.7
maraca 25.8
percussion instrument 24.9
happy 24.4
musical instrument 24.2
person 22
mother 21.7
adult 19.9
couple 19.1
smiling 18.8
together 18.4
home 18.3
portrait 17.5
love 17.3
lifestyle 17.3
fun 17.2
parent 16.7
face 16.3
boy 15.6
children 15.5
two 14.4
father 13.8
smile 13.5
happiness 13.3
kid 13.3
old 13.2
senior 13.1
sitting 12.9
playing 12.8
cute 12.2
cheerful 12.2
attractive 11.9
childhood 11.6
handsome 11.6
chair 11.4
loving 11.4
brother 11.2
leisure 10.8
daughter 10.6
indoors 10.5
throne 10.5
looking 10.4
son 10.3
casual 10.2
holding 9.9
grandmother 9.8
little 9.7
elderly 9.6
husband 9.5
costume 9.5
women 9.5
play 9.5
men 9.4
kids 9.4
care 9
interior 8.8
blond 8.7
grandma 8.7
holiday 8.6
expression 8.5
youth 8.5
friends 8.4
black 8.4
chair of state 8.4
pretty 8.4
fashion 8.3
entertainment 8.3
lady 8.1
group 8.1
to 8
colorful 7.9
seat 7.9
clothing 7.8
excited 7.8
party 7.7
toddler 7.6
hand 7.6
wife 7.6
enjoying 7.6
sit 7.6
joy 7.5
human 7.5
life 7.5
mature 7.4
park 7.4
indoor 7.3
active 7.2
celebration 7.2
religion 7.2
activity 7.2

Google
created on 2018-03-16

painting 91.1
art 83.9
portrait 71.3
modern art 66.7
artwork 64.2

Microsoft
created on 2018-03-16

person 95.7
indoor 91.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-5
Gender Male, 84.9%
Sad 2.4%
Confused 2.7%
Happy 0.8%
Disgusted 1.5%
Angry 82%
Surprised 0.8%
Calm 9.6%

AWS Rekognition

Age 4-7
Gender Female, 89.8%
Surprised 2.6%
Angry 46.2%
Sad 6.6%
Calm 32.8%
Disgusted 4.1%
Confused 4.4%
Happy 3.3%

AWS Rekognition

Age 4-9
Gender Female, 69.8%
Confused 4.7%
Sad 5.7%
Calm 46.3%
Happy 0.3%
Surprised 1.3%
Angry 40.8%
Disgusted 0.9%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.9%
Person 94.7%
Guitar 61.2%

Categories

Captions

Azure OpenAI

Created on 2024-12-03

The image appears to be a classical painting featuring three figures in period clothing typical of the Renaissance or Baroque era. The central figure stands clad in an elegant greenish-black textured garment adorned with buttons, a wide lace collar, and cuffs. They are holding what looks like a recorder, a musical instrument, in their right hand. To the left of the central figure sits a younger figure wearing a billowing white dress with lace trim at the neck and sleeves. They are engaged with a large open book resting on their lap. The setting includes a rich red curtain backdrop to the right and a dark sky with clouds visible through an archway in the background. There is a green carpet with a detailed red and gold pattern underfoot. To the right of the seated figure, there is a small basket tilted over, with lemons spilling out onto the floor and a small white feather nearby. A notable attention to detail is evident in the depiction of fabrics, textures, and the carefully rendered still-life elements of the lemons and the basket. The painter seems to capture a moment of domestic tranquility and intellectual pursuit, suggesting a scene of cultured leisure.

Anthropic Claude

Created on 2024-11-27

The image depicts three children in formal attire. The child in the center wears a red dress with puff sleeves, while the child on the left wears a black outfit and holds a recorder-like instrument. The child on the right sits on the floor, holding an open book. The background features ornate draperies and a lush, colorful floor covering. The overall impression is one of a formal, staged portrait of these young children.

Meta Llama

Created on 2024-11-24

The image depicts a painting of three children, likely from the 18th or 19th century, based on the style and clothing. The children are dressed in formal attire, with the boy on the right wearing a dark green velvet suit and holding a flute, the girl in the middle wearing a red dress, and the boy on the left wearing a white dress. The girl is sitting on the floor, reading a book, while the other two children stand behind her. The background of the painting features a blue wall with a red curtain, and a green floor with a red patterned rug. There are also some objects on the floor, including a basket of oranges and a book. The overall atmosphere of the painting is one of elegance and refinement, suggesting that it may have been commissioned by a wealthy family or aristocrat. The painting appears to be a portrait of the children, possibly taken to commemorate a special occasion or milestone. The level of detail and realism in the painting suggests that it was created by a skilled artist, possibly one who was trained in the classical tradition of portraiture. Overall, the image provides a glimpse into the lives of three children from a bygone era, and offers a fascinating insight into the art and culture of the time.