Human Generated Data

Title

Portrait of a Family

Date

1663

People

Artist: Jakob Ochtervelt, Dutch c. 1635 - 1708-1710

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Frederic Fairchild Sherman in memory of his brother, Frank Dempster Sherman, 1922.135

Human Generated Data

Title

Portrait of a Family

People

Artist: Jakob Ochtervelt, Dutch c. 1635 - 1708-1710

Date

1663

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Frederic Fairchild Sherman in memory of his brother, Frank Dempster Sherman, 1922.135

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 99.7
Human 99.7
Chair 95.1
Furniture 95.1
Person 94.1
Person 93.4
Person 89.4
Art 86.9
Painting 80.3
Figurine 68.6
Toy 63.3

Clarifai
created on 2020-04-24

people 99.8
group 98.8
adult 98.2
woman 97.9
wear 97.2
child 97.1
education 96.7
man 96.5
gown (clothing) 95.2
girl 95.2
school 94.8
painting 93.1
art 92.7
graduation 91.3
lid 90.3
portrait 89.6
boy 89.6
music 88.3
costume 88.3
teacher 87.5

Imagga
created on 2020-04-24

wheelchair 49.4
chair 36
man 29.5
people 29
person 28
teacher 27.7
seat 27
male 26.4
child 23.4
smiling 23.1
adult 21.5
educator 21.4
professional 18.1
happy 17.5
lifestyle 17.3
boy 16.5
kid 15.9
furniture 15.7
family 15.1
musical instrument 15
portrait 14.2
cheerful 13.8
full length 13.6
day 12.5
mother 12.3
couple 12.2
smile 12.1
sitting 12
outdoors 11.9
girls 11.8
performer 11.6
walk 11.4
indoors 11.4
parent 11.4
together 11.4
holding 10.7
park 10.7
posing 10.7
attractive 10.5
group 10.5
women 10.3
children 10
comedian 9.6
standing 9.6
walking 9.5
men 9.4
culture 9.4
youth 9.4
holiday 9.3
teen 9.2
outdoor 9.2
business 9.1
kin 9.1
room 9.1
care 9
entertainer 8.8
pushing 8.8
father 8.8
home 8.8
teens 8.7
happiness 8.6
cute 8.6
kids 8.5
casual 8.5
friends 8.4
washboard 8.4
pretty 8.4
street 8.3
20s 8.2
device 8.2
active 8.2
furnishing 8.2
handsome 8
job 8
businessman 7.9
autumn 7.9
student 7.9
boys 7.7
modern 7.7
classroom 7.7
expression 7.7
ethnic 7.6
adults 7.6
human 7.5
city 7.5
scholar 7.4
musician 7.4
school 7.4
present 7.3
color 7.2
suit 7.2
guy 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

clothing 92.6
person 91
smile 74.3
dog 73.5
woman 63.4
furniture 50.1

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 5-15
Gender Female, 98.7%
Fear 0.1%
Confused 0.6%
Happy 81.2%
Calm 16.8%
Sad 0.3%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 50-68
Gender Male, 98.1%
Angry 20.8%
Calm 67%
Fear 1.9%
Sad 5.1%
Confused 1.4%
Happy 0.7%
Surprised 2.3%
Disgusted 0.9%

AWS Rekognition

Age 23-35
Gender Female, 51.7%
Surprised 1.6%
Angry 2.2%
Sad 7%
Happy 0.6%
Fear 0.6%
Calm 85.1%
Disgusted 2.3%
Confused 0.6%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Feature analysis

Amazon

Person
Chair
Painting
Person 99.7%
Person 94.1%
Person 93.4%
Person 89.4%
Chair 95.1%
Painting 80.3%

Categories

Imagga

events parties 57.7%
people portraits 42.2%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The painting depicts an interior scene with three individuals seated around a table draped with a colorful cloth. The setting appears to be a well-furnished room with intricately designed tiles on the floor and artwork adorning the walls in the background. Two of the individuals appear to be adults engaged in reading or conversation, with books or papers on the table. The third figure is a child in the foreground, interacting with a small dog. Various objects lie on the floor, including a red hat and a pipe. The overall atmosphere suggests a domestic scene from a past era, possibly showing a familial moment or an academic discussion.

Created by gpt-4 on 2024-12-03

This image depicts an interior scene with three figures positioned around a table. Despite the blurring of their faces, the individuals appear to be engaged in various activities, such as reading or interacting. On the table lies a large open book. The setting includes a wooden floor with a checkered pattern at the far end of the room, and on the sideline there's a red chair with a pillow on it. In the foreground, a child's toy and a musical instrument are strewn on the floor, indicating the presence of a younger individual even without seeing the face. Furthermore, a small dog is interacting with one of the figures. Artwork hangs on the wall within the room, and a partial view of another room can be seen through an open doorway, which shows a painting and a chair. The interior is detailed with elements that suggest a domestic setting, possibly of a wealthy family.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-26

This is a Dutch Golden Age painting depicting an interior domestic scene. It shows three people in a formal room with a checkerboard floor visible in the background. Two adults are seated at a decorative table covered with a red cloth - one in black attire and one in light blue clothing. A child in a gray dress with colorful accents is shown playing with a small dog on the floor. There are some toys or objects scattered on the ground, including what appears to be a red hat and a spinning top. The room has elegant architectural details including columns, and there's a glimpse of a landscape painting visible through a doorway in the background. The painting demonstrates the characteristic Dutch attention to detail and domestic life that was popular in 17th century art.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a formal interior scene with several figures. In the center, a man in a black robe is seated at a desk, seemingly occupied with reading or writing. Next to him is a woman in a blue robe, who appears to be observing the man. In the foreground, a young girl in a gray dress is seated on the floor, playing with a small dog. The room is furnished with red chairs and decorative elements, creating a sense of opulence and grandeur.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a painting of a family scene, with a man, woman, and child seated around a table. The man is dressed in black attire, while the woman wears a black dress with a white collar and a light blue head covering. The child, a girl, is attired in a gray dress with a white collar and a white head covering. In the foreground, a small dog sits on the floor, and various objects are scattered about, including a red hat, a toy, and a book. The background of the painting features a room with a fireplace, a chair, and a table, all set against a dark wall. The overall atmosphere of the image is one of warmth and intimacy, capturing a moment of family life in a bygone era.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of a family scene, featuring a man, woman, and child in a room with a dog and various objects on the floor. * The man is seated on the left side of the image, wearing a black robe with a white collar. He has dark hair and is holding a piece of paper in his right hand. * The woman is seated on the right side of the image, wearing a black dress with a white collar. She has dark hair and is looking at the viewer. * The child is kneeling on the floor in front of the woman, wearing a gray dress with a white collar. She has blonde hair and is holding a small dog in her lap. * There are several objects on the floor, including a red hat, a book, and a small toy. * The background of the image shows a room with a fireplace, a table, and a chair. The walls are painted white, and the floor is made of wood. Overall, the image appears to be a portrait of a family, possibly from the 17th or 18th century. The style of the painting suggests that it may have been created by a Dutch or Flemish artist.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a family of three, consisting of a man, a woman, and a young girl. The man is seated on a chair, holding a book, while the woman is seated on a chair next to him, wearing a black dress. The young girl is sitting on the floor, holding a toy, and there is a dog beside her. The painting is framed with a black border.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a painting of a family portrait, possibly from the 17th century. The painting depicts a man, a woman, and a young girl, all sitting in a room. The man is seated on a chair, and the woman is standing behind him, while the young girl is kneeling on the floor in front of them. The man is holding a book and appears to be reading it, while the woman is looking at him. The young girl is holding a small object, possibly a toy, in her hand. The painting has a warm and intimate atmosphere, with the family members appearing to be close and affectionate.