Human Generated Data

Title

Portrait of a Family

Date

1663

People

Artist: Jakob Ochtervelt, Dutch c. 1635 - 1708-1710

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Frederic Fairchild Sherman in memory of his brother, Frank Dempster Sherman, 1922.135

Human Generated Data

Title

Portrait of a Family

People

Artist: Jakob Ochtervelt, Dutch c. 1635 - 1708-1710

Date

1663

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Frederic Fairchild Sherman in memory of his brother, Frank Dempster Sherman, 1922.135

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 99.7
Human 99.7
Chair 95.1
Furniture 95.1
Person 94.1
Person 93.4
Person 89.4
Art 86.9
Painting 80.3
Figurine 68.6
Toy 63.3

Clarifai
created on 2020-04-24

people 99.8
group 98.8
adult 98.2
woman 97.9
wear 97.2
child 97.1
education 96.7
man 96.5
gown (clothing) 95.2
girl 95.2
school 94.8
painting 93.1
art 92.7
graduation 91.3
lid 90.3
portrait 89.6
boy 89.6
music 88.3
costume 88.3
teacher 87.5

Imagga
created on 2020-04-24

wheelchair 49.4
chair 36
man 29.5
people 29
person 28
teacher 27.7
seat 27
male 26.4
child 23.4
smiling 23.1
adult 21.5
educator 21.4
professional 18.1
happy 17.5
lifestyle 17.3
boy 16.5
kid 15.9
furniture 15.7
family 15.1
musical instrument 15
portrait 14.2
cheerful 13.8
full length 13.6
day 12.5
mother 12.3
couple 12.2
smile 12.1
sitting 12
outdoors 11.9
girls 11.8
performer 11.6
walk 11.4
indoors 11.4
parent 11.4
together 11.4
holding 10.7
park 10.7
posing 10.7
attractive 10.5
group 10.5
women 10.3
children 10
comedian 9.6
standing 9.6
walking 9.5
men 9.4
culture 9.4
youth 9.4
holiday 9.3
teen 9.2
outdoor 9.2
business 9.1
kin 9.1
room 9.1
care 9
entertainer 8.8
pushing 8.8
father 8.8
home 8.8
teens 8.7
happiness 8.6
cute 8.6
kids 8.5
casual 8.5
friends 8.4
washboard 8.4
pretty 8.4
street 8.3
20s 8.2
device 8.2
active 8.2
furnishing 8.2
handsome 8
job 8
businessman 7.9
autumn 7.9
student 7.9
boys 7.7
modern 7.7
classroom 7.7
expression 7.7
ethnic 7.6
adults 7.6
human 7.5
city 7.5
scholar 7.4
musician 7.4
school 7.4
present 7.3
color 7.2
suit 7.2
guy 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

clothing 92.6
person 91
smile 74.3
dog 73.5
woman 63.4
furniture 50.1

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 5-15
Gender Female, 98.7%
Fear 0.1%
Confused 0.6%
Happy 81.2%
Calm 16.8%
Sad 0.3%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 50-68
Gender Male, 98.1%
Angry 20.8%
Calm 67%
Fear 1.9%
Sad 5.1%
Confused 1.4%
Happy 0.7%
Surprised 2.3%
Disgusted 0.9%

AWS Rekognition

Age 23-35
Gender Female, 51.7%
Surprised 1.6%
Angry 2.2%
Sad 7%
Happy 0.6%
Fear 0.6%
Calm 85.1%
Disgusted 2.3%
Confused 0.6%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Feature analysis

Amazon

Person 99.7%
Chair 95.1%
Painting 80.3%

Categories

Imagga

events parties 57.7%
people portraits 42.2%

Captions

Azure OpenAI

Created on 2024-12-03

This image depicts an interior scene with three figures positioned around a table. Despite the blurring of their faces, the individuals appear to be engaged in various activities, such as reading or interacting. On the table lies a large open book. The setting includes a wooden floor with a checkered pattern at the far end of the room, and on the sideline there's a red chair with a pillow on it. In the foreground, a child's toy and a musical instrument are strewn on the floor, indicating the presence of a younger individual even without seeing the face. Furthermore, a small dog is interacting with one of the figures. Artwork hangs on the wall within the room, and a partial view of another room can be seen through an open doorway, which shows a painting and a chair. The interior is detailed with elements that suggest a domestic setting, possibly of a wealthy family.

Anthropic Claude

Created on 2024-11-27

The image depicts a formal interior scene with several figures. In the center, a man in a black robe is seated at a desk, seemingly occupied with reading or writing. Next to him is a woman in a blue robe, who appears to be observing the man. In the foreground, a young girl in a gray dress is seated on the floor, playing with a small dog. The room is furnished with red chairs and decorative elements, creating a sense of opulence and grandeur.

Meta Llama

Created on 2024-11-23

The image depicts a painting of a family scene, featuring a man, woman, and child in a room with a dog and various objects on the floor. * The man is seated on the left side of the image, wearing a black robe with a white collar. He has dark hair and is holding a piece of paper in his right hand. * The woman is seated on the right side of the image, wearing a black dress with a white collar. She has dark hair and is looking at the viewer. * The child is kneeling on the floor in front of the woman, wearing a gray dress with a white collar. She has blonde hair and is holding a small dog in her lap. * There are several objects on the floor, including a red hat, a book, and a small toy. * The background of the image shows a room with a fireplace, a table, and a chair. The walls are painted white, and the floor is made of wood. Overall, the image appears to be a portrait of a family, possibly from the 17th or 18th century. The style of the painting suggests that it may have been created by a Dutch or Flemish artist.