Human Generated Data

Title

The Trio, Tokyo, Japan

Date

1898-1901

People

Artist: Lilla Cabot Perry, American 1848 - 1933

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Friends of the Fogg Art Museum Fund, 1952.117

Human Generated Data

Title

The Trio, Tokyo, Japan

People

Artist: Lilla Cabot Perry, American 1848 - 1933

Date

1898-1901

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Friends of the Fogg Art Museum Fund, 1952.117

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.3
Person 99.3
Person 98.7
Person 95.8
Leisure Activities 95.6
Art 89.5
Painting 89.5
Musical Instrument 87.3
Lute 82
Fiddle 76.8
Violin 76.8
Viola 76.8
Cello 64.7
Clothing 57.2
Apparel 57.2

Clarifai
created on 2018-03-16

people 99.6
adult 99.1
group 98.8
woman 98.1
music 97.9
wear 97.7
man 96.5
seat 96.4
painting 94.8
furniture 94.4
room 94.1
dancing 93.5
two 92.8
child 92
performance 90.3
art 89.8
religion 89.2
battle 87.3
three 86.6
position 85.1

Imagga
created on 2018-03-16

stringed instrument 54.5
musical instrument 47.2
oboe 37.9
man 25.5
woodwind 24.4
bowed stringed instrument 22.6
people 22.3
person 20.9
dress 19.9
male 19.8
wind instrument 19.8
bass 19.3
adult 19.1
violin 18.3
interior 17.7
love 16.5
device 16.4
fashion 15.8
couple 15.7
portrait 15.5
music 14.5
happy 14.4
looking 14.4
home 14.3
wedding 13.8
sitting 13.7
room 13.7
women 13.4
indoors 13.2
bride 12.5
chair 12.4
smile 12.1
attractive 11.9
lifestyle 11.6
flute 11.5
marriage 11.4
lady 11.4
instrument 11.3
bassoon 11.2
pretty 11.2
celebration 11.2
style 11.1
traditional 10.8
holding 10.7
guitar 10.6
face 10.6
cheerful 10.6
one 10.4
old 10.4
men 10.3
day 10.2
happiness 10.2
banjo 10.1
indoor 10
holiday 10
playing 10
married 9.6
play 9.5
model 9.3
two 9.3
hat 9.1
human 9
outdoors 8.9
posing 8.9
costume 8.8
together 8.8
smiling 8.7
luxury 8.6
clothes 8.4
musician 8.3
fun 8.2
stylish 8.1
romance 8
decoration 8
cello 7.9
hair 7.9
cute 7.9
viol 7.8
modern 7.7
expression 7.7
husband 7.6
vintage 7.4
tradition 7.4
entertainment 7.4
inside 7.4

Google
created on 2018-03-16

painting 81.6
art 80.9
modern art 54.5
artwork 54

Microsoft
created on 2018-03-16

person 98.5
floor 93.2
indoor 88.9
group 60.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 10-15
Gender Female, 54.8%
Surprised 45%
Sad 52.1%
Happy 47.7%
Disgusted 45%
Angry 45.1%
Calm 45%
Confused 45%

AWS Rekognition

Age 19-36
Gender Female, 54.9%
Sad 52.1%
Calm 45.3%
Angry 46.5%
Surprised 45.2%
Confused 45.1%
Happy 45.4%
Disgusted 45.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.3%
Person 98.7%
Person 95.8%
Painting 89.5%

Categories

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

The image depicts a serene domestic scene featuring three women engaged in playing musical instruments. One woman is seated at a piano on the left side, another is in the middle playing a cello, and the third woman on the right is playing a violin. They are all dressed in elegant, long-sleeved dresses, suggesting a formal or classical setting. The background includes a well-kept interior with a cabinet, plants, and pottery that adds to the calm and cultured atmosphere.

Created by gpt-4 on 2024-12-03

The image appears to depict a classical music scene, illustrated in an impressionistic painting style. Three individuals seem to be engaged in a performance or practice session, each playing a different instrument. From left to right, the first person is seated at a piano with sheet music in front of them, the second is playing a cello with a bow, and the third is holding a violin and a bow. They are all dressed in flowing garments that suggest a time period from the late 19th to early 20th century. The room in which they are situated is modestly furnished with wooden furniture, including a table with a vase upon it, and there's a stove against the back wall. Decorative elements such as a vase with flowers and what appears to be a Japanese print or painting on the wall add to the cultural ambiance of the setting. The color palette is subdued, consisting of earth tones with splashes of color provided by the garments and the decorative elements in the room. The flooring has a tiled pattern, and natural lighting seems to be coming through a window out of view.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a beautiful painting depicting three musicians performing together in what appears to be a home setting. The composition shows three figures in Victorian-era dress - one at the piano in a gray dress, another playing the cello in a white dress with a red accent, and a third playing the violin in a pink and white ensemble. The interior space has wooden floors and simple furnishings, with some decorative elements like a vase and flowers visible on a shelf in the background. The painting captures the elegance and refinement of chamber music performance in the late 19th or early 20th century, with careful attention paid to the flowing fabrics of the dresses and the focused postures of the musicians as they play their instruments. The overall mood is one of grace, concentration, and artistic harmony.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts three women dressed in elegant Victorian-era attire. One woman is seated at a piano, playing music, while the other two women are standing - one holding a cello and the other playing a violin. The women appear to be engaged in a musical performance together in what looks like a cozy, domestic setting. The artwork captures a moment of artistic collaboration and enjoyment among the three women.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

This image is a painting of three women playing musical instruments in a room. The woman on the left is seated at a piano, while the woman in the middle is playing a cello. The woman on the right is playing a violin. All three women are wearing long dresses and have their hair pulled back. The room has a wooden floor and walls, with a fireplace in the background. There are also several pieces of furniture, including chairs and tables, scattered throughout the room. The overall atmosphere of the painting is one of elegance and refinement, suggesting that the women are members of a wealthy or upper-class family.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a painting of three women playing musical instruments in a room. The woman on the left is playing the piano, the woman in the middle is playing the cello, and the woman on the right is playing the violin. They are all wearing long dresses and have their hair pulled back. The room has a wooden floor and walls, with a large window on the back wall. There is a table with a vase of flowers on it, and a shelf with some decorative items. The overall atmosphere of the painting is one of elegance and refinement, suggesting that the women are part of a wealthy or upper-class family.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The painting depicts a scene of three women playing musical instruments in a room. The woman on the left is playing the piano while the woman in the middle is playing the cello, and the woman on the right is playing the violin. The room has a wooden floor and a white wall. There is a table with a vase and a bowl on top, and a cabinet with shelves on the right side.

Created by amazon.nova-pro-v1:0 on 2025-01-04

In the room, three women are sitting on chairs, and one is standing, and they are performing music. The woman sitting on the left is playing the piano, and the other two are playing musical instruments. A few bowls and a vase are placed on the shelf behind them. A desk is placed beside the wall, and a flower vase is kept on it.