Human Generated Data

Title

The Champion

Date

c. 1897

People

Artist: Jack Butler Yeats, Irish 1871 - 1957

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Benjamin and Lilian Hertzberg, 2005.28

Human Generated Data

Title

The Champion

People

Artist: Jack Butler Yeats, Irish 1871 - 1957

Date

c. 1897

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Benjamin and Lilian Hertzberg, 2005.28

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.4
Person 98.4
Person 98.2
Art 97.9
Person 97.1
Person 96.6
Person 95.1
Painting 91.8
Person 64.3

Clarifai
created on 2019-06-01

painting 100
illustration 99.9
art 99.9
people 99.7
print 99.5
adult 98.7
Renaissance 98.7
man 98.5
woman 93.3
two 93.1
nude 92.7
wear 87.9
pastel 87.1
saint 86.2
group 85.5
antique 84.3
one 84.1
ancient 83.7
religion 83.7
vintage 83.3

Imagga
created on 2019-06-01

dog 47.2
hound 35.3
hunting dog 34.8
canine 26.2
bloodhound 21.9
statue 21.1
pet 20.2
sculpture 16.2
brown 16.2
domestic animal 15.9
head 13.4
art 12.7
elephant 12.5
ancient 12.1
travel 12
religion 11.6
breed 11.6
sand 11.2
wildlife 10.7
close 10.3
cute 10
domestic 9.9
wild 9.6
god 9.6
animals 9.3
tourism 9.1
architecture 8.6
friend 8.6
culture 8.5
stone 8.4
old 8.4
outdoors 8.2
history 8
dogs 7.9
doggy 7.8
rock 7.8
face 7.8
purebred 7.8
sitting 7.7
summer 7.7
pets 7.7
temple 7.6
earth 7.6
religious 7.5
funny 7.3
water 7.3
portrait 7.1

Google
created on 2019-06-01

Painting 91.6
Art 84.4
Visual arts 69.9
Illustration 62.3

Microsoft
created on 2019-06-01

painting 99.7
drawing 99.6
sketch 97.6
text 96.2
art 89.1
child art 79.9
person 79.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 78.2%
Calm 50.9%
Disgusted 3.2%
Confused 3.6%
Surprised 5.2%
Happy 1.7%
Sad 23.5%
Angry 12%

AWS Rekognition

Age 19-36
Gender Male, 54.8%
Confused 45%
Disgusted 45%
Happy 45%
Surprised 45%
Calm 54.9%
Sad 45.1%
Angry 45%

AWS Rekognition

Age 48-68
Gender Male, 53.2%
Angry 10.8%
Confused 7.3%
Surprised 8.8%
Happy 3.7%
Sad 42%
Calm 13.2%
Disgusted 14.2%

AWS Rekognition

Age 38-57
Gender Female, 53.1%
Confused 45.2%
Surprised 45.2%
Angry 45.2%
Calm 45.5%
Disgusted 45.2%
Sad 46.7%
Happy 51.9%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Confused 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.6%
Disgusted 50%
Sad 49.7%
Happy 49.6%

Feature analysis

Amazon

Person
Painting
Person 98.4%
Person 98.2%
Person 97.1%
Person 96.6%
Person 95.1%
Person 64.3%
Painting 91.8%

Captions

OpenAI GPT

Created by gpt-4 on 2025-03-09

The image is a painting that portrays a figure in the foreground with a muscular build, wearing a sleeveless top and walking assertively forward. The attire suggests a casual or labor-oriented setting. The painting style has a textured, somewhat impressionistic quality, with muted earthy tones and soft brushwork that gives a sense of movement and atmosphere. In the background, there are additional figures engaged in various activities, with some appearing to be in conversation or observing the surroundings. The setting appears to be outdoors, possibly a public space like a park or street given the presence of multiple individuals in what appears to be a social context, and the open space around them. The artwork evokes a sense of daily life with a focus on the central figure's movement through the environment. There's a signature at the bottom right that reads "Joaq." indicating the artist's name, JoaquĆ­n Sorolla.

Created by gpt-4o-2024-05-13 on 2025-03-09

The image is a painting that depicts a scene with a group of people. In the foreground, a muscular figure wearing red shorts and a grey sleeveless shirt with a black scarf is striding forward purposefully. On the left side, another individual is holding papers and seems to be interacting with someone beside them. In the background, there are several other figures, including one that appears to be wearing shorts and a top similar to the figure in the foreground. The setting appears to be an outdoor area with a blue and green hue. The overall atmosphere of the painting suggests an event or activity with multiple spectators.

Anthropic Claude

Created by claude-3-opus-20240229 on 2025-01-16

The watercolor painting depicts a crowded city street scene at night. In the foreground, a figure in a pink skirt or dress is shown walking or running, capturing a sense of movement and urgency. The loose, expressive brushstrokes convey the energy and bustle of the urban setting. Behind this central figure, other people are visible on the sidewalk and in the background, painted with quick, gestural strokes that suggest the anonymity of passersby in a city. The muted blue-green tones used throughout the image create a moody, atmospheric quality, evoking the feeling of an evening in a bustling metropolis. The artist's style appears impressionistic, prioritizing the overall mood and dynamism of the street scene over precise details or realism. The painting effectively transports the viewer into an immersive urban moment, inviting them to imagine the sights, sounds and energy of the city at night.

Created by claude-3-haiku-20240307 on 2025-01-16

The image depicts a group of people on a city street at night. In the foreground, there is a man walking, wearing a pale shirt and trousers. Behind him, there are several men who appear to be conversing or reading something. There is also a figure in the background that seems to be a woman. The overall atmosphere of the scene is rather mysterious and evocative.

Created by claude-3-5-sonnet-20241022 on 2025-01-16

This appears to be a watercolor painting from what seems to be the late 19th or early 20th century. It shows several figures in a street scene. In the foreground, there's a young person in motion, wearing light-colored shirt and reddish-brown knee-length pants, caught mid-stride in an energetic walking pose. Behind them are two men in dark coats and hats, one of whom appears to be looking at some kind of paper or document. In the background, there are a few more figures painted in a looser, less detailed style. The overall color palette is dominated by muted blues and greens, creating a somewhat somber urban atmosphere. The style suggests this might be from the Impressionist or Post-Impressionist period, with its loose brushwork and atmospheric quality.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-16

The image depicts a painting of a man in the foreground, dressed in a sleeveless shirt and red shorts, with his right arm bent at the elbow and his left arm extended behind him. He appears to be running or walking quickly. In the background, there are several other people visible, including two men on the left side of the image who are standing still and looking at something in their hands. The overall atmosphere of the painting suggests that it is set in an urban environment, possibly during the late 19th or early 20th century. The style of the painting is reminiscent of Impressionism, with loose brushstrokes and vivid colors used to capture the movement and energy of the scene. The artist's use of light and shadow adds depth and dimensionality to the image, drawing the viewer's eye to the central figure of the running man.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-16

The image is a painting by Pablo Picasso, titled 'The Runner.' Created in 1902, it showcases a young man in a running pose, dressed in a sleeveless shirt and red shorts. The background of the painting is less detailed, with a focus on the figure of the runner. This piece is an early example of Picasso's work, reflecting his exploration of form and movement during this period.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-16

The painting depicts a boy running on the road with two men behind him. The boy is wearing a brown short, and the two men are wearing hats and coats. The men are looking at something, and the boy is looking at them. Behind them, a man is walking with a dog, and two women are walking in the distance. The painting has a watermark on the bottom right corner.

Created by amazon.nova-lite-v1:0 on 2025-01-16

The image is a painting by the artist Jacques Villon, depicting a scene in a park with several people. The painting is in a watercolor style, with a blue and gray color palette. In the foreground, a man in a gray shirt and brown shorts is running, while in the background, there are two men in hats and coats standing and looking at a piece of paper. There are also two women walking in the distance, one of whom is holding a dog.

Text analysis

Amazon

SAKE