Human Generated Data

Title

The Fortune Teller

Date

19th century

People

Artist: Briegner,

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.510

Human Generated Data

Title

The Fortune Teller

People

Artist: Briegner,

Date

19th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.510

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Painting 99.5
Art 99.5
Person 97.8
Human 97.8
Person 80
Person 64
Person 62.3
Person 53.8

Clarifai
created on 2019-05-30

art 99.9
painting 99.5
illustration 99.5
religion 99.1
Renaissance 98.7
saint 98.6
god 98.3
print 98.1
people 97.9
veil 97.4
allegory 95.6
lithograph 95.4
Mary 95.1
adult 94.9
virgin 94.9
baby 94.8
kneeling 94.5
miracle 94.2
holy 93.9
book 93.8

Imagga
created on 2019-05-30

graffito 100
decoration 76.5
sketch 43.9
drawing 38.4
art 36.7
sculpture 35.3
old 28.6
ancient 26.8
statue 26
representation 25.8
antique 21
vintage 20.7
history 19.7
carving 18.9
architecture 18.8
grunge 17.9
culture 17.1
religion 16.1
retro 15.6
landmark 15.4
temple 15.3
god 15.3
stone 14.6
detail 14.5
artistic 13.9
church 13
decorative 12.5
texture 12.5
design 12.4
tourism 12.4
historical 12.2
symbol 12.1
famous 12.1
historic 11.9
aged 11.8
monument 11.2
style 11.1
letter 11
paper 11
painting 10.8
frame 10.8
travel 10.6
wall 10.5
building 10.3
religious 10.3
pattern 10.3
ornate 10.1
city 10
holy 9.6
spirituality 9.6
old fashioned 8.6
traditional 8.3
artwork 8.2
brown 8.1
figure 7.9
marble 7.9
cathedral 7.7
faith 7.7
cover 7.4
graphic 7.3
structure 7.3
paint 7.2
sky 7
textured 7

Google
created on 2019-05-30

Microsoft
created on 2019-05-30

drawing 98.3
sketch 91.4
person 85.3
cartoon 84.3
clothing 57.3
fabric 40.6
painting 30.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 53.5%
Sad 45.2%
Happy 49.1%
Angry 46.3%
Confused 45.7%
Surprised 45.8%
Disgusted 47.8%
Calm 45.1%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Angry 45.2%
Disgusted 45.1%
Happy 45.1%
Sad 54%
Calm 45.4%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Male, 54.8%
Confused 46%
Sad 46%
Calm 47.2%
Surprised 45.3%
Disgusted 49.4%
Angry 45.7%
Happy 45.5%

AWS Rekognition

Age 27-44
Gender Female, 72.3%
Confused 2.1%
Surprised 5.7%
Disgusted 27.2%
Calm 42.9%
Angry 3.9%
Happy 2.4%
Sad 15.7%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Happy 45.1%
Disgusted 45.2%
Calm 54.2%
Confused 45%
Sad 45.2%
Angry 45.2%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.9%
Calm 48.9%
Confused 45.9%
Happy 45.4%
Disgusted 45.8%
Surprised 45.3%
Angry 46.2%
Sad 47.5%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.5%
Person 97.8%
Person 80%
Person 64%
Person 62.3%
Person 53.8%

Categories

Captions

Microsoft
created on 2019-05-30

a painting on the wall 55.4%
a painting on a wall 54.5%
a painting of a horse 54.4%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-03-07

The image depicts a scene from a quaint village setting with a group of people gathered in the foreground. They are dressed in traditional, possibly 18th or 19th-century attire. There is a man riding a horse and a dog walking beside them. The background shows picturesque houses, a church with a steeple, and a castle or ruin atop a hill, suggesting a rural or historical European setting. The atmosphere appears to be lively and communal, as villagers engage with one another.

Created by gpt-4 on 2025-03-07

This is a detailed, colored artwork depicting a bustling scene likely set in a historical European village. In the foreground, there is a large cream-colored horse being tended to, and a small brown and white dog stands nearby. The village is characterized by quaint buildings with various architectural details, such as chimneys and window shutters. In the background, a castle on a hill overlooks the area, signifying that this might be set in medieval or early modern times. The landscape includes some barren trees and a partially cloudy sky. Several individuals are depicted going about their daily lives, contributing to a narrative of a lively village community. The attire suggests a historical period, with draped garments and head coverings indicative of traditional costume. The varying poses and attire of the individuals add depth to the scene and invite the viewer to imagine their stories and interactions.

Anthropic Claude

Created by claude-3-opus-20240229 on 2025-01-15

The image depicts a group of people gathered in a rural village or town setting. The people are wearing clothing that appears to be from an earlier historical period, possibly the 18th or 19th century based on the style of dress. The group includes both men and women, as well as children and dogs. In the background, there are thatched roof cottages and other rustic buildings, suggesting a quaint, countryside setting. The scene has a pleasant, communal atmosphere with the villagers interacting and going about their daily lives. The artwork has a sketched, watercolor quality with earthy tones predominating. The style evokes a sense of nostalgia and captures a slice of life from a bygone era in what seems to be a close-knit, rural community.

Created by claude-3-haiku-20240307 on 2025-01-15

The image depicts a lively scene in a medieval village setting. In the foreground, there is a group of people gathered around, including a man on horseback, an older man with a walking stick, and a woman in a colorful dress. Other figures, both adults and children, are also visible. In the background, there are buildings with distinctive architectural features, such as towers and roofs, suggesting the medieval time period. The overall scene appears to capture a moment of social interaction and activity within this historical setting.

Created by claude-3-5-sonnet-20241022 on 2025-01-15

This is a watercolor painting depicting a lively village scene, likely from the 18th or early 19th century. The scene shows several people gathered in a village street, with rustic buildings and a castle or church visible in the background. There's a horse and a shaggy dog in the scene. The people are dressed in period clothing - the men wearing tall hats and long coats, and a woman in a pink dress with a green shawl. The style is detailed and the colors are soft and muted, typical of watercolor artwork from this period. The composition suggests this might be depicting a social gathering or casual street scene, with the figures appearing to be engaged in conversation or interaction. The overall atmosphere is quite pastoral and characteristic of rural European life of the era.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-15

This image is a watercolor painting of a group of people in a village setting. The scene depicts a lively gathering, with several individuals engaged in various activities. In the foreground, a woman in a pink dress and green shawl is being supported by two men, one wearing a top hat and the other a brown coat. A man on horseback is also present, while a dog is seen running towards the left side of the image. In the background, several buildings are visible, including houses and what appears to be a church or other religious structure. The sky above is blue and cloudy, adding to the overall atmosphere of the scene. The painting's style suggests that it may be from the 19th century, although the exact date is not specified. Overall, the image presents a charming and lively depiction of village life during this time period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-15

The image depicts a scene of people gathered in a village, with a man riding a horse in the foreground. The man is wearing a hat and holding a staff, while the horse is white with a brown mane and tail. In the background, there are several buildings, including a church steeple and a castle. The sky is blue with white clouds. The people in the image are dressed in traditional clothing, with men wearing hats and women wearing long dresses. Some of the people are carrying baskets or bags, while others are simply standing or walking. The overall atmosphere of the image is one of activity and movement, with people going about their daily business in the village. The image appears to be a painting or drawing, possibly created in the 19th century. The style is reminiscent of Romanticism, with its emphasis on emotion and the beauty of nature. The use of muted colors and the focus on the human figure suggest a sense of realism, while the fantastical elements, such as the castle in the background, add a touch of fantasy. Overall, the image is a charming and evocative portrayal of village life in the past. It captures the essence of a bygone era, with its simple yet vibrant depiction of people and their surroundings.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-15

The painting depicts a group of people in a village. A man is sitting on a horse and holding a stick in his hand. A man is standing beside the horse, and a dog is standing in front of him. A man with a cane is standing beside him, and a woman is standing near him. A man with a hat is standing beside the woman. A few houses are located behind them.

Created by amazon.nova-lite-v1:0 on 2025-01-15

This is an old painting of a village scene. In the foreground, there are several people gathered around a horse and a dog. The horse is being held by a man wearing a hat and a coat, while the dog is standing beside the horse. The people are dressed in old-fashioned clothing and seem to be talking to each other. In the background, there are houses with chimneys and a castle-like structure. The painting has a vintage look and feel to it.

Created by amazon.nova-lite-v1:0 on 2025-01-10

The image depicts a watercolor painting of a bustling scene set in a village. In the foreground, a group of people is gathered around a man riding a horse. The rider is wearing a hat and a long-sleeved shirt, and he holds the reins of the horse with one hand while pointing with the other. The horse is white and appears to be standing calmly. The people around the horse are dressed in old-fashioned clothing, suggesting a historical setting. To the left of the horse, a man in a green uniform stands with a dog at his side. The dog is looking up at the man, who seems to be engaged in conversation with the rider. Behind the horse, a woman with a child on her shoulder is looking at the rider, possibly asking for directions or information. The child is holding a small object, possibly a toy or a tool. In the background, there are several buildings with thatched roofs, indicating a rural setting. Some of the buildings have flags on top, and there are trees and a castle-like structure in the distance. The sky is clear and blue, suggesting a sunny day. The painting is signed "G.C." in the lower right corner, indicating the artist's name. The overall composition and style suggest that the painting is from the 19th century, possibly the Victorian era.

Created by amazon.nova-pro-v1:0 on 2025-01-10

A group of people are gathered in an outdoor area, possibly in a village. Some of them are wearing hats, and one is wearing a cane. A man is holding the horse's rope, while the other is holding the horse's head. A dog is standing beside the horse. A man on the left is holding a stick. A few houses are located behind them, and a mountain is at a distance.