Human Generated Data

Title

Selling Pigs

Date

-

People

Artist: A. Schlegel,

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.514

Human Generated Data

Title

Selling Pigs

People

Artist: A. Schlegel,

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.514

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Human 99.7
Person 99.7
Person 99.5
Painting 98.6
Art 98.6
Person 98.2
Drawing 74.8
Animal 68.9
Mammal 67.7
Sketch 58.2
Person 45.9

Clarifai
created on 2019-05-30

print 99.7
illustration 99.3
people 99.3
lithograph 99.2
painting 99.2
art 98.8
adult 98.4
man 97.2
group 95.8
woman 93.6
mammal 90.8
two 90.7
tree 89.1
wear 89
war 88.9
old 85.1
veil 83.5
weapon 82.3
seat 82.2
bumpkin 80.7

Imagga
created on 2019-05-30

sand 30.1
desert 25.6
camel 23.8
travel 17.6
animal 15.2
landscape 14.1
dune 13.8
horse 13.8
beach 13.6
outdoors 13.4
sport 13.4
sky 12.8
tourism 12.4
dry 12.1
person 12
sun 11.3
animals 11.1
heat 11.1
summer 10.9
danger 10.9
hot 10.9
outdoor 10.7
adventure 10.4
people 10
riding 9.8
run 9.6
dangerous 9.5
tree 9.4
resort 9.1
bull 9
farm 8.9
color 8.9
arena 8.9
sandy 8.7
man 8.7
running 8.6
tropical 8.5
trainer 8.2
brown 8.1
bullfighting 7.9
holiday 7.9
day 7.8
arid 7.8
sea 7.8
sunny 7.8
blood 7.7
culture 7.7
old 7.7
fun 7.5
graffito 7.4
vacation 7.4
speed 7.3
sunset 7.2
trees 7.1
male 7.1
child 7

Google
created on 2019-05-30

Microsoft
created on 2019-05-30

drawing 99.4
painting 98.7
cartoon 95.9
text 95.3
sketch 93.8
animal 92.2
child art 91.6
dog 90.5
person 84.7
clothing 80.4
illustration 73.3
carnivore 66.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Disgusted 45.1%
Happy 46.1%
Angry 45.1%
Calm 52.9%
Sad 45.4%
Confused 45.1%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Disgusted 46.1%
Calm 47.4%
Surprised 45.4%
Sad 46.4%
Angry 47.4%
Confused 45.3%
Happy 46.9%

AWS Rekognition

Age 26-43
Gender Male, 50.6%
Happy 45.4%
Disgusted 45.5%
Confused 45.3%
Calm 51.2%
Angry 45.7%
Sad 46.7%
Surprised 45.1%

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.7%
Person 99.5%
Person 98.2%
Person 45.9%
Painting 98.6%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2025-03-06

The image shows a rustic, old-world scene with a pastoral feeling. In the foreground, a pig lies on the ground, while another pig stands close by. A dog sits beside a person wearing a dark hat and a cape, who seems to be holding the leash of the standing pig. The apparel suggests a setting from a historical period, potentially medieval or early modern Europe.

On the right side of the image, two figures stand close to each other, observing the scene. One is wearing a red vest and black breeches; the other is dressed in traditional clothing with a green bodice and blue skirt. The attire of these individuals also aligns with historical European fashion.

In the background, there is a half-timbered house with visible wattle and daub that needs repair, reinforcing the old-time setting. There are patches of vegetation and a well with a bucket, set against a natural, green landscape. The overall scene creates a narrative of daily life from a bygone era, possibly involving farming or village activities.

Created by gpt-4o-2024-05-13 on 2025-03-06

The image depicts a pastoral scene in a rural setting. There are three individuals dressed in traditional, historical attire engaging in conversation. One person appears to be gesturing or pointing while holding a stick or staff. Two pigs are present, one standing and the other lying down. There is also a dog sitting near the individual with the stick. The background features a rustic house with timber framing, surrounded by a garden with various plants and flowers. A wooden fence and a makeshift structure, possibly a well, can also be seen. The overall setting suggests a countryside environment from a past era.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-01-15

The image depicts a rural, rustic village scene. In the foreground, there are several people gathered around a farm animal, likely a pig or boar, that appears to be resting or sleeping on the ground. The people are dressed in traditional folk attire, with the men wearing hats and coats, and the women in long dresses.

In the background, there are several wooden buildings with thatched roofs, surrounded by lush greenery and trees. The overall scene conveys a sense of rural, rustic life in what seems to be a quaint, historic setting.

Created by claude-3-5-sonnet-20241022 on 2025-01-15

This is a watercolor illustration depicting a rural scene with figures in traditional European countryside attire from what appears to be the 18th or 19th century. The scene shows three people conversing outside a half-timbered building. There are several animals present: a brown dog sitting beside one figure dressed in green with boots and a hat, a white pig or sheep, and what appears to be a resting or sleeping dog on the ground. The figures are dressed in period clothing - one in green with a long coat, another in a red vest and dark pants, and a third in a traditional dress with an apron and headscarf. The background shows the architectural details of the building with exposed timber framing, and there are some green vines growing up the wall. The overall style suggests this is likely a German or Central European rural scene.

Created by claude-3-opus-20240229 on 2025-01-15

The image depicts a rural scene with several people and animals. In the foreground, there are two dogs lying on the ground. Standing next to them is a man dressed in hunting or outdoor attire, holding what appears to be a gun or rifle. He is conversing with two women, one wearing a red vest or jacket and a blue skirt, the other in a green dress. The background shows a rustic village setting with wooden buildings, a fence, and some plants or small trees. The overall style looks like a watercolor or gouache painting capturing everyday life in a countryside area.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-15

This image is a watercolor painting of a scene in which a man is pointing at a dead pig lying on the ground. The man is wearing a green shirt, black boots, and a black hat. He has a white bag slung over his shoulder and is holding a stick in his right hand, which he is using to point at the pig.

To the right of the man are two people standing together. The person on the left is wearing a red shirt, black pants, and a brown jacket. The person on the right is wearing a green shirt, a blue apron, and a red skirt. They both appear to be looking at the man and the pig.

In front of the man is another pig that is alive and standing. To the left of the man is a dog sitting on the ground. In the background, there is a house with a fence and some trees. The overall atmosphere of the painting suggests a rural or countryside setting, possibly in the 19th century.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-15

The image depicts a scene from the classic fairy tale "The Three Little Pigs" by the Brothers Grimm. It shows a man standing in front of a house, pointing at three pigs lying on the ground. The man is wearing a green jacket, black boots, and a hat, and is holding a stick in his right hand. He appears to be scolding or warning the pigs.

To the right of the man stands a woman, dressed in a green dress and headscarf, with her back turned towards him. She seems to be engaged in conversation with the man, possibly discussing the situation with the pigs.

In the background, a large house with a wooden fence and a gate can be seen. The house has a thatched roof and a chimney, and there are trees and flowers surrounding it. The overall atmosphere of the image is one of tension and drama, as the man's stern expression and the woman's concerned demeanor suggest that something serious is happening.

The image is likely an illustration from a children's book or a print from the 19th century, given its style and the fact that it depicts a well-known fairy tale. The use of muted colors and the detailed rendering of the characters and setting suggest a level of craftsmanship and attention to detail that was typical of illustrations from this era.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-15

The image is a watercolor painting of a rural scene. It depicts a man and a woman standing in front of a house with a dog and a pig. The man is wearing a hat and holding a stick, while the woman is wearing a bonnet and a dress. The house has a wooden fence and a wooden gate, and there are trees and plants in the background.

Created by amazon.nova-lite-v1:0 on 2025-01-15

The image depicts a scene from a 19th-century painting by the artist August Riedel. The painting shows a man in a green coat, a woman in a red dress, and a man in a red vest standing in front of a house. The man in the green coat is holding a rope and pointing at a dog, while the woman in the red dress is looking at the man in the red vest. The man in the red vest is looking at the dog. The dog is lying on the ground.

Created by amazon.nova-lite-v1:0 on 2025-01-13

The image depicts a scene from the 19th century, possibly a painting or an illustration. It shows a man and a woman standing on a path in front of a house. The man is wearing a hat and holding a stick, while the woman is wearing a bonnet and a long dress. They are accompanied by two dogs, one of which is lying on the ground. In the background, there is a house with a wooden fence and a tree.

Created by amazon.nova-pro-v1:0 on 2025-01-13

The image is a painting of a scene with people and animals. The painting has a vintage style. There are four people and two animals in the painting. A man is holding a leash and pointing at a pig. The pig is standing near a sheep that is lying on the ground. A man and a woman are standing near the sheep. They are all standing on a dirt road. A house is on the left side of the road. There are trees on both sides of the road.

Google Gemini

Created by gemini-2.0-flash on 2025-05-15

The painting depicts a countryside scene with several figures and animals gathered in front of a farmhouse. A man dressed in a dark green tunic, hat, and boots stands to the left, pointing with his right hand towards two pigs. A dog sits attentively by his side.

The pigs are the central focus, one standing and the other lying on the ground. To the right, a couple stands observing the scene. The man wears a red vest over a brown coat and black breeches, with a white cap on his head. The woman beside him is dressed in a green bodice and a red skirt with a blue apron. She wears a white headscarf.

Behind them, the farmhouse is visible, featuring a timber frame and exposed brick. A vine climbs up the side of the house. In the background, there are trees and what appears to be a well or a pump structure. The overall style of the painting is reminiscent of 19th-century illustrations, with soft colors and detailed textures.

Created by gemini-2.0-flash-lite on 2025-05-15

Here's a description of the image:

Overall Scene: This is a watercolor illustration depicting a rural scene, likely from a historical or storybook context. It showcases a man, a couple, a dog, and pigs in front of a rustic building. The artwork has a soft, illustrative style.

Key Elements:

  • The Man: A man in a dark hat and a long, green coat is standing on the left. He's pointing his finger towards the pigs, possibly indicating something about them. He's holding a whip.
  • The Couple: A man wearing a red vest and a woman wearing a green top, a headscarf, and a red skirt are standing nearby, observing the scene. They have a somewhat perplexed or interested expression.
  • The Animals: There are two pigs present: one is standing, and another is lying down on the ground. A dog is sitting down, next to the man.
  • The Setting: The scene takes place in a rural setting, probably in front of a farmhouse. The building behind them has a distinctive architectural style with exposed wooden beams and stone walls. There is also a wooden fence.

Style & Tone: The artwork has a warm, inviting tone, using soft watercolor washes and muted colors. The scene may be illustrative of a story.

Text analysis

Amazon

h
h le
le