Human Generated Data

Title

Dock Ballad

Date

c. 1835

People

Artist: Anonymous Italy (Naples) 1830, Italian 1800 - 1899

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Fine Arts Library, Harvard University, M22112

Human Generated Data

Title

Dock Ballad

People

Artist: Anonymous Italy (Naples) 1830, Italian 1800 - 1899

Date

c. 1835

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Fine Arts Library, Harvard University, M22112

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.5
Person 99.3
Person 99.1
Person 99
Person 98.9
Clothing 96.1
Apparel 96.1
Person 96.1
Hat 88.3
Art 85.7
Shoe 83.6
Footwear 83.6
Painting 75.7
Duel 72.9
Shoe 70
Person 50.9
Shoe 50.4

Clarifai
created on 2023-10-26

people 99.7
adult 99.1
group 99
man 99
wear 98.9
woman 98.8
veil 98.4
child 98.2
son 96.6
art 96
fun 95.4
facial expression 95.1
lid 94.6
motion 94.3
recreation 94
boy 93.7
girl 93.5
enjoyment 92.2
illustration 91.3
two 90.1

Imagga
created on 2022-01-22

sport 68.3
snow 37
winter 36.6
man 26.9
cold 25.8
people 22.3
mountain 21.9
vehicle 20.7
fun 20.2
ski 18.3
men 18
sled 17.3
action 16.7
male 16.3
extreme 16.3
ice 15.9
person 15.7
active 15.5
outdoor 15.3
outdoors 14.9
travel 14.8
speed 13.7
lifestyle 13
sky 12.7
conveyance 12.5
adventure 12.3
leisure 11.6
day 11
season 10.9
recreation 10.8
activity 10.7
cool 10.7
landscape 10.4
fast 10.3
sports 10.2
skiing 9.9
vacation 9.8
cartoon 9.8
adult 9.8
happy 9.4
air 9.2
slope 9.1
equipment 9
snowboard 8.9
powder 8.8
snowmobile 8.7
frost 8.6
play 8.6
holiday 8.6
smile 8.5
mountains 8.3
competition 8.2
exercise 8.2
cheerful 8.1
team 8.1
water 8
drawing 7.8
athlete 7.7
race 7.6
frozen 7.6
stick 7.6
power 7.6
skier 7.2
transportation 7.2
women 7.1

Google
created on 2022-01-22

Painting 81.2
Art 81
Chair 74
Font 71.4
Illustration 69.7
Drawing 68.2
Event 67.1
Vintage clothing 66.7
Visual arts 65.1
Artwork 56.3
Sitting 52.5
Paint 50.3

Microsoft
created on 2022-01-22

drawing 96.9
cartoon 96.2
person 92
sketch 91.8
clothing 91.6
text 90.6
illustration 84.1
man 72
footwear 50.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 24-34
Gender Female, 98.8%
Calm 38.8%
Angry 21.3%
Surprised 13%
Confused 10.8%
Sad 7.5%
Disgusted 4.6%
Fear 2%
Happy 2%

AWS Rekognition

Age 30-40
Gender Female, 98.2%
Sad 53.2%
Calm 26.8%
Fear 8.6%
Confused 3.8%
Disgusted 3.2%
Surprised 2.6%
Angry 1.4%
Happy 0.6%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Angry 97.7%
Disgusted 0.8%
Calm 0.5%
Happy 0.4%
Fear 0.3%
Surprised 0.2%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 70%
Sad 10.6%
Confused 4.4%
Angry 4.3%
Fear 3.4%
Surprised 2.9%
Disgusted 2.8%
Happy 1.5%

AWS Rekognition

Age 23-33
Gender Female, 99.5%
Happy 30.6%
Calm 28.2%
Sad 18.1%
Fear 10.3%
Surprised 5.3%
Disgusted 3.4%
Confused 2.1%
Angry 2%

AWS Rekognition

Age 23-33
Gender Male, 81.9%
Angry 47%
Disgusted 41.1%
Fear 2.6%
Calm 2.4%
Surprised 2.2%
Sad 1.9%
Confused 1.9%
Happy 1%

AWS Rekognition

Age 22-30
Gender Male, 90.7%
Calm 95.8%
Surprised 1.2%
Sad 0.6%
Angry 0.6%
Confused 0.5%
Disgusted 0.5%
Fear 0.4%
Happy 0.3%

Feature analysis

Amazon

Person
Hat
Shoe
Person 99.7%
Person 99.5%
Person 99.3%
Person 99.1%
Person 99%
Person 98.9%
Person 96.1%
Person 50.9%
Hat 88.3%
Shoe 83.6%
Shoe 70%
Shoe 50.4%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people standing around a table -100%

OpenAI GPT

Created by gpt-4 on 2024-12-22

The image depicts a group of individuals dressed in colorful early 19th-century attire, suggesting a social or leisure scene from that era. The attire includes hats, vests, and trousers of various patterns and styles, typical of the period's fashion. Some individuals are seated while others stand, appearing to be engaged in conversation. The scene takes place on a cobblestone surface, and the artwork bears a caption that may indicate the title or subject, although it is not entirely legible in the image provided. The artwork style suggests that this is likely a hand-colored print.

Created by gpt-4o-2024-05-13 on 2024-12-22

The image depicts a group of seven people dressed in colorful, traditional attire. They are arranged in a casual setting, with some sitting on a bench and others standing or sitting on stools. The clothing includes vibrant hats, scarves, and pants, suggesting a lively and social scene. The ground is paved with stones, adding a rustic element to the illustration. The caption at the bottom reads "Cantine scena di Mola," which is Italian for "Cantine scene of Mola."

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-22

The image depicts a group of people with diverse attire and postures. There are several men and women in traditional or eccentric costumes, including hats, vests, and pants of various colors and patterns. One person is standing and pointing, while others are seated or standing in various poses. The image appears to be a scene or caricature of some kind, with the title "Carla scena di Melo" written below it.

Created by claude-3-5-sonnet-20241022 on 2024-12-22

This is a historical illustration depicting a colorful street scene. It shows a group of seven men in various casual and working-class attire from what appears to be the 19th century. Their clothing includes bright colors like red, blue, green, and pink, with some wearing striped pants, vests, and different styles of hats including top hats and caps. The figures are arranged in an informal gathering on what looks like a cobblestone street or plaza. One figure is pointing while others appear to be in conversation or relaxing, with some seated on what appears to be a bench or stool. The style suggests this is likely a European scene, possibly Italian given the text below the image which reads "Gente sicura al Molo" (People at the Pier/Dock). The illustration has a folk art or documentary quality typical of period costume studies or street life depictions.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-22

The image depicts a group of six men in various attire, gathered around a man who is pointing to something outside the frame. The scene appears to be set in an outdoor environment, possibly a street or plaza.

The men are dressed in a mix of traditional and modern clothing, with some wearing hats, while others have bare feet. The man pointing is wearing a top hat and holding a book or paper in his left hand. He is gesturing towards the right side of the image, as if indicating something to the other men.

The background of the image is a plain beige color, which helps to focus attention on the group of men. The overall atmosphere of the image suggests a sense of camaraderie and discussion among the group, as they appear to be engaged in a lively conversation.

The image may be a historical illustration or engraving, given its style and the fact that it is presented on a white background with a caption at the bottom. The caption reads "Canto steso al Male" in Italian, which translates to "Same song to the evil" or "The same song for the wicked." This suggests that the image may be related to a social or political commentary from the past.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-22

The image depicts a group of eight men gathered around one man who is pointing to something outside the frame. The men are dressed in various attire, including hats, vests, and pants, with some wearing shirts and others not. They appear to be engaged in conversation or discussion.

Key Features:

  • A group of eight men
  • One man pointing to something outside the frame
  • Various attire, including hats, vests, and pants
  • Some men wearing shirts, others not
  • Engaged in conversation or discussion

Conclusion:

The image suggests that the men are gathered for a purpose, possibly to discuss or plan something. The pointing gesture by one of the men implies that they may be looking at something specific, such as a map or a diagram. Overall, the image conveys a sense of camaraderie and collaboration among the group of men.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-25

The image depicts a group of men gathered on a stone pavement, likely in a town square or marketplace. They are dressed in traditional clothing, with hats and boots, and some are smoking pipes. One man in the center, wearing a top hat, appears to be addressing the others, possibly giving a speech or making an announcement. The man on the left, wearing a red hat, seems to be listening intently. The image has a vintage look, suggesting it may be an old drawing or painting.

Created by amazon.nova-pro-v1:0 on 2025-02-25

The image is a hand-drawn illustration of a group of people gathered in a circle. The group consists of eight people, with seven of them sitting on a bench and the eighth person standing. The people are wearing hats, and some are wearing shoes. The man in the center of the group is holding a book and pointing at something. The man on the right side of the group is holding a pipe.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

The image is a hand-colored lithograph depicting a group of men in a social setting. They appear to be dressed in clothing typical of the early 19th century.

  • Composition: There are seven men depicted. They are arranged in a somewhat informal gathering, with some seated on a bench or a stool and others standing. The composition is set against a plain, light-colored background that suggests a scene outdoors or in a simple interior.
  • Clothing: The men's clothing is varied, but generally suggests a working-class or rural aesthetic. There's a range of hats, from simple straw hats to top hats. The garments include jackets, vests, shirts, and trousers, in a variety of colors. One man is wearing a blue cloak, and another has a red scarf. The clothing suggests some are fishermen or of the merchant class.
  • Activity: The central figure, wearing a top hat and holding a book, appears to be addressing the others, pointing with his right hand and looking towards the upper right. Some men are looking at him, while others seem to be reacting to his words. The man on the far right is smoking a pipe.
  • Setting: The men are set on what appears to be a cobblestone surface, indicating a street or square.
  • Overall Tone: The image has a narrative quality, suggesting a scene from everyday life. The coloring adds a vibrancy to the image. The title "Conte storia al Melle" at the bottom translates roughly to "Telling stories at the Melle."

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

The image is an illustration of seven men standing or sitting together on a cobblestone street. They appear to be from the 19th century, judging by their clothing. The men are all dressed differently, but they all wear hats.

The man in the center of the image is wearing a black top hat, a gray coat, and tan pants. He is holding a book in his left hand and pointing with his right hand. The man to his right is wearing a gray top hat and smoking a pipe.

The other men are sitting on benches or stools. They are all dressed in a variety of colors, including red, blue, green, and yellow.

The image is signed "Canto storia al Melo."

Text analysis

Amazon

al
Mele
Cause steue al Mele
Cause
steue

Google

Caule deuo al Dllele
Caule
deuo
al
Dllele