Human Generated Data

Title

[Andreas, Lyonel, and Julia Feininger at the beach, Heringsdorf]

Date

1909

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.545

Human Generated Data

Title

[Andreas, Lyonel, and Julia Feininger at the beach, Heringsdorf]

People

Artist: Unidentified Artist,

Date

1909

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.545

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Human 99.3
Tool 96.7
Shovel 92
Clothing 90.6
Apparel 90.6

Clarifai
created on 2025-01-09

people 99.8
child 98.8
two 96.6
one 96.2
adult 94.2
group together 93.9
three 92.4
man 92.2
boy 90.3
recreation 88.8
wear 87.8
kneeling 86.1
four 83.5
woman 83.1
reclining 82.9
group 81.5
monochrome 79
beach 79
street 78.5
son 77.6

Imagga
created on 2022-07-02

man 29.6
child 27.7
people 25.1
sport 22.6
beach 21.5
snow 20.2
fun 20.2
person 20.2
active 20
sand 19.8
male 19.6
adult 18.8
outdoors 17.9
outdoor 17.6
vacation 17.2
shovel 15.9
play 15.5
summer 14.8
boy 14.8
winter 14.5
activity 14.3
leisure 14.1
lifestyle 13.7
sea 13.3
ball 13.3
happy 13.2
cold 12.9
outside 12.8
equipment 12.1
youth 11.9
portrait 11
exercise 10.9
sky 10.8
tool 10.7
women 10.3
playing 10
world 9.9
mask 9.9
mountain 9.8
player 9.8
hand tool 9.5
love 9.5
action 9.3
relaxation 9.2
guy 9.1
dress 9
human 9
sun 8.9
juvenile 8.8
water 8.7
men 8.6
wall 8.6
smile 8.6
ocean 8.5
relax 8.4
attractive 8.4
joy 8.4
fashion 8.3
recreation 8.1
athlete 7.9
couple 7.8
season 7.8
weather 7.8
sunny 7.8
travel 7.7
athletic 7.7
moving 7.6
adventure 7.6
legs 7.5
one 7.5
mountains 7.4
competition 7.3
alone 7.3
success 7.2
smiling 7.2
suit 7.2
weapon 7.2
holiday 7.2
game 7.1
happiness 7.1

Google
created on 2022-07-02

Hat 75.8
Sun hat 73.1
Knee 72.9
Monochrome 72.2
Fedora 70.4
Monochrome photography 69.9
Sitting 64.9
Recreation 63.7
Snow 60.6
Fun 60.6
Freezing 59.9
Flooring 57.5
Winter 56
Child 55.3
Soil 52
Elbow 50.7
Baseball cap 50.6

Microsoft
created on 2022-07-02

person 99
outdoor 95.7
clothing 93.7
human face 78.3
snow 73.4
black and white 72.1
toddler 52.5

Color Analysis

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

Clothing
Footwear
Human face
Human hand
Balloon
Human arm
Human hair
Human leg

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 90.5%

AWS Rekognition

Hat 90.6%

Clarifai

Clothing 79.8%

Clarifai

Clothing 73.8%

Clarifai

Clothing 51.6%

Clarifai

Footwear 74.7%

Clarifai

Footwear 64.7%

Clarifai

Footwear 48.4%

Clarifai

Footwear 44.2%

Clarifai

Footwear 42.5%

Clarifai

Footwear 40.4%

Clarifai

Footwear 40.3%

Clarifai

Human face 74%

Clarifai

Human face 58.2%

Clarifai

Human face 42.4%

Clarifai

Human hand 52.7%

Clarifai

Balloon 47.6%

Clarifai

Human arm 46.3%

Clarifai

Human hair 35.3%

Clarifai

Human leg 34.1%

Categories

Captions

Microsoft
created by unknown on 2022-07-02

a person sitting on the snow 71.8%
a person sitting on the snow 70.9%
a person that is sitting in the snow 64.8%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a woman in a hat and a man in a suit and hat

Created by general-english-image-caption-blip-2 on 2025-06-28

a man and woman are playing in the sand with a child

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This vintage black-and-white photograph depicts a playful scene on a sandy beach, likely from the early 20th century. On the left side, a young child, dressed in a light-colored dress and sun hat, stands holding a shovel that is taller than them. The child also appears to hold an object resembling a balloon or ball in their other hand. In the center of the image, a man in a striped shirt and dark pants is caught in motion, seemingly bending forward or falling into the sand while digging. On the right, a woman wearing a long skirt, a lace-detailed blouse, and a large decorative hat sits calmly and watches the activity. She looks amused or content, observing the scene unfold. The background is simple, featuring more sections of sand and beach structures, possibly dressing tents or cabanas. There is an overall nostalgic and cheerful tone to the image.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a vintage black and white photograph of three people on a sandy beach, likely from the early 20th century judging by their clothing. On the left, a young child in a light-colored dress and sun hat holds a large shovel handle. In the center, a man is caught mid-cartwheel or somersault, adding a dynamic and playful element to the scene. To the right, a woman is seated, dressed in a long skirt, blouse, and a large hat, smiling as she watches the activity. There are large beach tents or changing booths in the background, typical of seaside resorts during that era. Overall, the image captures a lighthearted moment of leisure and family fun at the beach.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to depict a group of people, likely from a traditional or indigenous community, engaged in some kind of ritual or ceremonial activity. The individuals are dressed in traditional clothing and appear to be performing some kind of task or ceremony on the ground. The scene has a sense of solemnity and ritual significance, though without being able to identify the specific individuals, I cannot comment on the nature of the activity. The black and white photograph gives the image a timeless, historical quality.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white vintage photograph taken at what appears to be a beach or sandy area. In the image, there are several people in early 1900s-style clothing. A child in a white dress is standing with what looks like a shovel or beach toy. Another person appears to be bending or playing in the sand, and there's someone sitting on the sand wearing what appears to be a hat and light-colored top with dark bottoms. The clothing styles and the grainy quality of the photograph suggest this was taken in the early 20th century. The scene captures what seems to be a leisurely day at the beach.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a woman and two children playing on the beach. The woman, dressed in a white blouse with lace trim, dark pants, and a dark hat with a bow, sits on the sand with her legs crossed. She is looking at the children, who are engaged in play.

To the left of the woman, a child is standing in the sand, holding a balloon and a stick. The child is wearing a white dress and a hat. Behind the child, another child is bending over, digging in the sand with their hands. This child is wearing a dark shirt and pants.

In the background, there are some buildings visible, but they are not clearly defined. The overall atmosphere of the image suggests a warm and sunny day at the beach, with the children enjoying themselves in the sand.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image depicts a black-and-white photograph of three individuals engaged in an activity on a sandy surface, likely a beach. The person on the left is a child, dressed in a white dress and holding a shovel with both hands. They appear to be digging in the sand.

In the center of the image, another child is bent over, also engaged in digging or playing in the sand. This child is wearing dark pants and a white shirt.

On the right side of the image, an adult is seated on the sand, facing the two children. The adult is dressed in dark pants and a white blouse, and is wearing a hat adorned with a ribbon. The adult's posture suggests that they are supervising or interacting with the children.

The background of the image is blurry, but it appears to feature some structures or objects that are not clearly defined. Overall, the image captures a moment of playful activity and interaction between the three individuals in a sandy environment.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image is a black-and-white photograph capturing a family moment at the beach. Three individuals are featured in the scene, all dressed in vintage clothing. A woman is seated on the sand, wearing a hat adorned with a bow and a long-sleeved blouse. She is looking towards the right side of the image. In front of her, a young child stands holding a shovel, likely engaged in playful digging in the sand. Behind the child, a man is bent over, possibly assisting the child or participating in the activity. The setting is sandy, and the shadows cast by the individuals and objects are visible, adding depth to the image.

Created by amazon.nova-pro-v1:0 on 2025-06-13

A black-and-white image of a group of people playing in the sand. A woman is sitting on the sand, wearing a hat, and looking at the child who is standing in front of her. A child is holding a shovel and a ball in his hands. Behind him, a boy is bending down and looking at something. Behind them, there is a building, and its shadow falls on the sand.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

The black and white photo depicts a woman seated at a sandy beach wearing a period-style hat and clothing. A young child holding a balloon and shovel stands nearby while another person is bent over with their head close to the sand. Beach cabins are visible in the background.

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

The image is a black and white photograph of a family enjoying a day at the beach. The focus is on a young girl in a dress who is holding a shovel and a balloon, a man bent over in what appears to be a cartwheel, and a woman sitting down and watching. The girl is in the left side of the image, the man in the middle, and the woman on the right side of the image. The background is simple, with beach huts and sand. The lighting seems to be natural light, giving a sense of warmth and happiness to the scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image is a black-and-white photograph depicting a scene at the beach. It features two women and a child engaged in an activity. The woman on the left is bending over and appears to be using a shovel to dig into the sand. She is wearing a long dress and a hat, which suggests that the photograph might be from an earlier era when such attire was common for beach outings.

The woman on the right is sitting on the sand, holding the child in her lap. She is also dressed in a long dress and a hat, and she seems to be looking at the child or the activity taking place. The child is wearing a hat and appears to be observing the woman with the shovel.

In the background, there are beach huts or cabins, indicating that this scene takes place at a beach resort or a similar location. The overall atmosphere suggests a leisurely day at the beach, with the individuals enjoying their time together.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

The image is a black and white photograph depicting a family scene on a sandy beach. There are four individuals visible in the scene:

  1. On the right side, an adult woman is sitting on the sand, wearing a light-colored blouse with a patterned design on the back, dark-colored pants, and a wide-brimmed hat. She is smiling and appears relaxed.
  2. In the center, a young girl is holding a long stick and standing on the sand, wearing a white dress with a short skirt and dark leggings. She is looking at something off-camera to her left.
  3. Behind the girl and the woman, a young boy is lying on the sand, partially obscured by the woman. He is wearing a light-colored shirt, dark pants, and a cap.
  4. Another adult, possibly another woman, is partially visible in the background. She is bending over, seemingly interacting with the boy or the sand.

The scene appears to be a casual, family-oriented moment on the beach, with the individuals engaged in activities such as playing and resting. The overall atmosphere is relaxed and leisurely.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white photograph captures a vintage scene on a beach, likely from the early 20th century.

  • Foreground: A woman is seated on the sand, wearing a white blouse with lace details and dark pants. She has a wide-brimmed hat adorned with a ribbon. Her posture suggests she is relaxed or possibly tending to something in her hands. Her shoes are off and placed beside her.

  • Midground: A young girl is standing, dressed in a white dress with a dark skirt and dark shoes. She holds a small shovel or similar toy in her right hand, suggesting she is playing in the sand. A boy stands nearby, dressed in a striped shirt and dark pants. He is bent over, appearing to be engaged in an activity on the sand, possibly digging or playing with toys.

  • Background: The beach setting is evident, with more sand and possibly a structure or some objects in the distance. The overall atmosphere suggests a family outing or a leisurely day at the beach.

The photograph conveys a sense of nostalgia and simplicity, typical of early 20th-century beach scenes.