Human Generated Data

Title

[Werner Jackson, Julia Feininger, and Linde S., Deep, Baltic Coast]

Date

1930

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.55.4

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Werner Jackson, Julia Feininger, and Linde S., Deep, Baltic Coast]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1930

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.55.4

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Machine Generated Data

Tags

Amazon
created on 2022-06-10

Human 99.6
Clothing 95
Apparel 95
Flag 91.7
Symbol 91.7
Outdoors 88
Female 86.4
Nature 84.6
Face 80
Shorts 72.7
Meal 67.4
Food 67.4
Woman 66.3
Shelter 64
Countryside 64
Building 64
Rural 64
Girl 63.7
American Flag 63.6
People 62.1
Portrait 61.5
Photography 61.5
Photo 61.5
Water 60.1
Smile 59.2
Transportation 58.8
Vehicle 58.8

Clarifai
created on 2025-01-09

people 99.8
group together 99.1
adult 98.5
two 98.2
woman 98
group 96.8
reclining 96.5
man 96.1
three 94.4
four 93.2
administration 92.6
wear 91.4
tent 90.3
several 90.1
war 89.8
vehicle 89.5
recreation 87.4
campsite 87.2
military 85.5
furniture 84.8

Imagga
created on 2022-06-10

adult 29.8
person 29.1
stretcher 25.9
man 25.5
people 25.1
litter 20.7
male 18.5
happy 18.2
outdoors 18.1
sitting 17.2
conveyance 16.2
leisure 15.8
fun 15.7
couple 15.7
lifestyle 14.5
fashion 14.3
smile 14.2
love 13.4
portrait 12.9
body 12.8
home 12.8
hair 12.7
child 12.5
model 12.4
patient 12.2
attractive 11.9
relax 11.8
relaxation 11.7
summer 11.6
day 11
family 10.7
couch 10.6
lady 10.5
pretty 10.5
sexy 10.4
men 10.3
smiling 10.1
holiday 10
cheerful 9.7
human 9.7
indoors 9.7
clothing 9.7
guy 9.6
happiness 9.4
leg 9.4
sand 9.3
vacation 9
seat 9
style 8.9
beach 8.8
sofa 8.8
women 8.7
sport 8.5
casual 8.5
lying 8.5
senior 8.4
case 8.4
alone 8.2
playing 8.2
boy 7.8
face 7.8
play 7.8
sunny 7.7
footwear 7.7
outside 7.7
sick person 7.6
joy 7.5
mature 7.4
blond 7.3
teenager 7.3
dress 7.2
kid 7.1
interior 7.1
cadaver 7.1
sea 7

Google
created on 2022-06-10

Microsoft
created on 2022-06-10

person 99.7
text 93.6
water 80.3
black and white 61.9
ship 50.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 61.4%
Calm 94.7%
Surprised 8%
Fear 5.9%
Sad 2.3%
Happy 0.5%
Confused 0.4%
Disgusted 0.4%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Boat

Clarifai

Woman
Human face
Clothing
Human hair
Human hand
Human head
Human arm
Footwear

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 95.9%

AWS Rekognition

Person 93.5%

AWS Rekognition

Boat 58.8%

Clarifai

Woman 84.5%

Clarifai

Woman 74.7%

Clarifai

Woman 62.2%

Clarifai

Woman 36.8%

Clarifai

Human face 71.3%

Clarifai

Human face 70.7%

Clarifai

Human face 69.7%

Clarifai

Clothing 66.3%

Clarifai

Clothing 42.6%

Clarifai

Clothing 33.5%

Clarifai

Human hair 38.8%

Clarifai

Human hand 35.7%

Clarifai

Human head 34.6%

Clarifai

Human arm 34.1%

Clarifai

Footwear 33.1%

Categories

Imagga
created on 2022-06-10

paintings art 94.6%
people portraits 3.7%
food drinks 1.1%

Captions

Microsoft
created by unknown on 2022-06-10

a group of people sitting on a bed 29.3%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people sitting on a beach

Created by general-english-image-caption-blip-2 on 2025-07-06

three people sitting on the beach with an umbrella

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts three people seated on a sandy beach, engaging in a casual activity, possibly enjoying drinks together. Behind them is a striped beach shelter, providing shade and privacy. The surroundings include scattered belongings and expansive sandy terrain, with the coastline visible in the background, adding to the beach atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image appears to be a negative photograph showing three people seated on a sandy beach, gathered around a small object or possibly a fire pit. One individual is sitting on the left, wearing a light-colored robe or towel wrapped around them. To the right, another person is wearing a dark sleeveless top and shorts. The third person, in the center, is wearing a hat and light-colored top. Behind them is a striped windbreaker with alternating light and dark vertical stripes, providing a backdrop to their gathering. The sandy beach stretches into the distance, partially covered with objects scattered across it.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image depicts three people, likely women, sitting on the ground in what appears to be an outdoor setting, possibly a beach or rocky area. They are wearing light, casual clothing and seem to be engaged in some kind of activity or conversation. The background suggests a nighttime or low-light environment, with a striped canopy or structure visible in the background. The overall scene has a vintage or historical feel to it, conveying a sense of a bygone era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a vintage black and white photograph showing people relaxing at what seems to be a beach or poolside setting. There's a striped beach umbrella or awning visible in the background. The image has a casual, leisurely summer atmosphere typical of mid-20th century recreational photography. The lighting and shadows create an interesting contrast in the black and white composition, and the image appears to have some age-related deterioration or artifacts typical of photographs from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image depicts three individuals seated on the beach, engaged in a game of cards. The person on the left is attired in a swimsuit and has short, curly hair. The individual in the middle is wearing a swimsuit and a hat, with their hair styled in a bob. The person on the right is dressed in a swimsuit and has short, straight hair.

The trio is situated on a beach, surrounded by sand and rocks. A striped beach umbrella stands behind them, while a small table with a chair is visible in the background. The atmosphere appears to be relaxed and casual, with the group enjoying each other's company as they play cards.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image depicts a black-and-white photograph of three individuals on a beach, with two women and one man. The man is positioned on the left side of the image, while the two women are situated on the right side. The man is wearing light-colored shorts and has short hair, and he appears to be engaged in an activity involving a small object in his hands.

One of the women is dressed in a dark-colored swimsuit with a light-colored skirt, and she has short hair. She is also holding a small object in her hands. The other woman is wearing a light-colored swimsuit and has long hair, which is partially obscured by a hat. She is seated behind the other two individuals.

In the background, there is a striped beach umbrella or tent, and the ground is covered with sand and rocks. The overall atmosphere of the image suggests a relaxed and casual setting, possibly during the daytime when the sun is not too intense.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The black-and-white photograph depicts a beach scene with three individuals. Two of them are seated on the sand, while the third one is standing. The person on the left is wearing a hat and is looking down, possibly engaged in an activity. The person on the right is wearing a sleeveless top and is looking at something in front of them. Behind them is a beach umbrella with stripes. In the distance, there is a blurry view of the sea and a silhouette of a mountain.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photo features three people sitting on the sand, probably on the beach. They are probably having a conversation while looking at something. Two of them are wearing swimwear, while the other is wearing a hat. The woman on the right is wearing a bracelet. There is a striped beach tent behind them, and there are some objects near it. The photo has a grainy quality, and it is slightly blurry.

Google Gemini

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

The image shows three people sitting on a beach near a striped beach cabana, possibly engaged in a game or activity with their hands. The beach seems to be sandy, and the background shows the sea. The image appears to be an old, possibly vintage, photograph, given its black and white style.

Created by gemini-2.0-flash-lite on 2025-05-01

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage-style, grayscale photograph. It appears to be a negative, as the light and dark tones are inverted. The setting is likely a beach, judging by the sandy terrain.

Composition:

  • There are three figures in the foreground, all seemingly sitting on the sand.
  • A striped beach shelter occupies a portion of the right side of the frame.
  • The background shows a low, flat horizon, likely the sea or a coastline.
  • There are elements like sticks, and what may be shoes or beach accessories scattered across the sand, adding to the beachy atmosphere.

Details:

  • The figures are people in swimwear, typical of a beach scene.
  • One figure appears to be wearing a swim suit with a pattern, and another in swim trunks.
  • There is a person wearing a sun hat.
  • They appear to be interacting or perhaps playing a game.

Tone:

The negative effect creates a contrasty and somewhat mysterious mood. It gives the photo a vintage or historical quality. The subject matter suggests leisure, relaxation, and social interaction.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a black and white photograph depicting a beach scene. Three people are sitting on a rocky beach, with the ocean in the background. They are seated on blankets and appear to be enjoying a leisurely day.

  • The person on the left is a man with light-colored hair, wearing a sleeveless shirt and shorts. He is sitting cross-legged and seems to be engaging in conversation with the others.
  • The person in the middle is a woman wearing a hat and a long-sleeved top. She is sitting with her legs extended and appears to be holding something in her hands.
  • The person on the right is a woman wearing a hat and a sleeveless top with a skirt. She is sitting with her legs bent and seems to be looking at something in her hands.

A striped beach umbrella is set up to the right, providing some shade. There are also some scattered items around them, including what looks like a small sailboat toy and some sticks or driftwood in the background. The overall atmosphere suggests a relaxed, casual outing by the sea.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image appears to be a black-and-white photograph depicting a group of people enjoying a night-time scene at a beach or a similar setting. The individuals are seated on the sand under a striped beach umbrella, which is prominently visible on the right side of the image.

The person on the left is shirtless and appears to be adjusting or putting on a pair of shoes. The individual in the center is wearing a light-colored dress and a hat, and they seem to be engaged in a conversation or activity with the person on the left. The person on the right is dressed in a dark-colored dress and is seated with their legs crossed, holding a small object, possibly a shoe or a similar item.

In the background, there are some indistinct objects and a dark, blurry area that might suggest a body of water or a distant landscape. The overall atmosphere of the image conveys a casual and relaxed beach setting, likely during the evening or night.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This image is a black-and-white photograph showing three women seated on a sandy beach. They are dressed in vintage swimwear, which suggests the photo is from an earlier time period, possibly the early to mid-20th century. The women appear to be engaged in a casual conversation. One woman is wearing a hat, and another has her hair pulled back. There is a striped beach umbrella providing some shade to the group. The beach is rocky, and there are a few scattered items in the background, including what appears to be a bucket and some sticks. The overall scene conveys a relaxed, leisurely atmosphere.