Human Generated Data

Title

[Tomas and Wysse Feininger and dog, seated on lawn, viewed from above]

Date

1940s-1950s

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1011.63

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Tomas and Wysse Feininger and dog, seated on lawn, viewed from above]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1011.63

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Outdoors 98.5
Play Area 87.1
Toy 81.7
Grass 81.6
Plant 81.6
Face 81.6
Head 81.6
Clothing 75.5
Footwear 75.5
Outdoor Play Area 70.9
Swing 61
Nature 57.5
Park 55.2

Clarifai
created on 2023-10-15

people 99.7
monochrome 98.8
portrait 96.7
one 96.6
adult 96.5
man 96.1
girl 96.1
child 95.9
woman 95.7
street 95.6
two 93.2
boy 91.6
water 88.7
wear 88.2
beach 87.9
music 86.6
sea 86.2
art 86
baby 85.3
analogue 82.3

Imagga
created on 2019-01-31

adult 23.9
people 22.3
person 18.9
man 16.8
attractive 16.1
fitness 15.3
leisure 14.9
equipment 13.8
portrait 13.6
sport 13.4
lady 13
male 12.8
body 12.8
exercise 12.7
outdoors 12.7
weight 12.2
one 11.9
happy 11.9
beach 11.8
lifestyle 11.6
device 11.5
wall 11.4
dumbbell 11.4
water 11.3
athlete 11.2
drawing chalk 11.2
pretty 11.2
sand 11
street 11
outdoor 10.7
human 10.5
fun 10.5
hair 10.3
sports equipment 10.1
active 9.9
hand 9.9
summer 9.6
urban 9.6
concrete 9.6
sitting 9.4
healthy 9.4
outside 9.4
action 9.3
smile 9.3
face 9.2
fashion 9
health 9
activity 9
sexy 8.8
chalk 8.8
work 8.6
legs 8.5
casual 8.5
child 8.4
tool 8.1
recreation 8.1
cool 8
clothing 7.9
model 7.8
youth 7.7
athletic 7.7
city 7.5
fit 7.4
alone 7.3
happiness 7

Google
created on 2019-01-31

Microsoft
created on 2019-01-31

picture frame 13.8
black and white 13.8
feet 8.8
girl 5.4
fashion 4.5
animal 3.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Male, 97.2%
Sad 99.7%
Calm 21.9%
Surprised 6.4%
Fear 6%
Happy 4.6%
Confused 2.5%
Angry 1.6%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Female, 68.1%
Calm 96.6%
Surprised 6.3%
Fear 5.9%
Sad 3.3%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0%

Feature analysis

Amazon

Person
Boy
Child
Male
Shoe

Clarifai

Footwear
Human arm
Human face
Clothing
Human hand
Picture frame
Human leg
Tree
Human hair
Human head

AWS Rekognition

Person 99%

AWS Rekognition

Person 99%

AWS Rekognition

Boy 99%

AWS Rekognition

Child 99%

AWS Rekognition

Male 99%

AWS Rekognition

Shoe 75.5%

Clarifai

Footwear 86.7%

Clarifai

Footwear 85%

Clarifai

Human arm 57%

Clarifai

Human face 56.9%

Clarifai

Human face 42.1%

Clarifai

Clothing 50.5%

Clarifai

Clothing 48.8%

Clarifai

Human hand 46.9%

Clarifai

Picture frame 44.8%

Clarifai

Human leg 44.7%

Clarifai

Human leg 38.6%

Clarifai

Human leg 34.4%

Clarifai

Tree 43.5%

Clarifai

Tree 40.3%

Clarifai

Tree 35.7%

Clarifai

Human hair 37.7%

Clarifai

Human head 36.7%

Categories

Imagga
created on 2019-01-31

paintings art 99.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

photograph of a group of men playing a game of dominoes.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man laying on the ground next to a woman

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This black-and-white image depicts three people outdoors, relaxing on the grass beneath a tree. Two of them, a man and a woman, are lying down, while the other woman is seated nearby. The man appears to be petting or interacting with a dog that is lying close to him. The seated woman is wearing a sleeveless white top with dark pants and sandals, leaning back on her arm. The overall atmosphere is casual and serene, with the group situated near what appears to be an outdoor metal staircase or structure on the right edge of the frame. The image captures a quiet, candid moment in nature, possibly from the mid-20th century judging by the clothing and photo style.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image is a black and white photograph taken from an elevated perspective, capturing three people on the grass. In the foreground, two people are lying down: one appears to be an adult or teenager male wearing a light shirt and pants, and the other is a child wearing a jacket and cap. They are engaged in what looks like a playful interaction. The third person, a female, is sitting on the grass nearby, supporting herself with one arm behind her. She is dressed in a sleeveless top and pants, with sandals on her feet. The scene appears to be outdoors, with a tree visible on the left side of the image and metal steps or a structure on the right, suggesting they might be near a playground or park.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows two people lying on the ground, seemingly engaged in some kind of physical altercation or struggle. One person appears to be on top of the other, with their arms and legs entangled. The scene looks tense and confrontational, though without more context it's difficult to determine the exact nature of the interaction. The image has a grainy, black and white quality, suggesting it may be an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a black and white photograph taken from above, looking down at what seems to be a street or ground surface. Several people can be seen from this aerial perspective, wearing what appear to be light-colored clothing. The image has a grainy, vintage quality to it, suggesting it may be a historical photograph. The lighting creates strong shadows, and the angle provides an interesting geometric perspective of the scene below.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

This image depicts a black and white photograph of two individuals and a dog lying on the ground. The person on the left is dressed in a white sleeveless top and a dark skirt, while the person on the right wears light-colored pants and a light-colored shirt. The dog, positioned between them, appears to be a medium-sized breed with a light-colored coat.

The scene is set outdoors, with trees and grass visible in the background. A metal structure, possibly a fence or a gate, is partially visible on the right side of the image. The overall atmosphere suggests a casual and relaxed setting, with the individuals and the dog enjoying each other's company in a natural environment.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image is a black and white photograph of two people lying on the ground, captured from an overhead perspective. The photograph appears to be taken from a high angle, possibly from a window or a balcony, with the subjects positioned below.

The person on the left is a woman wearing a white tank top, black skirt, and sandals. She is lying on her back with her legs extended to the right and her arms at her sides. Her head is turned to the right, and she is looking up towards the camera.

The person on the right is a man wearing a light-colored shirt, light-colored pants, and dark shoes. He is lying on his side with his legs bent and his feet pointing towards the left. His head is turned to the left, and he is looking down towards the woman.

The background of the photograph shows a grassy area with trees and bushes in the distance. There are also some objects visible in the background, including what appears to be a doormat or a rug on the ground.

Overall, the image suggests that the two people are relaxing or resting in a park or outdoor setting. The overhead perspective and the focus on the subjects' bodies create a sense of intimacy and closeness, while the background provides context and adds depth to the scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

The image is a black-and-white photograph that depicts two individuals lying on the ground. One person is lying on their back, while the other is lying on their stomach. They are both wearing casual clothing. The person lying on their back is wearing a short-sleeved shirt and pants, while the other person is wearing a long-sleeved shirt and pants. The ground appears to be covered with grass, and there is a tree trunk visible in the background.

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image is a black-and-white photograph of two people lying on the ground, probably in a park. The person on the left is lying on their back with their legs stretched out, while the person on the right is lying on their stomach with their head turned to the left. They are both wearing casual clothing and appear to be relaxed. In the background, there is a tree trunk and some rocks. The image has a slightly blurry quality, possibly due to its age or the quality of the photograph.

Google Gemini

Created by gemini-2.0-flash on 2025-04-28

Here is a description of the image:

The black and white image, shot from a high angle, shows two individuals and a dog relaxing outside on what appears to be a grassy area.

A woman with short hair is lying down, propped up on her elbow. She is wearing a light-colored top and dark-colored shorts. Her legs are stretched out, and she has sandals on.

Nearer to the bottom of the image, a man is lying on his back, cradling a dog. He is wearing a light-colored shirt and pants. The dog is nestled close to him, and he appears to be petting it.

In the background, there is a tree, with its trunk visible near the top-left corner of the image. There also appears to be a structure, possibly a building or a piece of furniture, with some of its components visible in the top-right corner. The light is somewhat muted, and the overall feel of the image is relaxed and informal.

Created by gemini-2.0-flash-lite on 2025-04-28

Here's a description of the image:

Overall:
The image is a black and white photograph taken from a high angle. It appears to be a candid snapshot of a couple enjoying some time outdoors.

People and Animals:

  • Two people are visible, a man and a woman, seemingly relaxed. The man is lying on his back with a small dog resting on him. The woman is lying on the ground beside him with her head turned and legs crossed.
  • There's a small dog, possibly a puppy, nestled with the man.

Setting:

  • They're lying on a grassy area. A tree trunk is visible near the woman.
  • A curved element, possibly a pipe or support beam, casts a shadow across the scene.
  • The edge of a window or frame creates a dark border on the right side of the photograph.

Style:

  • The picture has a vintage feel, possibly taken in the mid-20th century, based on the clothing.
  • The black and white adds a nostalgic quality.
  • The composition suggests a casual, informal setting.

In essence, the image captures a peaceful and pleasant moment shared between a couple and their dog outdoors.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-23

The image is a black-and-white photograph depicting two children playing outdoors. The setting appears to be a paved area, possibly a sidewalk or a patio, with a tree trunk and some vegetation visible in the background.

The child on the left is lying on their back with their legs in the air, wearing a light-colored shirt and dark shorts. The child on the right is lying on their stomach, facing the other child, wearing a light-colored shirt and light pants. The children seem to be engaged in a playful interaction, possibly playing a game or simply enjoying each other's company. The overall mood of the image is light-hearted and nostalgic, capturing a moment of childhood innocence and joy.

Qwen

No captions written