Human Generated Data

Title

East Berlin 1957

Date

1957

People

Artist: Arno Fischer, German 1927 - 2011

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Purchase through the generosity of David and Lisa Rich, 2017.9

Human Generated Data

Title

East Berlin 1957

People

Artist: Arno Fischer, German 1927 - 2011

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Purchase through the generosity of David and Lisa Rich, 2017.9

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 99.3
Apparel 95
Clothing 95
Shorts 95
Vehicle 79.3
Transportation 79.3
Overcoat 79.1
Coat 79.1
Pedestrian 72.3
Baby 72
Suit 67.9
Child 64.9
Kid 64.9
Tire 60.3

Clarifai
created on 2018-02-19

people 99.9
vehicle 99.1
adult 98.9
two 97.3
transportation system 96.6
child 96.5
portrait 96
one 95.8
street 95.7
man 95
group 94.3
group together 93.8
three 93.3
woman 92.1
boy 90.3
wear 89.1
war 88.7
car 87.7
monochrome 87.2
interaction 86.5

Imagga
created on 2018-02-19

car 33.2
vehicle 24.8
man 23.5
truck 22.8
people 20.1
television 19.1
adult 18.7
person 16.7
work 16.5
passenger 16
male 15.7
transport 15.5
world 14.6
happy 13.8
child 13.7
smiling 13.7
industry 13.6
machine 13.6
transportation 13.4
equipment 13.4
sitting 12.9
looking 12
working 11.5
job 10.6
indoors 10.5
automobile 10.5
outdoors 10.4
computer 10.4
business 10.3
senior 10.3
love 10.2
mature 10.2
office 10
industrial 10
smile 10
leisure 10
attractive 9.8
portrait 9.7
couple 9.6
drive 9.4
outside 9.4
happiness 9.4
lifestyle 9.4
two 9.3
outdoor 9.2
old 9
technology 8.9
home 8.8
together 8.8
driver 8.7
driving 8.7
day 8.6
auto 8.6
men 8.6
youth 8.5
holding 8.2
chair 8.2
worker 8
face 7.8
cargo 7.8
box 7.7
device 7.6
casual 7.6
forklift 7.6
fashion 7.5
horizontal 7.5
tourist 7.5
city 7.5
one 7.5
indoor 7.3
road 7.2

Google
created on 2018-02-19

Microsoft
created on 2018-02-19

person 99.3
child 93
little 79.2

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Human face
Clothing
Boy
Man
Land vehicle
Human hair
Wheel
Human head
Human nose
Human hand

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 91.8%

AWS Rekognition

Person 89.3%

Clarifai

Human face 92.1%

Clarifai

Human face 70.5%

Clarifai

Human face 69.3%

Clarifai

Human face 40.6%

Clarifai

Clothing 89.7%

Clarifai

Clothing 84%

Clarifai

Clothing 82%

Clarifai

Clothing 76%

Clarifai

Boy 72.2%

Clarifai

Man 60.9%

Clarifai

Land vehicle 57.8%

Clarifai

Human hair 46.2%

Clarifai

Wheel 45%

Clarifai

Wheel 34.5%

Clarifai

Human head 40.5%

Clarifai

Human head 38.5%

Clarifai

Human nose 35.1%

Clarifai

Human hand 35%

Clarifai

Human hand 33.7%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-30

a black and white photo of a family in front of a car

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a woman in a coat and coat jacket is walking down the street

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

The image is a black and white photograph capturing a scene of people interacting on a street. There is an old-fashioned vehicle, possibly a carriage or early automobile, with ornate detailing and large windows. Inside the vehicle, a person is visible sitting. Outside the vehicle, a woman with a coat and a bag appears to be in motion. Two children, one holding what seems to be a stick over their shoulder with a cloth tied to the end, are near the vehicle. The background features an urban setting with buildings and a presumably empty space or wall.

Created by gpt-4 on 2024-11-17

The image shows a black and white photograph capturing a moment on a street. On the left, there is an adult figure in motion, dressed in a light-colored coat and carrying what appears to be a bag. In the center, we see an old-fashioned vehicle, possibly a classic car, with distinguishable features such as a large headlamp and an ornate grille. There's a distinctive reflection in the rear window of the vehicle, which might be the surroundings or another vehicle passing by. To the right, a child in a coat and hat appears to be walking briskly, and in the lower-left corner, there is another blurred figure of a small child. The setting suggests an urban environment, and the attire of the individuals points to a bygone era. The blurriness of the figures hints at movement and the candid, possibly spontaneous nature of the photograph.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-27

This is a black and white historical photograph showing several people around a vintage car, likely from the 1920s or 1930s. The car appears to be a formal black sedan with a distinctive upright design typical of that era. There are a few children visible in motion around the vehicle, and someone can be seen seated inside the car. The image has a candid, spontaneous quality to it, with some of the figures appearing slightly blurred due to movement. The scene seems to be taking place on a street or driveway, with a plain wall visible in the background. The photograph has the characteristic grainy quality of early 20th century photography.

Created by claude-3-haiku-20240307 on 2024-11-17

The image appears to be a black and white photograph depicting people getting into or out of an old-fashioned horse-drawn carriage or wagon. The carriage has ornate details and a mirror on the side. There are several people visible, including a young child, who seem to be boarding or disembarking from the vehicle. The overall scene has a sense of movement and activity as the people interact with the carriage.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This is a black and white vintage photograph showing a scene with a classic car, likely from the 1920s or 1930s. The image captures several people around a dark-colored automobile, which appears to be a formal sedan or town car. The photograph has a candid quality to it, with some motion blur suggesting it was taken in the moment. The car has the distinctive boxy shape and running boards characteristic of early 20th century automobiles. The image has the grainy, slightly soft focus quality typical of photographs from this era.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image is a black-and-white photograph of a family scene, with a car in the background and people in the foreground. The car is an old-fashioned vehicle with a large body and a small window on the side. It appears to be parked on the side of the road, with a building visible behind it.

In the foreground, there are several people walking or standing near the car. One person is wearing a long coat and appears to be helping another person into the car. There are also two children in the foreground, one of whom is holding a stick or bat.

The overall atmosphere of the image suggests a casual, everyday scene from the past. The old-fashioned car and clothing suggest that the photo was taken sometime in the early 20th century. The presence of children and adults in the image adds a sense of warmth and familiarity to the scene.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-01

The image is a black-and-white photograph of a man and two children walking past a car. The man is wearing a long coat and has short hair. He is holding the hand of a child who is running ahead of him. The child has short hair and is wearing a light-colored shirt and pants. Another child is walking behind the man, also holding his hand. This child is wearing a light-colored shirt and shorts.

In the background, there is a car with an open door. A man is sitting in the driver's seat, and another man is sitting in the backseat. The car appears to be parked on the side of a road or street. There are buildings in the background, but they are not clearly visible due to the blurriness of the image.

Overall, the image suggests that the man and children are on their way somewhere, possibly to visit the men in the car. The image conveys a sense of movement and activity, as the children are running and the man is walking quickly to keep up with them.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The image is a black-and-white photograph capturing a scene from the past. In the foreground, a woman is standing next to a vehicle, possibly a car or a truck, with her head turned away from the camera. She is wearing a long coat and appears to be engaged in conversation with someone inside the vehicle. In the middle of the image, a man is sitting inside the vehicle, looking out the window. Behind him, there is a blurry figure, possibly another person. In the background, there are buildings and a clear sky.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The black-and-white image depicts a scene of a man sitting inside a vehicle, possibly a truck, with his right hand on the steering wheel. The vehicle is parked on the side of the road. Two children are standing on the right side of the vehicle, with one of them holding a stick. On the left side of the vehicle, there is a woman walking. Behind the vehicle, there is a building.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

The image is a black and white photograph, likely from the mid-20th century. The scene appears to be a city street. In the center of the frame is a vintage, enclosed automobile. The doors are open, revealing a man seated inside. A woman, positioned on the left of the car, is partially in focus and seems to be walking or moving. Two young children are also in the foreground; one is blurred and running, and the other is walking with a stick. The background includes a building or wall to the right of the car, and a slightly blurred structure to the left. The overall impression is of a candid, snapshot-style photograph capturing a moment of everyday life.

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

This black and white image captures a moment in time with a blend of blur and crisp details. A vintage car stands prominently in the center, its door open, revealing a man seated inside, his gaze directed forward with a solemn expression.

In the foreground, a woman, partially obscured by motion blur, appears to be passing by the car. Her coat is belted, and her hands are covered with knit gloves or mittens. A young child is also caught in motion, walking along the sidewalk in front of the vehicle. On the other side of the car, another child walks, holding a long object, perhaps a stick or a tool.

The backdrop is a mix of urban elements, including buildings and indistinct street features, all rendered in the grayscale tones that give the image a timeless, documentary feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The image appears to be a vintage black-and-white photograph capturing a street scene. In the foreground, there are three children, one of whom is slightly blurred, indicating motion. The children seem to be playing or walking near a parked vehicle.

The vehicle in the background is a classic hearse, identifiable by its distinctive design, including large windows and ornate details. The hearse is parked on the street next to a building. There are two adults in the scene; one is standing near the hearse, and the other is seated inside the vehicle. The adult standing outside appears to be interacting with or watching the children.

The overall atmosphere of the photograph suggests a candid moment, possibly from the mid-20th century, given the style of clothing and the design of the hearse. The image captures a blend of everyday life and a solemn event, as indicated by the presence of the hearse.

Qwen