Human Generated Data

Title

Vendor

Date

n.d.

People

Artist: Jean-Eugène-Auguste Atget, French 1857 - 1927

Printer: Berenice Abbott, American 1898 - 1991

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Donald Ottenstein in memory of Leah H. Ottenstein 1922-1999, Radcliffe Class of 1943, P2004.9

Human Generated Data

Title

Vendor

People

Artist: Jean-Eugène-Auguste Atget, French 1857 - 1927

Printer: Berenice Abbott, American 1898 - 1991

Date

n.d.

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Donald Ottenstein in memory of Leah H. Ottenstein 1922-1999, Radcliffe Class of 1943, P2004.9

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Human 99.6
Clothing 93.7
Apparel 93.7
Footwear 64.5
Canopy 63.2
Coal 55.2

Clarifai
created on 2023-10-30

people 100
adult 98.8
group together 98.6
child 98.6
two 98.3
three 96.8
man 95.2
four 95
war 93.9
wear 93
five 92.7
group 92.4
military 92.2
several 90.9
lid 90.6
boy 90.5
soldier 87.7
woman 86.5
administration 85.1
street 84.4

Imagga
created on 2022-06-03

seller 98.9
hat 38.3
people 26.8
person 26.6
man 24.2
male 23.4
adult 23.3
child 21.7
barrow 20.1
portrait 18.1
happy 17.5
boy 16.5
outdoors 15.7
handcart 15.3
cowboy 14.4
smile 14.2
kid 12.4
holding 12.4
together 12.3
umbrella 11.9
bucket 11.8
wheeled vehicle 11.7
smiling 11.6
family 11.6
couple 11.3
human 11.2
guy 11
teen 11
two 11
silhouette 10.8
cowboy hat 10.7
education 10.4
clothing 10.2
children 10
graduate 9.8
graduation 9.8
attractive 9.8
headdress 9.7
black 9.6
walk 9.5
field 9.2
outdoor 9.2
hand 9.1
pretty 9.1
suit 9
one 9
childhood 9
cheerful 8.9
container 8.7
happiness 8.6
business 8.5
hold 8.3
leisure 8.3
vessel 8.1
success 8
work 8
look 7.9
gown 7.8
play 7.8
western 7.7
expression 7.7
pair 7.6
fashion 7.5
fun 7.5
worker 7.4
vehicle 7.3
occupation 7.3
playing 7.3
lifestyle 7.2
looking 7.2
building 7.1
cartoon 7.1
love 7.1
working 7.1
businessman 7.1

Google
created on 2022-06-03

Microsoft
created on 2022-06-03

ground 99.8
outdoor 99.7
clothing 97.4
person 96.4
man 85.3
black and white 79.6
hat 74.2
umbrella 72.5
fashion accessory 56.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 54-64
Gender Male, 99.2%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%

Feature analysis

Amazon

Person
Shoe

Clarifai

Umbrella
Clothing
Footwear
Man
Woman
Chair
Tree
Human leg
Human face

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.8%

AWS Rekognition

Shoe 64.5%

Clarifai

Umbrella 88.8%

Clarifai

Umbrella 35.2%

Clarifai

Umbrella 35.1%

Clarifai

Clothing 88.2%

Clarifai

Footwear 69.4%

Clarifai

Footwear 65.9%

Clarifai

Footwear 60.5%

Clarifai

Footwear 52.3%

Clarifai

Footwear 36.2%

Clarifai

Man 64.1%

Clarifai

Woman 58.3%

Clarifai

Chair 48.5%

Clarifai

Tree 42.6%

Clarifai

Human leg 42.4%

Clarifai

Human leg 34.7%

Clarifai

Human face 39.6%

Categories

Imagga
created on 2022-06-03

streetview architecture 77%
nature landscape 10.4%
beaches seaside 6.6%
people portraits 1.9%
events parties 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-29

a man selling food on the beach with an umbrella

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man standing in front of a table with a grill

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts a street vendor standing beside a grilling setup, seemingly cooking or selling food. The setup includes a grill filled with coals and cooking items, a small stool, a bucket, and a bag nearby. In the background, a man and a woman are walking together under an umbrella, suggesting a casual outdoor setting. The scene appears to be historic or vintage in style, with subdued tones and traditional clothing.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a black-and-white photograph depicting a street scene. In the foreground, there is a street vendor standing beside a small portable cooking grill, which has various items scattered on it. The vendor is wearing an apron and a hat, and there is a folding chair next to him. On the ground, there is a bucket and a sack beside the setup. In the background, a man and woman are walking side by side, with the woman holding an umbrella. The backdrop is a somewhat blurred, open space with a few indistinct buildings, suggesting an urban setting. Overall, the scene conveys a moment of daily life, likely in an early 20th-century setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-10

The image appears to be a black and white photograph from an earlier era. It depicts a street scene with several people visible. In the foreground, there is a man standing behind a small table or cart, which appears to be selling some kind of food or goods. He is wearing a hat and what looks like a suit or formal attire. In the background, there are two other figures, one of whom appears to be holding an umbrella. The setting seems to be an outdoor, public space, possibly a street or beach. The overall mood and style of the image suggest it was taken sometime in the late 19th or early 20th century.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-10

The black and white image depicts an outdoor scene on what appears to be a beach or sandy area. In the foreground, an elderly man wearing a hat and suit is standing next to a large metal pot or cauldron filled with food, likely some type of seafood or shellfish. He has his hands on his hips and is looking off to the side, where a couple can be seen walking under an umbrella in the background. There are also some wooden stools or small tables set up near the cooking pot. The scene has an old-fashioned or vintage feel based on the clothing and setup.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-10

This appears to be a vintage black and white photograph showing a street scene. In the foreground, there's a street vendor with what looks like a food cart or grill setup, with some folding stools nearby. The vendor is wearing a hat and light-colored pants. In the background, you can see a few people walking, including some carrying parasols or umbrellas. The setting appears to be outdoors on what might be a sidewalk or public area. The image has the characteristic grainy quality of early photography, suggesting it was taken in the late 19th or early 20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-08

The image is a black-and-white photograph of a man standing behind a table with food on it, while two people walk in the background.

  • The man is wearing a hat and a long coat, and he has a beard. He is standing behind a table with a dark cloth covering it, and there are various items on top of the table, including what appears to be food.
    • The man's attire suggests that he may be a vendor or a street performer.
    • The table and its contents imply that he is selling food or offering some kind of service.
  • In the background, there are two people walking away from the camera. They are both wearing long coats and hats, and they appear to be walking together.
    • The two people in the background are out of focus, but they seem to be engaged in conversation.
    • Their clothing suggests that they may be from the same social class as the man in the foreground.
  • The overall atmosphere of the image is one of nostalgia and simplicity. The black-and-white color scheme gives the image a timeless feel, and the lack of modern technology or distractions creates a sense of intimacy and connection between the people in the scene.
    • The image may have been taken in the early 20th century, based on the clothing and the style of the photograph.
    • The image could be used to illustrate a historical or cultural context, or to evoke a sense of nostalgia or longing for a simpler time.

The image is a poignant portrayal of everyday life in the past, capturing a moment in time that is both familiar and foreign to us today.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-08

The image is a black-and-white photograph of a man standing behind a table with food on it, while two people walk by in the background. The man is wearing a hat and an apron, and he appears to be selling food from the table. The two people in the background are walking away from the camera, and one of them is holding an umbrella. The overall atmosphere of the image suggests that it was taken on a rainy day, possibly in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of a man standing behind a table with food on it. The man is wearing a hat and an apron, and he is looking at the food on the table. A bucket and a bag are on the ground near the table. A stool is on the right side of the table. A woman and a man are walking on the street, and the woman is holding an umbrella.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white photo features an old man standing in front of a table with a bucket and a stool beside him. He is wearing a hat and an apron. The table has a tray with food on it. He is looking at the food on the tray. Behind him, there are two people walking under an umbrella. They are walking in the opposite direction. In the distance, there are some houses.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-03

Here's a description of the image:

Overall Impression: The image is a vintage black and white photograph, likely taken in the early 20th century. It evokes a sense of a simple, perhaps slightly rustic, setting.

Foreground:

  • A man with a long white beard and a hat stands to the right. He's wearing what appears to be a dark jacket over a white apron. He has his hands in his pockets and appears to be observing the scene.
  • A large, dark metal container (likely a cooking apparatus) sits in the foreground. It's raised off the ground on legs and looks like a rudimentary cooking grill or smoker, and may contain food.
  • A small folding chair is beside the container.
  • A metal bucket and a jug are on the ground.

Background:

  • Two people, a man and a woman, are positioned in the background, standing in the rain under an umbrella.
  • Buildings or structures in the distance are blurred, suggesting an outdoor location.
  • The ground is covered in small stones.
  • The general ambiance is subdued, with a cloudy sky.

Atmosphere: The photograph has a nostalgic quality. It might be a snapshot of a simple gathering or a market scene. The muted tones and the slightly blurry background contribute to a sense of time passing.

Created by gemini-2.0-flash on 2025-05-03

Here's a description of the image:

The image appears to be a vintage black and white photograph. In the foreground, there is a large, dark-colored container on legs, seemingly filled with food items or some other material. A simple folding stool is positioned next to it. A man wearing a hat, apron, jacket, and a full beard stands beside the container, looking off to the right.

In the background, two figures are present. One is a woman in a long dress, and the other is a person with an umbrella.

The setting looks like an outdoor area, possibly a beach or a park, with a building in the distance on the right. The ground appears to be covered with gravel or sand. The overall mood of the photo seems somewhat overcast or somber.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image depicts a street scene, likely from the early 20th century, given the style of clothing and the quality of the photograph.

In the foreground, there is an older man wearing a hat, apron, and jacket standing next to a small makeshift grill or stove. The grill appears to be set up on a wooden table or stand, and it looks like he is cooking or selling food. There is a folding chair nearby, and a bucket and some bags are placed on the ground.

In the background, two people are walking away from the camera. One is a woman wearing a long dress and holding an umbrella, and the other is a man in a suit also holding an umbrella. The scene suggests it might be raining or has recently rained, as the ground appears wet and the people are using umbrellas.

The setting appears to be an open area, possibly a marketplace or a street, with some buildings visible in the distance. The overall atmosphere of the image conveys a sense of daily life and street commerce from a bygone era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

This is a black-and-white photograph depicting a scene that seems to be from a bygone era. In the foreground, there is a man standing behind a makeshift stall, which appears to be set up on a gravelly surface. The man is dressed in a dark coat and a wide-brimmed hat, and he seems to be selling goods that are displayed in the stall in front of him. The stall contains what looks like various items, possibly food or goods meant for sale.

In the background, there is another man and a woman walking away from the camera. The man is holding an umbrella, suggesting that it might be a rainy day or that there is a possibility of rain. The woman is wearing a long dress, and both of them appear to be in a hurry as they are walking quickly.

The setting appears to be a simple, rural area with some buildings visible in the background. The overall atmosphere of the photograph gives a sense of a quiet, everyday scene from a past time. The clothing and the style of the stall suggest it could be from the late 19th or early 20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph captures a street scene from a bygone era. In the foreground, an older man with a white beard and a hat stands behind a cart filled with various goods, likely selling them. He is dressed in a dark jacket and an apron, suggesting he is a vendor. Next to the cart is a small folding stool. In the background, two people are walking away from the camera, one of them holding an umbrella. The setting appears to be a dirt street with some buildings visible in the distance. The overall atmosphere of the image suggests a quiet, everyday moment from a past time.