Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4621

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4621

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.3
Accessories 95.2
Accessory 95.2
Screen 77.9
Electronics 77.9
Display 71.1
People 67.2
Outdoors 67
Water 65.5
Furniture 55.6

Clarifai
created on 2023-10-25

movie 99.8
negative 99.7
collage 99.5
people 99.3
filmstrip 99.1
slide 98.7
noisy 98.7
photograph 98.3
exposed 95.7
art 95.5
cinematography 95.3
screen 94.5
moment 93.4
woman 92.9
cinematic 92.3
group 91.7
analogue 90.8
portrait 90.7
window 90.6
locomotive 90.5

Imagga
created on 2022-01-08

case 47.5
shop 28.2
barbershop 28.2
television 23.6
building 21.9
architecture 21.1
old 19.5
mercantile establishment 19.4
broadcasting 16.7
business 16.4
black 15
urban 14.8
equipment 14.2
city 14.1
film 14
art 13.7
retro 13.1
place of business 12.9
house 12.5
vintage 12.4
design 12.4
telecommunication 11.7
glass 11.7
window 11.4
light 11.4
monitor 11.2
negative 11
dirty 10.8
grunge 10.2
office 9.7
computer 9.7
structure 9.6
electronic equipment 9.1
sign 9
technology 8.9
text 8.7
texture 8.3
frame 8.3
exterior 8.3
digital 8.1
symbol 8.1
detail 8
people 7.8
medium 7.8
movie 7.7
pattern 7.5
paint 7.2
home 7.2
interior 7.1
paper 7.1
travel 7
screen 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 96.4
screenshot 84.4
picture frame 78.6
person 75.4
clothing 64.1
man 51

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 81.9%
Angry 5%
Confused 4.8%
Sad 4.4%
Fear 1.9%
Surprised 0.9%
Disgusted 0.5%
Happy 0.5%

AWS Rekognition

Age 45-53
Gender Male, 93.5%
Calm 41.1%
Happy 33.9%
Sad 18.9%
Angry 2.1%
Fear 1.3%
Disgusted 1.1%
Confused 1%
Surprised 0.7%

AWS Rekognition

Age 48-54
Gender Female, 100%
Sad 65.4%
Calm 19.5%
Confused 5.1%
Surprised 2.6%
Angry 2.4%
Disgusted 2.4%
Fear 1.6%
Happy 0.9%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 75.8%
Sad 21%
Confused 1.9%
Angry 0.3%
Fear 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Sad 69.1%
Calm 16.8%
Happy 3.9%
Surprised 3.6%
Angry 2.2%
Disgusted 2%
Confused 1.6%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 93.3%
Confused 3.9%
Sad 1.3%
Fear 0.6%
Surprised 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 97.6%
Calm 65.1%
Sad 22.8%
Fear 4.9%
Happy 2.5%
Angry 1.6%
Disgusted 1.2%
Surprised 1.1%
Confused 0.8%

AWS Rekognition

Age 58-66
Gender Male, 97.8%
Calm 72.9%
Sad 11.7%
Confused 8.5%
Angry 4%
Disgusted 1.1%
Surprised 1%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 2-8
Gender Male, 97.1%
Calm 81.7%
Sad 14.5%
Confused 1.6%
Angry 1.2%
Happy 0.4%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Female, 93.8%
Sad 78.6%
Confused 5%
Calm 4.8%
Angry 4.1%
Happy 3.6%
Fear 2.4%
Disgusted 1%
Surprised 0.6%

AWS Rekognition

Age 35-43
Gender Male, 99.1%
Calm 70.4%
Sad 10%
Confused 6.6%
Happy 5.7%
Fear 3.8%
Disgusted 1.5%
Surprised 1.3%
Angry 0.8%

AWS Rekognition

Age 18-24
Gender Female, 51.1%
Calm 46.7%
Sad 36.2%
Angry 6.9%
Fear 3.5%
Disgusted 2%
Surprised 1.7%
Confused 1.5%
Happy 1.5%

AWS Rekognition

Age 18-24
Gender Male, 87.6%
Calm 66%
Confused 15.5%
Happy 11.1%
Surprised 3.9%
Disgusted 1.6%
Sad 0.8%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 16-24
Gender Male, 99.1%
Calm 76.1%
Sad 11.6%
Happy 5.8%
Angry 2.3%
Confused 2%
Disgusted 1.4%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Female, 63.6%
Calm 87.2%
Happy 11.1%
Surprised 0.8%
Sad 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Monitor

Clarifai

Man
Picture frame
Human face
Footwear
Clothing
Woman
Tree
Human hair

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 85.7%

AWS Rekognition

Person 85%

AWS Rekognition

Person 81.8%

AWS Rekognition

Person 81%

AWS Rekognition

Person 65.1%

AWS Rekognition

Person 60.9%

AWS Rekognition

Tie 95.2%

AWS Rekognition

Monitor 58.6%

Clarifai

Man 88.1%

Clarifai

Man 82.8%

Clarifai

Man 75.5%

Clarifai

Man 73.3%

Clarifai

Man 66.7%

Clarifai

Man 66%

Clarifai

Man 64.4%

Clarifai

Man 63.1%

Clarifai

Man 53.9%

Clarifai

Man 52.6%

Clarifai

Man 47.4%

Clarifai

Man 42.3%

Clarifai

Man 41.9%

Clarifai

Man 40.3%

Clarifai

Picture frame 88%

Clarifai

Human face 65.7%

Clarifai

Human face 65.3%

Clarifai

Human face 64.9%

Clarifai

Human face 64.7%

Clarifai

Human face 63.2%

Clarifai

Human face 59.3%

Clarifai

Human face 58.8%

Clarifai

Human face 51.6%

Clarifai

Human face 47.6%

Clarifai

Human face 36.9%

Clarifai

Footwear 60.2%

Clarifai

Footwear 54.8%

Clarifai

Footwear 47.8%

Clarifai

Footwear 44.4%

Clarifai

Footwear 42.1%

Clarifai

Footwear 40.5%

Clarifai

Clothing 55%

Clarifai

Woman 51.1%

Clarifai

Tree 38.3%

Clarifai

Human hair 37.4%

Clarifai

Human hair 34.3%

Categories

Imagga
created on 2022-01-08

interior objects 42.4%
cars vehicles 38.6%
paintings art 8.4%
text visuals 4.2%
food drinks 3.5%
streetview architecture 1.8%

Captions

Microsoft
created by unknown on 2022-01-08

graphical user interface 54.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

photograph of politician and his wife, taken.

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a black and white photo of a man in a suit and tie

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a black-and-white photograph, possibly from a film strip, capturing a festive or ceremonial event. People are dressed formally, with several individuals wearing suits and ties, and one person adorned with ceremonial sashes, suggesting they are part of a parade or procession. A woman holds a bouquet of flowers, which adds to the formal and celebratory tone of the scene. The background shows a bustling street with building facades, banners, and other participants and spectators, contributing to an atmosphere of public gathering or celebration.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image appears to be a photo negative featuring a street scene during a festive parade or procession. Several individuals are dressed formally, with some wearing suits and others in elegant attire reminiscent of formal events such as pageants or weddings. One person is wearing a sash, suggesting a position of honor or a ceremonial role, possibly a parade queen or official. A flower bouquet can be seen being held by one of the figures, which reinforces the celebratory nature of the event. The background includes architecture typical of urban areas, possibly indicating the event is taking place in a city. There are additional figures in the background, showcasing the event’s importance through the presence of spectators and participants. The image's composition reflects the hustle and bustle of a communal celebration.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph capturing a formal event or gathering. It shows a group of people, primarily men, dressed in suits and formal attire. In the center of the image, there is a woman wearing a long dress and carrying a bouquet of flowers, suggesting she may be the focus of the event. The people surrounding her seem to be observing or interacting with her. The image has a vintage or historical feel, with the film strip border around the edges.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white photograph shows a crowded street scene from the mid-20th century. A large group of well-dressed men in suits and hats are walking together down the sidewalk. Some are holding flowers and one man near the center is holding a bouquet. The men seem to be part of some kind of procession or event. Storefronts and awnings can be seen lining the street in the background. The image has a film strip border, suggesting it may be a still from a movie or newsreel footage capturing this moment from that era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a black and white photograph, likely from a film negative strip as indicated by the sprocket holes visible at the top and bottom. The image shows what appears to be some kind of formal or celebratory event on a street. Several people are wearing dark suits, and one person is wearing what looks like a sash or banner across their suit. There's a crowd in the background, and the setting appears to be urban with buildings visible. One person in the foreground has a boutonnière or flower pinned to their lapel. The image has a vintage quality to it, suggesting it was taken several decades ago.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image is a black-and-white photograph of a man in a suit, holding a bouquet of flowers and a cup. He is standing on the sidewalk, surrounded by other people in suits, and appears to be participating in some kind of event or celebration.

Key Features:

  • The man is wearing a dark suit with a white shirt and tie.
  • He is holding a bouquet of flowers in his left hand and a cup in his right hand.
  • He is standing on the sidewalk, surrounded by other people in suits.
  • There are buildings and trees visible in the background.
  • The overall atmosphere suggests a formal or celebratory occasion.

Possible Context:

  • The image may be from a wedding, graduation, or other special event.
  • The man may be a groom, best man, or other important figure in the event.
  • The bouquet of flowers and cup may be symbols of good luck, prosperity, or celebration.

Conclusion:

The image is a poignant snapshot of a special moment in time, capturing the joy and celebration of a significant event. The man's formal attire and the presence of flowers and a cup suggest a sense of occasion and ritual, while the surrounding crowd adds to the sense of community and shared experience.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a black and white photograph of a street scene, likely taken in the early 20th century. The photo is framed by a black border with perforations, suggesting it may be a contact sheet or a strip of film.

In the foreground, a man in a suit and tie stands out, holding a bouquet of flowers and wearing a sash that reads "MAYOR OF PARIS" in English. He appears to be addressing a crowd or audience, possibly at a formal event or ceremony. Behind him, a group of people are gathered, some of whom are also dressed in formal attire. A few individuals in the background are wearing hats, adding to the sense of formality and occasion.

The overall atmosphere of the image suggests a significant event or celebration, possibly related to politics or civic life in Paris. The presence of the mayor and the formal attire of the attendees implies a level of importance and prestige. The image may have been taken during a parade, a ceremony, or a public gathering, and its purpose could be to document the event or to commemorate a special occasion.

The image's historical context is likely the early 20th century, given the style of clothing and the technology used to take the photograph. The fact that the image is a contact sheet or a strip of film suggests that it may have been taken using an early camera or a specialized device for capturing multiple images at once.

Overall, the image provides a glimpse into the past, offering a unique perspective on a moment in time that may have been significant for the people involved. Its historical value lies in its ability to capture the essence of an era and the people who lived during that time.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

A black-and-white photo of a film strip features a picture of a woman in a gown and a sash, holding a bouquet of flowers. She is walking in the middle of the street, with a man on her right side holding a cup and a man on her left side holding a bouquet of flowers. Behind them, there are people standing and walking on the street, some of them wearing hats.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The photo is in black and white, and it is a film strip with sprocket holes on the side. There are two men standing on the side of the street, one of whom is wearing a tie and a flower pinned on his suit. They are both holding cups. In the middle, there is a woman wearing a sash holding a bouquet of flowers. Behind them are other people, some of whom are raising their hands.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

This is a black and white photograph taken from a negative strip. It appears to be a snapshot from a parade or public event, likely in the mid-20th century.

Key elements:

  • People: A large group of people, men and women, are present. Several men are wearing suits, some with bow ties. There are children in the frame as well. One man has a sash on that says "SOIR PATRON".
  • Activity: Several people appear to be drinking from cups.
  • Setting: The background suggests a street scene with buildings and market-like structures. Trees with few leaves indicate a possible spring or fall season.
  • Composition: The photo is framed by the black edges of the film negative strip, providing a sense of time and the photography process. The number "12" is visible on the negative.
  • Mood: The image conveys a sense of community and public gathering.

Based on the style and attire, the photo seems to be from the mid-20th century.

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

The image is a black and white photograph depicting a crowd of people in what appears to be a parade or public event. The photo is framed within the negative of a film strip and mounted on a white or light gray card.

In the center of the frame, a man wearing a suit and a sash that reads "Leur Patron" is seen drinking from a cup. To his left, a woman in a light-colored dress holds a bouquet. Both are in motion and appear to be part of a procession.

Further to the left, another man in a suit is walking, holding a hat in his hand. Behind him are other men in suits, as well as a small child standing on the side, possibly watching the parade.

The background shows buildings and awnings, suggesting an urban street. There are other people scattered throughout the background, adding to the sense of a crowded event. The overall tone of the photograph is that of a historical record, capturing a moment from the past.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image appears to be a black-and-white photograph from a filmstrip, depicting a formal event, likely a wedding. The scene is outdoors, with a crowd of people gathered, many of whom are dressed in formal attire such as suits and dresses.

In the foreground, there is a bride wearing a traditional wedding dress and holding a bouquet of flowers. She is accompanied by two men, one on each side, who are wearing suits and appear to be part of the wedding party. The man on the left is wearing a dark suit with a white flower pinned to his lapel, and the man on the right is also in a suit, holding a sash or ribbon.

The background shows more people, some of whom are also dressed formally, and there are buildings and possibly street vendors or market stalls, indicating that the event is taking place in an urban setting. The overall atmosphere suggests a celebratory and formal occasion.

Qwen

No captions written

Text analysis

Amazon

12
PAIRON
Sur PAIRON
Sur

Google

12 12
12