Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4604

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4604

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.5
Human 98.5
Person 97.8
Person 95.9
Interior Design 73.7
Indoors 73.7
Person 71.9
Monitor 66.1
Screen 66.1
Display 66.1
Electronics 66.1
Person 64.9

Clarifai
created on 2023-10-25

movie 99.9
negative 99.8
filmstrip 99.4
slide 98.7
exposed 98.5
photograph 98.3
cinematography 97.5
analogue 96.4
people 96.3
old 96.1
collage 95.1
art 94.6
noisy 94.1
dirty 93.4
retro 93.4
screen 92.9
rust 92.6
monochrome 92
vintage 91.2
two 85.5

Imagga
created on 2022-01-08

sequencer 100
apparatus 100
equipment 89.6
film 30.3
negative 27.8
grunge 19.6
old 19.5
retro 18.8
cinema 18.5
electronic equipment 18.1
movie 17.4
vintage 16.5
digital 16.2
frame 15.8
border 15.4
computer 15.2
business 15.2
digital clock 14.9
technology 14.8
camera 14.8
slide 14.6
equalizer 14.6
texture 14.6
strip 14.5
black 14.4
entertainment 13.8
art 13.6
screen 12.7
clock 12.3
industry 11.9
finance 11.8
filmstrip 11.8
noise 10.7
photography 10.4
office 10.4
antique 10.4
graphic 10.2
network 10.2
paper 10.2
music 9.9
timepiece 9.6
roll 9.5
word 9.4
data 9.1
rough 9.1
financial 8.9
information 8.8
scratch 8.8
tape 8.7
close 8.6
media 8.6
space 8.5
card 8.5
design 8.4
dark 8.3
economy 8.3
city 8.3
connection 8.2
aged 8.1
dirty 8.1
button 7.9
register 7.9
text 7.8
folder 7.8
panel 7.7
rust 7.7
audio 7.6
damaged 7.6
horizontal 7.5
sound 7.5
banner 7.3
template 7.3
investment 7.3
success 7.2
building 7.1

Microsoft
created on 2022-01-08

text 95.1
indoor 85.2
screenshot 71.5
photographic film 66.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 92.4%
Calm 54%
Surprised 13.2%
Confused 12.7%
Sad 11.7%
Fear 2.9%
Angry 2.3%
Disgusted 2.2%
Happy 0.9%

AWS Rekognition

Age 27-37
Gender Male, 99.1%
Calm 98%
Confused 1.2%
Sad 0.4%
Surprised 0.2%
Angry 0.1%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Calm 87%
Sad 5.3%
Confused 5%
Surprised 0.9%
Disgusted 0.8%
Angry 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 33-41
Gender Male, 94.4%
Happy 69.1%
Calm 17.4%
Sad 4.9%
Angry 2.8%
Surprised 1.8%
Confused 1.6%
Disgusted 1.5%
Fear 0.9%

AWS Rekognition

Age 47-53
Gender Male, 52.2%
Angry 74.4%
Sad 17%
Calm 6.1%
Disgusted 1%
Happy 0.7%
Fear 0.6%
Surprised 0.3%
Confused 0.1%

AWS Rekognition

Age 16-22
Gender Male, 81.5%
Calm 66.3%
Sad 26.8%
Angry 2.9%
Happy 1.1%
Confused 0.8%
Disgusted 0.8%
Surprised 0.8%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Monitor
Person 98.5%
Person 97.8%
Person 95.9%
Person 71.9%
Person 64.9%
Monitor 66.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a black and white photo of a man playing trumpet -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a man eating a hot dog, with a crowd of people in the background. The photograph is framed by a film strip border, which adds to its nostalgic and vintage feel.

  • Man Eating Hot Dog
    • The man is dressed in a suit and tie, and he is holding the hot dog in his right hand.
    • He appears to be taking a bite out of the hot dog, and his mouth is open as he does so.
    • The hot dog is long and thin, and it appears to be a classic New York-style hot dog.
  • Crowd of People
    • In the background, there is a crowd of people standing behind the man eating the hot dog.
    • They are all dressed in formal attire, suggesting that this may be a special event or occasion.
    • Some of the people in the crowd are looking at the man eating the hot dog, while others are looking away or talking to each other.
  • Film Strip Border
    • The photograph is framed by a film strip border, which adds to its nostalgic and vintage feel.
    • The border is made up of small squares, each containing a number or letter.
    • The numbers and letters appear to be randomly arranged, giving the impression that the photograph was taken from a reel of film.
  • Overall Atmosphere
    • The overall atmosphere of the photograph is one of excitement and celebration.
    • The man eating the hot dog appears to be enjoying himself, and the crowd of people in the background seems to be cheering him on.
    • The photograph captures a moment in time, and it provides a glimpse into a bygone era.

In summary, the image depicts a man eating a hot dog in front of a crowd of people, with a film strip border framing the photograph. The overall atmosphere is one of excitement and celebration, and the photograph provides a glimpse into a bygone era.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man in a tuxedo, holding a cigar in his mouth. The man has short dark hair and is wearing a white shirt with a black bow tie and a black jacket with a white flower on the lapel. He is looking to the right of the image.

In the background, there are several people standing around, some of whom are also wearing formal attire. There appears to be a building or structure behind them, but it is not clearly visible due to the poor quality of the image.

The overall atmosphere of the image suggests that it was taken at a formal event or gathering, possibly a wedding or a party. The man's attire and the presence of other formally dressed individuals support this interpretation. However, without more context or information about the image, it is difficult to say for certain what the occasion was or where the photo was taken.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

A black-and-white image is captured in a frame with a film strip on top and bottom. The image shows a man in a suit and bow tie blowing a cigar. He is standing next to another man in a suit and hat, who is holding a cigar in his hand. They are both looking at something in front of them. Behind them are people standing and watching, and there is a building with a sign that reads "DIST CAFE" on the side.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The image is a black-and-white photograph of a man in a suit and bow tie, who is holding a long, thin object. He appears to be blowing into it, possibly playing a musical instrument. He is looking upward, and his mouth is slightly open. Behind him, there are other people, some of whom are also dressed formally. They seem to be gathered in an outdoor setting, possibly for an event or celebration.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

The photograph is a black and white image captured on a film strip. The image appears to be a snapshot of a street scene, likely from the mid-20th century, given the style and format. It showcases a group of men in formal attire, possibly attending or participating in a parade, ceremony, or social event.

Key elements in the photograph:

  • Men in Formal Attire: Several men are featured, many wearing suits, bow ties, and what looks like boutonnières or flower pins on their lapels. Some are holding what appears to be a crossbar or a part of a larger object they are carrying.
  • Street Scene: The setting appears to be a street with brick buildings in the background. There is a sign for "Diamonds Cafe" visible, suggesting a business or location.
  • Action: The men seem to be in motion, walking or carrying something. Their expressions seem to be serious and focused.
  • Film Strip Format: The image is framed within the black lines and sprocket holes of a film strip. This indicates it's a photographic print made directly from the film negative.
  • "SUPER" marking: The bottom right corner of the film strip shows the word "SUPER," which likely indicates the type of film used.

Overall Impression:

The image captures a moment in time, possibly a community gathering, a parade or some kind of procession. The formal attire of the men, the street setting, and the film strip format give it a sense of historical value and provides a glimpse into the past.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

This is a black and white photograph of a strip of film with an image on it. The image appears to capture a scene of people carrying something, possibly a coffin, through a city street. Several individuals are visible, and they seem to be dressed in formal attire, suggesting a solemn event like a funeral.

In the foreground, there are two men wearing dark suits with bow ties and flowers pinned to their lapels. They are holding what looks like a wooden bar or support. The faces of other people can be seen in the background, indicating a small crowd or onlookers. Behind the people, buildings line the street, with signs or writing visible on some of the structures, including what appears to be a cafe.

The image is bordered by the film strip, which includes sprocket holes and markings that say "3" and "SUPER". The film strip is surrounded by a white border, making the photograph look like a framed piece of film.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph that appears to be a negative strip, showing a scene from what seems to be a formal event, possibly a wedding or a similar occasion. The photograph captures a group of people, with the focus on a man in the foreground who is wearing a suit and bow tie. He is holding a trumpet and appears to be playing it. Behind him, there are several other people, some of whom are also dressed in formal attire. The background includes a building with signs that read "DIAMOND CAFE" and "COMMON CAFE," suggesting the event might be taking place in or near a cafe. The image has a vintage feel, likely from the mid-20th century, given the style of clothing and the overall aesthetic.

Text analysis

Amazon

SUPER
CAFE
3
DIA
DIA ONO
ONO
AMON

Google

3. 0IAT OND. CAFE ANDS CAFE SUPER
3.
0IAT
OND.
CAFE
ANDS
SUPER