Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4624.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4624.1-4

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Display 98.5
Screen 98.5
Electronics 98.5
Person 98.3
Person 98.3
Person 96.5
Monitor 96.2
Person 95.9
Person 94.5
Person 94
Person 88.9
LCD Screen 79.9
TV 74.8
Television 74.8
Person 72.8
Person 62.7
Phone 57.2
Person 57
Person 51.6

Clarifai
created on 2023-10-25

screen 98.3
people 97.3
movie 95.9
collage 95
man 94
no person 93
technology 93
group 91.7
slide 91.5
snow 89.7
landscape 89.4
science 89.2
display 89.2
winter 89
art 88.1
museum 87.3
one 87
wear 86.2
painting 85.5
retro 85.1

Imagga
created on 2022-01-08

television 61.2
monitor 51.4
electronic equipment 37.9
equipment 32.4
web site 31.9
billboard 30.8
broadcasting 27.4
signboard 25
structure 23.3
telecommunication system 20.9
telecommunication 19.7
digital 17
film 15.7
black 15
computer 13.6
technology 13.4
medium 13.1
screen 12.4
hand 12.1
old 11.8
design 11.8
art 11.1
vintage 10.7
collage 10.6
office 10.4
architecture 10.1
people 10
global 10
frame 10
night 9.8
blackboard 9.7
sky 9.6
man 9.4
display 9.3
business 9.1
border 9
x-ray film 8.9
color 8.9
person 8.9
symbol 8.7
your 8.7
light 8.7
education 8.6
system 8.6
city 8.3
car 8.3
entertainment 8.3
pattern 8.2
science 8
chalkboard 7.8
travel 7.7
texture 7.6
destination 7.5
one 7.5
retro 7.4
object 7.3
success 7.2
board 7.2
road 7.2
modern 7

Microsoft
created on 2022-01-08

text 99
screenshot 97.2
indoor 88.7
person 64.7
display 61.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 83.3%
Sad 9.8%
Fear 1.6%
Confused 1.6%
Angry 1.1%
Surprised 1%
Happy 0.9%
Disgusted 0.7%

AWS Rekognition

Age 24-34
Gender Male, 94.6%
Sad 64.4%
Disgusted 18.7%
Calm 5.6%
Confused 5.3%
Surprised 3.2%
Angry 1.5%
Fear 0.8%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 81.4%
Angry 13.4%
Happy 1.5%
Fear 1.3%
Sad 1.1%
Disgusted 0.6%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 42-50
Gender Male, 98.5%
Calm 45.9%
Happy 35.5%
Surprised 6.3%
Angry 5.5%
Disgusted 2.3%
Sad 2.1%
Confused 1.2%
Fear 1.2%

AWS Rekognition

Age 22-30
Gender Male, 99.5%
Calm 55.3%
Sad 34.2%
Confused 5%
Happy 2.3%
Fear 1%
Angry 0.9%
Surprised 0.7%
Disgusted 0.6%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 62.3%
Sad 18%
Happy 7%
Angry 4.3%
Confused 3.3%
Fear 1.9%
Disgusted 1.9%
Surprised 1.4%

AWS Rekognition

Age 21-29
Gender Male, 50.4%
Fear 44.7%
Calm 23.9%
Sad 12.5%
Surprised 11.5%
Happy 3.4%
Disgusted 2.4%
Angry 1.3%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 89.1%
Calm 66.7%
Sad 22.4%
Happy 4.4%
Confused 2%
Angry 1.3%
Disgusted 1.3%
Fear 1.1%
Surprised 0.8%

AWS Rekognition

Age 19-27
Gender Female, 54.1%
Calm 94.7%
Confused 1.5%
Angry 1%
Sad 0.9%
Disgusted 0.6%
Happy 0.6%
Surprised 0.4%
Fear 0.3%

Feature analysis

Amazon

Person
Monitor
Person 99.2%
Person 98.3%
Person 98.3%
Person 96.5%
Person 95.9%
Person 94.5%
Person 94%
Person 88.9%
Person 72.8%
Person 62.7%
Person 57%
Person 51.6%
Monitor 96.2%

Categories

Imagga

text visuals 99.7%

Captions

Microsoft
created by unknown on 2022-01-08

a screen shot of a train station 38.1%
a screen shot of a store window 38%
a screen shot of a store 37.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a black and white photo of a group of people in a parade -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black and white film strip featuring four photographs of a parade or festival, with a crowd of people and a decorated float in the background.

  • The first photo shows a man in a costume, possibly a king or prince, standing on a float decorated with flowers and other ornaments.
    • The man is wearing a crown and holding a scepter.
    • The float has a large archway made of flowers and greenery.
  • The second photo shows a close-up of the man's face, with a serious expression.
    • His eyes are cast downward, and his mouth is set in a determined line.
    • The background of the photo is blurred, but it appears to be the same float as in the first photo.
  • The third photo shows a group of people standing in front of the float, watching the man.
    • They are all dressed in formal attire, with suits and hats.
    • Some of them are holding cameras or other objects.
  • The fourth photo shows a wider view of the parade or festival, with more floats and people in the background.
    • There are several other floats, each decorated with flowers and other ornaments.
    • The crowd is large and enthusiastic, with people cheering and waving.

Overall, the image suggests that the man in the costume is an important figure at the parade or festival, and that the event is a significant occasion for the community.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image presents a strip of black and white film negatives, comprising five distinct frames. Each frame captures a unique moment, with the first three featuring a statue adorned with garlands, while the fourth and fifth frames depict a group of men in suits standing on the sidewalk.

The first frame showcases the statue from the back, surrounded by a floral archway. The second frame offers a closer view of the statue's head, still encircled by the garland. The third frame provides a side view of the statue, with the garland now draped around its body. The fourth frame captures a group of men in suits gathered around a car, with one individual kneeling beside it. The fifth frame depicts a larger group of men in suits standing on the sidewalk, with some of them holding flags.

The film strip is set against a white background, with a small orange stain visible at the bottom. The overall atmosphere of the image suggests that it may be related to a cultural or religious event, given the presence of the statue and the formal attire of the individuals in the later frames.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image appears to be a strip of film containing multiple photographs taken in black and white. The film strip has a series of numbers and letters along the top, indicating the order and identification of each frame. The photographs depict a variety of scenes, including:

  1. A person dressed in ornate clothing, possibly a religious figure, surrounded by decorative elements.
  2. A gathering of people in a public space, with some individuals dressed in formal attire and others in casual clothing. There are also cars and buildings visible in the background.
  3. A person dressed in a suit and tie, standing in front of a car and interacting with someone else.

The film strip has a slightly blurry and worn appearance, suggesting that it may be an old or vintage photograph. Overall, the image provides a glimpse into different scenes and events captured in a series of photographs on a film strip.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white strip of four photographs. The strip is labeled "SUPER XX" and has numbers "16" to "19" on the bottom. The first two photographs show a person wearing a costume with a headdress and surrounded by flowers. The third photograph shows a group of people standing in front of a building, with one person bending down. The fourth photograph shows a group of people standing in front of a building with an American flag.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

This is a strip of 35mm film negatives, showing a series of photographs taken, likely, during a religious procession or event.

Here's a breakdown:

  • Frames 16 & 17: These appear to focus on a statue of a religious figure (possibly a bishop or saint) with an elaborate headdress, wearing what looks like an ornate garment. The statue is surrounded by a large floral arrangement, maybe a wreath or garland.
  • Frame 18: The statue is now in a street scene. A large crowd of people are gathered around the statue, with some men tending to it, likely arranging flowers or something similar. There's a car in the background. The storefronts visible suggest it's a busy street.
  • Frame 19: This frame depicts a procession of men, some carrying flags, moving down a street. They're dressed in suits and seem to be part of the event.

The film strip itself shows details such as "SUPER XX" (likely a film type) and "SAFETY FILM". The sprocket holes indicate it is 35mm film. The entire image exudes a vintage feel, indicating the photographs were taken some time ago.

Created by gemini-2.0-flash on 2025-05-16

The image is a strip of four black and white film frames, featuring a statue of a religious figure, likely a pope or bishop, surrounded by wreaths of flowers. The first two frames show close-ups of the statue, which is adorned with a tall hat and elaborate vestments. The statue is encircled by a dense arrangement of white flowers, resembling chrysanthemums.

The third frame captures a wider scene of people gathered around the statue, some wearing suits and hats. One man is bending down, possibly placing something at the base of the statue. A vintage car is visible in the background, and buildings line the street, suggesting an urban setting.

The fourth frame shows a group of men, also dressed in suits, standing on the street. An American flag is held by one of the men. The background features more buildings and what appears to be a street canopy or awning.

The film strip has markings and numbers, including "SAFETY FILM" and "SUPER XX," indicating the type of film used. The film frames are numbered 16, 17, 18, and 19. The image suggests a public event or ceremony honoring the religious figure represented by the statue.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a strip of black-and-white film negatives showing a sequence of four frames from what appears to be a parade or public event. Here's a detailed description of each frame:

  1. Frame 1 (Leftmost): This frame shows a close-up of a person wearing a large, elaborate costume. The costume is adorned with numerous round, fluffy decorations, possibly resembling flowers or feathers. The person's face is partially obscured by the costume.

  2. Frame 2: This frame provides a slightly wider view of the same person in the costume. The person appears to be standing next to a vehicle, and the background includes more of the surroundings, which seem to be a street scene.

  3. Frame 3: This frame shows a broader view of the scene. The costumed individual is now seen in the context of a street with several onlookers. There are people standing around, some appearing to be taking photos or observing the event. A car is visible in the background.

  4. Frame 4 (Rightmost): This frame focuses on a group of people standing on the street. They are dressed in formal attire, including suits and hats, suggesting that this might be a formal or ceremonial event. The people are engaged in conversation or observing something off-camera.

The film strip itself has markings along the edges, including frame numbers (16, 17, 18, 19) and the label "SUPER XX SAFETY FILM." The film appears to be a type of safety film, which is less flammable than traditional nitrate film.

Text analysis

Amazon

FILM
18
19
17
SUPER
16
SAFETY
SUPER XX
XX

Google

SAFEDYA FILM SUPER XX 17 18
SAFEDYA
FILM
SUPER
XX
17
18