Human Generated Data

Title

Untitled (crowd gathered around woman, young boy and small boat, Mantalocking, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8515

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd gathered around woman, young boy and small boat, Mantalocking, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8515

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.2
Human 99.2
Person 99.2
Person 98.9
Person 98.6
Person 98.5
Person 98.4
Person 97.7
Person 97.1
Person 96.5
Clothing 96.4
Apparel 96.4
Person 96.2
Person 92.8
Person 87
Face 84.6
Female 79.5
People 71.8
Dress 69.2
Suit 66.9
Coat 66.9
Overcoat 66.9
Girl 65.9
Person 64.7
Person 63.6
Person 62.7
Photography 61
Photo 61
Woman 59.4
Shorts 58.6

Clarifai
created on 2023-10-25

people 99.8
group together 98.2
group 98.2
many 97.1
man 96.1
adult 95.3
leader 94.2
woman 93.6
music 86.5
administration 85.1
sitting 84.6
child 81.9
chair 78.4
education 78.2
wear 77.3
musician 76.6
several 74.4
outfit 73.1
retro 71.6
uniform 71

Imagga
created on 2022-01-09

person 34.6
people 26.8
man 24.9
patient 23.6
adult 21
nurse 20.5
male 18.4
case 16.6
portrait 15.5
bride 15.3
sick person 14.6
old 13.9
men 13.7
dress 13.5
business 13.4
businessman 13.2
women 12.6
room 12.5
couple 12.2
group 12.1
clothing 12
wedding 11.9
happiness 11.7
teacher 11.7
team 11.6
two 11
black 10.8
face 10.6
happy 10.6
blackboard 10.5
student 10.4
love 10.3
vintage 9.9
fashion 9.8
hospital 9.7
ancient 9.5
work 9.4
culture 9.4
groom 9.2
worker 8.9
art 8.8
smiling 8.7
education 8.6
bouquet 8.5
religious 8.4
care 8.2
new 8.1
religion 8.1
history 8
to 8
boy 7.8
hand 7.6
human 7.5
lifestyle 7.2
family 7.1
medical 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 96
text 81.9
clothing 75.9
statue 68

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Female, 99.5%
Happy 91.2%
Surprised 3.6%
Calm 2.6%
Confused 1%
Disgusted 0.5%
Fear 0.5%
Sad 0.4%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Female, 84.6%
Calm 94.1%
Sad 3.2%
Happy 1.3%
Disgusted 0.5%
Angry 0.5%
Fear 0.2%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 26-36
Gender Female, 82.5%
Happy 38.2%
Sad 30.9%
Calm 28.6%
Fear 1%
Angry 0.6%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 10-18
Gender Male, 94.9%
Calm 46.7%
Sad 46.1%
Angry 1.9%
Confused 1.4%
Happy 1.3%
Fear 1.3%
Disgusted 0.8%
Surprised 0.5%

AWS Rekognition

Age 34-42
Gender Male, 96.4%
Happy 67.2%
Calm 28.4%
Surprised 1.4%
Fear 0.9%
Confused 0.8%
Disgusted 0.5%
Sad 0.4%
Angry 0.4%

AWS Rekognition

Age 51-59
Gender Female, 72.4%
Calm 99.5%
Sad 0.3%
Happy 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Female, 97.5%
Calm 36.7%
Fear 25.2%
Happy 24%
Sad 5.3%
Confused 3.2%
Surprised 2.7%
Angry 1.6%
Disgusted 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.2%
Person 99.2%
Person 98.9%
Person 98.6%
Person 98.5%
Person 98.4%
Person 97.7%
Person 97.1%
Person 96.5%
Person 96.2%
Person 92.8%
Person 87%
Person 64.7%
Person 63.6%
Person 62.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people standing around a man in a suit -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image is a black-and-white negative showing a gathering of people, likely outdoors, with a focus on a child interacting with an adult. The adult appears to be leaning over and engaging with the child, potentially helping or showing something. The group around them is diverse, with men, women, and children casually dressed, closely observing the interaction or perhaps an object in front of them. A woman in the center is holding a camera, suggesting a moment of documentation. There is a reflective surface and poles in the foreground, possibly part of a boat or exhibit. The atmosphere suggests curiosity or interest.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a photographic negative depicting a group of people gathered closely together, possibly observing something of interest. One person in the foreground is bending over, interacting with a small child, who is holding onto a railing or barrier. The onlookers, including the child, are dressed in mid-20th-century attire, with one individual wearing a camera around their neck. The scene appears to be set outdoors, suggested by the grass underfoot. The negative format results in a reverse color palette, with light colors appearing dark and vice versa.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to show a group of people gathered around what looks like a display or exhibit. The people seem to be a mix of adults and children, and they are all dressed in clothing from what appears to be a different era, possibly the mid-20th century. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past. The people in the image are not identified, but they seem to be observing or interacting with the display or exhibit in front of them.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph showing a group of people looking down at something, likely a display or exhibit. The image appears to be from around the 1930s or 1940s based on the clothing styles visible - some women are wearing polka dot dresses and there are people in casual attire typical of that era. One person in the group appears to be holding a camera. The photograph has a negative number or identification code visible at the edges, suggesting it's from an archive or photo collection. The group is tightly clustered together, all peering down with interest at whatever is below them, creating an interesting composition of gathered onlookers.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black and white photograph of a group of people gathered around a man and a child, with the man holding a camera and the child standing next to him. The group appears to be watching something or someone, possibly a performance or a demonstration.

Here are the details of the image:

  • Group of People
    • There are approximately 15-20 people in the group.
    • They are all dressed in casual clothing, with some wearing hats and others wearing dresses or skirts.
    • Some of the people are standing with their arms crossed, while others have their hands on their hips or are gesturing towards the man and child.
  • Man with Camera
    • The man is standing in the center of the group, holding a camera in his right hand.
    • He is wearing a light-colored shirt and pants, and has a dark-colored tie around his neck.
    • He appears to be focused on taking a photo or video of something or someone.
  • Child
    • The child is standing next to the man, looking up at him with a curious expression.
    • The child is wearing a dark-colored shirt and pants, and has short hair.
    • The child appears to be around 4-6 years old.
  • Background
    • The background of the image is dark and indistinct, but it appears to be a outdoor setting, possibly a park or a field.
    • There are some trees or bushes visible in the distance, but they are not clearly defined.

Overall, the image suggests that the group is gathered around the man and child to watch a performance or demonstration, possibly related to photography or filmmaking. The man's camera and the child's curious expression add to the sense of excitement and wonder in the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black-and-white photograph of a group of people gathered around a woman and a child. The woman is bent over, and the child is standing in front of her. The group appears to be watching them intently.

The image has a white border with the numbers "17336" written in black at the top and bottom. There are also some illegible words written vertically along the right side of the border. The overall atmosphere of the image suggests that it may be a historical or archival photograph, possibly taken in the mid-20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph with a vintage feel. It depicts a group of people gathered in an outdoor setting, likely a park or a garden. The photograph has a blurry effect, giving it an old-fashioned look. The people in the image are standing and appear to be engaged in conversation or observing something. Some of them are smiling, while others seem to be focused on something in front of them.

In the center of the image, there is a young child standing next to an adult who is bending down. The adult is holding the child's hand, and they both seem to be looking at something with interest. Behind them, there is a blurry image of a boat or a ship, which adds to the vintage feel of the photograph.

The photograph has a watermark in the upper left corner that reads "17335" and "17336." These numbers likely refer to the specific frames or negatives used to create the image. The watermark is a common feature in vintage photographs, as it helps to identify and catalog the images.

Overall, the image captures a moment of everyday life in a bygone era, with people gathered together to enjoy the outdoors and each other's company. The blurry effect adds to the nostalgic feel of the photograph, making it a charming and evocative image.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white image shows a group of people standing in a field. The group consists of both men and women, and they are gathered around a boy. The boy is standing in front of a woman who is bending down and touching his hand. The woman is wearing a bandana on her head. Behind them, a woman is holding a camera.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image is a black and white negative showing a group of people gathered around a small boat. A woman in overalls leans over the bow, while a child in front of her seems to be touching the boat. The rest of the group is standing behind them, looking at the boat. One woman in the group has a camera hanging around her neck. The boat appears to have a mast. The words "KODAK SAFETY FILM" are written vertically along the right side of the image. Numbers "17335" and "17336" are written on the top and bottom of the image.

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

Overall Impression: The image appears to be a negative of a photograph, meaning the colors are inverted. It depicts a group of people gathered around a small boat. There's a sense of curiosity and perhaps a ceremonial or commemorative event.

Composition: The photograph is framed in a straightforward manner. The central focus is on the boat and the people surrounding it. The people are clustered together. A vertical pole is visible, possibly part of the boat or a supporting structure.

People:

  • A large group of people, men and women, are present. They are dressed in what seems to be casual clothing, consistent with the period.
  • A woman is bent over, interacting with a small child standing near the boat.
  • Some individuals seem to be holding drinks, suggesting a social gathering or celebration.

Boat:

  • The boat is small, with a simple design, perhaps a rowboat or a similar small watercraft. It is in the foreground.

Background:

  • The background appears to be a grassy area or park-like setting.

Overall Mood: The image has a slightly nostalgic feel, typical of older photographs. It conveys a sense of community and a shared experience.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black and white photograph showing a group of people gathered around a display case. The group appears to be a mix of adults and at least one child. The adults are dressed in casual clothing, and many of them are wearing glasses. The display case seems to be the focal point of their attention, suggesting they might be observing or discussing something inside it. The setting appears to be indoors, possibly in a museum or an exhibition hall, given the nature of the display case and the attentive behavior of the group. The lighting is even, and the overall atmosphere seems to be one of curiosity and interest. The image has a timestamp or identification number "17336" printed on the top and bottom.

Text analysis

Amazon

17336.
17336
NAOOX

Google

1335. 173 36. 17336.
1335.
173
36.
17336.