Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8511

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd gathered around woman holding hat, Mantalocking, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8511

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Person 99.5
Person 99.4
Clothing 97.9
Apparel 97.9
Person 96.7
Person 96
Person 95.9
Shorts 84.8
Crowd 84.5
Person 84.3
People 71.9
Face 70.9
Meal 65.3
Food 65.3
Sleeve 65
Female 64.6
Overcoat 61.7
Coat 61.7
Portrait 61.3
Photography 61.3
Photo 61.3
Suit 60.6
Audience 57

Clarifai
created on 2023-10-25

people 99.7
group 98.8
group together 98.5
many 97.3
man 97.3
administration 94.8
adult 94.5
leader 93.5
woman 92.7
child 92.4
crowd 90.3
music 88.7
education 86.3
audience 85
actor 83.9
monochrome 83
recreation 79
musician 77.4
wear 76.1
spectator 75.1

Imagga
created on 2022-01-09

people 32.3
man 30.2
person 28.7
male 27.7
senior 24.3
happy 23.2
smiling 21.7
adult 21.6
couple 20.9
teacher 20.3
child 18.8
nurse 17.5
men 17.2
together 16.6
elderly 16.3
family 16
women 15
love 15
portrait 14.9
happiness 14.1
patient 14.1
group 13.7
retired 13.6
home 13.5
husband 13.3
old 13.2
retirement 12.5
mature 12.1
cap 11.9
day 11.8
school 11.5
married 11.5
medical 11.5
indoors 11.4
smile 11.4
student 11.3
education 11.2
camera 11.1
casual 11
room 10.9
professional 10.7
human 10.5
mother 10.2
lifestyle 10.1
sibling 10
classroom 9.9
70s 9.8
health 9.7
wife 9.5
enjoying 9.5
sitting 9.4
headdress 9.3
two 9.3
blackboard 9.1
holding 9.1
team 8.9
outdoors 8.9
daughter 8.9
60s 8.8
educator 8.8
older 8.7
class 8.7
grandfather 8.6
clothing 8.5
togetherness 8.5
hand 8.3
hospital 8.3
emotion 8.3
fun 8.2
cheerful 8.1
looking 8
seniors 7.8
couples 7.8
youth 7.7
father 7.6
world 7.6
joy 7.5
spectator 7.5
friendship 7.5
shower cap 7.5
leisure 7.5
kin 7.4
care 7.4
indoor 7.3
girls 7.3
black 7.2
childhood 7.2
modern 7

Google
created on 2022-01-09

Photograph 94.2
Hat 82.6
Shorts 82.6
Adaptation 79.3
Sleeve 77
Font 76.7
T-shirt 75.3
Snapshot 74.3
Crew 73.7
Event 72.5
Photo caption 70.4
Vintage clothing 70.2
Monochrome photography 66.9
Monochrome 66.3
Stock photography 64.7
Team 64.3
History 64
Suit 62.2
Room 58.3
Uniform 58.2

Microsoft
created on 2022-01-09

person 99.2
text 97
clothing 96.5
man 94.9
human face 75.9
smile 66.1
crowd 0.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 83.8%
Calm 93.5%
Sad 4.9%
Happy 1%
Surprised 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 87%
Happy 97.4%
Surprised 1%
Calm 0.7%
Sad 0.5%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 45-51
Gender Female, 53.4%
Happy 96.9%
Surprised 1.5%
Calm 0.5%
Fear 0.4%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%
Sad 0.2%

AWS Rekognition

Age 27-37
Gender Female, 52.3%
Calm 90.3%
Happy 4.2%
Surprised 4.1%
Sad 0.4%
Disgusted 0.4%
Confused 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 84.6%
Happy 73.5%
Fear 10.8%
Sad 8.9%
Surprised 4.4%
Calm 0.8%
Confused 0.6%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Female, 93.3%
Happy 98.6%
Fear 0.5%
Sad 0.4%
Surprised 0.2%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Male, 81.5%
Calm 88.9%
Fear 3.7%
Happy 2.2%
Sad 1.8%
Surprised 1.7%
Disgusted 0.8%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Male, 98.2%
Calm 91.7%
Fear 7.3%
Happy 0.4%
Disgusted 0.3%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 94.8%
Calm 99.2%
Happy 0.3%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.7%
Person 99.5%
Person 99.5%
Person 99.4%
Person 96.7%
Person 96%
Person 95.9%
Person 84.3%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a group of men standing around a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This image appears to be a group of people gathered in a social or communal setting. The focus is on a woman at the center holding a dish or plate while engaging with those around her. The group consists of men and women dressed in casual attire, such as plaid shirts, short-sleeved tops, and skirts or pants. The individuals are interacting, with some smiling and others appearing engaged in conversation. The atmosphere suggests a sense of camaraderie or community event. The image itself is in a negative format, as evidenced by the reversed tones.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a negative photograph featuring a group of individuals gathered together. The setting appears social, with several people standing closely, possibly engaged in a group activity or conversation. There is a woman at the center wearing a checkered shirt and dungarees, who is holding a hat. The individuals seem to be informally dressed in shirts and casual wear, suggesting a relaxed or casual event. The background is dark, making the subjects in the foreground more prominent. The edges of the photograph include markings and numbering, typical of photographic processing in the past. The overall atmosphere seems to be one of camaraderie or shared enjoyment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of people gathered together, likely in some kind of community or social setting. The individuals appear to be engaged in an activity or event, with some people holding plates or other items. The image is in black and white, giving it a historical feel. The people seem to be smiling and interacting with one another, suggesting a sense of community and togetherness.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from an earlier era, showing a group of people gathered together and sharing a lighthearted moment. They're all smiling and appear to be in good spirits. The group includes several individuals wearing casual summer clothing - some in shorts, others in plaid shirts and light-colored pants. One person is wearing what appears to be overalls or an apron. The image has a very candid, natural feel to it, capturing a moment of genuine amusement or joy. The photo has the number "17327" written at the top and bottom, suggesting it may be from an archive or collection. The lighting and composition suggest this might be taken outdoors or in a covered area, as there appear to be vertical support beams or poles visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a group of people gathered around a woman. The woman is wearing a short-sleeved dress with a checkered patterned top and dark-colored bottom. She has blonde hair and is holding a small object in her hand.

The group of people surrounding the woman are all men, and they appear to be dressed in casual attire. Some of them are wearing plaid shirts, while others have on dark-colored shirts. They all seem to be engaged in conversation with the woman, who is standing in the center of the group.

In the background, there are several tall poles or flagpoles visible, but it's unclear what they are for. The overall atmosphere of the image suggests a social gathering or event, possibly a party or a meeting. The people in the photo appear to be relaxed and enjoying each other's company, with some of them smiling or laughing.

The image has a white border around it, with the number "17327" written in black at the top and bottom. This suggests that the image may have been taken for a specific purpose or project, but the exact context is unclear without more information.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a group of people gathered around a woman holding a bowl. The woman, positioned centrally in the image, is dressed in a checkered shirt and dark overalls. She holds a dark-colored bowl in her hands, which appears to be the focal point of the gathering.

To her left stands a man wearing a dark shirt, who is reaching out to touch the bowl. On her right side, another man is visible, although his features are not clearly defined due to the image's quality. The background of the image is filled with additional people, all of whom are facing towards the woman and the bowl.

The overall atmosphere of the image suggests that the group has assembled for a specific purpose or event, possibly related to food or a communal activity. However, without more context, it is difficult to determine the exact nature of the gathering.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph with a vintage feel. It depicts a group of people gathered in a semi-circle, possibly at an event or social gathering. The individuals are smiling and appear to be engaged in conversation. The woman in the center, wearing an apron, holds a bowl and seems to be offering something to the man on her left. The man on the right is holding a ladle, possibly scooping something from the bowl. The photograph has a slightly blurry effect, adding to its nostalgic charm. The image also features a watermark with the number "17327" in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of a group of people standing together. The people are smiling, and they seem to be having a good time. The group is composed of both men and women, and they are all dressed casually. The man in the center is holding a bowl, and he seems to be pouring something into it. The woman next to him is wearing an apron and holding a ladle. The image has a vintage look, and it appears to have been taken in the past.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Scene:

The image appears to be a negative, resulting in a reverse color scheme. A group of people, mostly men, are gathered together outdoors. They seem to be in a celebratory or social setting.

Key Elements and Observations:

  • People: There are many people in the photo, with the majority being men. One woman is prominently featured. They are all dressed in casual clothing typical of the mid-20th century, like short sleeve shirts, overalls. Many are smiling and appear to be interacting with each other.
  • Interaction: The central focus seems to be on an interaction taking place. One man is handing something to a young woman who is holding a hat
  • Context: The presence of people dressed in casual attire, their smiling faces, and the object being handed off to the woman suggests a social event or celebration.
  • Composition: The picture is well-composed, with the figures arranged in a way that directs the viewer's attention to the central interaction.

Other details:

  • There is text on the top and bottom of the image, which may indicate a catalog number or identifying information.
  • The photo has a vintage quality that suggests it was taken decades ago.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image is a black and white photograph of a group of people gathered together. The photo seems to be an inverted negative, giving it an unusual look. The people are dressed in what appears to be summer attire, with a mix of short-sleeved shirts, trousers, and some in shorts. One person, a young woman, is wearing overalls and holding a hat. They all seem to be looking in the same general direction, possibly at something happening out of frame, and many of them are smiling. The setting looks like it could be outdoors, based on the presence of vertical elements in the background that might be masts or poles. The number "17327" is written on the top and bottom of the photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image appears to be a black-and-white photograph of a group of people gathered together, likely at a social event or celebration. The group consists of both men and women, and they seem to be in a jovial mood, with many of them smiling and laughing. The people are dressed in casual attire, such as shorts, short-sleeved shirts, and light jackets, suggesting a warm or temperate climate.

In the center of the image, a woman is holding a large bowl, possibly containing food, and is interacting with a man who seems to be receiving something from the bowl. The people around them are watching this interaction, and their expressions suggest they are enjoying the moment. The background is somewhat blurred, but it appears to be an outdoor setting, possibly a patio or a deck, with some structures and trees visible.

The photograph has a vintage feel, indicated by the clothing styles and the quality of the image. There are also some numbers and text visible on the borders of the photo, which might be related to archiving or cataloging the image.

Text analysis

Amazon

17327.
KODAK

Google

17327. 11327.
17327.
11327.