Human Generated Data

Title

Untitled (people gathered in a circle singing at a luau on City Island)

Date

c. 1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10477

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people gathered in a circle singing at a luau on City Island)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10477

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.5
Musical Instrument 91.1
Animal 90.5
Mammal 90.5
Accordion 88.7
Musician 65.9
Portrait 61.8
Photography 61.8
Face 61.8
Photo 61.8
Music Band 58.5

Clarifai
created on 2023-10-25

people 99.9
music 99.6
group 99.2
musician 98.7
adult 98.3
woman 98
accordion 97.9
instrument 96.7
man 96.7
many 96.6
group together 93.6
wear 92.1
guitar 90.5
crowd 90.2
child 89.3
street 86.3
band 85.7
administration 84.8
drum 83.7
leader 83.5

Imagga
created on 2022-01-09

accordion 100
keyboard instrument 100
wind instrument 100
musical instrument 100
man 29.5
people 24
male 22.7
concertina 17.7
person 15.8
adult 15
old 14.6
free-reed instrument 14.2
men 13.7
music 12.7
silhouette 12.4
art 12.4
portrait 12.3
couple 12.2
musician 11.8
black 10.8
musical 10.5
senior 10.3
retro 9.8
style 9.6
together 9.6
sitting 9.4
lifestyle 9.4
instrument 9.3
face 9.2
vintage 9.1
religion 9
retirement 8.6
play 8.6
statue 8.6
culture 8.5
youth 8.5
hand 8.3
playing 8.2
group 8.1
indoors 7.9
love 7.9
boy 7.8
two 7.6
studio 7.6
player 7.5
happy 7.5
traditional 7.5
monument 7.5
room 7.3
aged 7.2
history 7.1
family 7.1

Google
created on 2022-01-09

Hat 89.8
Art 76.4
Monochrome 75.6
Sun hat 75.6
Monochrome photography 74.8
Snapshot 74.3
Crowd 72.4
Event 71.4
Crew 70.5
Room 70
Vintage clothing 67.6
Stock photography 65.1
History 64.5
Visual arts 63
Team 61.9
Suit 60.8
Illustration 57.5
Font 54.2
Painting 52.3
Photography 51.7

Microsoft
created on 2022-01-09

person 98.8
text 98.5
black and white 90.4
people 67.6
group 65.8
man 64.5
clothing 53.5
crowd 1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Surprised 36.3%
Calm 19.9%
Confused 19.9%
Happy 9.2%
Disgusted 8.6%
Sad 3%
Angry 2.3%
Fear 0.9%

AWS Rekognition

Age 38-46
Gender Female, 71%
Calm 99.3%
Sad 0.3%
Happy 0.2%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 26-36
Gender Female, 57.8%
Calm 91%
Sad 5.4%
Confused 1%
Happy 0.7%
Surprised 0.5%
Angry 0.5%
Fear 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Horse

Clarifai

Man
Human face
Woman
Clothing
Footwear
Human hair

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 96.3%

AWS Rekognition

Person 95.4%

AWS Rekognition

Person 94.6%

AWS Rekognition

Person 88.7%

AWS Rekognition

Person 75.2%

AWS Rekognition

Person 63.4%

AWS Rekognition

Person 55.8%

AWS Rekognition

Person 44.9%

AWS Rekognition

Horse 90.5%

Clarifai

Man 85.6%

Clarifai

Man 74.3%

Clarifai

Man 56.4%

Clarifai

Man 53%

Clarifai

Man 50.3%

Clarifai

Man 36.8%

Clarifai

Human face 82.1%

Clarifai

Human face 80.5%

Clarifai

Human face 79.2%

Clarifai

Human face 77.5%

Clarifai

Human face 75.5%

Clarifai

Human face 68.1%

Clarifai

Human face 46.8%

Clarifai

Human face 41.7%

Clarifai

Human face 33.9%

Clarifai

Woman 77.4%

Clarifai

Woman 74.4%

Clarifai

Woman 66.4%

Clarifai

Woman 46.8%

Clarifai

Woman 44.9%

Clarifai

Woman 40.1%

Clarifai

Woman 39.2%

Clarifai

Woman 35.7%

Clarifai

Clothing 72.3%

Clarifai

Clothing 66.8%

Clarifai

Clothing 66.3%

Clarifai

Clothing 64.3%

Clarifai

Clothing 64%

Clarifai

Clothing 47.3%

Clarifai

Clothing 43.8%

Clarifai

Clothing 35%

Clarifai

Footwear 36.2%

Clarifai

Footwear 34.2%

Clarifai

Human hair 35.9%

Categories

Imagga
created on 2022-01-09

paintings art 78.8%
interior objects 15.8%
streetview architecture 1.7%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of a group of people sitting around a table.

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people are gathered around a group of accordions

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image appears to be a reversed negative of a social gathering outdoors. A group of people is seated on the ground, some holding cups, while one individual plays an accordion. The scene also includes a person dressed in attire featuring leis and a hat, suggesting a festive or tropical setting. In the background, additional people are visible, including individuals near trees and others standing or engaging in activities. Various objects, such as picnic supplies, can be seen scattered throughout the scene. The atmosphere seems casual and communal.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a photographic negative depicting a group of people sitting in a circle on the ground, likely enjoying a social gathering or picnic outdoors. One person is playing an accordion, contributing to the festive atmosphere. The individuals are dressed in casual summer attire, including dresses and leis, suggesting a warm climate and possibly a themed event. In the background, other people are standing or moving around, with some dressed in swimsuits, indicating a relaxed, leisure-oriented setting. The scene is taking place under trees, providing shade to the gathering, with picnic items such as baskets or containers scattered around.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to depict a group of people gathered in an outdoor setting, possibly a festival or celebration. The individuals are dressed in various costumes and attire, suggesting a theatrical or artistic performance. In the center of the image, a person is playing an accordion, surrounded by other performers and spectators. The overall scene has a surreal and dreamlike quality, with a sense of whimsy and imagination.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from a historical setting, possibly the 1940s or 1950s. The image shows a group of people gathered in a circle, with one person playing an accordion. There's someone wearing a wide-brimmed hat who appears to be leading or central to the gathering. The photo has an informal, social feel to it, like a casual outdoor gathering or party. The lighting creates interesting contrasts in the image, with what appears to be bright sunlight creating strong shadows. The group appears to be sitting on the ground, and there are some structures or objects visible in the background. The overall composition suggests this might be some kind of recreational or social activity, possibly with music and entertainment being part of the gathering.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people gathered in a circle on the beach. The group consists of both men and women, all dressed in clothing typical of the 1920s or 1930s, including swimsuits, dresses, and hats. They are seated on blankets or towels on the sand, with some holding drinks or other items.

In the center of the circle, a man is playing an accordion, adding to the lively atmosphere. The background of the image shows other people in swimsuits, as well as a few trees and what appears to be a brick structure. The overall mood of the image is one of joy and celebration, capturing a moment of socializing and entertainment on the beach.

The image has a handwritten number "44545" at the bottom, which may be a reference number or identifier for the photograph. The image is also stamped with the words "NEW YORK CITY - SOAFETY - 1937," indicating that it was taken in New York City in 1937.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This black-and-white photograph captures a lively outdoor gathering of people, with a central focus on a man playing an accordion. The scene is set in a grassy area, where individuals are seated in a circle, engaged in conversation and enjoying each other's company. The atmosphere appears relaxed and joyful, with some people holding drinks and others simply socializing.

In the background, additional figures can be seen standing or walking around, adding to the sense of a casual outdoor event. The overall mood of the image is one of camaraderie and celebration, with the accordion player at the center of the action.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of a group of people gathered in a circle. The people are dressed in various outfits, including hats, necklaces, and bracelets. Some of them are holding cups, and one person is playing an accordion. The background of the image is blurry, with people standing and sitting in the distance. The photo has a watermark with the text "445 45" in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white photo shows a group of people sitting on the ground in a circle. Some of them are wearing hats and necklaces. A man is playing an accordion. There are blurry images of people in the background. The photo has a watermark that reads "44545" at the bottom. The photo seems to have been taken in the 1940s or 1950s.

Google Gemini

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

The image appears to be a black and white negative of a scene depicting a gathering or party. A group of people are seated in a circle on the ground. Most of them are wearing leis, traditional Hawaiian garlands of flowers or leaves, around their necks. In the center of the group, a man is playing an accordion. He is also wearing a lei.

Behind the seated group, there are other people standing and walking around. One woman is wearing a floral dress and appears to be walking away. In the background, there is also a brick structure that could be a barbecue or some other type of outdoor cooking facility.

The overall setting seems to be a park or outdoor area, with trees visible in the background. The presence of leis and the general atmosphere suggests a celebration or social event, possibly with a Hawaiian theme.

Created by gemini-2.0-flash-lite on 2025-05-02

This black and white image is a candid shot of a gathering, likely an outdoor party. In the center, a group of people are seated on the ground in a circle. One individual in the circle is playing an accordion. Other figures are casually interacting, some with leis around their necks. In the background, several other figures are present, some appear to be standing, others possibly dancing or socializing near what appears to be a makeshift bar. The overall atmosphere suggests a relaxed, festive occasion.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image appears to be a black-and-white photograph capturing a lively outdoor gathering. It features a group of people sitting in a circle on the ground, engaging in what seems to be a social or musical event. The individuals are dressed in casual attire, with some wearing hats and others in light clothing suitable for warm weather.

In the center of the circle, one person is playing an accordion, suggesting that music is a central part of the gathering. The people around the musician seem to be enjoying the performance, with some looking directly at the musician and others engaged in conversation.

In the background, there are more people, some of whom appear to be dancing or moving around, adding to the festive atmosphere. The setting looks like an open field or a park, with tents and other structures visible in the distance, indicating that this might be part of a larger event or festival.

The overall mood of the image is one of camaraderie and enjoyment, with people coming together to share a moment of leisure and entertainment.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

This image appears to be a black and white photograph capturing a lively outdoor gathering. In the foreground, several individuals are seated on the ground, engaged in conversation and enjoying each other's company. The attire of the people suggests a festive or relaxed event, possibly a party or a casual get-together. One person is playing an accordion, indicating live music is part of the event. In the background, there are additional people, some appearing to be in motion or dancing, contributing to the energetic atmosphere. The setting looks like a grassy area, possibly a park or a field, and the overall mood of the image is cheerful and social. The vintage quality of the photo and the clothing styles suggest it may have been taken in the mid-20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white image depicts a lively outdoor gathering, likely a beach or picnic scene. A group of people is sitting on the ground in a circle, enjoying each other's company. In the center, a man is playing an accordion, and another man wearing a hat appears to be singing or engaging with the group. The individuals are dressed in casual, summery attire, with some wearing hats and necklaces. In the background, there are blurred figures, possibly dancing or moving around, and some structures that look like a small stone wall or building. The overall atmosphere is festive and relaxed.

Text analysis

Amazon

44545
MJ17--YT3RA--X