Human Generated Data

Title

Untitled (woman holding up tea kettle surrounded by other women and gifts)

Date

1958

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4652

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman holding up tea kettle surrounded by other women and gifts)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4652

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Chair 99.6
Furniture 99.6
Human 99.4
Meal 93.9
Food 93.9
Face 92.9
Clothing 92.5
Apparel 92.5
Accessories 88.5
Accessory 88.5
Tablecloth 87.5
Crowd 83.5
Restaurant 82.8
People 81.2
Dish 79.9
Table 78.3
Indoors 77
Female 73.5
Portrait 73.5
Photography 73.5
Photo 73.5
Dining Table 72.3
Home Decor 71.4
Dress 68.8
Room 67.8
Shorts 67.5
Kid 65.6
Child 65.6
Man 64.2
Girl 63.2
Outdoors 62.3
Audience 62.3
Leisure Activities 60.3
Smile 59.5
Woman 58.5
Suit 57.6
Coat 57.6
Overcoat 57.6
Sitting 56.8
Linen 56.5
Party 55.9

Clarifai
created on 2023-10-15

people 99.8
group 99.1
child 98.3
man 96.8
many 96.2
group together 95.3
crowd 94.4
woman 92.8
boy 92.2
adult 91.1
education 91
war 90.1
school 89.7
music 88.5
administration 87.2
dancing 84.7
adolescent 84
sit 82.4
recreation 81.6
audience 77.6

Imagga
created on 2021-12-14

business 24.3
male 22.7
man 19
newspaper 17.7
drawing 17.6
people 17.3
person 17
grunge 17
silhouette 16.5
chart 16.2
businessman 15.9
negative 15.8
product 14.6
office 14.5
plan 14.2
creation 13.9
classroom 13.8
design 13.5
team 13.4
work 13.4
diagram 13.4
old 13.2
room 12.9
sign 12.8
technology 12.6
paper 12.6
film 12.3
education 12.1
construction 12
finance 11.8
vintage 11.6
retro 11.5
sketch 11.3
success 11.3
human 11.2
manager 11.2
art 11
symbol 10.8
building 10.6
gymnasium 10.5
group 10.5
men 10.3
architecture 10.2
financial 9.8
idea 9.8
black 9.6
blackboard 9.4
adult 9.4
youth 9.4
student 9.3
professional 9.1
hand 9.1
modern 9.1
aged 9
sky 8.9
computer 8.9
growth 8.8
teaching 8.8
boy 8.7
play 8.6
writing 8.5
athletic facility 8.4
portrait 8.4
power 8.4
graphic 8
looking 8
photographic paper 8
women 7.9
urban 7.9
child 7.8
graph 7.7
money 7.7
city 7.5
dollar 7.4
sport 7.4
letter 7.3
facility 7.3
currency 7.2
teacher 7.1
job 7.1

Google
created on 2021-12-14

Black-and-white 84.2
Style 83.9
Font 82.5
Shorts 80.3
Adaptation 79.4
Hat 77.2
Monochrome photography 74.2
Monochrome 72.9
Chair 72.8
Event 72.2
Art 72.1
Crew 67.8
Visual arts 64.5
Room 64.5
Stock photography 63.3
T-shirt 62.6
Team 60.4
Sitting 60.2
Photo caption 58.6
History 57.8

Microsoft
created on 2021-12-14

text 98.9
drawing 92.1
person 90.8
clothing 86.6
man 80.2
window 80.2
black and white 79.8
sketch 79.2
cartoon 78.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-32
Gender Male, 67.6%
Calm 82.1%
Surprised 14.4%
Confused 1.4%
Happy 1.2%
Sad 0.5%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 26-42
Gender Female, 73.4%
Happy 56.4%
Calm 25.6%
Sad 10.9%
Surprised 2.8%
Fear 2.5%
Confused 1%
Angry 0.7%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 53.5%
Calm 95.9%
Sad 2.7%
Happy 1.3%
Angry 0.1%
Surprised 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Female, 96.3%
Happy 50.2%
Calm 21.7%
Sad 13.6%
Confused 6.4%
Angry 4.5%
Surprised 2.6%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Male, 65.3%
Calm 61.8%
Angry 13.1%
Sad 10.5%
Surprised 8.6%
Happy 3.4%
Confused 1.9%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 21-33
Gender Male, 76.3%
Calm 44.3%
Sad 38.6%
Happy 9.8%
Angry 4.4%
Confused 1.8%
Fear 0.4%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 45-63
Gender Female, 78%
Calm 88.7%
Sad 9.9%
Surprised 0.5%
Confused 0.2%
Happy 0.2%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Female, 59.6%
Sad 46.7%
Calm 39.4%
Happy 6.7%
Angry 2.8%
Fear 2.5%
Confused 0.8%
Surprised 0.7%
Disgusted 0.3%

AWS Rekognition

Age 30-46
Gender Female, 71.4%
Sad 66.2%
Calm 14.3%
Happy 8.4%
Angry 6.4%
Confused 2.5%
Fear 1%
Disgusted 0.8%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses

Clarifai

No features identified

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 94.7%

AWS Rekognition

Person 87.6%

AWS Rekognition

Person 82.6%

AWS Rekognition

Person 81.7%

AWS Rekognition

Person 81.6%

AWS Rekognition

Person 70.1%

AWS Rekognition

Sunglasses 88.5%

Categories

Imagga
created on 2021-12-14

paintings art 80.1%
people portraits 19%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This is a black-and-white, inverted negative image depicting a group of people gathered around a table with various items on display, including wrapped gifts and objects. The setting appears to be indoors, possibly at an event or gathering. Several attendees are interacting with each other and engaging with the items on the table while dressed in formal or semi-formal attire.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image appears to be a negative photograph showing a group of people gathered in a festive setting. In the foreground, there are several gift-wrapped boxes, suggesting a celebration or gathering where presents are involved. The individuals are wearing mid-20th-century attire, with some women in dresses and hairstyles typical of that era. One person in the center is holding a wrapped gift or possibly a food item. The group collectively appears to be participating in a social event, possibly a party or a gathering for a special occasion.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting a group of people gathered together in what seems to be a celebration or party setting. There are several individuals visible, some of whom are holding what appears to be a cake or other celebratory item. The people in the image are dressed in a variety of styles, suggesting it may be a diverse group. The overall scene conveys a sense of joy and togetherness.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a vintage black and white photograph, likely from the 1950s or 1960s, showing what appears to be a cooking or baking class or demonstration. Several people are gathered around what looks like a table or counter, and someone in the center is holding what appears to be a covered dish or pan. The people in the image are wearing typical 1950s-style clothing, including checkered and striped patterns, and several are wearing aprons. The image has a bright, overexposed quality typical of flash photography from that era. The setting appears to be indoors, possibly in a classroom or community center kitchen setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a group of people gathered around a table, likely at a party or celebration. The image is heavily overexposed, making it difficult to discern details, but some features are still visible.

Key Features:

  • Group of People: A large group of people, mostly women, are standing around a table. They are dressed in various outfits, with some wearing dresses and others wearing aprons.
  • Table: The table is covered with a tablecloth and has several items on it, including what appears to be a cake or other baked goods.
  • Cake: In the foreground, there is a cake or other baked good on the table. It is unclear what type of dessert it is, but it appears to be decorated with frosting and other toppings.
  • Background: The background of the image is blurry, but it appears to be a room with windows and possibly a doorway. There are also some people standing in the background, but they are not clearly visible due to the overexposure.

Overall:

The image suggests that the group of people are celebrating a special occasion, possibly a birthday or anniversary. The presence of a cake and other baked goods on the table supports this interpretation. However, without more information, it is difficult to determine the exact nature of the event or the significance of the image.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black-and-white photograph of a group of women gathered around a table, with one woman holding a cake. The women are dressed in various outfits, including dresses and aprons, and some are wearing hats or headscarves. The table is covered with a variety of items, including boxes, bags, and what appears to be a cake stand.

The atmosphere of the image suggests that the women are celebrating a special occasion, possibly a birthday or anniversary. The presence of the cake and the festive attire of the women support this interpretation. However, without more context, it is difficult to determine the exact nature of the celebration.

Overall, the image provides a glimpse into a joyful and celebratory moment in the lives of these women, and invites the viewer to imagine the story behind the scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image shows a black-and-white photograph of a group of people gathered in a room. Some of them are wearing white wigs and face paint, and they appear to be participating in some kind of event or activity. One person in the center of the image is holding a silver bowl, and there are several other people standing around them. The image has a blurry effect, and there is a watermark in the bottom left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white photo shows a group of people gathered in a room. Some of them are standing, while others are sitting. They are wearing costumes, some of them are wearing wigs, and some are wearing eyeglasses. A person in the center is holding a teapot and a flower. There are several objects on the table, including a box, a bottle, and a cup.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

This is a black and white negative of a gathering. There's a clear focus on a group of people, likely women, in what appears to be a social or celebratory setting. The image is a bit faded, giving it a vintage feel.

Key Elements and Details:

  • The Group: A cluster of people are the central focus. They are dressed in what seems to be casual or semi-formal attire, with dresses and perhaps aprons. The subjects seem to be primarily women with the occasional man.
  • The Activities: The woman in the plaid shirt is holding what appears to be a cake with a lid. The people are gathered around a table full of gifts, packages, and some food, suggesting it is a party, shower, or celebratory event.
  • The Setting: The event is taking place indoors, but it's difficult to tell exactly where. The background fades into the white, which does not help determine where it is.
  • Other Details: There are other people in the background, likely also guests at the gathering. The overall feel is joyful.

In essence, the photo captures a moment of community and celebration, frozen in time. The faded look adds to the nostalgic feel.

Created by gemini-2.0-flash on 2025-05-16

Here's a description of the image:

The image appears to be a black-and-white negative of a photograph, possibly from the mid-20th century, showing a group of people gathered indoors, likely at a party or gathering.

There are a number of people visible, mostly women, who appear to be looking in various directions. Some are standing behind tables laden with items that could be gifts or food. One individual holds up a pot or container with what looks like flowers attached to it. The clothing styles suggest the period. Some women are wearing dresses or blouses with bows and patterns, and some have their hair styled in bouffants.

In the foreground, there are wrapped gifts, suggesting a celebration like a birthday or wedding shower. The general atmosphere is one of community and celebration.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph depicting a group of individuals in what appears to be a festive or theatrical setting. The people in the image are dressed in various costumes and accessories, suggesting they might be part of a performance, play, or celebration.

Here are some detailed observations:

  1. Costumes and Attire:

    • The individuals are wearing a mix of clothing styles, including dresses, aprons, and headscarves. Some are dressed in more traditional or period attire, while others have more casual or modern clothing.
    • One person is wearing a checkered apron and holding a bouquet of flowers.
    • Another individual is wearing a striped dress and headscarf.
    • A few people have their faces painted or covered, possibly with masks or makeup.
  2. Setting:

    • The background is somewhat blurred, but it appears to be an indoor setting, possibly a stage or a large room.
    • There are various props and decorations scattered around, including what looks like a chair, a table, and some fabric or textiles.
  3. Poses and Expressions:

    • The individuals are posed in a way that suggests they are performing or participating in a staged event.
    • Some are smiling, while others have more neutral or serious expressions.
    • The group is arranged in a semi-circle, with some people standing and others sitting or kneeling.
  4. Overall Atmosphere:

    • The image conveys a sense of camaraderie and celebration, with the group appearing to be engaged in a shared activity or performance.
    • The black-and-white nature of the photograph gives it a vintage or historical feel.

This photograph likely captures a moment from a theatrical performance, a cultural event, or a community gathering, showcasing the participants in their costumes and roles.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-30

This image is a black and white photograph depicting a group of people gathered in what appears to be a festive or celebratory setting. The individuals are dressed in attire that suggests a past era, possibly the mid-20th century. They are standing around a table piled high with wrapped gifts, and one person is holding a decorated cake, indicating a party or a gift-giving event. The people are smiling and seem to be enjoying themselves. The background shows more people and additional decorations, reinforcing the idea of a lively and joyful gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-30

This black-and-white image depicts a lively scene of a group of people gathered around a table filled with gift boxes. The individuals appear to be women, dressed in mid-20th century fashion, including dresses, skirts, and hats. One woman in the center is holding a cake with a decorative flower, and she seems to be the focus of the attention. The background shows more people standing and observing the scene, with some smiling and others engaged in conversation. The atmosphere suggests a celebratory occasion, possibly a bridal shower or a similar event. The image has a vintage feel, with the lighting and shadows adding to its nostalgic quality.

Text analysis

Amazon

25200
KODVK--80