Human Generated Data

Title

Untitled (barbecue for the American Institute of Baking)

Date

1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8888

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (barbecue for the American Institute of Baking)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8888

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.6
Human 99.6
Person 98.5
Shorts 98.3
Clothing 98.3
Apparel 98.3
Person 97.9
Meal 97.8
Food 97.8
Person 97.3
Person 95.7
Person 93.8
Person 91
Outdoors 87.8
Plant 84.3
Nature 83
Tree 81.6
Person 79.5
Person 78.1
People 74.8
Grass 72.4
Person 70.8
Dish 69.1
Female 67.2
Face 67
Picnic 66.7
Vacation 66.7
Leisure Activities 66.7
Furniture 56.8

Clarifai
created on 2023-10-26

people 99.8
adult 98
man 97
group together 96.9
group 96.1
many 96
monochrome 95.8
war 94
military 93.2
flame 92.7
street 92.5
woman 91.1
wear 90.5
smoke 90.3
vehicle 89.8
tent 88.7
furniture 87.6
home 87.2
two 87.1
campsite 86.6

Imagga
created on 2022-01-15

sky 23.6
landscape 23
cloud 17.2
smoke 16.7
industrial 16.3
old 16
danger 15.5
device 15.1
scene 14.7
bench 14.2
man 14.1
environment 13.2
outdoor 13
winter 12.8
weapon 12.7
travel 12.7
dirty 12.6
factory 12.6
vehicle 12.4
sax 12.3
scenic 12.3
gun 12.2
water 12
industry 11.9
snow 11.8
steam 11.6
tree 11.5
park 11.5
outdoors 11.3
summer 10.9
protection 10.9
scenery 10.8
black 10.8
destruction 10.7
building 10.7
toxic 10.7
male 10.6
chemical 10.6
weaponry 10.4
clouds 10.1
power 10.1
people 10
structure 10
person 9.9
vintage 9.9
mask 9.6
dark 9.2
vacation 9
river 8.9
nuclear 8.7
forest 8.7
pollution 8.6
armament 8.6
architecture 8.6
dangerous 8.6
artillery 8.5
grunge 8.5
adult 8.4
tourism 8.2
rifle 8.2
retro 8.2
tourist 8.2
conveyance 8.1
light 8
lifestyle 7.9
rural 7.9
work 7.8
machine 7.8
billboard 7.8
season 7.8
protective 7.8
antique 7.8
space 7.8
field artillery 7.7
field 7.5
cloudy 7.5
natural 7.4
countryside 7.3
grass 7.1
trees 7.1
day 7.1
paper 7.1
torpedo 7

Google
created on 2022-01-15

Black 89.6
Organism 86.7
Black-and-white 85.2
Style 83.8
Adaptation 79.3
Font 79
Rectangle 78.8
Art 78.7
Tints and shades 77.3
Plant 76.3
Chair 76
Monochrome photography 75.6
Table 75.3
Monochrome 72.7
Vintage clothing 71.2
Room 70.9
Classic 65.1
Tree 64.6
Sitting 64.1
Visual arts 64

Microsoft
created on 2022-01-15

table 94.2
text 93.2
furniture 92
black and white 91.8
chair 73.8
monochrome 62.8
house 54.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 64.3%
Calm 99.9%
Happy 0%
Sad 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 94%
Calm 99.8%
Sad 0.1%
Surprised 0%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 91.4%
Sad 45.1%
Calm 39.6%
Happy 6.6%
Fear 5.4%
Disgusted 1.3%
Angry 1%
Surprised 0.7%
Confused 0.4%

AWS Rekognition

Age 30-40
Gender Male, 95.5%
Calm 56.1%
Happy 16.2%
Surprised 6.3%
Fear 5.7%
Disgusted 5.4%
Sad 4.4%
Angry 4.1%
Confused 1.7%

AWS Rekognition

Age 24-34
Gender Male, 99.5%
Happy 90.9%
Sad 3.6%
Calm 1.8%
Confused 1.5%
Disgusted 0.9%
Fear 0.6%
Surprised 0.5%
Angry 0.3%

AWS Rekognition

Age 21-29
Gender Male, 74.4%
Sad 71.1%
Calm 18.2%
Confused 4.3%
Fear 2.4%
Happy 1.4%
Angry 1.2%
Disgusted 0.8%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%
Person 98.5%
Person 97.9%
Person 97.3%
Person 95.7%
Person 93.8%
Person 91%
Person 79.5%
Person 78.1%
Person 70.8%

Captions

Microsoft
created by unknown on 2022-01-15

text 60.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-05

a photograph of a man and a woman are standing in front of a table with a table cloth -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image appears to be a negative of a social gathering outdoors. A table covered with a cloth is set up in the foreground, topped with various dishes, bowls, and desserts, suggesting a meal or celebration. A man and a child are interacting near a structure resembling a stone well or a grill. In the background, a group of people is seated on chairs, possibly enjoying the event. The setting includes trees and a grassy area, indicating it takes place in a garden or park.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a negative photograph depicting a social gathering or picnic scene outdoors. In the foreground, there is a table covered with a cloth, upon which various dishes and food items are placed. To the left, a man in striped clothing is kneeling near a brick structure that resembles a wishing well, interacting with a child who is holding a plate. The gathering appears to be taking place in a grassy area with trees and foliage in the background. In the mid-ground, several people are seated in a semi-circle, suggesting a communal, relaxed atmosphere. The vegetation includes a mix of leafy trees and possibly palm-like plants, indicating a setting with diverse flora.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to depict an outdoor gathering or event. There is a table set up with various food items and dishes, suggesting a meal or refreshments being served. Several people can be seen seated around the table, seemingly engaged in conversation or enjoying the food. The background features lush vegetation, including palm trees, creating a tropical or garden-like setting. The overall scene conveys a sense of community and social interaction taking place in an outdoor, natural environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a vintage black and white photograph of an outdoor gathering or party. There's a covered serving area or buffet table set up with what looks like various dishes and plates of food laid out. Several people are gathered around the table, appearing to be serving or getting food. The setting seems to be in a yard or outdoor space with some foliage visible in the background. The image has a casual, informal feel typical of mid-20th century social gatherings. The lighting and contrast in the photo gives it a distinctive period look, and there's a number visible in the corner that might be a date or photo identification number (4-1211 4).

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of people gathered in a backyard setting, likely during a social event or celebration.

Key Elements:

  • Setting: The scene is set in a backyard, with a grassy area and trees visible in the background.
  • Table and Food: A table is positioned in the foreground, covered with a dark-colored tablecloth. Various dishes and glasses are arranged on the table, suggesting a meal or snack is being served.
  • People: Several individuals are seated around the table, while others stand nearby. They appear to be engaged in conversation and enjoying each other's company.
  • Atmosphere: The overall atmosphere of the image conveys a sense of warmth and camaraderie among the group.

Summary:

The image captures a joyful moment of social interaction and community bonding, with the group gathered around the table and enjoying each other's company in a relaxed outdoor setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image depicts a black-and-white photograph of a backyard barbecue scene. The central focus is a table covered with a dark tablecloth, adorned with various dishes and plates. A man, dressed in shorts and a striped shirt, is seen serving food from a grill situated to the left of the table. On the right side of the table, a woman stands, wearing a dress and an apron.

In the background, several individuals are seated on benches, while trees and bushes surround the area. The overall atmosphere suggests a casual outdoor gathering or celebration.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

A black-and-white photo shows a group of people gathered around a table and a grill, possibly for a barbecue party. The man on the left is wearing slippers and is leaning over the grill. The woman on the right is wearing a necklace and is standing next to a table covered with a tablecloth. There are several people sitting on chairs behind them. The area is surrounded by trees.

Created by amazon.nova-lite-v1:0 on 2025-05-30

The image is a black-and-white photograph depicting a family gathering or picnic in a backyard. The setting is outdoors, with a table covered in a dark cloth and laden with various food items. A woman stands near the table, possibly overseeing the meal preparations or serving food. A man is seen stepping onto a brick structure, possibly a barbecue grill or a makeshift oven, to cook food. Several people are seated on the grass around the table, enjoying the meal. The image conveys a sense of togetherness and family bonding during a casual outdoor gathering.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

The image is a black and white, negative photograph capturing a group of people gathered for what appears to be a picnic or outdoor meal.

Here's a breakdown of the scene:

  • Foreground: A man, presumably the host or cook, is seen in the foreground. He's positioned near what looks like a well-shaped structure. He is interacting with the well and appears to be serving food on a plate. A young girl is standing next to the man. A large table laden with food and drinks dominates the center. The table is covered with a dark cloth and holds dishes, plates, and various food items.
  • Midground: Several people are seated on a bench or chairs, seemingly enjoying the gathering. They are positioned behind the table.
  • Background: A lush, possibly wooded, area forms the backdrop, adding depth to the scene.
  • Overall Impression: The photograph exudes a sense of a relaxed, social gathering, potentially a family picnic or a community event. The composition suggests a casual, intimate moment captured in time. The style of the photograph and clothing worn by the people suggests the image was taken some time ago.

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

This is a black and white negative of a photograph depicting a group of people gathered for what appears to be an outdoor meal or gathering.

In the foreground, a man is leaning over what looks like a well. He's wearing a collared shirt and shorts. Beside him, a child is holding a plate, possibly receiving food from the man.

Behind them, there is a table spread with a variety of dishes. Several people are seated on a bench in the background, watching or conversing. A woman is standing near the table, possibly serving or supervising the arrangement.

The setting seems to be a backyard or garden area, with trees and foliage visible in the background. The overall atmosphere suggests a relaxed, communal event.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a group of people gathered outdoors for a social event, likely a barbecue or picnic. The setting appears to be a backyard or garden with lush greenery and trees in the background.

Key details include:

  1. Foreground:

    • A man in a striped shirt is seated on a brick structure, possibly a barbecue grill, and appears to be cooking or preparing food.
    • A woman standing next to him is holding a plate of food.
    • A table covered with a dark tablecloth is laden with various dishes, bowls, and utensils.
  2. Background:

    • Several people are seated on a bench or chairs, engaged in conversation and enjoying the meal.
    • The background includes a garden with various plants and trees, and a structure with a slanted roof, possibly a shed or a small pavilion.
    • The atmosphere seems relaxed and convivial, typical of a casual outdoor gathering.
  3. Additional Notes:

    • The photograph is in black and white, giving it a vintage feel.
    • The image has a number "41211 4" written at the bottom, which might be a reference or catalog number.

Overall, the image captures a moment of social interaction and enjoyment in a pleasant outdoor setting.

Text analysis

Amazon

41211
VAGOY
04
VT774°2

Google

41211
41211