Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.945

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.945

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 100
Building 100
Dining Room 100
Dining Table 100
Furniture 100
Indoors 100
Room 100
Table 100
Food 100
Meal 100
Restaurant 98.7
Cafeteria 97.8
Dish 97.5
Beverage 90.1
Coffee 90.1
Face 87.9
Head 87.9
Lunch 80.5
People 67.7
Dinner 66.6
Bowl 57.8
Eating 56.8
Cutlery 56.7
Spoon 56.7
Food Court 56.4
Kitchen 55.5
Stew 55.4
Tabletop 55

Clarifai
created on 2018-05-11

people 100
group 99.6
group together 99.5
several 98.6
four 97.8
adult 97.2
man 96.9
sit 96.4
many 95.8
military 95.7
five 95
furniture 94.1
woman 94.1
war 94
administration 92.1
room 89.2
uniform 87.9
wear 85.5
recreation 85.2
three 85.1

Imagga
created on 2023-10-06

man 36.3
people 33.5
adult 32.1
table 31.3
male 30.6
person 26.8
sitting 24.9
business 23.1
businessman 22.9
office 21.3
indoors 21.1
couple 20.9
home 20.7
meeting 19.8
men 19.7
team 18.8
happy 18.2
professional 18
women 17.4
smiling 17.4
group 16.9
working 16.8
together 16.6
work 16.6
businesswoman 16.4
smile 15.7
desk 15.3
businesspeople 15.2
job 15
mature 14.9
30s 14.4
looking 14.4
executive 14.2
adults 14.2
friends 14.1
senior 14.1
discussion 13.6
child 13.5
teamwork 13
corporate 12.9
restaurant 12.9
suit 12.8
classroom 12.4
talking 12.4
student 12.2
laptop 12.2
clothing 12.1
indoor 11.9
drink 11.7
lifestyle 11.6
beverage 11
holding 10.7
40s 10.7
family 10.7
education 10.4
worker 10.3
manager 10.2
glasses 10.2
two 10.2
teacher 10.1
children 10
color 10
students 9.7
colleagues 9.7
room 9.7
success 9.7
workplace 9.5
paper 9.4
learning 9.4
casual 9.3
emotion 9.2
pen 9.2
20s 9.2
food 9.1
portrait 9.1
cheerful 8.9
kin 8.8
boy 8.7
daytime 8.7
love 8.7
studying 8.6
day 8.6
glass 8.6
happiness 8.6
staff 8.6
college 8.5
females 8.5
attractive 8.4
study 8.4
document 8.3
book 8.3
occupation 8.2
secretary 8.1
computer 8.1
dinner 8
kitchen 8
elementary age 7.9
discussing 7.9
couples 7.8
conference 7.8
having 7.7
books 7.7
partner 7.7
mid adult 7.7
dad 7.7
eating 7.6
friendship 7.5
coffee 7.4
cup 7.2
face 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.9
indoor 96.9
group 60.4
meal 27.7
dining table 9.7
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 29-39
Gender Female, 55.4%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Sad 99.6%
Calm 22.2%
Surprised 6.6%
Confused 6%
Fear 6%
Disgusted 2.4%
Angry 1.8%
Happy 0.3%

AWS Rekognition

Age 43-51
Gender Male, 99.5%
Calm 96.9%
Surprised 6.3%
Fear 5.9%
Sad 3%
Angry 0.3%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99%
Calm 61.3%
Happy 12.7%
Fear 9.4%
Sad 8.2%
Surprised 8.1%
Confused 2.4%
Disgusted 2%
Angry 1.1%

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Coffee Cup

Clarifai

Man
Human face
Clothing
Food
Table
Human hair
Tableware
Human nose
Human eye
Human mouth
Human hand
Drink

AWS Rekognition

Adult 99%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 98.2%

AWS Rekognition

Adult 97.5%

AWS Rekognition

Male 99%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 98.2%

AWS Rekognition

Male 97.5%

AWS Rekognition

Man 99%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 98.2%

AWS Rekognition

Man 97.5%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 59.4%

AWS Rekognition

Coffee Cup 90.1%

Clarifai

Man 94.3%

Clarifai

Man 93.4%

Clarifai

Man 84.9%

Clarifai

Human face 87.9%

Clarifai

Human face 83%

Clarifai

Human face 79.7%

Clarifai

Human face 72.6%

Clarifai

Clothing 75.6%

Clarifai

Clothing 44.8%

Clarifai

Food 69.6%

Clarifai

Food 68%

Clarifai

Food 59.5%

Clarifai

Food 58.2%

Clarifai

Food 47.4%

Clarifai

Food 45%

Clarifai

Table 56%

Clarifai

Human hair 54.2%

Clarifai

Human hair 50%

Clarifai

Human hair 44.9%

Clarifai

Human hair 43.2%

Clarifai

Tableware 53.8%

Clarifai

Tableware 48.4%

Clarifai

Tableware 46.9%

Clarifai

Tableware 42.7%

Clarifai

Tableware 38.2%

Clarifai

Human nose 37.7%

Clarifai

Human nose 35.3%

Clarifai

Human nose 34.9%

Clarifai

Human eye 37.5%

Clarifai

Human mouth 35.9%

Clarifai

Human hand 35.8%

Clarifai

Drink 34.3%

Categories

Imagga
created on 2023-10-06

people portraits 55.2%
paintings art 36.2%
food drinks 4.8%
pets animals 2.4%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of people sitting around a table

Created by general-english-image-caption-blip-2 on 2025-07-04

a black and white photo of a family eating at a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a group of people seated around a dining table, enjoying a meal. The table is set with various bowls, plates, cups, and utensils. There appear to be dishes such as bread and other food items, alongside beverages like coffee or tea. The individuals are dressed in overalls and work attire, indicating a rural or working-class setting. In the background, shelves with cooking pots and containers can be seen, providing a sense of a homey and communal atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of people sitting around a table having a meal. They are dressed in workwear, possibly overalls or denim shirts, which suggests they might be workers enjoying a meal together. There is a woman serving or assisting at the table on the left side of the image. The table is set with plates, bowls, and cups, and there are various dishes of food spread out, including bread and other meal items. The background shows a shelf with more kitchen items, indicating a setting in a dining or kitchen area. The setting appears to be modest, suggesting a rural or working-class environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a group of people gathered around a table, eating a meal together. The scene appears to be set in a modest, cluttered kitchen or dining area, with various dishes and food items on the table. The people in the image appear to be working class or lower-income individuals, dressed in simple, practical clothing. They are intently focused on their meal, suggesting this is a meaningful moment of shared sustenance and community.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a black and white historical photograph showing several workers or laborers having a meal together. They are seated at a table covered with a white tablecloth and various dishes and bowls. The men are wearing what appears to be work clothes or overalls, suggesting they might be factory workers or farmers. A woman in a dress can be seen standing, possibly serving food. The setting looks like it could be a dining room or kitchen with wallpaper visible in the background. The image has the quality and style typical of photographs from the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a woman serving food to three men at a table.

The woman, positioned on the left side of the image, is wearing a sleeveless dress with a patterned design. She has short dark hair and is holding a spoon in her right hand, which she is using to serve food from a large bowl into a smaller one. The three men, seated at a table, are all wearing dark shirts and overalls. They appear to be engaged in eating, with two of them holding spoons in their hands.

The table is set with various dishes, including plates, bowls, cups, and glasses. The background of the image shows a room with a wall covered in floral wallpaper and a door on the right side. In the center of the room, there is a large pot or pan sitting on a stove or counter. The overall atmosphere of the image suggests a domestic setting, possibly a family dinner or a gathering of friends.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image depicts a black-and-white photograph of a family gathered around a table for a meal. The table is set with plates, bowls, cups, and silverware, indicating a formal dining setting.

In the foreground, a woman stands on the left side of the table, wearing an apron and holding a plate of food. She appears to be serving the others. Three men sit at the table, each engaged in eating from their respective bowls. The man on the far right holds a spoon in his right hand, while the other two men use both hands to eat.

The background of the image features a wall adorned with floral wallpaper, adding a touch of warmth and coziness to the scene. Overall, the image conveys a sense of warmth, comfort, and togetherness, capturing a moment of shared experience and connection among family members.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo shows a family having a meal together at the dining table. The table is covered with a tablecloth and has various dishes, including bowls, plates, spoons, and cups. The three men are sitting on chairs, and they are eating. One of them is holding a spoon and a cup. The woman is standing, and she is holding a cup and a plate. Behind them is a cabinet with various items on top.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a family sitting around a table, engaged in a meal. The family comprises three men and a woman. The woman, standing behind the men, appears to be serving food from a plate or bowl. The men are seated at the table, with one man holding a bowl of food and another holding a cup. The table is set with plates, bowls, cups, and utensils. The room has a rustic, vintage feel, with a wooden table and chairs, and a wooden cabinet or shelf in the background.

Google Gemini

Created by gemini-2.0-flash on 2025-05-30

Here's a description of the image:

This is a black and white photograph of a group of people sitting around a table, seemingly enjoying a meal. The scene feels intimate and may depict a family gathering or a communal meal.

At the table, men are mostly the focus. They all appear to be in similar attire, possibly denim shirts or overalls, suggesting a working-class or rural setting. They are engaged in eating, with plates and bowls of food in front of them. One man is using a spoon in a jar of what appears to be cream, while others are eating with forks and spoons from their individual plates.

Standing and serving them is a woman who seems to be pouring a beverage, possibly coffee, into cups. She is wearing an apron.

The table is covered with a white tablecloth, and there is an assortment of dishes and serving ware present. In the background, there's a credenza with other food items and utensils, suggesting a well-prepared meal. The decor is simple, with patterned wallpaper and what looks like a door in the background.

The overall impression is that of a close-knit group sharing a meal together in a modest setting.

Created by gemini-2.0-flash-lite on 2025-05-30

Here's a description of the image:

Overall Scene:

The photograph captures a candid moment of a family meal, likely during a time of economic hardship or in a rural setting, given the era of the photo. The black and white photography adds a sense of nostalgia and realism.

People:

  • The Woman Serving: Standing on the left, a woman wears a patterned apron. She appears to be serving a meal, holding a cup and looking down towards the person in front of her.
  • Men at the Table: Three men are seated around the table, all appearing to be working-class, with what appears to be overalls. They are focused on their food.

Setting & Details:

  • The Table: A simple table covered with a white tablecloth.
  • Food: The table is laden with plates of food, bowls of what may be a side dish, and a pitcher. The type of food is difficult to determine, although is likely typical of the era.
  • Background: A glimpse into the room reveals a shelf or cabinet, suggesting a kitchen or dining area.

Mood and Impression:

The photograph exudes a sense of simplicity, togetherness, and perhaps a hint of struggle. It captures a real-life moment, making it feel intimate and authentic.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a family meal. Four individuals are seated around a table, engaged in eating. Here is a detailed description:

  1. Setting: The scene appears to be set in a modest kitchen or dining area. The background includes a countertop with various kitchen items, including pots, pans, and dishes.

  2. People:

    • Woman (left): She is wearing a dress with a lace or embroidered design on the bodice. She is standing and appears to be serving food or interacting with the others at the table.
    • Young Man (center-left): He is seated and wearing a dark, collared shirt. He is eating from a plate in front of him.
    • Older Man (center-right): He is also seated, wearing overalls and a dark shirt. He has a beard and is looking down, possibly at his food.
    • Older Man (right): He is seated at the end of the table, wearing a dark shirt and suspenders. He is holding a spoon and eating from a bowl.
  3. Table: The table is covered with a light-colored tablecloth and is set with various dishes and utensils. There are bowls, plates, cups, and glasses. The food includes what appears to be a roasted meat, possibly chicken, and other side dishes.

  4. Atmosphere: The atmosphere seems to be casual and familial, suggesting a typical mealtime in a household. The individuals are focused on their food, indicating a moment of shared sustenance and togetherness.

The photograph captures a candid moment of everyday life, likely from an earlier era given the style of clothing and the black-and-white format.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a scene of a group of people gathered around a dining table, engaged in a meal. The setting appears to be a domestic environment, possibly a kitchen or dining room, with floral wallpaper and a traditional wooden sideboard in the background. There are four individuals visible in the image. Two of them are seated at the table, while the other two are standing, with one of the standing individuals serving food from a pot into a bowl. The table is laden with various dishes and utensils, including plates with food, bowls, cups, and cutlery. The individuals appear to be dressed in casual attire, suggesting a relaxed and informal setting. The overall atmosphere of the photograph is warm and homely, capturing a moment of shared dining and perhaps a community or family gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph appears to depict a group of people, likely farm workers, eating a meal together. Three men are seated at a table covered with plates of food, bowls, and cups. They are dressed in work clothes, including overalls and button-up shirts, suggesting they may have just finished working. One of the men is eating from a bowl, while the other two are looking at their food. A woman, possibly a cook or a family member, is standing behind the men, serving them food from a bowl. The setting appears to be a simple, rustic dining area with a stove and other kitchen items in the background. The overall atmosphere suggests a communal, hardworking environment.