Human Generated Data

Title

Untitled (county fair, central Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.619

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (county fair, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.619

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Face 99.7
Head 99.7
Photography 99.7
Portrait 99.7
Sun Hat 99.4
Dining Table 98.2
Furniture 98.2
Table 98.2
Indoors 96.2
Restaurant 96.2
Food 95.8
Meal 95.8
Dish 92.1
Cap 89.2
Architecture 76.7
Building 76.7
Dining Room 76.7
Room 76.7
Beverage 73.4
Coffee 73.4
Cafeteria 71.6
Cutlery 57.4
Spoon 57.4
Cup 57.3
Baseball Cap 56.6
Smoke 55.8
Body Part 55.5
Finger 55.5
Hand 55.5
Fork 55.5
Lunch 55.4

Clarifai
created on 2018-05-11

people 99.7
group together 98.8
adult 98.8
man 97.8
lid 97.3
group 97
war 95.2
administration 94.7
wear 94.5
veil 94
woman 93.6
monochrome 92.3
several 91.3
military 91
four 89.7
recreation 89.5
two 89.1
vehicle 88.7
furniture 87.7
street 86.8

Imagga
created on 2023-10-06

hat 56.7
man 41.9
male 39.1
person 30.8
work 27.5
headdress 27
people 26.8
clothing 25.5
worker 25.2
cowboy hat 24.2
business 23.1
working 23
adult 22.9
job 21.2
sombrero 20.6
men 19.7
businessman 19.4
industry 17.1
hand 16
engineer 15.9
occupation 15.6
helmet 15.5
happy 15
professional 15
looking 14.4
smile 14.2
office 13.9
construction 13.7
portrait 13.6
businesspeople 12.3
building 12.2
sitting 12
scholar 11.6
uniform 11.6
holding 11.6
look 11.4
meeting 11.3
computer 11.2
two 11
handsome 10.7
face 10.7
architect 10.6
collar 10.5
together 10.5
success 10.5
corporate 10.3
covering 10.2
smiling 10.1
safety 10.1
consumer goods 10.1
businesswoman 10
suit 9.9
hardhat 9.8
contractor 9.7
indoors 9.7
profession 9.6
engineering 9.5
plan 9.5
casual 9.3
intellectual 9.3
20s 9.2
successful 9.2
indoor 9.1
builder 9.1
laptop 9.1
seller 9.1
group 8.9
site 8.4
black 8.4
guy 8.4
cup 8.4
teamwork 8.3
employee 8.2
outdoors 8.2
one 8.2
foreman 8.2
industrial 8.2
team 8.1
paper 8
home 8
interior 8
staff 7.9
table 7.9
child 7.9
couple 7.8
labor 7.8
project 7.7
equipment 7.7
hard 7.6
document 7.5
room 7.5
manager 7.4
technology 7.4
restaurant 7.3
cowboy 7.3
clipboard 7.2
architecture 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 97.9
dish 53.4
old 42.1

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 24-34
Gender Male, 79.7%
Sad 99.8%
Calm 24.5%
Surprised 6.5%
Fear 5.9%
Confused 2.4%
Angry 0.7%
Disgusted 0.3%
Happy 0.2%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Coffee Cup

Clarifai

Man
Human face
Fedora
Table
Footwear
Clothing
Human arm
Tableware
Human head
Human nose
Human hair
Human hand

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 99%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 93%

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 99%

AWS Rekognition

Adult 96.5%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 99%

AWS Rekognition

Male 96.5%

AWS Rekognition

Man 99.1%

AWS Rekognition

Man 99%

AWS Rekognition

Man 96.5%

AWS Rekognition

Hat 94%

AWS Rekognition

Coffee Cup 73.4%

AWS Rekognition

Coffee Cup 72.4%

Clarifai

Man 93.8%

Clarifai

Man 91.8%

Clarifai

Man 75.5%

Clarifai

Man 47.5%

Clarifai

Human face 87.9%

Clarifai

Human face 77.6%

Clarifai

Fedora 59.8%

Clarifai

Table 49.6%

Clarifai

Table 33.4%

Clarifai

Footwear 44.2%

Clarifai

Footwear 33%

Clarifai

Clothing 41.2%

Clarifai

Clothing 33.7%

Clarifai

Human arm 41.1%

Clarifai

Human arm 36.8%

Clarifai

Human arm 35.8%

Clarifai

Tableware 40.8%

Clarifai

Tableware 36.1%

Clarifai

Human head 40.6%

Clarifai

Human nose 40.2%

Clarifai

Human hair 36.2%

Clarifai

Human hand 35.8%

Clarifai

Human hand 34%

Categories

Imagga
created on 2023-10-06

food drinks 42.3%
paintings art 32.6%
pets animals 11.6%
interior objects 3.9%
cars vehicles 2.8%
people portraits 2.3%
nature landscape 2.1%
beaches seaside 1.1%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-06

three men eating at a table with plates and cups

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a group of men sitting at a table with food

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts two men sitting at a wooden table outdoors. Both are wearing hats and casual clothing, with plates of food and cups in front of them. The setting appears to be a social gathering or picnic, with covered structures and people in the background. The environment is informal and suggests a rural or community-oriented context.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts two men seated at a table, presumably enjoying a meal. Both are dressed in casual clothing; the man on the left is wearing a buttoned shirt and a cap, while the man on the right is also wearing a buttoned shirt with rolled sleeves and a hat. On the table is a partially consumed meal with plates and cups visible in front of them. The setting appears to be outdoors, possibly at an event or gathering, with structures and another group of people visible in the background. Overall, the scene conveys a relaxed, informal social atmosphere.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows two men sitting at a table, eating what appears to be a meal. They are both wearing hats - one has a fedora-style hat, while the other is wearing a wide-brimmed hat. The men seem to be engaged in conversation as they eat. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-12

The black and white image shows two men sitting at a table outdoors, likely at a cafe or restaurant. They are both wearing hats and seem to be engaged in conversation while eating or drinking. There are cups, plates and what looks like food on the table in front of them. The background is slightly blurred, but other tables and chairs can be seen, suggesting they are in a public setting. The casual, candid nature of the photo gives it a slice-of-life feel, capturing a moment of daily interaction and socializing.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from an earlier era, showing two people seated at what looks like a table or counter. They are both wearing hats - one appears to be wearing a military-style cap while the other has on a fedora or similar brimmed hat. They appear to be eating a meal, with plates and cups visible on the table in front of them. The image has a candid, documentary-style quality typical of photographs from perhaps the 1930s or 1940s. Both individuals are wearing work clothes or overalls, suggesting they might be laborers or farmers taking a meal break.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image depicts two men seated at a table, engaged in eating. The man on the left is attired in a light-colored cap and a dark shirt, while the man on the right wears a white fedora hat with a dark band and a dark shirt. Both individuals are intently focused on their food.

In front of them, the table is set with plates, cups, and utensils. The background of the image features a blurred scene, with people standing and a vehicle visible in the distance. The overall atmosphere suggests that the men are taking a break to enjoy a meal together.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image is a black-and-white photograph of two men eating at a table. The man on the left is wearing a hat and a collared shirt, and he is holding a piece of food in his right hand. The man on the right is also wearing a hat and a collared shirt, and he is eating with a fork in his right hand. There are plates and cups on the table in front of them.

In the background, there are people standing around, and a car can be seen parked in the distance. The overall atmosphere of the image suggests that the men are enjoying a meal together, possibly at a picnic or outdoor gathering.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The image is a black-and-white photograph of two men sitting at a table outside. They are both wearing hats and appear to be eating. The man on the left is wearing a cap, and the man on the right is wearing a white hat with a black band. The table has plates, cups, and napkins on it. In the background, there is a blurry image of a person standing near a car and a building.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The black-and-white photo shows two men sitting at a table and eating. They are both wearing hats and have plates of food in front of them. One of them is holding a fork and appears to be eating, while the other one is holding a cup. There are two cups and some napkins on the table. Behind them, there are two people standing near a car.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Scene:

The black and white photograph captures a candid moment of what appears to be a casual outdoor gathering or meal. Two men are prominently in focus at a table, while other figures are visible in the background.

The Men:

  • Man on the Left: He is wearing a cap and a button-up shirt. He is holding something small to his mouth and appears to be eating.
  • Man on the Right: He is wearing a hat with a dark band. He is also eating something with a fork.

Table and Setting:

  • They are sitting at a wooden table.
  • There are cups, plates, and food remains scattered on the table.
  • A crumpled paper napkin sits on the table.
  • The background is slightly out of focus, but it suggests an outdoor setting, perhaps with a car and some other people.

Overall Tone:

The image has a nostalgic quality due to the black and white format and the casual nature of the scene. It gives the impression of a simple, everyday moment captured in time.

Created by gemini-2.0-flash on 2025-04-29

Here's a description of the image:

The image is a black and white photograph featuring a group of people enjoying a meal outdoors. The composition focuses on two men seated at a table in the foreground. The man on the left wears a cap and is holding something to his mouth, seemingly eating. The man on the right wears a light-colored fedora with a dark band and appears to be in the act of taking a bite of food he holds in his hands.

On the table in front of them are plates, cups, and what looks like food wrappings, suggesting they are midway through or finishing a meal. In the background, out of focus, are other individuals, including a woman wearing a light colored dress with dark polka dots and what appears to be a vehicle. The scene is set under what could be an outdoor shelter or canopy, as suggested by the visible supporting structures. The overall feel of the image is candid and captures a moment of everyday life, likely from the mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image is a black-and-white photograph depicting two older men sitting at a table, enjoying a meal. Both men are wearing hats; one has a light-colored hat with a dark band, while the other wears a darker hat. They are both focused on their food, with the man on the right actively eating with a fork. The table has several items on it, including plates, cups, and a crumpled napkin. The setting appears to be outdoors, possibly in a casual dining area or a street market, as there are other people and structures visible in the background. The overall atmosphere seems relaxed and informal.

Qwen