Human Generated Data

Title

Untitled (county fair, central Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.404

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (county fair, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.404

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
People 100
Sun Hat 99.8
Photography 96.1
Face 96.1
Head 96.1
Portrait 95.8
Cap 87.4
Animal 70.2
Bull 70.2
Mammal 70.2
Outdoors 67.7
Baseball Cap 57.4
Nature 57.2
Grass 56.4
Plant 56.4
Shirt 56.1
Bullfighter 55.9
Cowboy Hat 55.4
Countryside 55.4

Clarifai
created on 2018-05-11

people 99.8
group 98
adult 96.9
man 96.7
group together 95.4
woman 94.9
child 94.1
four 88.8
wear 88.2
five 88.2
several 88.1
administration 87.5
lid 87.3
offspring 85.3
three 84.9
many 83.3
two 82.8
veil 82.4
war 81.2
boy 81

Imagga
created on 2023-10-06

hat 59.9
cowboy hat 44.7
man 34.3
ballplayer 33.5
player 33.1
person 32.6
clothing 32.3
headdress 29.7
male 29.4
athlete 28.5
outdoors 25.5
uniform 25.5
people 22.9
contestant 20.1
cowboy 18.2
horse 18
sport 17.6
covering 16.1
helmet 15.8
adult 15.6
consumer goods 15.3
recreation 15.2
gun 14.8
outdoor 14.5
two 14.4
field 14.2
military 13.5
military uniform 13.4
happy 13.2
couple 13.1
boy 13
guy 13
weapon 12.7
western 12.6
portrait 12.3
together 12.3
senior 12.2
child 11.9
soldier 11.7
leisure 11.6
war 11.6
walk 11.4
active 11.3
outside 11.1
grass 11.1
riding 10.7
hand 10.6
hiking 10.6
sky 10.2
competition 10.1
game 9.8
look 9.6
love 9.5
men 9.4
father 9.3
sports 9.2
travel 9.1
danger 9.1
summer 9
activity 9
family 8.9
battle 8.8
backpack 8.8
army 8.8
smile 8.6
pair 8.5
relationship 8.4
park 8.2
protection 8.2
handsome 8
day 7.8
mane 7.8
happiness 7.8
horses 7.8
equipment 7.7
hobby 7.6
walking 7.6
shirt 7.5
hold 7.4
smiling 7.2
lifestyle 7.2
looking 7.2
season 7

Microsoft
created on 2018-05-11

outdoor 100
person 99.8
sky 98.1
group 56.8
crowd 1.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 16-22
Gender Female, 67.8%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 3.7%
Confused 3%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Female, 67.8%
Surprised 81.3%
Happy 34.6%
Calm 12.2%
Fear 6.5%
Sad 2.3%
Angry 1%
Disgusted 0.8%
Confused 0.6%

AWS Rekognition

Age 14-22
Gender Male, 99.6%
Sad 97.9%
Calm 35.3%
Fear 7.3%
Surprised 6.5%
Happy 3.3%
Confused 2.3%
Disgusted 0.7%
Angry 0.7%

AWS Rekognition

Age 23-33
Gender Male, 57.3%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.7%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 90.8%
Surprised 8.2%
Fear 6.1%
Confused 3.2%
Sad 2.3%
Disgusted 0.7%
Happy 0.5%
Angry 0.3%

AWS Rekognition

Age 31-41
Gender Female, 97.4%
Calm 85.2%
Surprised 7.5%
Fear 6.3%
Sad 4.3%
Confused 2.9%
Happy 1.8%
Disgusted 1%
Angry 0.8%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Calm 52.2%
Fear 41.7%
Sad 7.1%
Surprised 6.4%
Disgusted 0.8%
Happy 0.7%
Confused 0.6%
Angry 0.4%

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat

Clarifai

Human face
Man
Clothing
Footwear
Human hair
Woman
Human eye
Human head
Human mouth
Hat
Human nose

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 96%

AWS Rekognition

Person 91%

AWS Rekognition

Person 83.2%

AWS Rekognition

Person 82.8%

AWS Rekognition

Person 81.2%

AWS Rekognition

Person 71%

AWS Rekognition

Adult 98.9%

AWS Rekognition

Adult 98.3%

AWS Rekognition

Adult 97.1%

AWS Rekognition

Adult 96%

AWS Rekognition

Adult 83.2%

AWS Rekognition

Male 98.9%

AWS Rekognition

Male 98.3%

AWS Rekognition

Male 97.1%

AWS Rekognition

Male 96%

AWS Rekognition

Male 83.2%

AWS Rekognition

Man 98.9%

AWS Rekognition

Man 98.3%

AWS Rekognition

Man 97.1%

AWS Rekognition

Man 96%

AWS Rekognition

Man 83.2%

AWS Rekognition

Hat 84.7%

AWS Rekognition

Hat 59.8%

AWS Rekognition

Hat 57.1%

Clarifai

Human face 96.6%

Clarifai

Human face 68.3%

Clarifai

Human face 65.5%

Clarifai

Human face 57.7%

Clarifai

Human face 56.3%

Clarifai

Human face 54.4%

Clarifai

Human face 47.4%

Clarifai

Human face 39.8%

Clarifai

Man 90.7%

Clarifai

Man 80.3%

Clarifai

Man 73.3%

Clarifai

Man 47.6%

Clarifai

Man 45.1%

Clarifai

Man 42.3%

Clarifai

Man 39.5%

Clarifai

Man 37.4%

Clarifai

Man 33.9%

Clarifai

Clothing 87.1%

Clarifai

Clothing 73.6%

Clarifai

Clothing 69.3%

Clarifai

Clothing 59.9%

Clarifai

Clothing 53.3%

Clarifai

Clothing 47%

Clarifai

Clothing 42.1%

Clarifai

Clothing 36.7%

Clarifai

Clothing 34%

Clarifai

Footwear 54.3%

Clarifai

Footwear 50.7%

Clarifai

Footwear 49%

Clarifai

Footwear 40.7%

Clarifai

Footwear 40.3%

Clarifai

Human hair 43.9%

Clarifai

Human hair 41.1%

Clarifai

Human hair 34.7%

Clarifai

Woman 39.4%

Clarifai

Human eye 39.4%

Clarifai

Human head 37.2%

Clarifai

Human mouth 35.7%

Clarifai

Hat 35.7%

Clarifai

Human nose 35.2%

Categories

Imagga
created on 2023-10-06

pets animals 81.4%
paintings art 8.3%
nature landscape 7.2%
beaches seaside 1.5%
people portraits 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of people standing around a horse drawn carriage

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a crowd of people watching a race

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts a group of people standing or leaning along the edge of a dirt track, possibly observing an event or race. Most of the individuals are dressed in vintage-style clothing, including hats, button-up shirts, and suspenders, suggesting the image is from a past time period. There is a fence in the background separating the track from what appears to be a larger crowd, with trees and structures visible in the distance. The atmosphere seems to be one of anticipation or casual interest.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a group of people standing closely together, watching an event or spectacle that takes place off-frame, likely across a dirt track or field. The individuals are dressed in early to mid-20th-century clothing; some men wear hats and suspenders, while women are seen in dresses. The crowd is gathered in a natural setting, as indicated by the presence of dirt and possible vegetation in the background. The image captures a moment of keen attention and anticipation among the spectators.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to depict a crowd of people, primarily men, gathered outdoors. In the foreground, there are several individuals standing together, some wearing hats. The background shows a large crowd of people, suggesting this may be some kind of public event or gathering. The overall scene has a historical feel, with the black and white photography style.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a black and white historical photograph showing a line of spectators at what seems to be a sporting event or outdoor gathering. Several people in the crowd are wearing white shirts and hats typical of mid-20th century casual wear. The image has a candid, documentary-style quality to it, with people focused on something happening off-camera. In the background, you can see what appears to be a field or open ground area. The photograph has the characteristic grainy quality of vintage photography from this era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of people standing in a line, with a fence and crowd visible in the background. The scene appears to be set in a rural or outdoor setting, possibly during a festival or event.

  • A group of people are standing in a line, facing the same direction.
    • The people are dressed in casual clothing, with some wearing hats and others not.
    • They appear to be waiting for something or someone, possibly a parade or performance.
  • In the background, there is a fence that separates the crowd from the rest of the area.
    • The fence is made of wood or metal and has a gate in the center.
    • Beyond the fence, there is a large crowd of people gathered in a field or park.
    • The crowd appears to be watching something, possibly a parade or performance.
  • The overall atmosphere of the image suggests a sense of anticipation and excitement.
    • The people in the line appear to be waiting eagerly for something to happen.
    • The crowd in the background seems to be enjoying themselves, possibly cheering or clapping.
  • The image may have been taken during a specific event or celebration, such as a county fair or festival.
    • The presence of a fence and gate suggests that the area may be enclosed or restricted in some way.
    • The crowd in the background appears to be diverse, with people of different ages and backgrounds gathered together.

Overall, the image captures a moment of anticipation and excitement as people wait for something to happen. The presence of a fence and crowd in the background adds depth and context to the scene, suggesting that it may have been taken during a specific event or celebration.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of people standing in a line, with a dirt road or track behind them. The individuals are dressed in casual attire, including hats and collared shirts, and appear to be waiting for an event or activity to begin.

In the background, a crowd of people can be seen gathered behind a fence, suggesting that the event may be a sporting competition or festival. The overall atmosphere of the image is one of anticipation and excitement, as the people in the foreground wait eagerly for the event to start.

The image provides a glimpse into a moment in time, capturing the emotions and atmosphere of a specific event or occasion. It invites the viewer to imagine the context and significance of the event, and to consider the experiences and perspectives of the people depicted in the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of a group of people gathered in a dirt track, possibly at a race event. The people are standing in a line, facing the track, with their backs to the camera. They are all wearing hats, and some of them are wearing glasses. The man in the middle is wearing a white shirt and a tie, and he has his hands on his back. The woman on the left side of the man is wearing a dress and a hat. In the distance, there is a fence and a crowd of people watching the race.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image shows a black-and-white photo of people standing in line on a dirt field. The man in the middle is wearing a hat and eyeglasses, and his hands are on the shoulders of the man on his right. The man on the right is wearing a hat and suspenders. On the left, a man is wearing a hat and smiling. In the distance, there are people standing behind a fence.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-01

Here is a description of the image:

The image is a black and white photograph capturing a moment at what appears to be a public event, likely an agricultural fair or race day, judging by the backdrop. A row of people is positioned in the foreground, their backs partially turned towards the camera.

Key features and observations include:

  • People: A diverse group of people are standing in a line, looking towards the left side of the frame. Their attire suggests a historical setting, possibly the early to mid-20th century. Many are wearing hats.
  • Hats: Several men are wearing hats, typical of the era.
  • Backdrop: The background reveals a crowd of spectators standing behind a fence, indicating an audience watching an event.
  • Overall Scene: The photograph has a candid, documentary feel. The composition suggests the photographer captured a moment of casual observation, capturing the scene and the people as they were.
  • Atmosphere: The image has a nostalgic and slightly grainy quality.

Created by gemini-2.0-flash on 2025-06-01

Certainly! Here's a description of the image:

Overview

The image appears to be a black and white photograph taken outdoors, likely in the first half of the 20th century. It depicts a group of people standing in a line, presumably watching an event. There is a sense of casual observation and anticipation in the scene.

Description

  • People: The main focus is a row of individuals of various ages. Many of the men are wearing hats, some with brimmed hats typical of the period. Their clothing seems to be casual, with a mix of shirts, trousers, and overalls. A woman or girl can be seen further back in the crowd. There's a large crowd gathered behind a barrier in the background.

  • Setting: The people are standing near a muddy or dirt track, which suggests an outdoor event like a horse race or a fair. The ground looks uneven and possibly wet.

  • Background: Behind the group, there's a fence, and beyond that, a large crowd of onlookers. Buildings are faintly visible in the far distance.

  • Atmosphere: The image evokes a sense of a bygone era, with the clothing styles and the informal gathering. It has a candid, documentary feel, capturing a moment of communal experience.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a group of people gathered outdoors, likely at a public event or gathering. The scene appears to be from an earlier era, possibly mid-20th century, based on the clothing and hairstyles. Here are some detailed observations:

  1. People and Attire:

    • The group consists of both men and women.
    • The men are wearing light-colored shirts, with some in suspenders, and hats, which were common in the mid-20th century. One man is wearing a light-colored suit jacket and a hat.
    • The women have their hair styled in a manner typical of the mid-20th century, with one woman wearing a floral-patterned blouse.
  2. Setting:

    • The background shows a large open field with a crowd of people in the distance, suggesting a public event such as a sports match, fair, or outdoor festival.
    • There are wooden structures and what appears to be a fence or barrier in the background, possibly indicating an arena or stadium setting.
  3. Activity:

    • The individuals in the foreground seem to be engaged in conversation or observing something off-camera.
    • Their expressions and body language suggest they are relaxed and enjoying the event.
  4. Atmosphere:

    • The overall atmosphere appears to be casual and social, with people dressed in everyday attire suitable for a warm day.

This image captures a moment of social interaction and community gathering, reflecting the fashion and social norms of its time.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image depicts a group of people gathered in an outdoor setting, possibly a park or an open field, with a dirt ground. The individuals are dressed in attire that suggests a mid-20th-century setting, with men wearing hats and suspenders, and women in dresses and aprons. Some people are seated on the ground, while others stand, and the crowd extends into the background, behind a fence. There are trees and buildings visible in the distance, indicating a rural or suburban environment. The black-and-white quality of the photo suggests it is from an earlier time period, likely the 1940s or 1950s. The overall scene appears to capture a moment of community gathering or event, with people focused on something happening out of frame.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white image depicts a group of people standing in a line outdoors. The scene appears to be from an earlier time period, possibly the mid-20th century. The individuals are dressed in period-appropriate clothing, with some wearing hats and others in button-up shirts and pants. The setting seems to be a rural or semi-rural area, as there is a dirt field in the background. In the distance, there is a large crowd of people behind a fence, suggesting that the individuals in the foreground may be participating in some sort of event or activity that has drawn a significant audience. The overall atmosphere of the image is one of anticipation or observation.