Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)

Date

July 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.690

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.690

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.9
Face 99.5
Head 99.5
Photography 99.5
Portrait 99.5
People 94.3
Cap 90.9
Baseball Cap 57.9
Coat 57.4
Sun Hat 57.3
Happy 57.2
Smile 57.2
Architecture 56
Building 56
Factory 56
Accessories 55.9
Bag 55.9
Handbag 55.9
Manufacturing 55.5
Earring 55.4
Jewelry 55.4
Lady 55.3
Body Part 55.1
Finger 55.1
Hand 55.1

Clarifai
created on 2018-05-11

people 100
group 99.5
adult 99.3
group together 98.6
wear 98.5
two 98.4
man 97.6
many 97.5
woman 97.4
several 97.2
vehicle 95
one 94.4
merchant 93.8
four 93.2
three 92.9
veil 92.2
street 90.4
recreation 89.2
outfit 88.3
child 87.5

Imagga
created on 2023-10-06

man 35.6
person 29.5
male 29.1
people 28.4
old 26.5
senior 25.3
hat 21.3
men 19.7
adult 18.9
seller 17.4
elderly 16.3
grandfather 15.8
outdoors 14.9
portrait 13.6
lifestyle 13
retirement 12.5
smiling 12.3
mature 12.1
outside 12
home 12
retired 11.6
statue 11.4
hand 11.4
happy 11.3
brass 11.2
glasses 11.1
worker 10.8
musical instrument 10.1
wind instrument 10
face 9.9
age 9.5
sitting 9.4
aged 9
religion 9
gun 8.9
building 8.8
work 8.8
uniform 8.8
happiness 8.6
industry 8.5
black 8.4
clothing 8.4
leisure 8.3
father 8.2
gray 8.1
guy 7.8
standing 7.8
ancient 7.8
older 7.8
outdoor 7.6
head 7.6
human 7.5
religious 7.5
city 7.5
pensioner 7.4
holding 7.4
cheerful 7.3
art 7.2
history 7.1
hair 7.1
smile 7.1
job 7.1
indoors 7
together 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.9
outdoor 99.1
people 65.1
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 21-29
Gender Female, 100%
Angry 46.8%
Confused 33.4%
Calm 10.2%
Surprised 8%
Fear 7.1%
Sad 2.5%
Disgusted 1.8%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Male, 96.7%
Calm 58.9%
Happy 13.2%
Surprised 8.4%
Fear 7.6%
Sad 7.5%
Angry 6.9%
Disgusted 2.3%
Confused 1.8%

AWS Rekognition

Age 16-24
Gender Male, 83.7%
Fear 42.1%
Disgusted 20.9%
Angry 11.3%
Surprised 11.1%
Calm 6.9%
Confused 6.6%
Happy 5.7%
Sad 4.1%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Female
Person
Woman
Male
Man
Boy
Child
Hat

Clarifai

Human face
Clothing
Man
Footwear
Hat
Woman
Human hair
Human nose
Human eye
Human hand

AWS Rekognition

Adult 99.6%

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 98.7%

AWS Rekognition

Adult 88.1%

AWS Rekognition

Female 99.6%

AWS Rekognition

Female 99.5%

AWS Rekognition

Female 88.1%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 90.2%

AWS Rekognition

Person 90%

AWS Rekognition

Person 89.1%

AWS Rekognition

Person 88.1%

AWS Rekognition

Person 81.2%

AWS Rekognition

Person 80.6%

AWS Rekognition

Person 75.9%

AWS Rekognition

Woman 99.6%

AWS Rekognition

Woman 99.5%

AWS Rekognition

Woman 88.1%

AWS Rekognition

Male 98.7%

AWS Rekognition

Male 89.1%

AWS Rekognition

Man 98.7%

AWS Rekognition

Boy 89.1%

AWS Rekognition

Child 89.1%

AWS Rekognition

Hat 78.9%

Clarifai

Human face 97.3%

Clarifai

Human face 91%

Clarifai

Human face 71.3%

Clarifai

Human face 63.2%

Clarifai

Human face 59.9%

Clarifai

Human face 44.4%

Clarifai

Human face 35.3%

Clarifai

Clothing 91.2%

Clarifai

Clothing 70.9%

Clarifai

Clothing 60.1%

Clarifai

Clothing 46.6%

Clarifai

Clothing 44.7%

Clarifai

Clothing 44.7%

Clarifai

Clothing 42.8%

Clarifai

Clothing 34.9%

Clarifai

Clothing 33.6%

Clarifai

Man 82.4%

Clarifai

Man 71.5%

Clarifai

Man 46%

Clarifai

Man 44.4%

Clarifai

Man 34.2%

Clarifai

Footwear 59.4%

Clarifai

Footwear 58.7%

Clarifai

Footwear 33.1%

Clarifai

Hat 54.3%

Clarifai

Woman 52.6%

Clarifai

Human hair 49.4%

Clarifai

Human hair 35.5%

Clarifai

Human nose 38.5%

Clarifai

Human nose 35.4%

Clarifai

Human eye 37.8%

Clarifai

Human eye 37.8%

Clarifai

Human eye 35.7%

Clarifai

Human hand 33.5%

Categories

Imagga
created on 2023-10-06

paintings art 49.2%
pets animals 14.5%
interior objects 10.6%
streetview architecture 9.1%
nature landscape 5.5%
people portraits 4.2%
food drinks 2.6%
cars vehicles 2.1%

Captions

Microsoft
created by unknown on 2018-05-11

a black and white photo of a person 90.4%
a group of people sitting on a bench 71.4%
an old photo of a person 71.3%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a woman in a hat and a man in a hat

Created by general-english-image-caption-blip-2 on 2025-07-06

a woman and two children at a carnival

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts a lively outdoor scene with several people interacting and moving about in what appears to be a fair or public gathering. Visible features include a wooden structure in the background, individuals seated on a ride or amusement attraction, and others walking and mingling in the area. Clothing styles suggest a mix of traditional and casual wear, with intricate patterns noticeable on garments. The setting is well-lit, suggesting daytime activities.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a scene at what appears to be a fair or outdoor event. The foreground shows two individuals: one on the left wearing a patterned coat with a floral design and with short, dark hair, and another on the right wearing a striped poncho and a dark hat with light-colored, long hair tied back. A young child with short hair is standing between them, seen from the back. In the background, other people are gathered, with some appearing to be walking around, mingling, and engaging in various activities in what seems like a bustling, lively atmosphere. There is a structure that looks like a merry-go-round or ride visible to the right. The image is in black and white, conveying a sense of nostalgia or historical context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting a scene from what seems to be a rural or small-town setting. It shows two people, an older woman wearing a patterned shawl or scarf and a younger boy, possibly a child, standing together in an outdoor environment with various objects and structures visible in the background. The image has a vintage or historical feel to it, suggesting it may have been taken some time in the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-18

The black and white image shows two women standing together at what appears to be an outdoor market or fair. One woman is facing the camera while the other has her back turned. The woman facing the camera has short dark hair and is wearing a floral patterned shirt or dress. The woman with her back turned has long light-colored hair and is wearing a striped shirt or dress. In the background, there are various stalls or booths set up with people milling about, suggesting it is a busy marketplace setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph that appears to be from the early-to-mid 20th century. The image shows a person wearing a patterned dress or blouse with floral designs and what appears to be a dark hat. The background suggests an industrial or factory setting, with machinery or equipment visible in the blurred background. The photograph has a documentary or journalistic quality to it, possibly capturing working conditions or daily life during the industrial era. The lighting and composition create an intimate portrait that gives viewers a glimpse into this historical moment.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of two women and a child in what appears to be a market or fair setting. The woman on the left has short dark hair and wears a floral-patterned dress with a white collar. The woman on the right has short, light-colored hair and wears a dark-colored hat and a patterned blouse. The child is partially visible, with their head and upper body visible, and appears to be wearing a light-colored shirt.

In the background, there are several people standing around, and what appears to be a stage or platform with a railing. The overall atmosphere of the image suggests a lively and bustling environment, possibly during the daytime.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black and white photograph of a group of people at an outdoor event, possibly a carnival or fair. The main focus of the image is on two women and a child in the foreground, with a crowd of people visible in the background.

Foreground:

  • A woman on the left wears a floral-patterned dress with a white collar and has dark hair pulled back.
  • A woman on the right wears a striped shirt and a hat, and has her arm around a child.
  • The child has short hair and is facing away from the camera.

Background:

  • A crowd of people is visible, including men and women of various ages.
  • There are several booths or stalls in the background, possibly selling food or merchandise.
  • The atmosphere appears to be lively and festive, with people milling about and enjoying themselves.

Overall:

  • The image captures a moment in time at an outdoor event, showcasing the diversity and energy of the crowd.
  • The use of black and white photography adds a sense of nostalgia and timelessness to the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The black-and-white image shows two women standing in an outdoor area, possibly a fair or carnival. The woman on the left is wearing a floral blouse, while the woman on the right is wearing a hat and a dress. They are standing close to each other and appear to be engaged in a conversation. Behind them, there are several people, some of whom are walking. In the distance, there is a Ferris wheel and other rides.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white photo of a woman and a boy standing near a woman wearing a hat. The woman wearing a hat is holding the hand of the boy. The woman in front of her is looking at her. Behind them are people walking and sitting on chairs. There are also some structures, such as a tent, a fence, and a machine. The woman wearing a hat is probably talking to the woman in front of her.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

Here's a description of the image:

This is a black and white photograph depicting a scene, possibly at an outdoor gathering or event, with several figures.

  • Foreground: Two women and a child are the main subjects.

    • On the left, a young woman in a floral patterned dress is looking directly at the camera with an open-mouthed expression.
    • To the right, a woman with a hat is depicted in profile, her face showing the signs of age, with a pensive look. She is wearing a striped shawl over a white top.
    • Between them, a child with a bowl haircut has their back towards the camera.
  • Background: In the mid-ground, there are blurry figures of people. A man is walking away from the viewer. Parts of structures and possibly a carnival ride are visible, suggesting a fair or festival setting.

  • Overall Impression: The image has a candid, snapshot quality, capturing a moment in time. The contrast between the faces and the environment, and the lack of a staged composition, gives a sense of realism. The photograph appears to be from a previous era.

Created by gemini-2.0-flash on 2025-05-31

In a black and white outdoor shot, three people are captured amidst a bustling crowd. The focus is on a young woman and an older woman, both standing with a child in front of them.

The young woman, positioned to the left, is facing the camera directly. Her mouth is slightly open, giving the impression that she is in the middle of a conversation. She is wearing a floral-patterned dress with a deep V-neck.

To her right, an older woman with a weathered face and wispy hair is wearing a dark hat. She is looking to her left with a slightly open mouth. Her outfit consists of a striped top over a white undershirt.

Between them, a child with short hair is visible from the back. The crowd behind them adds to the liveliness of the scene, suggesting a festive or crowded event. In the background, the partial view of what appears to be a Ferris wheel adds to the atmosphere of a fair or carnival.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph capturing a candid moment at what appears to be a market or fair. The scene includes two prominent individuals in the foreground.

On the left, there is a younger person with short hair, wearing a patterned garment that looks like a traditional shawl or poncho. This person is looking off to the side with a somewhat serious or contemplative expression.

On the right, there is an older individual wearing a hat and a striped shawl or poncho. This person is looking towards the younger individual, appearing to be engaged in conversation or interaction.

In the background, there are several other people, some of whom are blurred, suggesting movement and activity. The setting includes what appears to be market stalls or booths with various items on display, indicating a bustling environment. The overall atmosphere suggests a culturally rich and lively event, possibly a traditional market or festival.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image appears to be a black-and-white photograph capturing a candid moment at what seems to be a fair or outdoor market. In the foreground, there are three individuals: a young person wearing a patterned top, a child in the middle, and an older person wearing a striped top and a hat. The older person seems to be engaged in conversation or perhaps giving directions to the young person. The background is bustling with activity, featuring other people, some of whom are blurred, suggesting movement and a lively environment. The setting includes wooden structures and possibly amusement rides, indicating a fair or fairground atmosphere. The overall mood of the image is dynamic, reflecting the energy of a community gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph captures a candid moment at what appears to be a public gathering or event. In the foreground, a woman with a boy's head in her lap is engaged in conversation with another woman. The woman holding the boy is wearing a patterned shawl and a hat, while the other woman is dressed in a blouse with a floral pattern. In the background, there are several people standing and conversing, and some benches or seating structures are visible. The setting seems to be outdoors, possibly in a market or fair-like environment. The overall atmosphere of the photograph suggests a casual, everyday scene from a past era.