Human Generated Data

Title

Untitled ("Hooverville," Circleville, Ohio)

Date

July 1938-August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2636

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled ("Hooverville," Circleville, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2636

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.2
Clothing 94
Apparel 94
Face 92.2
Transportation 90.8
Vehicle 90.8
Automobile 90.8
Wood 74.1
Worker 70
People 66.4
Outdoors 63.2
Building 61.8
Hardhat 61.5
Helmet 61.5
Hat 60
Urban 59.9
Carpenter 56.1
Countryside 55.9
Nature 55.9
Beard 55.4

Clarifai
created on 2023-10-15

people 99.9
portrait 99.5
adult 98.5
man 98.3
elderly 98.1
group 97.7
monochrome 96.2
family 96.1
three 96
two 95.2
woman 93.8
child 93.7
son 92.7
old 91.9
group together 90.2
sadness 89.9
facial expression 88.9
four 88.4
documentary 86.2
offspring 83.9

Imagga
created on 2021-12-15

statue 71.3
sculpture 57.1
kin 38
art 28.6
fountain 27.2
architecture 26.6
ancient 25.1
stone 24.5
monument 23.4
history 23.3
old 23
marble 22.5
culture 20.5
world 19.9
religion 19.7
structure 19.3
travel 19
carving 18.5
historic 17.4
tourism 17.3
antique 17.3
historical 17
building 16.8
religious 14.1
landmark 13.6
god 13.4
city 13.3
famous 13
figure 13
detail 12.9
column 12.4
face 12.1
decoration 11.6
man 10.8
vintage 10.8
catholic 10.7
portrait 10.4
head 10.1
people 9.5
cadaver 9.3
church 9.3
temple 9.2
traditional 9.2
statues 8.9
sibling 8.8
carved 8.8
roman 8.8
memorial 8.1
mask 8
home 8
worship 7.7
heritage 7.7
holy 7.7
sky 7.7
outdoor 7.7
disguise 7.6
decorative 7.5
closeup 7.4
tourist 7.3
plastic art 7.2
love 7.1
male 7.1
grave 7
mother 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 98.2
person 95.3
clothing 93.7
human face 90.9
man 90.6
window 86.7
old 85.4
smile 65.8
black and white 50.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 69.6%
Fear 30.5%
Sad 29.5%
Happy 12.1%
Angry 9.8%
Calm 8.8%
Confused 6.8%
Surprised 1.4%
Disgusted 1.2%

AWS Rekognition

Age 47-65
Gender Male, 97.9%
Sad 74.4%
Calm 24.5%
Angry 0.4%
Confused 0.4%
Fear 0.1%
Surprised 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 3-11
Gender Female, 55.4%
Happy 91.2%
Sad 3.1%
Calm 2.1%
Fear 1.1%
Confused 0.9%
Angry 0.8%
Surprised 0.5%
Disgusted 0.4%

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Car

Clarifai

Clothing
Human face
Human hair
Wheel
Human arm
Human nose
Land vehicle
Human hand

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.1%

AWS Rekognition

Car 90.8%

Clarifai

Clothing 96.8%

Clarifai

Clothing 95.2%

Clarifai

Clothing 89.8%

Clarifai

Clothing 41.4%

Clarifai

Clothing 40%

Clarifai

Human face 74.9%

Clarifai

Human face 73.4%

Clarifai

Human face 56.8%

Clarifai

Human hair 43.5%

Clarifai

Human hair 41.2%

Clarifai

Wheel 37.9%

Clarifai

Human arm 36.4%

Clarifai

Human arm 36.3%

Clarifai

Human nose 35.8%

Clarifai

Land vehicle 35.3%

Clarifai

Human hand 34%

Categories

Imagga
created on 2021-12-15

paintings art 59.8%
people portraits 27.6%
pets animals 8.5%
interior objects 1.5%

Captions

Microsoft
created by unknown on 2021-12-15

an old photo of a man 89.4%
old photo of a man 87.5%
a man sitting in front of a window 60.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

photograph of a family in a farm.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man and a child in a truck bed

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image depicts a rural scene with three individuals dressed in worn clothing, suggesting a working-class or farming environment. To the left, a child is seen wearing overalls, standing next to a wooden structure. The adult figure in the center sits with arms crossed, conveying a sense of fatigue or contemplation. Behind the figures, a vintage car and wooden barrels are visible, adding to the rustic atmosphere. The setting appears to be outdoors, near a wooden building or shed.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a black and white photograph depicting a group of three people in an outdoor setting. In the foreground, an adult sits on the edge of a wooden structure, perhaps a crate or a wagon, with arms crossed in front in a relaxed posture. To the left of this individual, a child is standing with hands on hips, wearing a striped shirt and overalls. Behind them, partially visible, is another child who appears to be resting one hand on the edge of the wooden structure. In the background, there is a vintage automobile parked, indicating the historical context of the image. The setting appears rustic, possibly rural, with wooden buildings and rural elements surrounding the subjects.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph depicting two people, an older man and a younger boy, standing together in what seems to be a rural or working-class setting. The older man has a weathered, serious expression on his face, while the younger boy has a more curious and engaged demeanor. They are standing in front of a wooden structure, with an old truck or vehicle visible in the background. The overall scene suggests a sense of hardship or difficult living conditions, but also a close relationship between the two individuals.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph that appears to be from the early-mid 20th century. It shows three people - an older man in a striped shirt and two younger boys. The man is wearing work clothes including a striped button-up shirt with rolled sleeves, and appears to be holding something in his hands. One of the boys is wearing overalls, while another can be seen in the background. There's also what appears to be an old car visible in the background. The image has a documentary or photojournalistic quality to it, suggesting it may have been taken during the Great Depression or a similar period in American history. The setting appears rural or working-class, with wooden structures visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man and two boys standing outside a wooden structure, with a car parked behind them.

The man, positioned on the right side of the image, sits on a wooden bench with his hands clasped together in front of him. He wears a striped shirt with rolled-up sleeves and has short hair. The boy to his left, leaning against the bench, has short hair and wears a long-sleeved shirt. The other boy, standing in front of the bench, has short hair and wears overalls.

In the background, a wooden structure with an open doorway is visible, along with a barrel and a car with a license plate that reads "N41763." The ground is covered in dirt or gravel.

The overall atmosphere of the image suggests a rural or farm setting, possibly during the 1930s or 1940s, based on the clothing and the style of the car.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of an older man and two boys. The man, with a weathered face and unkempt hair, sits on a wooden box, wearing a striped shirt and dark pants. He holds his hands out in front of him, possibly displaying something to the camera.

To his left stands a boy with short, curly hair, dressed in overalls. Behind them, another boy peers out from behind the wooden box, his hand resting on his chin. In the background, a vintage car with the license plate "N41763" is visible, along with a wooden structure that appears to be a shed or barn. The overall atmosphere suggests a rural setting, possibly during the Great Depression era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph depicting a scene from the past. In the foreground, there are three individuals. The man on the right is standing with his hands clasped together, wearing a belt and a striped shirt. He has a serious expression on his face. To his left, there is a boy leaning on a wooden box, wearing a shirt and overalls. Another boy is standing behind him, looking at the man on the right. In the background, there is a wooden structure, possibly a shed or a barn, with a barrel and a car parked outside. The overall atmosphere of the image is somber and reflective.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of three individuals. The man in the center is seated and appears to be engaged in a task, possibly repairing something. He is wearing a long-sleeved shirt and has a serious expression on his face. On his left, there is a boy standing with his hands on the wooden structure. He is wearing an apron over his shirt and has a smiling face. Behind him, there is another boy with his hand on his chin. In the background, there is a car parked behind a wooden structure.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph featuring a weathered-looking man and two boys, seemingly in a rural or economically challenged setting. The photograph has a strong sense of realism, likely taken during a period of social documentation.

Detailed Description:

  • The Man: He is the central figure, positioned in the foreground and slightly to the right. He has a gaunt face, tousled hair, and a weary expression. He's wearing a striped long-sleeved shirt, dark pants with a belt, and appears to be sitting or leaning on a wooden structure. His hands are clasped together in front of him, suggesting a posture of introspection or resignation.

  • The Boys: Two young boys are visible in the background. The boy to the left is wearing overalls, with his hands resting on the wooden structure the man sits on. The boy to the right is leaning on the wooden structure with his chin in his hand.

  • Setting: The background is somewhat cluttered and suggests a rural or impoverished environment. There's a dilapidated wooden building or shed to the left, a barrel filled with produce behind the boy to the right, and an old car with a license plate (H41763) visible in the top right corner. Some strands of barbed wire are running throughout the scene as well.

  • Tone: The image conveys a somber and documentary tone. The expressions of the subjects, their clothing, and the state of the surroundings all contribute to a sense of hardship and perhaps perseverance in the face of adversity.

Let me know if you'd like a more specific interpretation or analysis!

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression: The image is a black and white photograph that appears to be a candid portrait of a family or group of people in a rural setting, likely during a time of economic hardship, such as the Great Depression. The composition and subject matter convey a sense of hardship, resilience, and the everyday life of working-class individuals.

Key Elements and Details:

  • Subject: The central figure is an older man, likely the father or head of the household. He is wearing a striped shirt, possibly a work shirt, and his hands are clasped together, resting on his knee. He has a weary expression on his face, suggesting a life of hardship.
  • Children: Two young boys are also visible. One boy is on the left of the photo, leaning against the railing or a wooden structure with a calm expression. The other boy is leaning over the railing behind the father.
  • Setting: The background includes a weathered wooden structure, possibly a barn or shed, and a partially visible car. There's also a barrel that may be filled with produce. The setting gives the impression of a rural environment.
  • Mood and Atmosphere: The black and white tones, the worn clothing of the subjects, and their expressions combine to create a somber and melancholic atmosphere. The photograph likely aims to portray the realities of poverty and the resilience of people facing difficult circumstances.

Overall: It appears to be a historically significant photo, potentially capturing a moment of struggle during a significant period.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph that appears to be from the early to mid-20th century. It depicts three individuals standing outside a rustic wooden structure, possibly a barn or shed.

In the foreground, an older man is seated on the edge of a wooden trough or container. He is wearing a striped shirt and overalls, and his hands are clasped together. He has a serious expression on his face.

To the left of the older man, a young boy with light-colored hair is standing. He is wearing a sweater and overalls, and his arm is outstretched, pointing towards something in the trough. His expression is focused and curious.

In the background, another young boy with light-colored hair is leaning over the trough. He is wearing a sweater and a hat, and his hand is resting on his face as he looks down into the trough.

Behind the individuals, there is a vintage car parked, and the license plate is partially visible. The overall scene suggests a rural setting, possibly during a time of economic hardship, given the worn clothing and the rustic environment.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

This is a black-and-white photograph featuring three individuals. The setting appears to be a rural or agricultural environment, suggested by the wooden structure, the old vehicle in the background, and the appearance of the clothing worn by the individuals.

  • The person on the left is a young boy with short, curly hair, dressed in overalls, leaning against a wooden structure. He is smiling and looking towards the other boy.
  • The boy in the center has a similar hairstyle and is dressed in a dark long-sleeved shirt. He appears to be interacting with the boy on the left, with his hand on his chest.
  • The person on the right is an older man with a mustache, wearing a long-sleeved, striped shirt and dark pants. He is holding a small object in his hands, appearing to be examining or working on it.

The background shows a silhouette of a vehicle and what seems to be a rustic, outdoor setting. The overall mood of the photograph conveys a sense of a family or close-knit group in a rural setting, possibly engaged in an activity related to farming or manual labor.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph depicts a rural scene, likely from the early to mid-20th century. In the foreground, an older man is seen washing his hands in a wooden container. He is wearing a striped, long-sleeved shirt with the sleeves rolled up and appears to be engaged in manual labor. Two young boys, also dressed in similar striped, long-sleeved shirts, stand nearby. One boy is leaning on the wooden container, while the other has his hand on his chest, possibly shielding his face from the sun or simply posing.

In the background, there is a wooden structure, possibly a barn or shed, with a partially open door revealing some items inside. A vintage car is parked nearby, adding to the historical context of the image. The overall atmosphere suggests a moment of everyday life, possibly after a day of work on the farm.

Text analysis

Amazon

N41763

Google

NA1 763
NA1
763