Human Generated Data

Title

Untitled (Ohio?)

Date

c. 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3508

Human Generated Data

Title

Untitled (Ohio?)

People

Artist: Ben Shahn, American 1898 - 1969

Date

c. 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3508

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Human 99.5
Overcoat 87.9
Coat 87.9
Cowboy Hat 72.4
Sun Hat 70.8
Pants 55.2
Suit 55

Clarifai
created on 2023-10-25

lid 100
people 99.9
veil 99.6
man 99.4
fedora 98.3
adult 98.3
portrait 97.8
two 97.6
cowboy 97.2
wear 96.9
three 96.6
group 96.1
group together 95.5
coat 94.9
outerwear 94.7
cowman 92.8
cowboy hat 92.8
police 92.2
street 91.9
cap 91.6

Imagga
created on 2022-01-08

cowboy hat 100
hat 100
headdress 73.9
clothing 67.8
man 41
male 39
consumer goods 35.4
covering 34.9
portrait 31.7
person 31.7
people 27.9
military uniform 27.6
adult 25.9
uniform 25
smile 22.1
happy 21.3
cowboy 21.2
shirt 20.5
smiling 19.5
face 19.2
sombrero 18.7
handsome 18.7
suit 17.7
senior 15.9
western 15.5
attractive 15.4
two 15.2
wearing 15.2
model 14.8
guy 14.7
hand 14.4
black 14.4
style 14.1
outdoors 13.4
engineer 12.9
expression 12.8
hair 12.7
work 12.6
standing 12.2
fashion 12.1
men 12
looking 12
construction 12
one 11.9
helmet 11.8
posing 11.5
horse 11.4
boy 11.3
mature 11.2
industry 11.1
business 10.9
pose 10.9
lifestyle 10.8
architect 10.6
job 10.6
couple 10.5
old 10.4
outside 10.3
occupation 10.1
jacket 9.8
hardhat 9.8
together 9.6
elderly 9.6
happiness 9.4
manager 9.3
professional 9.3
human 9
fun 9
worker 8.8
look 8.8
engineering 8.6
casual 8.5
pretty 8.4
dark 8.4
cheerful 8.1
success 8
cowgirl 7.9
cap 7.9
love 7.9
pair 7.6
smart 7.5
child 7.5
holding 7.4
close 7.4
safety 7.4
sexy 7.2
building 7.1
women 7.1
kid 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

hat 99.9
fashion accessory 99.6
fedora 98.9
outdoor 98.8
person 98.5
text 97.7
cowboy hat 97.6
sun hat 96.4
clothing 90.4
man 81.9
human face 78.5
old 43.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 94.3%
Sad 4.5%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.8%
Calm 99.9%
Sad 0%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 60.4%
Angry 31.1%
Sad 2.7%
Confused 2.3%
Disgusted 1%
Surprised 1%
Fear 0.8%
Happy 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat
Person
Jacket

Clarifai

Man
Tree
Fedora
Human face
Footwear
Cowboy hat
Window
Human nose

AWS Rekognition

Hat 99.9%

AWS Rekognition

Hat 97.7%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 83%

AWS Rekognition

Jacket 55.9%

Clarifai

Man 94.9%

Clarifai

Man 92.7%

Clarifai

Man 84.8%

Clarifai

Man 56.1%

Clarifai

Man 49.2%

Clarifai

Man 44.4%

Clarifai

Tree 81.7%

Clarifai

Tree 49.4%

Clarifai

Tree 36.5%

Clarifai

Tree 33.1%

Clarifai

Fedora 77.9%

Clarifai

Human face 72.9%

Clarifai

Human face 61%

Clarifai

Human face 34.4%

Clarifai

Footwear 50.6%

Clarifai

Cowboy hat 45.8%

Clarifai

Window 35%

Clarifai

Human nose 33.6%

Categories

Imagga
created on 2022-01-08

paintings art 38.6%
streetview architecture 30.8%
people portraits 23.7%
nature landscape 4%
pets animals 2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

photograph of men in suits standing in front of a house.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a black and white photo of two men in overalls

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts two individuals wearing overalls and jackets, topped with wide-brimmed hats, standing outdoors in what appears to be a rural setting. The background includes a small stone building, a tree with sparse leaves, and other people gathered or walking nearby. On the rooftop behind them, a figure is visible, possibly engaged in work or observation. The scene conveys a casual, work-oriented environment characteristic of mid-20th-century rural life.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts two men standing in front of a building. They are wearing dark brimmed hats, overalls, and jackets. The setting appears to be outdoors in a possibly rural area, with a tree visible in the background. The building in the background has a person on the roof, and there are two other individuals walking on the left side of the image. The scene is captured in black and white.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two older men standing outside a building. They are both wearing hats and coats, with one man wearing a cowboy-style hat and the other a more formal hat. The men have serious expressions on their faces and appear to be engaged in some kind of conversation or interaction. The background includes a tree with leaves and what looks like a small structure or building behind the men. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from an earlier era, likely the early-to-mid 20th century. It shows two older men standing outside what appears to be a stone building. Both men are wearing dark hats and overcoats with denim overalls, which was typical working-class attire of the period. One man has a notable mustache. Their clothing and demeanor suggest they may be farmers or laborers. The composition has a documentary or journalistic quality to it, capturing what seems to be an authentic moment of rural American life. In the background, there's a stone or concrete building and some trees, and you can faintly see another person in the distance.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of two men standing in front of a house, with a tree and other people in the background.

The man on the left is wearing a dark jacket over a light-colored shirt and overalls. He has a mustache and is looking down at the ground. The man on the right is also wearing a dark jacket over a light-colored shirt and overalls. He is wearing a hat and looking to the right.

In the background, there is a small house with a tree in front of it. There are several people standing around the house, some of whom are wearing hats and overalls. The sky is visible through the branches of the tree. The overall atmosphere of the image suggests that it was taken in a rural or small-town setting, possibly during the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of two men standing in front of a building, with other people and objects visible in the background.

Key Elements:

  • Two men are standing in the foreground, both wearing dark jackets and hats. The man on the left has his hands in his pockets, while the man on the right has his hands behind his back.
  • In the background, there is a small building with a sloping roof and a chimney. Several people are standing around the building, some of whom appear to be working or engaged in activities.
  • There are also several trees and power lines visible in the background, suggesting that the scene is set in a rural or suburban area.

Overall Impression:

  • The image appears to be a candid shot of everyday life in a small town or village. The men in the foreground seem to be posing for the camera, while the people in the background are going about their daily activities.
  • The image has a nostalgic feel to it, evoking a sense of simplicity and community that is often associated with rural life.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of two men standing in front of a building. Both men are wearing hats and overalls. The man on the left has a mustache and is wearing a coat over his overalls. The man on the right is wearing a long-sleeve shirt and has his hands in his pockets. Behind them, there is a tree, and in the background, there is a building with a window and a door.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white photo of two men standing in front of a tree. They are wearing hats and jackets, with one of them wearing a denim overall. The man on the right is looking to the left, while the other man is looking at something in front of him. Behind them is a house with a man standing in front of it. There is also a pole with a street light on top.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

The image is a black and white photograph featuring two older men standing side-by-side. Both men are wearing dark, wide-brimmed hats, jackets, and overalls. The man on the left has a prominent mustache and is standing with his hand in his pocket. The man on the right also has his hand in his pocket. Behind them, there's a small, possibly brick building and some other men in the background, and trees that are beginning to bud. The overall impression is one of rural life or perhaps the working class.

Created by gemini-2.0-flash on 2025-05-09

The image is a black and white photograph featuring two elderly men standing side-by-side. Both men are wearing overalls and jackets. The man on the left has a wide-brimmed hat, a prominent mustache, and his hands are in his pockets. The man on the right is wearing a different style of hat and has one hand in his pocket.

Behind them, there is a building with a pitched roof and a small window. In the background, there are other people and some trees. A utility pole with wires is visible near the building, suggesting a rural or small-town setting. The overall tone of the photo is serious and candid, possibly from a historical documentary or photojournalism project.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting two elderly men standing outdoors. Both men are wearing similar attire, including dark hats, jackets, and overalls, suggesting they might be farmers or laborers. They are standing in front of a rustic building that appears to be made of logs or rough-hewn timber. The background includes a few more people and some trees, indicating a rural setting.

The man on the left has a mustache and is holding something in his left hand, possibly a piece of cloth or a small object. The man on the right has a more somber expression and is holding his jacket with his left hand. The overall scene gives an impression of a bygone era, possibly the early to mid-20th century, capturing a moment of rural life. The photograph has a candid, natural feel, providing a glimpse into the daily lives of these individuals.

Qwen

No captions written