Human Generated Data

Title

Untitled (Somerset, Ohio)

Date

July 1938-August 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3396

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Somerset, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3396

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Brick 99.9
Indoors 99.8
Restaurant 99.8
Clothing 99.8
Coat 99.7
Sitting 98.4
Furniture 98.3
Face 90.5
Head 90.5
Cap 83.4
Cafeteria 72.6
Jacket 69.7
Potted Plant 58
Diner 57.7
Food 57.7
Photography 57.5
Portrait 57.5
Baseball Cap 56.6
Cafe 56.5
Shop 56.3

Clarifai
created on 2018-05-10

people 99.8
adult 97.4
sit 97.1
one 95.7
man 95.4
furniture 95.3
indoors 92.2
woman 90.6
monochrome 89.7
portrait 88.8
seat 88.6
nostalgia 88.3
child 87
chair 86.5
newspaper 85.6
room 85.6
wear 83.3
actor 79.1
two 79
music 78.7

Imagga
created on 2023-10-06

newspaper 52.1
product 41.7
creation 32.7
man 26.9
laptop 25.7
daily 25.1
office 24.4
business 22.5
people 22.3
person 22.2
male 22
businessman 19.4
adult 18.9
computer 18.7
building 17.7
sitting 17.2
professional 16.3
room 16.3
corporate 15.5
work 14.6
shop 14.2
job 14.1
old 13.9
men 13.7
happy 13.1
notebook 12.8
working 12.4
executive 12.3
modern 11.9
technology 11.9
alone 11.9
indoor 11.9
architecture 11.7
portrait 11.6
smiling 11.6
indoors 11.4
smile 10.7
success 10.5
businesspeople 10.4
looking 10.4
education 10.4
mercantile establishment 9.9
chair 9.8
blackboard 9.6
lifestyle 9.4
senior 9.4
casual 9.3
screen 9.2
black 9
couple 8.7
standing 8.7
day 8.6
finance 8.4
horizontal 8.4
color 8.3
scholar 8.3
window 8.3
outdoors 8.2
suit 8.1
home 8
women 7.9
table 7.9
retired 7.7
career 7.6
side 7.5
city 7.5
one 7.5
manager 7.4
park 7.4
jacket 7.4
student 7.4
street 7.4
cheerful 7.3
worker 7.3
confident 7.3
businesswoman 7.3
face 7.1
travel 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

building 99.5
outdoor 98.4
text 89.5
newspaper 84.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 45-51
Gender Female, 97.3%
Fear 90%
Surprised 9.9%
Calm 8.2%
Sad 6.8%
Confused 1.2%
Disgusted 0.9%
Angry 0.9%
Happy 0.4%

AWS Rekognition

Age 57-65
Gender Male, 100%
Calm 84%
Sad 6.5%
Surprised 6.4%
Fear 6.1%
Angry 5.5%
Confused 1%
Happy 0.5%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Male, 98.8%
Calm 80.2%
Sad 8.3%
Happy 8%
Surprised 6.4%
Fear 6%
Confused 0.7%
Disgusted 0.4%
Angry 0.3%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 13
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Plant
Bench
Hat

Clarifai

Clothing
Human face
Man
Human arm

AWS Rekognition

Adult 99.7%

AWS Rekognition

Adult 97.8%

AWS Rekognition

Male 99.7%

AWS Rekognition

Male 97.8%

AWS Rekognition

Man 99.7%

AWS Rekognition

Man 97.8%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 87.2%

AWS Rekognition

Plant 89.6%

AWS Rekognition

Bench 78.3%

AWS Rekognition

Hat 76.4%

Clarifai

Clothing 95.5%

Clarifai

Clothing 73.2%

Clarifai

Clothing 58.1%

Clarifai

Clothing 36.9%

Clarifai

Human face 82.5%

Clarifai

Human face 77%

Clarifai

Human face 57.9%

Clarifai

Man 55.9%

Clarifai

Human arm 33.5%

Categories

Imagga
created on 2023-10-06

streetview architecture 54.6%
paintings art 40.7%
interior objects 2.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a man sitting on a bench in front of a store

Created by general-english-image-caption-blip-2 on 2025-07-07

a man sitting on a bench outside a mill

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows a storefront labeled "MILLS" with a brick wall on the left and a window featuring potted plants inside. Outside, a bench advertising Coca-Cola is positioned in front of the window. A man, dressed in overalls, a jacket, and a hat, is seated on the bench. The scene suggests a casual or small-town environment.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows a man sitting on a wooden bench outside a building with brick walls. Above the bench, there is a partially visible sign that reads "MILLS" on the window. The bench has an advertisement for Coca-Cola, with the words "DRINK" and the recognizable Coca-Cola script visible. Inside the window, there are potted plants with large leaves. The scene evokes a vintage or historical atmosphere, suggesting a small-town setting. The man is wearing a hat and overalls, which may suggest a casual or rural style typical of earlier decades.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a black and white photograph of a man sitting on a bench in front of a storefront. The storefront has a large sign that reads "MILLS" and features a decorative plant display in the window. The man appears to be an older gentleman wearing a hat and overalls, and he is sitting on a bench with a sign that says "Drink Mills Cola". There are also two other people visible through the window of the storefront.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph that appears to be from an earlier era, showing the storefront of a business called "MILLS." In the image, there's a person seated on what appears to be a wooden bench or seat with "Drink Coca-Cola" text visible on it. The person is wearing overalls, a cardigan, and a fedora-style hat. The storefront features a brick wall and a window display with what looks like potted plants or flowers. Through the window, another figure can be seen inside the establishment. The overall composition suggests this might be a small-town store or business, likely from the early-to-mid 20th century.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of a man sitting on a bench outside a storefront. The man is wearing a dark jacket, overalls, and a hat. He is sitting on a bench with the words "DRINK Coca-Cola" written on it.

Behind him is a storefront with a window that has the word "MILLS" written on it in large letters. Through the window, you can see some plants and another man sitting at a table inside the store. The overall atmosphere of the image suggests a quiet, rural setting, possibly in the early 20th century.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of a man sitting on a bench outside a storefront. The man is wearing a hat, a cardigan, and overalls, and he is looking at the camera with a neutral expression. He is sitting on a wooden bench with a Coca-Cola advertisement on it.

In the background, there is a brick wall and a window with a sign that reads "MILLS" in large letters. Through the window, you can see a woman standing behind a counter, and a potted plant on the floor. The overall atmosphere of the image suggests a quiet, everyday moment in a small town or village.

The image appears to be from the mid-20th century, based on the clothing and the style of the photograph. It may have been taken by a professional photographer or a hobbyist, but the exact context and purpose of the image are unclear.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

A black-and-white photograph of an old man sitting on a bench in front of a shop with the word "MILLS" written on the glass window. He is wearing a hat and a sweater and is holding his chin with his left hand. A woman is standing inside the shop, near the glass window, with her hand on her chin. The shop has potted plants on the window sill.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph of a man sitting on a bench outside a shop. The shop has a brick wall and a glass window with the word "Mills" written on it. The man is wearing a hat and overalls, and he is sitting on a bench with a Coca-Cola sign on it. Inside the shop, a woman is standing behind a counter, and there is a potted plant on the window sill. The image captures a moment of everyday life, with the man sitting outside the shop and the woman working inside.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-06

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely from an older era. It captures a scene on the front porch or storefront of a building called "Mills." There's a quiet, somewhat melancholy mood to the picture.

Key Elements:

  • The Man: A man is seated on a bench in front of the "Mills" building. He's wearing overalls, a hat, and a cardigan, suggesting a rural or working-class setting. He appears to be deep in thought, with a serious expression on his face.
  • The Bench: The bench is made of metal and has the Coca-Cola logo on it, suggesting a connection to a store or business selling Coca-Cola.
  • The "Mills" Building: The name "Mills" is prominently displayed on the window. Through the window, we can see some plants, hinting that it could be a general store. The building's facade is brick.
  • The Woman: In the doorway or window to the right of the store, a woman appears to be watching.
  • Atmosphere: The image has a grainy quality, typical of older photographs. The lighting is soft, adding to the sense of quietude.

Inferences:

  • The photo likely depicts a scene from a rural or small-town setting in the past.
  • The "Mills" store was probably a local business.
  • The man might be a regular customer or a resident of the town, taking a break or simply observing the surroundings.

Let me know if you want any other details pointed out or discussed!

Created by gemini-2.0-flash on 2025-05-06

Here's a description of the image:

The image is a black and white photo of an older man sitting on a "Drink Coca-Cola" bench in front of a building. The man is wearing overalls, a light-colored shirt, a cardigan, and a hat. He appears to be looking directly at the camera.

Behind him, there is a brick wall and a window with the word "MILLS" displayed prominently on the glass. Inside the window, there are potted plants. To the right of the window, there is an open doorway where a woman is standing with her arms resting on a counter or ledge. She is looking out, possibly at the man sitting on the bench.

The overall impression is one of a small-town or rural setting, captured in a vintage style.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a scene outside a storefront. The store has a sign above the window that reads "MILLS." The window displays some plants and flowers, including a potted plant with long leaves and a basket of flowers.

In the foreground, an older man wearing overalls, a hat, and a jacket is seated on a wooden bench. The bench has an advertisement for Coca-Cola on the backrest, with the words "Drink Coca-Cola" visible. The man appears to be looking off to the side with a neutral expression.

In the background, through the store window, a woman can be seen inside the store. She is standing and looking out, possibly observing the street or passersby. The setting appears to be from an earlier era, possibly the mid-20th century, based on the clothing styles and the overall appearance of the scene. The brick wall and wooden bench add to the vintage feel of the photograph.

Qwen

No captions written

Text analysis

Amazon

MILLS
DRINK
5
100m

Google

ILL DRINK
ILL
DRINK