Human Generated Data

Title

Untitled (Worthington, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.221

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Worthington, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.221

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Jacket 100
Adult 99.7
Male 99.7
Man 99.7
Person 99.7
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Sun Hat 99.4
Adult 99
Male 99
Man 99
Person 99
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Formal Wear 92.6
Suit 92.6
Hat 89.1
Face 87.9
Head 87.9
Hat 84.9
Coat 72.6
Overcoat 65.2
Photography 64.9
Accessories 64.6
Body Part 64.2
Hand 64.2
Portrait 63.1
Finger 57.5
Cap 57.3
Cowboy Hat 55.4

Clarifai
created on 2018-05-11

people 99.8
lid 99.5
fedora 98.8
man 97.3
veil 95.8
two 95.6
three 94.7
elderly 91.8
wear 91.8
adult 91.2
administration 88.5
sheriff 85.7
law 85.5
group together 84.7
group 83.8
woman 82.7
overcoat 81.9
bowler 81
cowboy 80.8
four 79.9

Imagga
created on 2023-10-06

hat 76
man 49.7
cowboy hat 47.9
male 45.4
clothing 38.3
engineer 34.4
worker 33.1
helmet 32.6
construction 32.5
headdress 31.5
builder 31.3
people 30.7
person 30.5
industry 29.9
architect 29
work 27.5
occupation 26.6
professional 24.7
business 24.3
suit 24.2
job 23.9
engineering 22.8
site 22.5
manager 22.3
smile 22.1
portrait 22
adult 21.4
handsome 21.4
foreman 21.2
happy 20.7
uniform 20.2
building 19.8
success 19.3
men 18.9
covering 18.4
safety 18.4
attractive 18.2
military uniform 17.6
consumer goods 17.5
contractor 17.5
architecture 17.2
working 16.8
designer 16.4
workplace 16.2
smiling 15.9
hardhat 15.7
face 14.9
successful 13.7
industrial 13.6
development 13.3
black 13.2
blueprints 12.8
employment 12.6
skill 12.5
businessman 12.4
two 11.9
expert 11.8
plans 11.8
hard 11.4
structure 11.4
guy 11.2
outdoors 11.2
corporate 11.2
team 10.7
diversity 10.6
look 10.5
urban 10.5
looking 10.4
style 10.4
hand 9.9
cowboy 9.8
consultant 9.7
standing 9.6
build 9.5
plan 9.4
meeting 9.4
shirt 9.3
model 9.3
protection 9.1
one 9
inspector 8.9
clipboard 8.8
protective 8.8
labor 8.8
western 8.7
factory 8.7
mid adult 8.7
lifestyle 8.7
equipment 8.7
talk 8.6
tie 8.5
casual 8.5
teamwork 8.3
fashion 8.3
private 8.1
project 7.7
expression 7.7
collar 7.7
profession 7.7
mature 7.4
jacket 7.1
happiness 7
together 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.6
outdoor 98.8
man 94.6
standing 85.7
old 69.2
people 64.5
group 60.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 67-77
Gender Male, 99.8%
Calm 97.3%
Surprised 6.5%
Fear 6%
Sad 2.3%
Angry 0.6%
Confused 0.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 61-71
Gender Male, 98.4%
Happy 94.6%
Surprised 6.3%
Fear 5.9%
Calm 4.3%
Sad 2.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 18-24
Gender Male, 98.6%
Surprised 49.6%
Happy 29.6%
Calm 17%
Sad 13.2%
Fear 8.1%
Confused 1.3%
Disgusted 1.1%
Angry 1.1%

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Suit
Hat
Coat
Adult 99.7%
Adult 99.6%
Adult 99%
Adult 98.8%
Male 99.7%
Male 99.6%
Male 99%
Male 98.8%
Man 99.7%
Man 99.6%
Man 99%
Man 98.8%
Person 99.7%
Person 99.6%
Person 99%
Person 98.8%
Suit 92.6%
Hat 89.1%
Hat 84.9%
Coat 72.6%

Categories

Imagga

paintings art 99.5%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-31

a photograph of a man in a suit and hat standing in front of a store -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This is a black-and-white photograph featuring two men standing in front of an old building with worn paint. The building appears to house a restaurant, as part of the word "RESTAURANT" is visible on the window. The two men wear hats, with one dressed in a suit jacket and trousers and the other in workwear including suspenders and a collared shirt. There is another person seated in the background, partially visible near the entrance, and part of a "Royal Crown Cola" advertisement can be seen on the glass. The overall setting suggests a mid-20th-century, small-town or rural environment.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows a group of men standing in front of a damaged building with peeling paint. Two prominent figures are in the foreground; both men wear hats and are dressed in old-fashioned attire. The man on the left wears a dark suit jacket with a white shirt, while the man on the right is dressed in a denim or work shirt with suspenders. There is signage visible on the building behind them, partially reading "RESTAURANT" and advertising for "ROYAL" and "Coca-Cola." Another individual is seated between the two main figures, wearing a similar hat. Additionally, part of another person is visible on the far right, also dressed in a jacket and hat.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows two older men standing outside a building. One man is wearing a suit and hat, while the other is wearing more casual work clothes and a hat. They appear to be engaged in conversation or interacting with each other. The building behind them has a sign that says "Restaurant", indicating this is likely a commercial or public setting. The overall scene suggests this is a historical or vintage photograph, capturing a moment from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph that appears to be from an earlier era, likely the 1930s or 1940s. Two men are standing outside what appears to be a restaurant (visible signage in the background). Both men are wearing hats typical of the period. The man on the left is wearing a dark suit jacket and striped pants with a white shirt, while the man on the right is dressed more casually in what appears to be overalls or work clothes with suspenders. The image has a documentary or street photography style to it, capturing everyday life of the period. In the background, there's a third person seated, and some building facades with partial signage visible.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two men standing in front of a storefront, with the man on the left wearing a dark suit jacket and hat, and the man on the right wearing a denim shirt and hat. The storefront behind them has a sign that reads "RESTAURANT" in white letters, and another sign below it that is illegible. In the background, there are other people visible, including a man sitting on the ground and another man standing to the right of the two main subjects. The overall atmosphere of the image suggests a sense of community and gathering, possibly in a small town or rural area.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of four men standing outside a restaurant. The two men in the foreground are dressed in hats and coats, with the man on the left wearing a dark coat and the man on the right sporting a light-colored hat and coat. Behind them, two additional men are visible, one sitting down and the other standing up.

In the background, the exterior of the restaurant is visible, featuring windows with peeling paint and signs that read "RESTAURANT" and "ROYAL CROWN COLA." The overall atmosphere of the image suggests a casual gathering of men outside a local eatery, possibly during a break or after a meal.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

In a black-and-white image, two men are standing in front of a restaurant. They are both wearing hats, and one of them is wearing suspenders and a belt. They are both looking at something on their right side. Behind them is a man sitting on the ground, wearing a hat and a tie. On the right side is a man wearing a hat and a suit, standing in front of the restaurant.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph showing a scene outside a shop with a sign that reads "RESTAUPA." Two older men are standing in the foreground, both wearing hats. The man on the left is dressed in a suit and tie, while the man on the right is wearing overalls with suspenders. Behind them, there is a man sitting on a bench inside the shop, wearing a hat and looking out the window. The shop's glass windows are visible, with reflections of the men and the surrounding area. The photograph captures a moment of casual interaction or conversation between the two men outside the shop.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-05

Here is a description of the image:

This black and white photograph captures a scene from a bygone era. Two older men, likely in their late 50s to early 70s, are the central figures, standing near a weathered building. Both are wearing hats, adding to the vintage feel of the image.

The man on the left is dressed in a dark blazer over a slightly unbuttoned white shirt. He's got a weathered face, suggesting a life lived outdoors or through hard work. His hands are in his pockets and he is looking directly at the camera.

To his right, another man is dressed in denim overalls held up by suspenders, his hands on his hips. He also has a hat, and a bit of a mustache. The man is looking off to the side.

In the background, a portion of a shop or restaurant facade is visible. Faded signage for a "Restaupa" and "Royal Co." are visible, along with a Coca-Cola advertisement. The setting suggests a small town or rural area, reinforcing the historical nature of the photograph.

Created by gemini-2.0-flash on 2025-06-05

The black-and-white photograph shows four men in front of a building, likely a restaurant or general store. The building is weathered, with peeling paint and signs in the windows that read "CH" and "RESTAURANT." A Coca-Cola sign is also visible.

In the foreground, two men stand out. On the left, a man wearing a hat, a dark jacket, and an open collared shirt. He has a serious expression and his hands are in his pockets.

To his right, the second man sports a hat, a buttoned work shirt, and suspenders. He has his hands on his hips and a slightly amused expression.

In the background, a third man sits on what appears to be a step or bench, wearing a hat and a suit. The fourth man is partially visible on the right side of the frame, wearing a hat, a suit, and a tie.

The overall impression is that of a candid shot capturing a moment in time, possibly during the mid-20th century. The image evokes a sense of nostalgia and rural life.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a group of older men standing outside what appears to be a small, rustic building. The building has a sign that partially reads "Restaurant" and another sign that seems to advertise "Royal Crown Cola." The men are dressed in clothing typical of an earlier era, with hats, jackets, and work clothes.

The man on the left is wearing a dark jacket, a white shirt, and a hat. He has a serious expression and is standing with his hands in his pockets. The man on the right is dressed in a denim-like jacket and pants, with a hat and suspenders. He is standing with his hands on his hips and appears to be looking at something or someone off-camera. In the background, there are other men, one of whom is sitting and wearing a hat.

The overall setting suggests a rural or small-town environment, possibly from the early to mid-20th century. The weathered appearance of the building and the clothing of the men indicate a sense of hard work and simplicity.

Text analysis

Amazon

ROYAL
CH
CO
RESTAUPA

Google

CH RESTAUPA ROYAL
CH
RESTAUPA
ROYAL