Human Generated Data

Title

Untitled (Plain City, Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2656

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Plain City, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2656

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Sun Hat 100
Brick 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Hat 98.8
Hat 98.5
Shirt 97.5
Accessories 90.1
Glasses 90.1
Glasses 84.6
Formal Wear 81.6
Tie 81.6
Architecture 72.8
Building 72.8
Wall 72.8
Dress Shirt 55.9
Cap 55.4
Cowboy Hat 55.2

Clarifai
created on 2018-05-10

people 99.8
elderly 99.1
lid 99
adult 98.3
man 98.1
veil 96.7
wear 96.4
two 96.2
portrait 95.3
leader 95.3
three 94.4
one 91.5
group 89.9
administration 86.2
group together 85.4
fedora 82.6
four 81.5
actor 80.6
five 75.2
offense 72.9

Imagga
created on 2023-10-05

man 49.7
hat 44.8
male 42
helmet 33.1
person 32.4
clothing 32.3
engineer 31.8
people 31.2
worker 29.9
architect 29.9
professional 29.1
builder 28.7
construction 26.5
business 26.1
work 25.9
occupation 25.7
adult 24.1
handsome 24.1
uniform 23.9
suit 23.2
industry 23
job 22.1
smiling 21.7
foreman 21.5
engineering 20.9
smile 20.7
site 20.6
contractor 19.5
portrait 18.8
manager 18.6
building 18.2
headdress 17.9
men 17.2
success 16.9
architecture 16.4
looking 16
happy 15.7
designer 15.5
bow tie 15
working 15
workplace 14.3
businessman 14.1
cowboy hat 14.1
attractive 14
standing 13.9
necktie 13.9
safety 13.8
hardhat 13.7
structure 13.2
cap 13
blueprints 12.8
military uniform 12.5
team 12.5
holding 12.4
covering 12.2
face 12.1
consumer goods 12
one 11.9
20s 11.9
mortarboard 11.9
expert 11.8
hard 11.4
employee 11.1
successful 11
confident 10.9
plans 10.8
employment 10.6
skill 10.6
collar 10.5
profession 10.5
corporate 10.3
black 10.2
industrial 10
hard hat 9.9
seller 9.7
serious 9.5
build 9.5
plan 9.5
office 9.2
garment 8.9
urban 8.7
project 8.7
confidence 8.6
wearing 8.6
development 8.6
guy 8.5
shirt 8.4
hand 8.4
teamwork 8.3
inspector 7.9
consultant 7.8
labor 7.8
diversity 7.7
casual 7.6
studio 7.6
career 7.6
map 7.6
smart 7.5
meeting 7.5
businesswoman 7.3
happiness 7.1
look 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.8
man 96.8
outdoor 89.6
headdress 86.8
hat 74.9
old 55.5
older 34.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 65-75
Gender Male, 99.9%
Angry 44.6%
Calm 18.7%
Disgusted 16.1%
Confused 11.6%
Surprised 9.5%
Fear 6.3%
Sad 2.8%
Happy 0.5%

AWS Rekognition

Age 57-65
Gender Male, 99.7%
Calm 84.5%
Surprised 7%
Happy 6.8%
Fear 6.4%
Sad 2.9%
Angry 1.6%
Confused 1.2%
Disgusted 0.9%

Microsoft Cognitive Services

Age 81
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat
Shirt
Glasses
Tie
Person 99.7%
Person 99.4%
Adult 99.7%
Adult 99.4%
Male 99.7%
Male 99.4%
Man 99.7%
Man 99.4%
Hat 98.8%
Hat 98.5%
Shirt 97.5%
Glasses 90.1%
Glasses 84.6%
Tie 81.6%

Categories

Captions

Microsoft
created by unknown on 2018-05-10

a man wearing a hat 97.6%
a man wearing a black hat 96.2%
a man wearing a white hat 95.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-05

a photograph of a man in a hat and suspender hat -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This black-and-white image shows two individuals standing in front of a cylindrical brick structure, possibly a large chimney or decorative building feature. Both are dressed in collared shirts with suspenders. The person on the left is wearing a textured straw hat, and the person on the right is wearing a light-colored hat with a wider brim. In the background, part of another building can be seen, as well as faint details like trees or structures, indicating an urban or semi-urban environment.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts two individuals standing in front of a large brick structure. The person on the left is wearing a light-colored shirt with overalls and a straw hat, while the individual on the right is dressed in a button-up shirt with suspenders and a wide-brimmed hat. The brick structure behind them is composed of layered, horizontally-laid bricks, and there is a small rectangular metallic or plastic plate attached to it. The photograph is in black and white, suggesting it could be from an earlier era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of two men standing in front of a brick wall. The man on the left is wearing a straw hat, a collared shirt, and overalls. He has a mustache and is looking at the man on the right. The man on the right is wearing a white fedora, a collared shirt, and suspenders. He is also wearing glasses and has a mustache. He is looking directly at the camera.

The background of the image is a brick wall with a large cylindrical structure behind it. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s. The clothing and hairstyles of the men, as well as the style of the brick wall and the cylindrical structure, are all consistent with this time period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a black-and-white photograph of two men standing in front of a brick wall. The man on the left wears a straw hat, a light-colored shirt, and suspenders, while the man on the right sports a white fedora hat, a light-colored shirt, and suspenders. The background features a curved brick wall with a large cylindrical structure, accompanied by a building visible in the distance to the left. The overall atmosphere of the image exudes a sense of nostalgia and simplicity, capturing a moment in time from a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of two men standing next to each other in front of a brick wall. The man on the left is wearing a straw hat and eyeglasses, while the man on the right is wearing a white hat, eyeglasses, and a necktie. Both men are wearing suspenders and appear to be smiling. The brick wall behind them has a sign or label attached to it, but it is not legible in the image.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The image is a black-and-white photograph of two men standing next to each other. Both men are wearing hats, with one wearing a straw hat and the other wearing a white hat. They are both wearing suspenders and eyeglasses. The man on the right is wearing a tie. They are standing in front of a brick wall. In the background, there is a house and a cloudy sky.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-07

Here's a description of the image:

Overall Impression:

The photograph is a black and white image of two men, possibly farmers, leaning against a brick structure. It has a vintage feel, suggesting it was taken a long time ago.

Details:

  • The Men: Both men are wearing glasses and hats. The man on the right is wearing a white dress shirt, tie, and suspenders with a white wide-brimmed hat. The other man, seen mostly from the side, is wearing a straw hat and collared shirt with suspenders.
  • The Brick Structure: They are leaning against a brick wall. The wall has a distinctive texture and appears to be part of a larger, possibly cylindrical, building.
  • Tone: The photograph has a somewhat serious or stoic tone. The men are not smiling.
  • Lighting and Composition: The lighting appears to be natural, and the composition is fairly straightforward, with the men positioned in front of the brick wall.

Possible Context:

Based on the attire and the brick structure, this photograph could be from the early to mid-20th century. It might depict farmers or workers taking a break.

Created by gemini-2.0-flash on 2025-05-07

Here's a description of the image:

The image is a black and white photograph featuring two older men. One man is on the left side of the frame, wearing a light-colored straw hat, glasses, a collared shirt, and suspenders. He is looking off to the right at the other man. The second man, positioned on the right, is wearing a white fedora, round glasses, a light-colored shirt with a tie, and suspenders. He is leaning against a brick wall and looking directly at the camera with a somewhat serious expression. The brick wall behind them has cylindrical sections and flat portions. In the background, a building can be seen in the distance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring two older men standing in front of a large, cylindrical brick structure.

  • The man on the left is wearing a light-colored, wide-brimmed hat, a light-colored shirt, and suspenders. He has a slight smile on his face and is looking towards the other man.
  • The man on the right is wearing a white, flat-topped hat with a dark band, round spectacles, a light-colored shirt, and suspenders. He has a neutral expression and is looking directly at the camera.
  • The background shows a large, cylindrical brick structure, which appears to be an industrial or agricultural storage tank. The bricks are arranged in a regular pattern, and the structure has a somewhat weathered appearance.

The overall setting suggests a rural or industrial environment, and the attire of the men indicates a time period from the early to mid-20th century.