Human Generated Data

Title

Untitled (Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1269

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1269

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Clothing 99.9
Coat 99.9
Photography 99.8
Portrait 99.6
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Smoke 97.3
Jeans 81
Pants 81
Jacket 66.4
Smoking 66.3
Window 57.3
Formal Wear 57.3
Suit 57.3
Overcoat 55.9
Architecture 55.8
Building 55.8
Wall 55.8

Clarifai
created on 2018-05-11

people 99.8
adult 98.3
one 98
man 96.5
portrait 95.4
step 95.3
street 92.7
door 87.1
offense 87
actor 83.3
window 82.4
boy 79.8
profile 79.7
wear 77.9
child 77.2
doorway 76.7
leader 75
music 75
sadness 73.6
wall 73.1

Imagga
created on 2023-10-06

window shade 34.3
window blind 27.4
blind 23.4
building 19.9
architecture 17.7
person 16.9
protective covering 16.9
urban 14.8
window 14.8
lifestyle 14.5
male 14.3
portrait 14.2
man 14.1
people 13.9
city 13.3
old 12.5
adult 12.4
wall 12.4
relaxation 11.7
black 11.5
body 11.2
office 11
house 10.9
face 10.7
entrance 10.6
art 10.6
business 10.3
covering 10.2
stone 10.2
door 10.2
world 10
travel 9.9
step 9.8
design 9.6
hair 9.5
structure 9.5
sitting 9.4
statue 9.3
sculpture 9.1
alone 9.1
human 9
home 8.8
happy 8.8
call 8.7
outdoor 8.4
pretty 8.4
attractive 8.4
fashion 8.3
one 8.2
outdoors 8.2
style 8.2
dress 8.1
life 8.1
posing 8
smile 7.8
boy 7.8
ancient 7.8
outside 7.7
stairs 7.6
casual 7.6
historical 7.5
tourism 7.4
exterior 7.4
street 7.4
device 7.3
column 7.3
copy space 7.2
open 7.2
sliding door 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

building 99.8
outdoor 99.4
black 70.4
white 62.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 45%
Happy 38.1%
Surprised 8.3%
Fear 7%
Confused 6.9%
Sad 2.6%
Angry 1.2%
Disgusted 1%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Jeans
Person 99.4%
Adult 99.4%
Male 99.4%
Man 99.4%
Jeans 81%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a man standing in front of a window -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a person leaning against the side of a wooden building with horizontal siding. The individual is wearing dark clothing, including a long-sleeved jacket or sweater and trousers, and is holding an object in one hand. There is a window visible behind the person, with a partially reflective surface showing faint details. Part of a sign is seen to the left of the frame, with the letters "ER" visible. Shadows cast on the building add depth to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a person standing outdoors against the wall of a wooden building with horizontal paneling. The person is wearing a dark-colored jacket and pants, and is holding a bottle in their hand. Their posture is relaxed, leaning back slightly against the wall, with one hand in their pocket. The window next to the person reflects some shapes, possibly trees or other elements from the surroundings. The area seems to be well-lit, likely due to sunlight, which casts shadows on the wall and highlights the details of the siding. There is also part of a sign visible on the left side of the image with the letters "ER".

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a man standing in front of a wooden building with horizontal siding. He is wearing a coat and appears to be looking off to the side. The building has a window visible, and there is some text on the side of the building that is partially obscured. The overall scene has a black and white, vintage aesthetic.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a black and white vintage photograph of someone climbing or breaking into a window of what looks like a wooden building with horizontal siding. The person is wearing what appears to be a jacket or coat and pants, and seems to be in the process of either entering or exiting through the window. The image has the grainy quality typical of older photography, likely from the early-to-mid 20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a man standing in front of a building, with a window and siding visible.

  • The man is standing in the center of the image, facing to the left. He has short hair and is wearing a dark-colored jacket and pants. His right hand is in his pocket, and he is holding a cigarette in his left hand.
  • The building behind him has a window with a broken pane, and the siding is weathered and worn. The wall is made of horizontal wooden planks, and there is a brick foundation at the bottom.
  • The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s. The style of the clothing and the architecture of the building are consistent with this time period.

In summary, the image is a vintage photograph of a man standing in front of a weathered building, with a window and siding visible. The man is dressed in dark clothing and is holding a cigarette in his hand. The building has a broken window and weathered siding, and the overall atmosphere suggests that it was taken in the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black and white photograph of a man standing in front of a building. The man has short hair and is wearing a dark-colored jacket and pants. He is leaning against the wall with his left hand in his pocket and his right hand raised to his mouth, possibly holding a cigarette.

Behind the man, there is a window with a wooden frame and a sign that appears to be partially obscured by the man's body. The sign has the letters "ER" visible, but the rest of the text is not legible. The building itself appears to be made of wood or siding, with horizontal planks covering the exterior.

Overall, the image suggests that the man is taking a break or enjoying a moment of leisure outside the building. The atmosphere is casual and relaxed, with the man's posture and expression conveying a sense of comfort and ease.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

A black and white photo shows a man standing on the side of a building with his hand on his chin. He is wearing a jacket and pants. The building has a window with a broken glass and a sign that reads "ER" on the side. The building has wooden walls and brick flooring. The photo has a vintage look.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white image of a man standing and leaning on the side of a building. He is wearing a jacket and pants. His right hand is in his pocket, while his left hand is on his chin. He is looking to the left. Behind him is a window with a wooden frame. The building has a brick wall on the bottom and a wooden wall on the top.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

Here is a description of the image:

The image is a vintage black and white photograph featuring a young man standing next to a window on a wooden, plank-style wall. The man is positioned on the left side of the frame, taking up the majority of that side. He is seen with his hand raised to his mouth as if he is eating or adjusting something near his face. He is wearing a dark jacket with a zippered front and dark pants, with one hand in his pocket.

The window next to him appears to be broken or damaged in the upper pane. To the left of the window is a sign with the letters "ER" visible, suggesting there might be more text that is cut off from the frame. The wall is made of horizontal wooden planks and shows signs of age and weathering, with various shades of gray and white present. The bottom of the wall is lined with what appears to be a brick foundation. The right side of the image features a significant amount of white space or faded area, diminishing the clarity of the image in that section.

Created by gemini-2.0-flash-lite on 2025-06-04

Here's a description of the image:

Overall Impression: The image is a black and white photograph of a young man standing next to a wooden structure, likely a building. It appears to be an older photograph, possibly from the mid-20th century, given the style and the graininess of the image.

Subject: The focal point is a young man. He's wearing a dark-colored zipped jacket and matching pants. He has a hand in his pocket and is holding something up near his face with his other hand, potentially a cigarette or a similar item. His hair is neatly styled with a noticeable part. He has a slightly casual or contemplative expression.

Setting: The man is positioned near a window. The building has horizontal wooden siding, and there's a brick base visible at the bottom. There is a sign visible to the left of the window that only shows part of the letters "ER." The window appears to have some cracks or damage.

Composition: The composition is simple, with the man positioned primarily on the left side of the frame, balanced by the wall and the sign in the background. The lighting suggests an outdoor setting with some shadowing. The photograph has a candid and slightly informal feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black and white photograph featuring a man leaning out of a window of a wooden building. The man appears to be wearing a dark jacket and pants, and he is holding a cigarette in his right hand, which is raised to his mouth. The building has horizontal wooden siding and a window with multiple panes. The window frame and siding show some signs of wear and age. Part of a sign is visible on the left side of the window, but it is partially obscured and not fully readable. The overall setting suggests an older, possibly rural or small-town environment. The man seems relaxed and is looking off to the side, possibly engaging in a casual moment.

Text analysis

Amazon

ER