Human Generated Data

Title

Untitled (Thomasville, North Carolina)

Date

May 1946-August 1946

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4297.6

Human Generated Data

Title

Untitled (Thomasville, North Carolina)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1946-August 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4297.6

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 100
Corridor 100
Indoors 100
Floor 100
Flooring 100
Art 86
Face 80.1
Head 80.1
Art Gallery 57
Interior Design 56.7
Arch 55.7

Clarifai
created on 2018-05-09

people 98
man 96.6
portrait 95.2
adult 94.1
one 93.3
lid 91.6
old 90
monochrome 89.3
retro 88.7
vintage 85.3
art 83
wear 79.7
person 78.9
war 78.8
sit 77.3
desktop 75.7
actor 73.9
antique 73.5
street 73.3
administration 72.4

Imagga
created on 2023-10-06

hat 55.6
man 38.3
male 32
person 30.7
portrait 27.2
face 26.3
headdress 22.7
people 22.3
clothing 22.2
old 20.9
covering 20.7
black 18.8
sombrero 17.9
senior 17.8
looking 16.8
adult 16.2
model 15.6
handsome 15.2
dark 15
mystery 14.4
fashion 14.3
men 13.7
mask 13.7
head 13.4
hair 12.7
mysterious 12.6
eyes 12
cowboy hat 12
outdoors 11.9
happy 11.9
attractive 11.2
guy 11.2
casual 11
smiling 10.8
eye 10.7
smile 10.7
look 10.5
one 10.4
style 10.4
consumer goods 10.4
vintage 9.9
retro 9.8
boy 9.6
smoke 9.3
beard 9.3
disguise 9.2
pose 9.1
cowboy 8.8
evil 8.8
art 8.6
wearing 8.6
expression 8.5
hand 8.4
costume 8.3
cheerful 8.1
posing 8
shirt 7.8
pretty 7.7
culture 7.7
elderly 7.7
serious 7.6
skin 7.6
gesture 7.6
studio 7.6
lady 7.3
teenager 7.3
girls 7.3
dress 7.2
mustache 7.2
romantic 7.1

Google
created on 2018-05-09

Microsoft
created on 2018-05-09

man 97.2
person 96.6
text 93.6
posing 62.4
old 55.4

Color Analysis

Feature analysis

Amazon

Building
Person
Painting
Lamp

Clarifai

Human face
Man
Hat
Clothing
Human arm
Human nose
Human mouth

AWS Rekognition

Building 99.3%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 88.6%

AWS Rekognition

Person 65.5%

AWS Rekognition

Painting 86%

AWS Rekognition

Painting 72%

AWS Rekognition

Painting 57.9%

AWS Rekognition

Lamp 55.7%

Clarifai

Human face 95.8%

Clarifai

Man 90.8%

Clarifai

Hat 81.4%

Clarifai

Clothing 49.7%

Clarifai

Human arm 42.6%

Clarifai

Human arm 42.3%

Clarifai

Human nose 42.1%

Clarifai

Human mouth 36.1%

Categories

Imagga
created on 2023-10-06

nature landscape 57.9%
paintings art 16.6%
pets animals 15.2%
streetview architecture 9.9%

Captions

Microsoft
created by unknown on 2018-05-09

a man posing for a photo 87.1%
an old photo of a man 86.7%
a person posing for the camera 86.6%

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This is a photographic negative depicting an older man wearing glasses, a hat, and suspenders sitting outdoors. The man appears to have a mustache and is dressed in a buttoned-up shirt. In the background, there are leaves and foliage, suggesting a garden or natural setting. Part of another person is visible to the left, wearing a polka-dot patterned outfit, along with objects like a cup and a bag that are also present in the scene. The image has the flat and inverted tonal characteristics typical of negatives, with light areas appearing dark and vice versa.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a photographic negative showing an older man sitting outdoors. He wears a hat with a round pin or button on the front and glasses. His shirt has buttons and is held up by suspenders. To the left, there is a partial view of another person wearing a polka-dotted outfit, with only a portion of their torso and hand visible. They are reaching toward a container or possibly a picnic setup, as there appears to be a wicker basket and a cup. The background includes foliage and possibly a fence or wall, suggesting an outdoor or garden setting. The image’s negative format means that the colors and lighting are inverted, resulting in a darker appearance where light areas normally are.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows an older man with glasses and a hat, sitting in what appears to be a floral or patterned environment. He has a serious expression on his face and is wearing a dark jacket. The background behind him is blurred, creating a sense of focus on the man's face and upper body. The image has a black and white, vintage aesthetic, suggesting it may be an older photograph.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image shows an elderly man wearing a hat, glasses, and suspenders over a collared shirt. He appears to be outdoors, with trees and foliage visible in the background. The man has a serious expression on his face and is looking directly at the camera. The image has an artistic, textured quality with visible brushstrokes or patterns overlaying parts of the photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white vintage photograph that appears to be from a historical collection at Harvard University, as indicated by the credit line at the bottom. The image shows a figure wearing glasses and what appears to be dark clothing. They are wearing what looks like a cap or hat. The photograph has some degradation and spotting typical of old photographs, and there appears to be some foliage or decorative pattern visible in the background. The image has an aged, antique quality with the characteristic grainy texture and contrast of early photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man and a woman, with the man in the foreground and the woman to his left. The man is wearing a hat, glasses, and a dark shirt with suspenders, while the woman is dressed in a polka-dot dress. The background of the image features a floral patterned wallpaper or curtain, and a table with a cup and saucer on it. The overall atmosphere of the image suggests a casual, everyday scene, possibly from the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man wearing a hat and glasses, with a woman in the background. The man is centered in the frame, facing the camera, and is wearing a dark shirt with a collar and buttons down the front. He has a light-colored apron over his shirt, and a wide-brimmed hat with a circular object on the front. The woman is partially visible on the left side of the image, wearing a dress with a polka dot pattern and a white apron. She appears to be holding a cup or container in her hand.

In the background, there are leaves and branches visible, suggesting that the photo was taken outdoors. The overall atmosphere of the image is one of casualness and informality, with the subjects appearing relaxed and at ease. The use of a black-and-white filter adds a sense of nostalgia and timelessness to the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

A black-and-white photograph shows a man standing in front of a wall with a blurry background. He is wearing a hat, eyeglasses, a collared shirt, and suspenders. He seems to be looking at something on the left side, and his mouth is slightly open. On the left side, there is a blurry image of a woman sitting on a chair with a cup on the table.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man wearing a hat and glasses. He is standing in front of a background that appears to be a wall with a leaf pattern. He is wearing a long-sleeved shirt with buttons and suspenders. The man has a mustache and is looking directly at the camera. There is another person in the background, possibly a woman, wearing a dress with a leaf pattern.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

Here's a description of the image:

The image is a black and white negative portrait of a man in a hat and glasses, likely taken in the early to mid-20th century. He's positioned in front of some leafy foliage. The details are somewhat inverted due to the negative format, making the image appear in shades of light and dark that are opposite of what would be seen in a positive print.

Here are some key elements:

  • The Man: He's the main subject, with a stern expression. He's wearing a wide-brimmed hat with a circular emblem on the front, round glasses, and a dark shirt with suspenders. He also has a mustache.
  • Setting: The background appears to be outdoors, with a backdrop of dense green foliage, possibly a hedge or bushes.
  • Other Figures: Part of a person on the left is visible. It shows part of a dotted dress.
  • Style: The image has a vintage feel, characteristic of early photography with its tonal range and slightly grainy appearance.

The picture is marked at the bottom as "© President and Fellows of Harvard College (Harvard University Art Museums)".

Created by gemini-2.0-flash on 2025-05-31

The image is a black and white photograph. The photo is a close-up of a man in a hat and suspenders, standing next to a woman in a polka dot dress. The man is wearing glasses and has a mustache. He is looking directly at the camera. The woman is standing to the left of the man, and her arm is visible in the image. There is a small hat on the ground next to her. The background of the image is a garden with plants and flowers. The photograph is taken with a shallow depth of field, so the man is in focus while the background is blurred. There are some marks and scratches on the photo as though the photo has aged. The image is a negative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring an elderly man wearing a wide-brimmed hat, round glasses, and a dark shirt with a lighter-colored apron or vest. He has a mustache and appears to be looking directly at the camera. The background consists of a patterned wallpaper with a floral design, and there is a partially visible figure of a woman on the left side of the image, dressed in a polka-dot dress and holding a cup. The overall setting seems to be indoors, possibly in a domestic environment. The photograph has a vintage feel, which is further supported by the grainy quality and the attire of the subjects. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums) and is marked with the identifier "P1970.4297.0006."

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image is a black-and-white photograph featuring a man seated outdoors. He is wearing a wide-brimmed hat, glasses, and a long-sleeved shirt with a vest and overalls. The background appears to be a floral wallpaper pattern, and there is a basket and a polka-dotted fabric partially visible on the left side of the frame. The man is positioned center-right in the image, and the overall tone of the photograph suggests a vintage aesthetic. The photo is labeled as being from the Harvard University Art Museums, indicating its historical and cultural context.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This is a black-and-white photograph of an older man, likely taken in the early 20th century. The man is wearing a light-colored hat with a dark button or emblem in the center, round-framed glasses, and a collared shirt with suspenders. He has a mustache and is looking directly at the camera with a neutral expression.

The background features some foliage, possibly ivy or leaves, which are slightly out of focus. To the left of the man, there is a patterned dress, a hat, and a cup, suggesting that the photo was taken in a casual setting, possibly during an outdoor event or a picnic. The overall tone and texture of the image suggest it is an old photograph with some signs of wear or damage. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Text analysis

Amazon

ARTHUR
MUSEUM
ARTHUR AL SACKLER MUSEUM
AL SACKLER
II

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4297.0006
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4297.0006