Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2889

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2889

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Overcoat 97.3
Sun Hat 95.2
Formal Wear 94.6
Suit 94.6
Face 92.3
Head 92.3
Photography 76
Portrait 76
Jacket 55.7
Hardhat 55.1
Helmet 55.1

Clarifai
created on 2018-05-10

people 100
adult 98.8
lid 98.2
man 98.2
wear 97.8
two 97.4
administration 96.8
outfit 96.1
veil 95.8
group 95.3
portrait 94.1
group together 93.7
fedora 93.7
three 93.7
leader 93.2
woman 93
offense 91.8
military 90.7
one 89.7
four 88.4

Imagga
created on 2023-10-05

cowboy hat 100
hat 100
headdress 100
clothing 72.3
man 37
consumer goods 36.4
covering 36.2
male 35.5
person 33.7
people 30.1
portrait 29.1
adult 26.5
sombrero 26.2
face 24.9
smile 21.4
happy 20.7
cowboy 20.6
attractive 19.6
model 17.9
hand 17.5
guy 17.5
black 17.4
handsome 16.9
fashion 15.1
suit 15.1
style 14.8
looking 14.4
two 14.4
expression 13.7
western 13.6
hair 13.5
business 13.4
shirt 13.1
boy 13
smiling 13
men 12.9
one 12.7
pretty 11.9
helmet 11.6
couple 11.3
senior 11.3
human 11.2
sexy 11.2
casual 11
occupation 11
dark 10.9
child 10.8
worker 10.8
kid 10.6
job 10.6
fun 10.5
construction 10.3
industry 10.2
professional 10.1
head 10.1
cute 10
old 9.8
mysterious 9.7
architect 9.7
look 9.6
engineer 9.6
women 9.5
love 9.5
eyes 9.5
work 9.4
lifestyle 9.4
site 9.4
youth 9.4
safety 9.2
pose 9.1
posing 8.9
together 8.8
standing 8.7
mystery 8.7
gesture 8.6
smart 8.5
indoor 8.2
outdoors 8.2
children 8.2
success 8
eye 8
building 7.9
cowgirl 7.9
happiness 7.8
builder 7.8
serious 7.6
wearing 7.6
engineering 7.6
studio 7.6
holding 7.4
lady 7.3
girls 7.3
blond 7.2

Microsoft
created on 2018-05-10

person 99.9
man 99
suit 94.3
outdoor 93
headdress 89.5
military uniform 89.2
standing 82.4
hat 81.7
old 59.6
helmet 40.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 24-34
Gender Male, 98.7%
Calm 77.8%
Surprised 16.3%
Fear 6.5%
Disgusted 3.4%
Confused 2.8%
Sad 2.4%
Angry 0.9%
Happy 0.3%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Coat
Hat

Clarifai

Man
Human face
Fedora
Human hair
Glasses
Human nose
Human head
Human arm

AWS Rekognition

Adult 99.5%

AWS Rekognition

Adult 99.4%

AWS Rekognition

Male 99.5%

AWS Rekognition

Male 99.4%

AWS Rekognition

Man 99.5%

AWS Rekognition

Man 99.4%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.4%

AWS Rekognition

Coat 97.4%

AWS Rekognition

Hat 93%

AWS Rekognition

Hat 83%

Clarifai

Man 96.4%

Clarifai

Man 88.5%

Clarifai

Human face 88.2%

Clarifai

Human face 81.8%

Clarifai

Fedora 71.7%

Clarifai

Fedora 59.6%

Clarifai

Human hair 43.6%

Clarifai

Human hair 37.7%

Clarifai

Glasses 41.3%

Clarifai

Human nose 38.1%

Clarifai

Human head 37.6%

Clarifai

Human arm 34%

Categories

Imagga
created on 2023-10-05

people portraits 52.3%
pets animals 23.2%
paintings art 7.2%
events parties 6.8%
streetview architecture 5.1%
text visuals 1.9%
interior objects 1.4%
food drinks 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of men in suits and hats standing in front of a sign that says

Created by general-english-image-caption-blip-2 on 2025-07-05

two men in hats standing next to a sign for rent

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This black-and-white image depicts two individuals dressed in formal attire, including overcoats, suits, and hats, indicative of early-to-mid 20th century fashion. They are standing outside near a sign that reads, "FOR RENT - Apply Oliver Lakin Company." The listed address and phone number suggest a commercial or residential space available for lease, likely located in New York. Shadows and lighting suggest the scene was captured outdoors during daylight.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts two men standing outside in front of a sign that reads "FOR RENT" with additional text stating "APPLY OLIVER LAKIN COMPANY" and a partial address "101 WEST 4..." in New York. Both men are wearing overcoats and hats, typical of early to mid-20th century fashion. They appear to be in a business or urban setting, given their attire and the "for rent" sign behind them. The photograph is in black and white, suggesting it is from a historical period.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows two men standing in front of a building with a "For Rent" sign. The men are wearing suits and hats, suggesting they are from an earlier time period, likely the early to mid-20th century. The building appears to be an office or commercial space that is available for rent, as indicated by the sign. The overall scene conveys a sense of urban setting and the formality of the men's attire suggests a professional or business context.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white vintage photograph showing two men wearing similar attire typical of the early 20th century. They are both dressed in dark overcoats and fedora-style hats with bands. Behind them, there is a "FOR RENT" sign visible on what appears to be a building wall, with text mentioning "Oliver Lakin Company" and an address in West New York. The image has the characteristic grainy quality of early photography, and the lighting creates strong shadows, giving it a film noir-like quality.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two men standing in front of a storefront with a "For Rent" sign.

  • The man on the left is wearing a light-colored fedora hat, a dark overcoat, and a dark suit jacket. He is facing to the right, looking at the other man.
  • The man on the right is wearing a dark-colored fedora hat, a dark overcoat, and a dark suit jacket. He is facing forward, looking directly at the camera.
  • Behind the men, there is a storefront with a large window and a door. The window has a sign that reads "For Rent" in large letters, with smaller text below it that says "Oliver Lakin Company" and "101 West 4th Street, New York."
  • The background of the image is out of focus, but it appears to be a city street with other buildings and people in the distance.

The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly in the 1920s or 1930s. The clothing and hairstyles of the men, as well as the style of the storefront, are consistent with this time period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two men standing in front of a storefront with a "For Rent" sign. The man on the left wears a dark coat and a light-colored fedora, while the man on the right sports a dark coat, a light-colored fedora, and a striped tie. The sign behind them reads "FOR RENT" at the top, followed by "APPLY OLIVER LAKIN COMPANY REAL ESTATE 101 WEST 4TH PHONE NEW YORK." The background features a dark storefront with a glass door, and the overall atmosphere suggests a vintage or historical setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring two men standing next to each other in front of a building. Both men are dressed in formal attire, including hats, coats, and ties. The man on the left is wearing a suit, while the man on the right is wearing a suit and tie. They are both looking towards the right side of the image, possibly at something or someone of interest. Behind them, there is a sign that reads "FOR RENT" with additional text that is partially obscured.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white photo shows two men standing next to each other. They are both wearing suits, ties, and hats. The man on the left is looking at the other man, who is looking to the right. Behind them is a signboard with the words "FOR RENT" and "OLIVER LAKIN COMPANY" written on it. The man on the left has a shadow on the wall, which is probably cast by the sunlight.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

The image is a black and white photograph featuring two men standing in front of a building. Both men are dressed in similar attire – dark overcoats, hats, and ties, evoking a vintage, possibly mobster-esque style. The man on the left is seen in profile, while the man on the right is facing the camera. Behind them, there is a "FOR RENT" sign with the company name "OLIVER LAKIN COMPANY" and an address. The photograph has a grainy texture, typical of older photographs, adding to the vintage aesthetic. There are some horizontal lines across the image that look like damage, possibly scratches or wear over time.

Created by gemini-2.0-flash on 2025-05-24

The photograph shows two men wearing hats and overcoats, standing in front of a "FOR RENT" sign. The sign is affixed to a surface that appears to be a window or door. The man on the left is facing away from the camera, his head turned slightly towards the other man. The man on the right is facing the camera directly. Both men are dressed in formal attire, suggesting a professional or business-like setting. The image is in black and white, lending it a vintage or historical feel. There is a horizontal line running across the middle of the photograph, possibly indicating a scratch or damage to the original print.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph featuring two men standing in front of a building. Both men are wearing overcoats and fedora hats, suggesting a time period likely in the early to mid-20th century. The man on the left is looking downward, while the man on the right is looking directly at the camera.

Behind them, there is a sign posted on the building that reads "FOR RENT" at the top. Below that, it states "APPLY OLIVER LAKIN COMPANY" followed by the address "101 WEST 47" and "NEW YORK." The sign appears to be advertising a property for rent through the Oliver Lakin Company.

The overall atmosphere of the image suggests a formal or business-related context, possibly depicting real estate agents or businessmen discussing the property. The attire and the style of the sign indicate that the photograph was taken in an urban setting, likely in New York City.

Qwen

No captions written

Text analysis

Amazon

FOR RENT
FOR
RENT
OLIVER
WEST
LAKIN
101
101 WEST 4.
4.
PHONE
APPLY
OLIVER LAKIN COMPANY
7
ORK
COMPANY
TEAL

Google

FOR RENT 0i WEST 4 ORK NE
FOR
RENT
0i
WEST
4
ORK
NE