Human Generated Data

Title

Untitled (Fourteenth Street, New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2770

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourteenth Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2770

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Apparel 100
Clothing 100
Human 99.8
Cap 86.6
Beanie 75.2
Finger 72.4
Sun Hat 67.4
Face 56.4

Clarifai
created on 2018-03-23

people 99.9
adult 98.1
child 97.2
portrait 97
wear 96.3
group 95.9
lid 95.5
veil 94.7
woman 94.4
man 93.4
two 91.3
administration 90.3
boy 90.1
street 88.6
music 87.6
facial expression 86.2
son 86
war 84.8
one 84.1
three 82

Imagga
created on 2018-03-23

people 34.6
man 33.6
portrait 33
male 32.3
hat 30.7
couple 29.6
happy 26.9
adult 25.9
person 25.2
together 24.5
love 23.7
brother 22.9
face 22.7
smiling 21.7
smile 20.7
attractive 20.3
women 19.8
child 19.6
pretty 19.6
cute 19.4
family 18.7
two 18.6
looking 18.4
dad 17.8
black 17.5
father 16.9
happiness 16.5
fashion 15.8
parent 15.5
handsome 15.2
cowboy hat 15
fun 15
mother 14.8
sitting 14.6
men 14.6
girls 14.6
sexy 14.5
lifestyle 13.7
expression 12.8
sibling 12.7
style 12.6
dark 12.5
romance 12.5
model 12.4
headdress 12.3
guy 12
casual 11.9
clothing 11.6
girlfriend 11.5
world 11.3
relationship 11.2
20s 11
cheerful 10.6
brunette 10.5
boy 10.4
emotion 10.1
cipher 10
romantic 9.8
lady 9.7
indoors 9.7
married 9.6
enjoying 9.5
youth 9.4
leisure 9.1
hand 9.1
husband 9.1
son 8.9
kid 8.9
hair 8.7
affection 8.7
boyfriend 8.7
loving 8.6
wife 8.5
senior 8.4
old 8.4
holding 8.3
children 8.2
posing 8
home 8
hugging 7.8
friends 7.5
human 7.5
city 7.5
relaxing 7.3
sensual 7.3
dress 7.2
body 7.2
lovely 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 100

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 45-66
Gender Female, 95.9%
Confused 2.9%
Surprised 3.1%
Happy 74.1%
Angry 3%
Disgusted 6.7%
Sad 7.2%
Calm 3.1%

AWS Rekognition

Age 10-15
Gender Male, 85.1%
Disgusted 0.6%
Calm 96.1%
Confused 0.5%
Surprised 1.1%
Sad 0.8%
Happy 0.4%
Angry 0.4%

AWS Rekognition

Age 23-38
Gender Male, 88.5%
Angry 8.3%
Sad 47.3%
Happy 1.9%
Surprised 3.5%
Confused 6.3%
Disgusted 2.8%
Calm 29.9%

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Hat
Helmet

Clarifai

Human face
Clothing
Human nose
Human eye
Human hand
Human mouth

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.4%

AWS Rekognition

Hat 98.6%

AWS Rekognition

Hat 69.4%

AWS Rekognition

Hat 65.7%

AWS Rekognition

Helmet 62.7%

Clarifai

Human face 97.9%

Clarifai

Human face 97.3%

Clarifai

Human face 40.2%

Clarifai

Human face 33.5%

Clarifai

Clothing 94.8%

Clarifai

Clothing 89.2%

Clarifai

Clothing 86.9%

Clarifai

Clothing 85.9%

Clarifai

Clothing 52.7%

Clarifai

Clothing 40.4%

Clarifai

Clothing 39.6%

Clarifai

Clothing 34.7%

Clarifai

Human nose 45.4%

Clarifai

Human nose 43.8%

Clarifai

Human eye 42.5%

Clarifai

Human eye 40%

Clarifai

Human eye 39.6%

Clarifai

Human eye 37.6%

Clarifai

Human hand 38.4%

Clarifai

Human hand 34.5%

Clarifai

Human mouth 36.8%

Clarifai

Human mouth 36%

Categories

Imagga
created on 2018-03-23

people portraits 76.3%
paintings art 23.6%
food drinks 0.1%

Captions

Microsoft
created by unknown on 2018-03-23

a person wearing a hat 88.6%
a person wearing a black hat 87.1%
a group of people posing for the camera 85.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-11

a photograph of a woman in a hat and a man in a hat

Created by general-english-image-caption-blip-2 on 2025-06-27

a black and white photo of two people standing in front of a store

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image depicts a bustling outdoor scene, possibly in a market or urban setting. There are several people wearing vintage clothing, including hats, jackets, and sweaters, suggesting a mid-20th-century time period. In the background, there is signage with partial text visible ("MEN"), a fabric stall, and other individuals engaged in conversation or activity. The environment is lively and reflective of a social gathering or marketplace ambiance.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a black and white photograph depicting a busy street scene. In the foreground, two individuals are engaged in conversation, with one of them gesturing with their hand. Both are wearing hats; one a lighter shade and the other a dark, cloche-style hat. The street appears crowded, with people in the background wearing various styles of hats, including a bowler and another cloche hat. To the left, there is a patterned fabric hanging, possibly a coat or a piece of clothing. In the distance, a sign with the word "MEN" is visible, suggesting a nearby store or section of a store. The overall atmosphere of the image suggests an urban setting in the past, possibly in the early to mid-20th century.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This is a black and white photograph that appears to be from an earlier historical period. The image shows two people wearing hats - one appears to be a young child in a cap, and the other is an adult wearing what looks like a beret or similar head covering. They are captured in what seems to be a street or urban setting, with some blurred figures and a storefront visible in the background. The photograph has an intimate, candid quality to it, capturing a moment of genuine expression between the subjects. The contrast and grain of the black and white photography gives the image a classic documentary style feel.

Created by claude-3-haiku-20240307 on 2024-12-30

The image shows two people, a young boy and an elderly woman, standing in what appears to be a crowded urban setting. The boy is wearing a cap and the woman is wearing a head covering. They are both smiling and seem to be interacting with each other. The background suggests a busy, somewhat rundown commercial area, with various objects and signage visible. The overall tone of the image is one of warmth and connection between the two individuals, despite their apparent differences in age and social status.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This is a black and white photograph that appears to have been taken in an urban setting, likely from the mid-20th century. The image shows a street scene with people wearing period-appropriate clothing including caps and hats. The composition has an intimate, candid quality typical of street photography from this era. The lighting and contrast create a striking documentary-style image that captures a moment of everyday life. In the background, there appears to be a storefront or building with some signage visible. The photograph has a naturalistic, unposed quality that gives viewers a glimpse into a genuine moment in time.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a young man and woman in the foreground, with other people in the background. The young man is on the left side of the image, wearing a light-colored cap and a dark sweater over a white collared shirt. He has his right hand raised to his chest, and he appears to be looking at the woman.

The woman is on the right side of the image, wearing a light-colored hat and a dark dress or coat. She is facing the young man and appears to be smiling or laughing. In the background, there are several other people, including a man in a light-colored shirt and a dark hat, who is standing with his back to the camera. There is also a sign that says "MEN" in the background, but it is not clear what it refers to.

Overall, the image appears to be a candid shot of two people interacting with each other in a crowded setting. The atmosphere seems relaxed and friendly, with the woman's smile suggesting a sense of joy or amusement.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a black-and-white photograph of a group of people in an urban setting. The central figures are two individuals, one male and one female, both wearing hats. The man on the left has a serious expression, while the woman on the right appears to be smiling or laughing. In the background, several other people are visible, some of whom are also wearing hats. The overall atmosphere of the image suggests a lively and vibrant scene, possibly from the early 20th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white image depicts a boy and a woman standing in front of what seems to be a store. The boy is wearing a cap and has a serious expression on his face. The woman is wearing a hat and has a smile on her face. She is also wearing a necklace and has her hand raised. Behind them, there are other people, some of whom are wearing hats.

Created by amazon.nova-lite-v1:0 on 2025-06-01

A black-and-white photo shows a young boy and a woman standing next to each other in what appears to be a crowded street or market. The boy is wearing a cap and has a serious expression, while the woman is smiling and wearing a beanie. Behind them, there are several people wearing hats, and one of them is wearing a white hat. The background is blurry, and there are signs and objects in the distance.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

Here is a description of the image:

The photograph is a black and white image of a crowded street scene. In the foreground, a young boy with a newsboy cap looks directly at the camera with a serious expression. To his right, a woman with short hair and a beret smiles warmly, appearing to be engaged in a conversation. Behind them, there are glimpses of other people, some wearing hats, creating a sense of bustling activity. The background suggests a storefront, with a sign that reads "MEN" partially visible. Clothing items hang on the left, and there are framed pictures in the background. The overall composition and tonality of the photograph evoke a sense of history and documentary realism.

Created by gemini-2.0-flash-lite on 2025-05-29

Here's a description of the image:

This is a black and white photograph, likely from a historical period, depicting a street scene with a group of people.

Composition and People:

  • The image is focused on a few individuals. A young Black boy wearing a flat cap is prominently in the foreground, gazing directly at the camera with a serious expression.
  • To his right, a Black woman is the next focal point, she wears a beret and smiles.
  • Behind them, several other people are visible, some with hats, suggesting a bustling environment.
  • The overall composition suggests a candid street photograph, capturing a moment in time.

Setting and Background:

  • The background is somewhat obscured, but there is some evidence of a storefront or shop. You can see the word "MEN" on a sign.
  • There appear to be some items hanging up, possibly clothes, suggesting a commercial area or a street market.

Overall Impression:

The photo has a vintage feel due to the black and white style. It creates a sense of observing a moment from the past. The focused expressions of the subjects create a feeling of authenticity and humanity.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The image is a black-and-white photograph capturing a moment in a busy street scene. It features two main subjects in the foreground: a young boy and a woman. The boy, wearing a cap and a sweater, is looking directly at the camera with a neutral expression. The woman, wearing a beret and a dark coat, is smiling and appears to be engaged in conversation or interacting with someone off-camera.

In the background, there are several other people, some of whom are wearing hats, suggesting that the photograph might have been taken in an earlier era when such attire was common. The setting seems to be an urban environment, possibly a market or a busy street, as indicated by the presence of various people and the partially visible signage and storefronts. The overall atmosphere of the image conveys a sense of everyday life and social interaction in a bustling city setting.

Qwen

No captions written