Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2838

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2838

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Body Part 100
Finger 100
Hand 100
Clothing 100
Face 99.7
Head 99.7
Photography 99.7
Portrait 99.7
Person 99.4
Adult 99.4
Female 99.4
Woman 99.4
Person 99.1
Adult 99.1
Female 99.1
Woman 99.1
Hat 98.1
Person 97.2
Accessories 96.9
Bag 96.9
Handbag 96.9
Glasses 93
Person 86.5
Sun Hat 79.5
Person 79.5
Wallet 79.3
Lady 75.2
Hat 71.9
Cap 57.6
Electrical Device 57.1
Microphone 57.1
Purse 56.4
Crowd 55.7
Baseball Cap 55.7
Blouse 55.2
Sunglasses 55.2
Electronics 55.1
Phone 55.1

Clarifai
created on 2018-05-10

people 99.9
adult 99.4
woman 98.2
portrait 97.9
wear 97
one 95.3
actress 94.9
two 93.7
monochrome 93.5
facial expression 93.1
man 92.9
veil 91.2
administration 90.4
musician 89.9
street 88.1
outfit 88.1
music 87.5
group 86.6
singer 83.9
indoors 81.4

Imagga
created on 2023-10-05

person 28.9
portrait 28.5
people 27.3
adult 26.8
man 24.9
face 22.7
sexy 22.5
model 21.8
fashion 21.1
male 20.9
black 18.6
attractive 17.5
chain mail 17.1
happy 16.9
dress 16.3
pretty 16.1
smiling 15.9
style 15.6
smile 15
lady 14.6
clothing 14.3
armor 14.1
body armor 13.6
women 13.4
couple 13.1
blond 13
hat 12.9
elegant 12.8
hair 12.7
love 12.6
lifestyle 12.3
one 11.9
vintage 11.6
spectator 11.4
human 11.2
body 11.2
expression 11.1
sensual 10.9
elegance 10.9
posing 10.7
child 10.6
looking 10.4
passion 10.3
work 10.3
youth 10.2
indoors 9.7
performer 9.7
together 9.6
brunette 9.6
men 9.4
happiness 9.4
worker 9.4
cute 9.3
casual 9.3
bow tie 9.2
mother 9.2
traditional 9.1
old 9.1
fun 9
luxury 8.6
necktie 8.3
leisure 8.3
inside 8.3
retro 8.2
cheerful 8.1
family 8
boy 7.8
vogue 7.7
two 7.6
wearing 7.6
studio 7.6
hot 7.5
relationship 7.5
shop 7.5
world 7.5
holding 7.4
light 7.3
makeup 7.3
indoor 7.3
sensuality 7.3
make 7.3
stylish 7.2
home 7.2
handsome 7.1
romantic 7.1
protective covering 7.1
kid 7.1
job 7.1
interior 7.1
modern 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.9
outdoor 94.3
people 67.1
crowd 1.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 45-51
Gender Female, 100%
Calm 86.4%
Surprised 8.1%
Confused 6.3%
Fear 6.3%
Sad 2.3%
Happy 1%
Angry 0.8%
Disgusted 0.5%

AWS Rekognition

Age 45-51
Gender Female, 100%
Confused 95.7%
Surprised 6.4%
Fear 6.1%
Sad 2.2%
Calm 1.6%
Angry 1.1%
Disgusted 0.4%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Male, 89%
Calm 70.2%
Surprised 12.8%
Fear 6.6%
Sad 5.1%
Happy 4.2%
Disgusted 3.8%
Confused 3%
Angry 1.4%

AWS Rekognition

Age 4-10
Gender Male, 77.2%
Calm 98.4%
Surprised 6.3%
Fear 6.1%
Sad 2.3%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Angry 0%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Female
Woman
Hat
Glasses
Wallet
Person 99.4%
Person 99.1%
Person 97.2%
Person 86.5%
Person 79.5%
Adult 99.4%
Adult 99.1%
Female 99.4%
Female 99.1%
Woman 99.4%
Woman 99.1%
Hat 98.1%
Hat 71.9%
Glasses 93%
Wallet 79.3%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-28

a photograph of a woman in a polka dot dress and hat -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The monochrome image captures two women standing in front of a store window or glass door. They are engaged in conversation. The woman on the left is dressed in a polka-dot-patterned outfit and wears a hat, while the woman on the right is wearing a patterned dress with short sleeves and a bag strap over her shoulder. Reflections in the glass show mannequins and other individuals in the background, creating a busy and layered urban scene.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts two individuals standing in front of a storefront window. The left individual is wearing a dotted dress and a hat, holding a rectangular object. The right individual is dressed in a patterned dress with a v-neck and has arms crossed. In the reflection behind them, mannequins can be seen wearing hats, suggesting this may be a clothing store. The background includes reflections of other elements from the street or shop window, creating a busy urban scene.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of two women standing in front of a storefront. The woman on the left wears a dark dress with white polka dots and a matching hat, while the woman on the right sports a patterned dress and glasses. Both women have their arms crossed, with the woman on the left holding a purse and the woman on the right grasping a cigarette.

In the background, a mannequin head and a few other people are visible, although they are not clearly defined. The overall atmosphere of the image suggests a casual, everyday scene, possibly taken in the 1920s or 1930s. The women's attire and hairstyles are consistent with fashion trends from that era, and the storefront behind them appears to be a small, local business.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image depicts two women standing in front of a storefront, with the woman on the left wearing a dark-colored dress adorned with white polka dots and a matching hat. She is holding a small black clutch purse in her right hand and has her left arm crossed over her body. The woman on the right is dressed in a patterned dress featuring a bow at the neckline and has her arms crossed. In the background, several mannequin heads are visible through the store window, while the overall atmosphere of the image suggests that it was taken during the daytime, possibly in the 1930s or 1940s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

A black-and-white photograph features two women standing in front of a glass door, possibly engaged in a conversation. The woman on the left is wearing a hat, a polka-dot dress, and a watch, and she holds a black purse in her left hand. The woman on the right wears glasses, a patterned dress, and a handbag. Behind them, there is a reflection of people, mannequins, and objects in the glass door.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white photo shows two women standing in front of a glass window. The woman on the left is wearing a polka-dot blouse and a hat. She is holding a handbag in her left hand and a cigarette in her right hand. The woman on the right is wearing eyeglasses and a ring. She is also holding a handbag in her left hand. Behind them are mannequins wearing hats.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-26

This is a black and white photograph depicting two women standing near a shop. The woman on the left is wearing a hat and a polka-dot dress. She is holding a small black object and an umbrella. The other woman, standing to the right, is wearing glasses and a dress with a floral pattern. She is standing with her arms crossed. The background appears to be a shop window. There are hat mannequins in the shop window. The photograph is well-composed and gives a sense of time, possibly the early to mid 20th century, through their clothing and the overall aesthetic of the photograph.

Created by gemini-2.0-flash on 2025-05-26

Here is a description of the image:

The image is a black and white photograph of two women, standing next to each other, perhaps in front of a store or building. The composition is divided roughly in half, with each woman occupying a distinct space.

On the left, a woman with short, wavy hair is wearing a hat and a dress with large polka dots. She holds an umbrella in her right hand and carries a clutch. She is looking slightly to the right, her expression neutral. Behind her, visible through what appears to be a window or store display, are several mannequin heads wearing hats, suggesting a hat shop or department store.

To the right of the photograph is another woman, wearing glasses and a printed dress tied at the waist. Her arms are crossed, and she appears to be in conversation or speaking, given the slight opening of her mouth. Behind her is a partially visible sign or poster, indicating the proximity to a storefront or public space.

The image is a candid street scene, capturing a slice of life, and the style of clothing suggests that it was taken during the mid-20th century. The quality of the print lends it a vintage feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring two women standing in front of a shop window. The woman on the left is wearing a polka-dotted dress with short sleeves and a hat adorned with a decorative ribbon or band. She has a handbag slung over her shoulder and appears to be looking to the side. The woman on the right is dressed in a patterned, loose-fitting garment and is wearing glasses. She has her arms crossed and is looking directly at the camera. The background shows reflections of other people and buildings, indicating that the photo was taken in an urban setting. The overall scene suggests a casual, everyday moment captured in a city street.