Human Generated Data

Title

Untitled (Judith Shahn, New York City)

Date

1934-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.194

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Judith Shahn, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1934-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.194

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Human 99.7
Bonnet 92.8
Wood 73.6
Cap 72.6
Coat 65.4
Beanie 65.3
Face 64.3
Sun Hat 56.4
Overcoat 56.1

Clarifai
created on 2023-10-15

portrait 98.8
one 96.9
people 96.7
old 96.1
retro 94.2
vintage 94
street 93.6
lid 92.8
step 90.6
wear 90.2
man 89.9
gun 89.3
monochrome 88.7
adult 88.2
boy 87.3
art 84.7
sepia 84
music 83.4
dark 79
military 76.9

Imagga
created on 2021-12-15

person 27.8
portrait 25.9
man 23.5
people 23.4
black 19.8
adult 19.4
male 18.2
child 17.8
hat 17.5
wall 17.1
face 14.9
world 14.8
attractive 14
fashion 13.6
human 13.5
one 13.4
youth 12.8
casual 12.7
hair 12.7
pretty 12.6
brick 12.4
clothing 11.4
uniform 11.3
happy 11.3
sexy 11.2
cute 10.8
device 10.3
sitting 10.3
culture 10.2
lifestyle 10.1
teen 10.1
performer 9.8
urban 9.6
comedian 9.6
model 9.3
alone 9.1
looking 8.8
happiness 8.6
men 8.6
headdress 8.6
hand 8.4
city 8.3
street 8.3
teenager 8.2
danger 8.2
style 8.2
posing 8
musical instrument 7.9
boy 7.8
eyes 7.7
mask 7.7
outdoor 7.6
serious 7.6
wind instrument 7.5
leisure 7.5
dirty 7.2
smile 7.1
women 7.1
love 7.1
modern 7

Google
created on 2021-12-15

Smile 93.5
Hat 90.2
Style 83.8
Black-and-white 83.4
Headgear 82.5
Sun hat 79.1
Tints and shades 77.4
Vintage clothing 76.2
Child 74.5
Cap 74.2
Monochrome photography 74.1
Wood 73.1
Monochrome 72.4
Art 71.5
Fedora 70.4
Happy 68.5
Room 66.9
Toddler 65.4
Rectangle 64.3
Sitting 64.1

Microsoft
created on 2021-12-15

building 99.8
outdoor 99.5
person 97.3
human face 95.7
clothing 95.6
text 90.5
black and white 72.1
smile 57.2
hat 50.8
old 48.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Male, 84.9%
Happy 98.1%
Calm 1.2%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

Human face
Human head
Woman
Human mouth
Human eye

AWS Rekognition

Person 99.7%

AWS Rekognition

Hat 97.6%

Clarifai

Human face 96.2%

Clarifai

Human head 68.4%

Clarifai

Woman 57.9%

Clarifai

Human mouth 37.9%

Clarifai

Human eye 34.7%

Clarifai

Human eye 34.2%

Categories

Imagga
created on 2021-12-15

paintings art 43.5%
nature landscape 26.1%
pets animals 14.5%
food drinks 6.1%
people portraits 5%
streetview architecture 1.9%
interior objects 1.1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

a boy with a hat.

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a woman in a hat and coat is standing in front of a wooden wall

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts a person standing in front of a wooden plank wall, with long braids tied with large plaid bows. They are wearing a dark coat with buttons and a hat. The shadow of their figure is cast clearly on the wooden backdrop, adding depth and texture to the composition. The overall style and setting suggest an old-fashioned or vintage aesthetic.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image shows a child wearing a dark coat and a hat, standing against a wooden wall composed of horizontal planks. The child has long hair styled in braids, each adorned with large plaid bows. The lighting creates a distinct shadow of the child's profile on the wooden background, capturing the outline of the hat and braids. The image is in black and white, suggesting it is from a past era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a young person, likely a child, standing in front of a wooden wall or structure. The child is wearing a hat, a coat, and a scarf, and has a cheerful expression on their face. The image appears to be a black and white photograph, giving it an older, vintage feel. The background is slightly blurred, drawing the focus to the child in the center of the frame.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a vintage black and white photograph, likely from the early 20th century, showing a young child dressed in winter clothing including a dark coat and a bowler or derby-style hat. The child is standing against what appears to be a wooden wall made of horizontal planks. The lighting creates an interesting shadow effect on the wall. The photograph has that characteristic sepia-toned quality common to photographs from that era, and despite its age, the image is quite clear and well-preserved.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a young girl standing in front of a wooden wall, with her shadow cast on the wall behind her.

The girl is wearing a dark coat with large buttons and a plaid scarf around her neck. She has a dark hat on her head, and her hair is styled in braids that fall over her shoulders. Her hands are clasped together in front of her, and she appears to be smiling at the camera.

The background of the image is a wooden wall made up of horizontal planks. The wall is weathered and worn, with visible signs of aging and wear. The overall atmosphere of the image is one of nostalgia and simplicity, evoking a sense of a bygone era.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a vintage photograph of a young girl standing in front of a wooden wall. The girl is dressed in a dark coat with buttons down the front, a plaid scarf tied around her neck, and a dark hat. Her hands are clasped together in front of her, and she is smiling at the camera.

The background of the image is a weathered wooden wall, which appears to be made of horizontal planks. The wall has a rough texture and is painted a light color, but it is worn and faded in some areas. The overall atmosphere of the image is one of simplicity and innocence, capturing a moment in time from the past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a vintage photograph featuring a young girl standing against a wooden wall. She is dressed in a long-sleeved coat with a bow on the collar and a hat. The girl is smiling and seems to be posing for the camera. Her shadow is cast on the wall behind her, indicating that the photo was taken during the day. The wooden wall has a weathered appearance, with visible cracks and marks, suggesting that it is an older structure.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of a young girl. She is standing against a wooden wall, and her shadow is cast on the wall behind her. The girl is wearing a hat, a coat, and a scarf. She is smiling and looking directly at the camera. The girl's hair is tied back, and she has a bow in her hair. The girl is wearing a coat with buttons down the front.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage, black-and-white photograph of a young girl. The photograph has a slightly aged or sepia-toned look, typical of older photographs. The girl is smiling and appears to be standing outside.

Details:

  • Subject: The main focus is a young girl. She is wearing a dark-colored coat and a hat, suggesting a cooler climate or season. She has her hair styled in braids, with plaid ribbons tied in them. She appears to be smiling with her front teeth showing.
  • Setting: The background consists of a wooden plank wall, and a large shadow is cast on the wall to the left of the girl, possibly caused by a tree. The bright sunlight casts the shadow that obscures a lot of the left side of the image.
  • Composition: The girl is positioned slightly off-center, with her right side towards the camera. This composition makes her the obvious focus of the image.
  • Tone/Mood: The photograph evokes a sense of nostalgia and perhaps a hint of simplicity. The girl's smile contributes to a cheerful mood, but the slightly aged appearance of the photo also suggests the passage of time.

Overall:

The photograph gives a snapshot into a bygone era, capturing a moment of childhood happiness.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a vintage black-and-white photograph featuring a young girl standing in front of a wooden wall. She has pigtails tied with plaid bows and a matching plaid scarf. She wears a dark coat and a rounded hat, and her hands are clasped in front of her. The sun casts a distinct shadow of her and a nearby object onto the wall behind her. The overall tone of the image is nostalgic and evokes a sense of a different era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a vintage photograph of a young girl standing against a wooden wall. The girl is wearing a dark coat with a plaid scarf tied around her neck and a dark hat. She has her hair styled in braids that are looped up on either side of her head. The photograph has a sepia tone, which gives it an aged appearance, and there is a noticeable shadow of the girl cast on the wooden wall behind her. The girl appears to be squinting, possibly due to bright sunlight. The overall mood of the image suggests a candid moment captured in the past.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-09

The image is a vintage black-and-white photograph of a young girl standing against a wooden wall. The girl is wearing a dark coat with what appears to be a plaid scarf or tie around her neck and a dark hat. Her hair is styled in a bob cut, and she has a friendly, slight smile on her face. The wooden wall behind her has horizontal planks and shows signs of wear and tear, with some discoloration and imperfections. The shadows on the wall suggest the photograph was taken in natural light, possibly during the late afternoon, as the shadows are elongated and angled. The overall tone of the image is nostalgic and evokes a sense of a bygone era.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-09

This is a sepia-toned black-and-white photograph of a young girl standing outdoors. She is wearing a dark coat, a plaid scarf, and a beret-style hat. She has curly hair that is visible on either side of her face, partially covered by the scarf. She is smiling and looking slightly to her left. The background consists of a wooden wall with horizontal planks, and her shadow is cast on the wall behind her. The overall mood of the image is warm and nostalgic.