Human Generated Data

Title

Untitled (Philip Shan and Hattie, Judith, and Ezra Shahn, Brooklyn, New York City)

Date

Fall 1936-Spring 1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4377.5

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Philip Shan and Hattie, Judith, and Ezra Shahn, Brooklyn, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Fall 1936-Spring 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4377.5

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Hat 100
Face 100
Head 100
Photography 100
Portrait 100
Path 99.5
Brick 98.6
Walkway 98.4
Sun Hat 92.5
City 87.2
Flagstone 74.2
Bonnet 67.6
Road 67.4
Street 67.4
Urban 67.4
Dress 57.6
Costume 57.4
Animal 57.1
Pet 57.1
Cap 55.9
Outdoors 55.8
Architecture 55.2
Building 55.2
Wall 55.2
Cowboy Hat 55.2

Clarifai
created on 2018-05-10

people 99.6
adult 96.9
man 94.4
wear 94.3
woman 94.2
child 93.9
veil 92.9
one 92.7
portrait 87.8
two 86.6
retro 85.9
monochrome 84.4
street 79.8
music 78.9
boy 78.1
facial expression 76.6
outfit 76.4
group together 74.3
group 73.9
wedding 72.2

Imagga
created on 2023-10-05

statue 53.7
fountain 42.9
structure 30.4
sculpture 30.3
groom 21.6
architecture 21.2
art 18.5
column 16.7
ancient 16.4
monument 15.9
portrait 15.5
building 15.3
city 15
culture 14.5
dress 14.5
history 14.3
historical 14.1
tourism 14
old 13.9
historic 13.8
marble 13.7
stone 12.8
travel 12.7
religion 12.5
bride 12.5
people 12.3
fashion 12.1
traditional 11.6
love 11
wedding 11
person 10.8
face 10.7
couple 10.5
style 10.4
church 10.2
tourist 10.1
man 10.1
landmark 9.9
decoration 9.8
married 9.6
adult 9.2
elegance 9.2
wed 8.8
celebration 8.8
bridal 8.8
costume 8.7
antique 8.7
bouquet 8.6
famous 8.4
romantic 8
posing 8
look 7.9
design 7.9
veil 7.8
flowers 7.8
theater 7.8
summer 7.7
head 7.6
human 7.5
memorial 7.4
makeup 7.3
detail 7.2
color 7.2
gown 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

window 83.4
white 66.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 54-62
Gender Female, 93.5%
Calm 46.6%
Happy 39.2%
Surprised 11.3%
Fear 6.3%
Sad 2.8%
Disgusted 2.1%
Confused 0.8%
Angry 0.8%

AWS Rekognition

Age 41-49
Gender Male, 99.3%
Happy 97.3%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Calm 2%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 26-36
Gender Male, 62.6%
Sad 99.7%
Fear 32.3%
Surprised 6.3%
Angry 0.4%
Confused 0.2%
Calm 0.2%
Happy 0.2%
Disgusted 0.1%

Feature analysis

Amazon

Person
Baby
Adult
Male
Man
Coat

Clarifai

Clothing
Human face
Footwear
Human head
Human hair
Human arm

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 93.5%

AWS Rekognition

Baby 97.9%

AWS Rekognition

Adult 97.1%

AWS Rekognition

Adult 93.5%

AWS Rekognition

Male 97.1%

AWS Rekognition

Male 93.5%

AWS Rekognition

Man 97.1%

AWS Rekognition

Man 93.5%

AWS Rekognition

Coat 78.5%

Clarifai

Clothing 88.6%

Clarifai

Clothing 68.9%

Clarifai

Clothing 56.5%

Clarifai

Clothing 41.1%

Clarifai

Human face 84%

Clarifai

Human face 81%

Clarifai

Human face 79.7%

Clarifai

Footwear 50.1%

Clarifai

Footwear 47.4%

Clarifai

Footwear 46.8%

Clarifai

Human head 44.6%

Clarifai

Human hair 44.5%

Clarifai

Human arm 35.7%

Clarifai

Human arm 34.6%

Categories

Imagga
created on 2023-10-05

paintings art 89.3%
streetview architecture 5.5%
pets animals 3.6%
interior objects 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man in a white suit and hat with a child

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a family with a baby

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image appears to be a black-and-white photographic negative of a group of individuals in front of a wooden building with siding. The person in the foreground is a young child dressed in light-colored clothing and a scarf. The person behind the child is wearing a lighter outfit, hat, and glasses. To the left, there are structural elements such as a doorway, while to the right there is a window with a mesh covering. Stone or tile flooring is visible at the bottom of the image, and faint writing appears on some parts of the wall.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a black and white photographic negative showing two individuals standing in front of a wooden building. The person in the back is wearing a hat, a coat, and has their hands resting on the shoulders of the person in front. The person in front is a child wearing a coat, scarf, and pants, and appears to be holding a small object in their hands. The setting is outdoors, with a stone-paved ground beneath them. There is a visible door on the left side and a window on the right side behind the individuals.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to depict a group of people dressed in elaborate, traditional-looking costumes. They are standing on the steps of what seems to be a wooden structure. The costumes include long, flowing white garments and hats or headpieces. The individuals have smiling expressions on their faces, suggesting this may be some kind of ceremonial or cultural event. The image has a black and white, vintage aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical black and white photograph showing several figures wearing white clothing and hats standing on what looks like stone or concrete steps. The image has a somewhat ghostly or double-exposed quality to it, which was sometimes characteristic of early photography techniques. The photograph appears to be credited to Harvard University Art Museums, suggesting it's part of their historical collection. The image has a grainy, vintage quality typical of early 20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of three individuals, including two adults and a child, standing in front of a building with a wooden exterior and a metal gate. The adults are dressed in white clothing, while the child wears a white outfit with a hat. The building's door is visible on the left side of the image, and the ground appears to be made of stone or concrete.

The photograph appears to be an old, possibly historical, image, given its black-and-white nature and the style of clothing worn by the individuals. The image may have been taken in the early 20th century or earlier, based on the clothing and the style of the building.

Overall, the image provides a glimpse into the past, showcasing a moment in time when people were dressed in traditional attire and posed for a photograph in front of a building with a unique architectural style.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black and white photograph of four individuals, likely family members, standing in front of a building. The individuals are dressed in white clothing, with the two adults wearing hats. The two children are positioned in front of the adults, with one child holding a stuffed animal. The background of the image features a building with a window and a door, as well as a wall with writing on it. The overall atmosphere of the image suggests a casual, everyday moment captured in time.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black and white photograph of three individuals standing in front of a building. The person in the middle is wearing a white suit and a hat, and is holding a doll in his arms. The person on the left is wearing a hat and a white suit, and is holding the person in the middle. The person on the right is wearing a hat and a white suit, and is holding the person in the middle. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" in the bottom left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white image shows three people standing in front of a building. The two people behind are wearing hats and long-sleeved shirts. The person in front is wearing a hat and a scarf around his neck. The three people are smiling and seem to be posing for a photograph. The building has a door on the left side and a window on the right side.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

Here is a description of the image:

The image is an inverted black and white photograph of three people standing outside a wooden building. From top to bottom, they are an adult male, an adult female, and a child.

The adult male is wearing a hat and eyeglasses. The adult female is wearing a hat and a long coat. The child is wearing a scarf and a white jacket. They all seem to be smiling.

The building behind them has horizontal wooden planks and a window with a wire mesh screen. There is a closed door to the left. The stone ground in front of them is uneven, with large cracks.

There is some graffiti on the wall next to the door, including the word "DSAYA" and the phrase "TAIS A BLACK SMIT".

The image appears to be a scanned negative, with the light and dark areas reversed.

Created by gemini-2.0-flash-lite on 2025-05-27

Here's a description of the image:

Overall Impression:

The image appears to be a negative of a photograph, giving it an inverted color scheme. It depicts a group of four people posed in front of a building with a wooden, slatted exterior.

Composition:

  • People: There are four figures, a child being held by another person and two more people behind them. They are all dressed in similar outfits.
  • Setting: The group is posed outside, likely on a porch or near a building with wooden siding and a window with a screen.
  • Lighting: The lighting appears to be natural.

Details:

  • The people wear hats.
  • The child has a scarf.
  • The photo appears to be old.

Overall, the photograph seems to be of a family or group of friends posing in front of a house. The style and appearance suggest it could be from the early to mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image appears to be a vintage black-and-white photograph depicting three individuals dressed in elaborate costumes, possibly for a cultural or festive event. Here are the detailed observations:

  1. Setting: The photograph is taken outdoors, in front of a building with wooden siding. There is a door on the left side and a window on the right side, both with visible frames. The ground is paved with stone slabs.

  2. Costumes:

    • The individuals are dressed in what seem to be traditional or ceremonial costumes.
    • The costumes are predominantly white and include flowing robes, head coverings, and various accessories.
    • The person in the front is holding a doll or a small figure dressed similarly in white.
    • The two individuals in the back are wearing hats and have their faces partially covered with masks or paint.
  3. Poses:

    • The person in the front is standing and holding the doll in a cradling position.
    • The two individuals in the back are standing close together, with the person on the left slightly behind the one on the right.
  4. Additional Details:

    • There is some text visible on the wall behind the individuals, but it is not entirely legible.
    • The photograph has some signs of aging, such as scratches and faded areas.

Overall, the image captures a moment from what appears to be a cultural or traditional event, with the participants dressed in distinctive and elaborate costumes.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph showing a group of people dressed in white costumes with masks, standing on a set of steps in front of a building. The costumes appear to have a decorative and theatrical element, with embellishments and possibly symbolic meanings. The individuals are standing in a layered formation, with some appearing to be on top of others. The setting suggests a possible ceremonial, performance, or celebratory context. The overall image has a vintage quality, indicating it may be from an earlier time period.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white image appears to be a double exposure photograph, creating an overlapping and ghostly effect. It shows several individuals, likely a family, standing together in front of a brick wall with a window. The individuals are dressed in light-colored clothing, and some are wearing hats. The double exposure effect makes the figures appear translucent and layered, giving the image an ethereal and surreal quality. The background includes a door with some text written on it, and the ground is made of stone or brick. The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Text analysis

Amazon

and
Art
University
of
College
Fellows
Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
(Harvard
P1970.4377.0005
President
TAJS
SMITH
is
TAJS is A ت BLACK - SMITH
SAYAO
BLACK -
A ت

Google

A BLAS ® President and Fellows of Harvard College (Harvard University Art Museums) P1970.4377.0005
A
BLAS
®
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4377.0005