Human Generated Data

Title

Untitled (Philip Shan and Hattie, Judith, and Ezra Shahn, Brooklyn, New York City)

Date

Fall 1936-Spring 1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4377.3

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Philip Shan and Hattie, Judith, and Ezra Shahn, Brooklyn, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Fall 1936-Spring 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4377.3

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 100
Coat 99.7
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Male 98.7
Person 98.7
Boy 98.7
Child 98.7
Male 98.4
Person 98.4
Boy 98.4
Child 98.4
Overcoat 86
Face 85.6
Head 85.6
People 83.1
Bonnet 80.1
Photography 75.4
Portrait 75.4
Coat 65.9
Sun Hat 56.5
Shirt 55.8
Architecture 55.1
Building 55.1
Hospital 55.1
Door 55.1

Clarifai
created on 2018-05-10

people 99.9
wear 97.5
adult 97.1
group together 96.3
group 95
man 94.2
several 92.5
four 91.4
two 90.7
veil 90.3
woman 90.3
three 89.2
outfit 89.2
leader 88.2
child 86.2
retro 85.5
administration 84.4
five 83.8
facial expression 82.5
lid 81.2

Imagga
created on 2023-10-06

nurse 34.4
coat 32.4
man 31.6
clothing 28.6
lab coat 28.1
male 26.2
uniform 24.3
person 21.9
professional 20.4
people 19.5
adult 19.2
medical 17.6
doctor 16.9
military uniform 16.8
happy 15.7
men 15.4
health 15.3
worker 15.1
job 15
hospital 14.4
businessman 14.1
garment 13.9
portrait 13.6
statue 13.2
occupation 12.8
smile 12.8
looking 12.8
business 12.7
old 12.5
profession 12.4
work 11.8
smiling 11.6
care 11.5
patient 11.1
face 10.6
medicine 10.6
building 10.4
senior 10.3
black 10.2
day 10.2
team 9.8
handsome 9.8
couple 9.6
suit 9.5
corporate 9.4
architecture 9.4
teamwork 9.3
friendly 9.1
attractive 9.1
gown 9
equipment 9
group 8.9
clinic 8.8
office 8.8
stethoscope 8.8
lab 8.7
happiness 8.6
serious 8.6
two 8.5
monument 8.4
mature 8.4
holding 8.2
covering 8.1
religion 8.1
home 8
sculpture 7.8
ancient 7.8
staff 7.7
travel 7.7
laboratory 7.7
30s 7.7
elderly 7.7
businesspeople 7.6
historical 7.5
cricket equipment 7.5
historic 7.3
new 7.3
color 7.2
dress 7.2
bright 7.1
consumer goods 7.1
indoors 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

man 97.2
person 97.1
window 85.1
posing 69.7
old 65.5

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 30-40
Gender Female, 69.3%
Happy 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.4%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 26-36
Gender Male, 71%
Calm 94.9%
Fear 6.4%
Surprised 6.3%
Sad 2.9%
Confused 0.7%
Happy 0.5%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Sad 95.1%
Happy 31.9%
Confused 13.7%
Surprised 7.1%
Fear 6.7%
Calm 1.6%
Disgusted 0.9%
Angry 0.7%

AWS Rekognition

Age 27-37
Gender Female, 54.7%
Calm 93.5%
Surprised 6.4%
Fear 6%
Happy 4.2%
Sad 2.6%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%

Imagga

Traits no traits identified

Feature analysis

Amazon

Coat
Adult
Male
Man
Person
Boy
Child
Coat 99.7%
Coat 65.9%
Adult 98.8%
Male 98.8%
Male 98.7%
Male 98.4%
Man 98.8%
Person 98.8%
Person 98.7%
Person 98.4%
Boy 98.7%
Boy 98.4%
Child 98.7%
Child 98.4%

Categories

Imagga

paintings art 99.5%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people standing in front of a house -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image is a black-and-white negative featuring a group of individuals posing outdoors. They are dressed in winter clothing, including coats, hats, and scarves. The background shows part of a wooden structure, with a door and a window that appears to have a wire mesh screen. The overall tone suggests a cold season or climate.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image appears to be a negative photograph depicting a group of four individuals standing in front of a building with wooden siding. They are all dressed in coats and hats, suggesting it may be cold weather. One of the individuals is holding something that resembles a handbag. There is a window on the right side with a grid pattern of glass, and a door on the left. The photograph has a vintage quality, indicated by the clothing style and the photographic technique used.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a family standing on the steps of a building. There is an adult man wearing a white coat and hat, an adult woman wearing an elaborate white dress and hat, and two young children, a boy and a girl, also dressed in white clothing. The image appears to be a historical black and white photograph, likely from the early 20th century based on the clothing and setting. The family members are posing together, suggesting this may be a formal portrait or special occasion photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white historical photograph showing a family group dressed in white clothing. The image appears to be from the early 20th century, based on the style of dress. The group includes what appears to be parents and children standing on what looks like a porch or entryway of a building. The adults are wearing formal attire - the taller figure is wearing a long white coat and hat, while next to them is someone in what appears to be a white dress and hat. Two children are also present, dressed in light-colored clothing. The photograph has the characteristic quality and style of early photography, with some visible aging and texture. According to the image credit, this photograph is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of a family standing in front of a house.

The man on the left is wearing a long, light-colored coat and a hat. He has his hands in his pockets. The woman in the middle is wearing a long, light-colored coat and a hat. She is holding a purse in her right hand. The boy on the right is wearing a light-colored suit and a hat. He is standing next to a small table or bench.

The background of the image shows the exterior of a house with wood siding and a window with a metal grate. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly in the 1920s or 1930s. The clothing and hairstyles of the individuals in the image are consistent with this time period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of a family of four standing in front of a house. The man on the left is wearing a long coat and hat, while the woman beside him is dressed in a long coat and hat as well. The two children, a boy and a girl, are standing in front of them, both wearing hats. The boy is holding a bag, and the girl has a bow in her hair.

The background of the image shows the exterior of a house with a window and a door. The overall atmosphere of the image suggests that it was taken during a special occasion or event, possibly a family gathering or celebration. The formal attire and the presence of a photographer suggest that the image was intentionally captured to commemorate the moment.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph of a family standing on a porch. The family consists of a man and a woman, both wearing hats, and three children. The man is wearing a suit and a hat, while the woman is wearing a dress and a hat. The children are also wearing hats and are holding a bag and a toy. The family is smiling and appears to be posing for a photograph. The image has a watermark in the bottom left corner that reads "President and Fellows of Harvard College (Harvard University Art Museums)" and a number "P1970.4377.0003."

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image is a black-and-white photograph of four people standing on the porch of a house. The people are wearing winter clothes. The person on the left is a man wearing a hat and a long coat with buttons. Next to him is a woman wearing a hat and a long dress. A girl is standing in front of the woman, holding a handbag. A boy is standing next to the girl, wearing a scarf around his neck.

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

The image shows a family portrait in negative. A man, wearing a hat, coat, and glasses, stands to the left. A woman, also wearing a hat and coat, stands next to him. Two children stand in front of them. The image is taken outdoors in front of a house. A door is behind the man and a window with a wire mesh screen is behind the children.

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

The image is a black and white negative photograph depicting a family portrait. The family stands in front of a wooden building, possibly a house.

The family members are:

  • A man wearing a fedora hat, glasses, a tie, and a long, double-breasted coat. He has his hands in his pockets.
  • A woman with a hat. She holds a small purse and is wearing a long coat.
  • Two young children, both wearing coats and hats. One child is holding a small object and the other is holding a large object.

The image's background shows a wooden exterior wall with a window covered by a wire mesh. The photograph has a somewhat grainy texture, typical of older photographic processes. Overall, it gives a vintage feel, suggesting it was taken sometime in the past.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-29

The image is a black-and-white photograph depicting a family of five posing outside a wooden building. The family appears to be dressed in formal attire, suggesting a special occasion or a portrait session.

  1. Adult Man: On the left, there is an adult man wearing a long coat, a suit, and a hat. He has a mustache and is looking directly at the camera.

  2. Adult Woman: To the right of the man is an adult woman dressed in a long, elegant white dress and a decorative hat. She is also looking at the camera.

  3. Children: There are three children in the photo:

    • The first child, standing in front of the woman, is wearing a white dress and a hat.
    • The second child, standing to the right of the first child, is dressed in a white suit with a hat.
    • The third child, standing to the right of the second child, is wearing a white dress with a scarf or shawl draped over the shoulders.

The background consists of the wooden exterior of a building with a window that has a wire mesh screen. The family is positioned near the entrance of the building, with the man standing closest to the door. The overall scene suggests a sense of formality and togetherness.

Text analysis

Amazon

and
of
Art
(Harvard
College
Fellows
Museums)
President and Fellows of Harvard College (Harvard University Art Museums)
University
Harvard
President
P1970.4377.0003

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4377.0003
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4377.0003