Human Generated Data

Title

Untitled (possibly Progressive Party convention)

Date

1948

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4284.3

Human Generated Data

Title

Untitled (possibly Progressive Party convention)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4284.3

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 99.4
Architecture 99.1
Building 99.1
Hospital 99.1
Head 98.1
Face 97.7
Crowd 82.2
Indoors 70.9
Smoke 58
Beard 57.6
Body Part 57.5
Finger 57.5
Hand 57.5
Clothing 57.4
Hat 57.4
Restaurant 57.1
Clinic 56.6
Cafeteria 55.6
Accessories 55.6
Sunglasses 55.6
Food 55.3
Meal 55.3

Clarifai
created on 2018-05-10

people 99.9
group 98.5
adult 97.4
man 96.5
child 94.9
woman 93.4
group together 92.9
monochrome 92.8
many 88.8
war 88.5
administration 87.1
leader 85.1
wear 80.9
room 79
several 78.5
military 78.2
furniture 77.1
medical practitioner 74.5
family 73.6
portrait 73.3

Imagga
created on 2023-10-06

person 25.2
people 22.3
man 22.2
surgeon 20.9
male 18.4
patient 17.1
men 15.4
adult 15.2
nurse 15
hospital 14
medical 12.3
love 11.8
room 11.7
clothing 11.6
couple 11.3
mask 11.2
old 11.1
bride 10.5
doctor 10.3
groom 10.3
women 10.3
dress 9.9
art 9.4
sculpture 9.2
wedding 9.2
city 9.1
hand 9.1
portrait 9.1
care 9
worker 9
health 9
black 9
human 9
medicine 8.8
surgery 8.8
indoors 8.8
home 8.8
celebration 8.8
happy 8.8
work 8.6
married 8.6
case 8.6
husband 8.6
sick person 8.5
brassiere 8.5
fashion 8.3
vintage 8.3
newspaper 8.2
iron lung 8.2
suit 8.1
history 8
operation 7.9
equipment 7.8
happiness 7.8
architecture 7.8
antique 7.8
ancient 7.8
statue 7.8
illness 7.6
respirator 7.5
professional 7.4
smiling 7.2
religion 7.2
team 7.2
hair 7.1
smile 7.1
face 7.1
covering 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 94.8
old 45.6

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 24-34
Gender Female, 88%
Calm 54.6%
Disgusted 20.7%
Surprised 11.9%
Fear 7.8%
Sad 3.5%
Confused 3.3%
Angry 2.7%
Happy 2.6%

AWS Rekognition

Age 48-54
Gender Female, 94%
Calm 92.3%
Surprised 6.7%
Fear 6%
Disgusted 4.2%
Sad 2.3%
Happy 1.1%
Confused 0.4%
Angry 0.4%

AWS Rekognition

Age 43-51
Gender Male, 99.6%
Calm 67.8%
Happy 17.5%
Surprised 15%
Fear 6%
Sad 2.6%
Confused 0.7%
Disgusted 0.7%
Angry 0.4%

AWS Rekognition

Age 50-58
Gender Female, 89.1%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Female
Woman
Baby

Clarifai

Human face
Man
Clothing
Woman
Human hair
Human hand
Human mouth

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 94.8%

AWS Rekognition

Person 94.2%

AWS Rekognition

Person 93.9%

AWS Rekognition

Person 93.8%

AWS Rekognition

Person 93.3%

AWS Rekognition

Person 58.3%

AWS Rekognition

Adult 98.4%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Adult 97.1%

AWS Rekognition

Adult 95.8%

AWS Rekognition

Adult 94.8%

AWS Rekognition

Adult 94.2%

AWS Rekognition

Adult 93.3%

AWS Rekognition

Male 98.4%

AWS Rekognition

Male 97.9%

AWS Rekognition

Male 97.1%

AWS Rekognition

Male 95.8%

AWS Rekognition

Male 93.3%

AWS Rekognition

Man 98.4%

AWS Rekognition

Man 97.9%

AWS Rekognition

Man 97.1%

AWS Rekognition

Man 95.8%

AWS Rekognition

Man 93.3%

AWS Rekognition

Female 94.8%

AWS Rekognition

Female 94.2%

AWS Rekognition

Woman 94.8%

AWS Rekognition

Woman 94.2%

AWS Rekognition

Baby 93.8%

Clarifai

Human face 92.7%

Clarifai

Human face 92%

Clarifai

Human face 87.7%

Clarifai

Human face 79.8%

Clarifai

Human face 69.8%

Clarifai

Human face 68.5%

Clarifai

Human face 65.2%

Clarifai

Human face 57.5%

Clarifai

Human face 53.1%

Clarifai

Man 87.7%

Clarifai

Man 85.7%

Clarifai

Man 83.8%

Clarifai

Man 79.8%

Clarifai

Man 74.2%

Clarifai

Man 69.1%

Clarifai

Man 49.6%

Clarifai

Man 40%

Clarifai

Clothing 85.9%

Clarifai

Clothing 64.2%

Clarifai

Clothing 62.6%

Clarifai

Clothing 61%

Clarifai

Clothing 44.2%

Clarifai

Clothing 42.1%

Clarifai

Clothing 37.4%

Clarifai

Clothing 33.9%

Clarifai

Woman 55.8%

Clarifai

Human hair 35.7%

Clarifai

Human hand 35%

Clarifai

Human mouth 33%

Categories

Imagga
created on 2023-10-06

paintings art 78.3%
people portraits 14.9%
pets animals 4.9%

Captions

Microsoft
created by unknown on 2018-05-10

a black and white photo of a person 84.6%
an old photo of a person 84.5%
old photo of a person 84.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people sitting in chairs in a room

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people sitting in chairs in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image appears to be a negative of a photograph depicting a group of people seated in a room, possibly at an event or meeting. The individuals are dressed formally, with men in suits and ties, and some women wearing hats. The setting includes chairs and visible walls in the background, suggesting an indoor environment. The people seem engaged, and some are holding documents or papers.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a negative photograph depicting a group of people seated in what appears to be an indoor setting, such as a lecture hall or conference room. The attendees are dressed in formal attire typical of a mid-20th-century setting, with men in suits and ties and women wearing hats and coats. The arrangement suggests that they are part of an audience or attending a meeting or presentation. The scene is viewed from a side angle, capturing several rows of seating with people focused on something out of frame.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to show a group of people gathered together, likely in a religious or ceremonial setting. The individuals are wearing robes and appear to be in a solemn or contemplative state. The image is in black and white, giving it a historic feel. While the image contains human faces, I will not identify or name any of the individuals present, as per the instructions provided.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph from the Harvard University Art Museums collection. The image shows a group of people wearing what appears to be medical face masks and white coats or uniforms, seated in rows. Given the medical attire and the time period (suggested by the photographic style), this could be from a medical school class, hospital staff meeting, or possibly during the 1918 influenza pandemic when mask-wearing became widespread. The image has a somewhat grainy, vintage quality typical of early 20th century photography. The people are all facing in the same direction, as if attending a lecture or presentation.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of individuals seated in a room, likely attending an event or lecture. The photograph is in black and white, with a prominent watermark at the bottom indicating it is from the Harvard University Art Museums.

The room appears to be a lecture hall or auditorium, with rows of chairs and a speaker's podium visible in the background. The attendees are dressed in formal attire, suggesting a professional or academic setting. Some of them are holding papers or notebooks, possibly taking notes during the presentation.

The overall atmosphere of the image suggests a serious and focused gathering, with the attendees engaged in the discussion or lecture being presented. The use of black and white photography adds a sense of nostalgia and timelessness to the image, evoking a bygone era of intellectual discourse and academic inquiry.

Key Features:

  • Black and white photograph
  • Lecture hall or auditorium setting
  • Formal attire worn by attendees
  • Papers or notebooks held by some attendees
  • Serious and focused atmosphere
  • Nostalgic and timeless feel

Inferences:

  • The event or lecture is likely related to academia or intellectual pursuits.
  • The attendees are likely scholars, researchers, or students.
  • The discussion or lecture being presented is likely focused on a specific topic or field of study.
  • The image captures a moment of intellectual engagement and exchange.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of people sitting in chairs, likely at an event or gathering. The individuals are dressed in formal attire, with men wearing suits and ties, and women wearing dresses or skirts. They appear to be engaged in conversation or listening to a speaker, as some of them are turned towards each other or facing forward.

In the background, there is a wall with a window on the right side, which suggests that the event is taking place indoors. The overall atmosphere of the image is one of sophistication and elegance, as the attendees are well-dressed and seem to be enjoying themselves.

The image has a vintage quality to it, with a grainy texture and a faded appearance. This could suggest that the photograph was taken many years ago, possibly in the early 20th century. Overall, the image provides a glimpse into a bygone era, showcasing the fashion and social norms of the time.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The image is a black-and-white photograph of a group of people seated in chairs. The photograph appears to be from an earlier era, possibly the early to mid-20th century, based on the clothing and hairstyles of the individuals. The people in the image are seated in rows, facing forward, and appear to be listening to a speaker or presentation. Some of the individuals are wearing glasses, and some have their heads bowed or tilted. The image has a slightly blurred quality, which may be due to the age of the photograph or the quality of the original print. The background of the image is a plain wall with a window and a door visible in the upper right corner. The image has a watermark in the bottom left corner that reads "President and Fellows of Harvard College (Harvard University Art Museums)" and a number "P1970.4284.0003" in the bottom right corner.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The black and white image shows a group of people sitting in a room. Some of them are wearing glasses, and some are holding books. The people are looking in different directions, and some are looking at something. The room has a white wall and a white ceiling. There is a watermark on the bottom left corner that reads "President and Fellows of Harvard College (Harvard University Art Museums)" and "P1970.4284.0003".

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

This is a black-and-white negative image of a group of people seated, seemingly attending an event or meeting. The people are mostly middle-aged and older, and they are dressed in what appears to be formal or semi-formal attire. Many are wearing glasses. The room is lit, but there is not a lot of contrast in the image, which makes distinguishing details difficult. There is a window in the background, and the rows of people suggest a lecture hall or auditorium setup.

Created by gemini-2.0-flash-lite on 2025-05-28

Here's a description of the image:

Overall Impression:

The image is a black and white, inverted photograph. It appears to be a candid shot of a group of people seated in what looks like an auditorium or meeting room. The image is aged and has some imperfections.

Key Elements:

  • People: Several people are visible, likely seated and possibly listening to someone or something. They appear to be dressed in attire that suggests a formal or professional setting. Some individuals are wearing eyeglasses.
  • Setting: The background seems to be a plain wall. There is a window or opening in the upper right corner of the image. The chairs they are sitting in are visible.
  • Light and Shadow: The inverted nature of the photograph causes shadows to appear light, and highlights to appear dark.

Possible Interpretation:

Given the setting and the people's appearance, the image could be of a lecture, meeting, or some other type of gathering. The age of the photograph suggests it could be a historical image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a group of people seated in what appears to be a formal or official setting, possibly a meeting or conference. The photograph is quite old, as indicated by the style of clothing and the quality of the image.

Key details include:

  1. People: The group consists mostly of men, dressed in suits and ties, suggesting a professional or formal occasion. There is at least one woman in the group, wearing a striped dress.
  2. Setting: The setting appears to be indoors, with a plain background, possibly a wall or partition. The individuals are seated in rows, facing forward, which indicates they are attending a presentation or speech.
  3. Attire: The men are wearing suits, ties, and some are wearing hats, which was common in earlier decades. The woman is dressed in a striped dress, which also reflects the fashion of an earlier era.
  4. Expression and Posture: The expressions and postures of the individuals suggest they are attentive and engaged in the event they are attending.
  5. Image Quality: The photograph has some signs of wear and age, including scratches and blurriness, which contribute to its vintage appearance.

The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums), indicating it may be part of an archival collection. The code "P1970.4284.0003" likely refers to its catalog number within the collection.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph showing a group of people seated at tables in what appears to be a formal setting, possibly a meeting or a social event. The individuals are dressed in formal attire, with some wearing hats, and the setting includes ornate tablecloths. The lighting is bright, with the main light source coming from the front, casting shadows behind the people. The room has a simple, somewhat bare look with minimal decorations, and there is a window or a door in the background. The overall atmosphere suggests a formal or academic gathering, as indicated by the text in the image which credits the President and Fellows of Harvard College and is associated with the Harvard University Art Museums.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph depicts an indoor gathering of individuals, likely during a formal event or meeting. The attendees are seated in rows, many dressed in suits and formal attire. Some individuals are wearing hats, while others have their hats off and held in their hands. The scene appears to be in a large room with a high ceiling and a window visible in the background. The image has a vintage quality, suggesting it was taken in the early to mid-20th century. The photograph is labeled with the text "© President and Fellows of Harvard College (Harvard University Art Museums)" and an image number "P1970.4284.0003."

Text analysis

Amazon

Art
and
University
(Harvard
of
Fellows
College
Harvard
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
President
P1970.4284.0003

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4284.0003
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4284.0003