Human Generated Data

Title

Untitled (elevated view of church interior with people seated in pews and assembly filing through center)

Date

1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9325

Human Generated Data

Title

Untitled (elevated view of church interior with people seated in pews and assembly filing through center)

People

Artist: Martin Schweig, American 20th century

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9325

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 91.8
Paper 84.3
Clothing 83.5
Apparel 83.5
Indoors 83.2
Crowd 82.2
People 81.3
Interior Design 79.6
Art 71.4
Room 71.2
Audience 59.9
Confetti 59.6
Party 58.6
Wedding 56

Clarifai
created on 2023-10-26

people 99.8
crowd 99.1
many 97.9
man 97.9
group 97.8
adult 96.7
cemetery 95.4
woman 94.6
audience 94.4
ceremony 93.7
religion 93.1
grave 92.1
child 91.3
congregation 91.1
leader 91.1
illustration 90.2
desktop 90.1
education 86.9
funeral 86.9
music 85.2

Imagga
created on 2022-01-23

sketch 38.5
drawing 38.1
grunge 35.7
texture 23.6
art 23.5
negative 21.7
representation 21.7
old 20.9
vintage 19.2
design 19.1
graphic 18.2
silhouette 18.2
film 17.1
decoration 16
frame 15.8
retro 15.6
splash 15.2
pattern 15
flower 14.7
aged 14.5
black 14.4
antique 14.1
backdrop 14
floral 13.6
paint 12.7
border 12.7
dirty 12.6
photographic paper 12.5
wallpaper 12.2
wall 12.2
structure 11.7
watercolor 11.5
surface 11.5
snow 11.4
textured 11.4
artistic 11.3
cold 11.2
decorative 10.9
style 10.4
ornament 10.3
graffito 10.1
cool 9.8
creative 9.7
close 9.7
crowd 9.6
paper 9.5
poster 9.4
light 9.4
leaf 9.3
plant 9.1
drop 9.1
material 8.9
color 8.9
water 8.7
scene 8.7
frozen 8.6
architecture 8.6
season 8.6
blank 8.6
weathered 8.5
modern 8.4
photographic equipment 8.3
city 8.3
element 8.3
painting 8.3
backgrounds 8.1
holiday 7.9
liquid 7.8
stencil 7.7
dance 7.7
winter 7.7
grungy 7.6
ice 7.4
artwork 7.3
branch 7.3
transparent 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

drawing 97.2
sketch 93.6
text 87.3
white 68.7
posing 63
group 62.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 61.2%
Calm 57.7%
Sad 14.6%
Fear 12.4%
Confused 5.4%
Happy 4.1%
Disgusted 2.3%
Angry 2%
Surprised 1.5%

AWS Rekognition

Age 18-26
Gender Female, 92.3%
Calm 92.6%
Sad 2.5%
Happy 2.3%
Disgusted 1.3%
Confused 0.6%
Angry 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 64.6%
Calm 39.1%
Disgusted 24%
Sad 11.2%
Happy 9%
Fear 7.3%
Angry 4.6%
Confused 3%
Surprised 1.8%

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Calm 75.4%
Happy 8.4%
Sad 7.1%
Confused 5.5%
Disgusted 1.3%
Angry 1%
Surprised 0.9%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Female, 96.7%
Sad 72.3%
Calm 16.1%
Confused 6.6%
Happy 3.8%
Angry 0.5%
Fear 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Female, 57.6%
Sad 76.2%
Calm 8.4%
Angry 3.9%
Happy 3.9%
Disgusted 3.4%
Surprised 1.6%
Fear 1.4%
Confused 1.2%

AWS Rekognition

Age 23-33
Gender Female, 60.2%
Calm 72.2%
Happy 17.2%
Sad 4.3%
Angry 2.1%
Fear 1.8%
Disgusted 1.3%
Surprised 0.6%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Female, 90.6%
Calm 79.5%
Sad 11.8%
Disgusted 4.4%
Happy 1.7%
Confused 1.2%
Fear 0.7%
Angry 0.5%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Female, 82.5%
Calm 48%
Sad 26.8%
Happy 14.7%
Confused 4.9%
Angry 2.1%
Fear 1.7%
Disgusted 1%
Surprised 0.9%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 91.9%
Sad 3.8%
Confused 2.1%
Happy 1.2%
Disgusted 0.5%
Surprised 0.4%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.7%
Calm 53.1%
Sad 29.6%
Confused 8.8%
Happy 2.9%
Disgusted 2.3%
Angry 1.7%
Fear 1%
Surprised 0.7%

AWS Rekognition

Age 21-29
Gender Female, 95.5%
Calm 64.8%
Sad 21.4%
Confused 6.2%
Happy 4.9%
Angry 0.9%
Disgusted 0.7%
Fear 0.6%
Surprised 0.4%

AWS Rekognition

Age 23-31
Gender Female, 97.6%
Calm 91.4%
Sad 6.4%
Happy 0.9%
Fear 0.3%
Surprised 0.3%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 75.9%
Calm 51.8%
Fear 21.7%
Sad 14.7%
Confused 5.3%
Happy 2.8%
Disgusted 1.7%
Angry 1.1%
Surprised 0.9%

AWS Rekognition

Age 23-33
Gender Female, 84.9%
Surprised 41.5%
Confused 23.5%
Calm 13.6%
Sad 8.2%
Fear 6.4%
Angry 3%
Happy 2.3%
Disgusted 1.6%

AWS Rekognition

Age 28-38
Gender Female, 52%
Sad 72%
Calm 13.4%
Happy 7.8%
Fear 2.8%
Disgusted 1.5%
Confused 1%
Angry 0.9%
Surprised 0.5%

AWS Rekognition

Age 35-43
Gender Male, 76.4%
Disgusted 34.9%
Sad 26.8%
Angry 15.7%
Happy 8.7%
Calm 7.2%
Fear 3.1%
Confused 1.9%
Surprised 1.8%

AWS Rekognition

Age 24-34
Gender Male, 81.2%
Calm 32.7%
Sad 25.8%
Confused 21.7%
Happy 7.3%
Angry 4.2%
Surprised 3.8%
Disgusted 3.5%
Fear 1%

AWS Rekognition

Age 28-38
Gender Male, 65.2%
Happy 60.9%
Calm 13.1%
Confused 7.9%
Angry 6.2%
Disgusted 3.9%
Fear 3.6%
Surprised 2.4%
Sad 2.1%

AWS Rekognition

Age 22-30
Gender Male, 64.3%
Fear 86.7%
Sad 8.6%
Angry 1.3%
Calm 1%
Surprised 0.9%
Disgusted 0.6%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 94.3%
Happy 51.2%
Calm 25.8%
Sad 11.9%
Confused 3.5%
Surprised 2.7%
Fear 2.2%
Disgusted 1.5%
Angry 1.2%

AWS Rekognition

Age 21-29
Gender Female, 62.8%
Calm 87.2%
Happy 9%
Sad 2%
Angry 0.6%
Confused 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 19-27
Gender Female, 86.4%
Sad 92%
Calm 3.1%
Happy 2.2%
Angry 1%
Confused 0.8%
Fear 0.4%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 23-33
Gender Female, 55%
Calm 75%
Sad 14.3%
Confused 4.4%
Disgusted 3.3%
Happy 1.7%
Surprised 0.4%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 79.9%
Calm 89.6%
Sad 8.3%
Happy 0.8%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 60.1%
Fear 30.8%
Sad 27.6%
Calm 23.5%
Disgusted 4.9%
Confused 4.4%
Angry 3.5%
Surprised 2.9%
Happy 2.5%

AWS Rekognition

Age 18-24
Gender Male, 68.3%
Sad 78.9%
Fear 10.9%
Calm 7.6%
Disgusted 0.7%
Angry 0.6%
Happy 0.5%
Confused 0.5%
Surprised 0.3%

AWS Rekognition

Age 14-22
Gender Male, 64.6%
Happy 34.2%
Calm 29.7%
Sad 22.5%
Fear 9%
Confused 2.4%
Angry 1.3%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 38-46
Gender Male, 78.5%
Sad 88.6%
Calm 8.1%
Happy 2.1%
Fear 0.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Female, 57.3%
Calm 82.4%
Sad 12.7%
Happy 1.5%
Confused 1.4%
Fear 0.7%
Angry 0.5%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 25-35
Gender Female, 87.5%
Calm 55.9%
Happy 15.7%
Sad 12%
Fear 5%
Confused 3.8%
Disgusted 3%
Angry 2.9%
Surprised 1.7%

AWS Rekognition

Age 22-30
Gender Male, 87%
Fear 77%
Sad 10.8%
Calm 5.8%
Happy 2.1%
Disgusted 1.9%
Angry 1%
Confused 0.9%
Surprised 0.5%

AWS Rekognition

Age 23-31
Gender Male, 88.9%
Calm 89.7%
Sad 5%
Happy 2.2%
Confused 0.9%
Disgusted 0.7%
Surprised 0.6%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 29-39
Gender Female, 94.7%
Happy 55.1%
Calm 14.6%
Sad 12.4%
Confused 9.1%
Fear 3.7%
Disgusted 1.8%
Surprised 1.7%
Angry 1.6%

AWS Rekognition

Age 18-26
Gender Male, 51.4%
Calm 86.9%
Sad 5.3%
Fear 2%
Angry 1.9%
Happy 1.4%
Confused 0.9%
Disgusted 0.8%
Surprised 0.7%

AWS Rekognition

Age 29-39
Gender Male, 72.5%
Calm 88.4%
Sad 4.2%
Happy 4.1%
Disgusted 1.7%
Confused 0.8%
Angry 0.3%
Surprised 0.3%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person

Clarifai

Person
Clothing
Human face

AWS Rekognition

Person 91.8%

AWS Rekognition

Person 81.8%

AWS Rekognition

Person 75.1%

AWS Rekognition

Person 71%

AWS Rekognition

Person 70.9%

AWS Rekognition

Person 68.1%

AWS Rekognition

Person 59.7%

AWS Rekognition

Person 52.5%

Clarifai

Person 81.9%

Clarifai

Person 42.7%

Clarifai

Person 42.2%

Clarifai

Person 40.6%

Clarifai

Person 37.1%

Clarifai

Person 36.6%

Clarifai

Person 35.7%

Clarifai

Person 34.5%

Clarifai

Person 34%

Clarifai

Clothing 60.6%

Clarifai

Clothing 60.4%

Clarifai

Clothing 48.1%

Clarifai

Clothing 47.5%

Clarifai

Clothing 45.9%

Clarifai

Clothing 43.5%

Clarifai

Clothing 41.2%

Clarifai

Clothing 41%

Clarifai

Clothing 37.7%

Clarifai

Clothing 37.3%

Clarifai

Clothing 37.3%

Clarifai

Clothing 37%

Clarifai

Clothing 35.3%

Clarifai

Clothing 35.3%

Clarifai

Clothing 35%

Clarifai

Clothing 33.4%

Clarifai

Clothing 33.3%

Clarifai

Human face 48.9%

Clarifai

Human face 45.4%

Clarifai

Human face 44.2%

Clarifai

Human face 44.1%

Clarifai

Human face 43.7%

Clarifai

Human face 42.3%

Clarifai

Human face 42%

Clarifai

Human face 40.6%

Clarifai

Human face 40.4%

Clarifai

Human face 39.9%

Clarifai

Human face 38.2%

Clarifai

Human face 37.8%

Clarifai

Human face 37%

Clarifai

Human face 35.7%

Clarifai

Human face 34.7%

Clarifai

Human face 34.3%

Clarifai

Human face 34.1%

Clarifai

Human face 33.7%

Clarifai

Human face 33.6%

Clarifai

Human face 33.2%

Categories

Imagga
created on 2022-01-23

paintings art 87.6%
streetview architecture 4.3%
text visuals 2.7%
interior objects 2.5%
beaches seaside 2.4%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

a group of people in a mosque.

Salesforce

Created by general-english-image-caption-blip on 2025-05-06

a photograph of a large group of people standing around a large building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image appears to be a photographic negative of a large ceremonial or formal gathering. The scene seems to involve numerous individuals dressed in suits and formal attire, gathered in an ornate environment, possibly a hall or church with arched windows and columns. A wreath on a stand is near the center of the image, indicating that this might be a memorial or tribute event. U.S. flags can be seen nearby, suggesting a patriotic or national element. The crowd is densely packed, demonstrating the significance of this occasion. Details such as faces and features are reversed in tone due to the negative format, which highlights the textures and architectural details in an inverted light.

Created by gpt-4o-2024-08-06 on 2025-06-13

This image appears to be a photographic negative of a large indoor gathering or ceremony. The scene is bustling with a dense crowd of people, many of whom are dressed in suits and hats, indicative of a formal event. The architecture in the background suggests a grand interior space, with ornate columns and arched doorways. There is a notable presence of wreaths, which might suggest that this event is a memorial service or ceremony of remembrance. The people are gathered closely together, possibly indicating that something significant is happening or about to be observed. The image has an overall high contrast due to its photographic negative format, with dark figures against a light background.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This is a black and white historical photograph showing a large crowd gathered in what appears to be an ornate indoor space. The architecture visible in the background shows decorative arches and detailed wall designs. The crowd is densely packed and appears to be formally dressed, with many people wearing what looks like suits or formal attire typical of an earlier era. The image has a somewhat faded or overexposed quality typical of vintage photography. The crowd extends from the foreground deep into the background of the image, suggesting this was a significant gathering or event, though the specific occasion is not clear from the image alone.

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image appears to depict a large crowd gathered in an ornate, architecturally impressive indoor space. The crowd is composed of numerous individuals wearing formal attire, suggesting this may be some kind of ceremonial or celebratory event. The space features intricate architectural details and decorations, creating an atmosphere of grandeur and significance. While the image does not identify any specific individuals, it conveys a sense of a significant gathering or occasion taking place within this ornate setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a large gathering of people in a grand, ornate building. The crowd is densely packed, with individuals dressed in formal attire, including suits and ties, and some wearing traditional Indian clothing. The men are mostly balding or have short hair, and many wear turbans or other head coverings.

In the foreground, a man stands out, wearing a white turban and a long, dark-colored robe. He appears to be addressing the crowd, possibly giving a speech or presentation. To his right, a man holds a bouquet of flowers, adding a touch of color to the otherwise monochromatic scene.

The background of the image features a large, ornate building with high ceilings and arched windows. The walls are adorned with intricate carvings and patterns, and a large chandelier hangs from the ceiling. The atmosphere of the image suggests a formal event or ceremony, possibly a religious or cultural celebration.

Overall, the image conveys a sense of grandeur and importance, with the large crowd and ornate surroundings creating a sense of occasion. The formal attire and traditional clothing worn by the individuals in the crowd add to the sense of formality and tradition.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a large gathering of people in a grand, ornate room. The crowd is densely packed, with individuals standing shoulder-to-shoulder, and appears to be engaged in some sort of ceremony or celebration. The atmosphere seems formal, with many attendees dressed in suits and ties, while others wear more traditional or ceremonial attire.

In the foreground, several individuals are positioned near what appears to be a podium or lectern, suggesting that a speech or presentation may be taking place. The background of the image features a stunning array of archways, columns, and intricate carvings, which add to the sense of grandeur and formality.

Overall, the image conveys a sense of importance and solemnity, with the crowd's attention focused on the proceedings at the front of the room.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image depicts a large gathering of people in a grand hall, possibly for a religious ceremony. The scene is captured in black and white, giving it a historical or vintage feel. The hall has arched openings and pillars, suggesting an architectural style that could be Gothic or Renaissance. The people are dressed in white robes, with some wearing hats or caps, indicating a formal or ceremonial event. A central figure, possibly a priest or religious leader, stands at the front, surrounded by others in white attire. The atmosphere appears solemn and reverent, with the crowd gathered attentively.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black and white photograph of a crowd of people gathered in a large hall. The crowd is mostly composed of men, many of whom are wearing suits and ties. Some of them are wearing hats, while others have their heads uncovered. The people are standing in rows, and some are sitting on chairs. There are also some people standing near the pillars and arches of the hall.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

Here is a description of the image:

The image appears to be a black-and-white negative photograph depicting a large group of people gathered inside an ornate building. The architecture features arched windows, decorated columns, and detailed wall designs. The crowd is densely packed, with individuals wearing various types of clothing, including suits and hats. Some people are standing, while others are seated. Several objects, such as floral wreaths and flags, are visible in the foreground. The overall scene suggests an event or ceremony taking place indoors. The high angle shot provides a wide view of the assembly and the surrounding interior.

Created by gemini-2.0-flash-lite on 2025-05-07

Here's a description of the image:

Overall Impression:

The image is a negative print of a large gathering, likely an event held indoors. It's difficult to ascertain the exact event from the image alone, but the presence of many people and some decorative elements suggest a formal occasion.

Key Features:

  • Large Crowd: The photograph captures a vast assembly of people. Their faces are partially obscured because of the negative effect.
  • Attire: The attendees appear to be wearing formal attire, with many individuals in suits and some wearing white jackets.
  • Setting: The event seems to be taking place in an ornate interior space. Pillars, arches, and decorative elements suggest a church, large hall, or similar building.
  • Floral Decorations: There are floral wreaths or arrangements present, possibly suggesting a ceremony or memorial event.
  • Elevated View: The photograph is taken from an elevated position, giving a broad overview of the gathering.
  • Flags: A flag is included.

Possible Interpretations:

Given the details, the image likely depicts a formal ceremony, possibly a commemoration, a religious service, or a civic event. The formal attire and large attendance imply a significant occasion.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image appears to be a historical black-and-white photograph of a large gathering inside a grand hall. The hall features ornate architectural details, including arched doorways, columns, and decorative elements on the walls and ceiling.

The crowd consists of numerous people, most of whom are dressed in formal attire, suggesting a significant or ceremonial event. Many of the individuals are wearing suits and hats, indicative of the fashion from an earlier era, likely the early to mid-20th century.

In the center of the hall, there is a prominent floral arrangement on a stand, which could indicate a focal point of the event, such as a memorial or a celebration. The people are densely packed, and some are looking towards the floral arrangement, while others are engaged in conversation or looking in different directions.

The overall atmosphere suggests a formal and solemn occasion, possibly a state funeral, a significant public ceremony, or a large social gathering. The grandeur of the hall and the formal dress of the attendees underscore the importance of the event.

Qwen

No captions written

Text analysis

Amazon

so
YT33AP
ODM

Google

Or
Or