Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Board of Directors

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.850.1

Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Board of Directors

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.850.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 97.7
Room 96.8
Indoors 96.8
Court 80.3
Waiting Room 76.1
Crowd 75
Furniture 67.6
Art 66
Reception 65.7
Reception Room 65.7
Audience 64.9
People 64
Jury 57.9
Pub 56.9

Clarifai
created on 2019-06-07

people 100
group 99.7
many 99.3
administration 99.2
leader 98.9
group together 98.9
adult 98.5
military 97.3
chair 97.2
several 94.8
furniture 94.6
home 93.4
war 93.2
man 92.5
room 90.9
sit 90.5
uniform 89.1
five 88
woman 85.9
soldier 85.4

Imagga
created on 2019-06-07

room 28.7
man 25.5
piano 23.1
chair 22
stringed instrument 21.6
percussion instrument 21.4
musical instrument 21.2
male 20.5
people 20.1
sitting 19.7
keyboard instrument 19.2
interior 18.5
grand piano 18
indoors 17.5
person 16.9
classroom 15.1
lifestyle 14.4
home 14.3
women 14.2
old 13.9
men 13.7
light 13.3
device 13.3
adult 12.4
smiling 12.3
black 12.1
business 11.5
couple 11.3
happy 11.3
table 11.2
upright 11
style 10.4
fire 10.3
window 10.3
restaurant 10.2
architecture 10.1
inside 10.1
indoor 10
smile 10
fashion 9.8
luxury 9.4
friends 9.4
furniture 9.3
house 9.2
holding 9.1
office 8.9
cheerful 8.9
group 8.9
steel 8.8
fireplace 8.7
wall 8.7
work 8.6
industry 8.5
living 8.5
two 8.5
passion 8.5
senior 8.4
modern 8.4
portrait 8.4
relaxation 8.4
smoke 8.4
leisure 8.3
fun 8.2
relaxing 8.2
looking 8
happiness 7.8
lamp 7.8
color 7.8
glass 7.8
attractive 7.7
technology 7.4
industrial 7.3
decoration 7.2
dress 7.2
sexy 7.2
night 7.1

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

person 99
clothing 98.5
sitting 96.3
man 95.7
black 78.4
people 76.5
old 62.9
white 61.7
group 61.7
smile 57.8
seated 30.3
older 22.1
family 20.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 54.6%
Disgusted 45.1%
Sad 45.5%
Angry 45.4%
Calm 52.6%
Confused 45.3%
Surprised 45.5%
Happy 45.6%

AWS Rekognition

Age 38-59
Gender Male, 54.1%
Angry 51.8%
Surprised 45.1%
Sad 45.8%
Confused 45.1%
Happy 45.1%
Calm 46.7%
Disgusted 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.6%
Confused 45.3%
Sad 49.3%
Disgusted 46.5%
Calm 47.8%
Happy 45.1%
Surprised 45.2%
Angry 45.9%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Disgusted 45.2%
Confused 45.4%
Happy 45.1%
Calm 49.9%
Surprised 45.3%
Angry 45.5%
Sad 48.6%

AWS Rekognition

Age 45-63
Gender Male, 54.1%
Surprised 45.3%
Disgusted 45.1%
Sad 49.1%
Angry 49.5%
Confused 45.2%
Calm 45.2%
Happy 45.6%

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Calm 53.4%
Happy 45.1%
Disgusted 45.1%
Surprised 45.2%
Angry 45.3%
Sad 45.7%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Female, 53.4%
Disgusted 48.5%
Angry 45.4%
Surprised 45.6%
Sad 46.5%
Calm 47.9%
Confused 45.2%
Happy 45.8%

AWS Rekognition

Age 60-90
Gender Male, 50.3%
Disgusted 45.2%
Confused 45.2%
Surprised 45.2%
Calm 51.1%
Happy 45.1%
Angry 46%
Sad 47.1%

AWS Rekognition

Age 38-59
Gender Female, 51.1%
Disgusted 47%
Surprised 45.3%
Happy 45.4%
Calm 50.5%
Angry 45.4%
Sad 46.1%
Confused 45.2%

AWS Rekognition

Age 38-59
Gender Male, 54%
Disgusted 45.1%
Surprised 45.2%
Confused 45.2%
Calm 45.6%
Angry 47.9%
Happy 45.2%
Sad 50.9%

AWS Rekognition

Age 38-59
Gender Male, 52.2%
Confused 45.2%
Calm 48.4%
Happy 45.8%
Disgusted 45.1%
Sad 49.8%
Angry 45.3%
Surprised 45.2%

AWS Rekognition

Age 29-45
Gender Female, 50.1%
Sad 48.8%
Calm 46%
Angry 45.7%
Happy 48.1%
Disgusted 45.4%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 48-68
Gender Female, 50.7%
Disgusted 48.6%
Angry 47%
Surprised 45.4%
Sad 46.1%
Calm 46.9%
Confused 45.3%
Happy 45.6%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting

Clarifai

Man
Clothing
Footwear
Human face

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 94%

AWS Rekognition

Person 90.5%

AWS Rekognition

Person 86.7%

AWS Rekognition

Person 85%

AWS Rekognition

Person 81.4%

AWS Rekognition

Person 78.2%

AWS Rekognition

Person 74.4%

AWS Rekognition

Person 73.4%

AWS Rekognition

Person 64.8%

AWS Rekognition

Person 49.2%

AWS Rekognition

Painting 66%

Clarifai

Man 81.7%

Clarifai

Man 78.7%

Clarifai

Man 76.6%

Clarifai

Man 76.4%

Clarifai

Man 75.8%

Clarifai

Man 70.1%

Clarifai

Man 54.7%

Clarifai

Man 54.4%

Clarifai

Man 49.1%

Clarifai

Man 44.3%

Clarifai

Man 40.4%

Clarifai

Man 39.4%

Clarifai

Man 38.1%

Clarifai

Clothing 76.8%

Clarifai

Clothing 71.4%

Clarifai

Clothing 69.7%

Clarifai

Clothing 61.4%

Clarifai

Clothing 56%

Clarifai

Clothing 49%

Clarifai

Clothing 47.1%

Clarifai

Clothing 45.8%

Clarifai

Clothing 40.4%

Clarifai

Footwear 65.6%

Clarifai

Footwear 51.5%

Clarifai

Footwear 48.7%

Clarifai

Footwear 48.5%

Clarifai

Footwear 46.9%

Clarifai

Footwear 39.2%

Clarifai

Footwear 35.8%

Clarifai

Footwear 35.3%

Clarifai

Human face 49.9%

Clarifai

Human face 48.6%

Clarifai

Human face 46.6%

Clarifai

Human face 45.3%

Clarifai

Human face 45.1%

Clarifai

Human face 43.7%

Clarifai

Human face 42.9%

Clarifai

Human face 41.7%

Clarifai

Human face 40.9%

Clarifai

Human face 39.7%

Clarifai

Human face 38.4%

Categories

Imagga
created on 2019-06-07

events parties 41.6%
interior objects 40.2%
people portraits 12%
streetview architecture 2.4%
food drinks 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a group of men sitting around a table

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of men sitting around a table in an old photo

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a formal gathering of men seated around a table in what appears to be an ornate room. The room features elaborate wallpaper, a decorative chandelier, and visible architectural details such as a fireplace with a mantle on the right side. The table is set with books and papers, suggesting a meeting or discussion. Some of the men are dressed in formal attire, including suits and ties, indicating a professional or official context. The flooring includes a patterned rug, adding to the refined atmosphere of the space.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a group of men gathered around a large wooden table in what appears to be a formal meeting room. The room is ornately decorated, with patterned wallpaper and a large chandelier hanging from the ceiling. There is a decorative mantle on the right side of the room, suggesting a fireplace. The men are dressed in formal attire, wearing suits with ties and waistcoats, indicating an early 20th-century setting. A patterned rug covers the floor, and there are books and papers on the table, which contribute to the formal and professional ambiance of the setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of a group of men gathered in what looks like a formal meeting or gathering. The men are seated around a large table, some wearing suits and ties, and there is an ornate chandelier hanging from the ceiling. The room has an ornate, old-fashioned decor with patterned wallpaper and other furnishings. The men seem to be engaged in some kind of discussion or meeting, though their specific roles or identities are not clear from the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph showing what appears to be a formal business or committee meeting from the late 1800s or early 1900s. The setting is an elegant Victorian-era room with patterned wallpaper and a decorative chandelier. There are approximately ten people seated around what looks like a meeting table, all dressed in formal attire typical of the period - dark suits with bow ties. The room has ornate architectural details including a fireplace mantel visible on the right side. The photograph captures the formal, serious atmosphere of what was likely an important business or governmental meeting of the era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a group of men in suits seated around a table in a formal setting, likely a meeting or conference room. The men are dressed in dark suits and ties, with some wearing white shirts and others wearing black shirts. They are seated in chairs around a long table, with some standing behind them. The room has a high ceiling, ornate wallpaper, and a large chandelier hanging from the ceiling. The floor is covered with a patterned rug, and there is a fireplace on the right side of the room. The overall atmosphere suggests a formal and professional setting, possibly a business meeting or conference.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a group of men in formal attire, seated around a table. The men are dressed in suits and ties, with some wearing bow ties. They appear to be engaged in a meeting or discussion, as they are seated around a table with papers and documents on it.

In the background, there is a fireplace with a mantle, and a chandelier hangs from the ceiling. The walls are adorned with wallpaper, and there is a rug on the floor. The overall atmosphere of the image suggests a formal gathering or meeting, possibly in a professional or business setting.

The image appears to be an old photograph, possibly from the early 20th century. The quality of the image is good, with clear details and a sharp focus. The lighting in the image is also well-balanced, with no harsh shadows or overexposure.

Overall, the image provides a glimpse into a formal gathering or meeting from the past, and offers insight into the attire and decor of the time period.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image is a black-and-white photograph of a group of men sitting in a room. The men are dressed in formal attire, including suits and ties. The room has a fireplace on the right side, and a chandelier is hanging from the ceiling. There are books on the table in front of them, and a few papers are on the desk. The image has a watermark with the number "16" in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image shows a group of men dressed in formal attire, seated around a table in a room. They are all wearing suits and ties, and most of them have mustaches. The room has a carpeted floor, and the walls are decorated with wallpaper. There is a chandelier hanging from the ceiling, and a fireplace is located on the right side of the room. The image is in black and white, giving it a vintage look.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Certainly! Here's a description of the image:

General Description

The image is a vintage black and white photograph depicting a group of people gathered around a table in what appears to be a formal or official setting. The scene has a somewhat dim and serious tone.

Composition

The people are arranged around a central table, some seated and others standing behind. There are men and a woman in the group. The room has ornate wallpaper and architectural details like moldings and a fireplace.

Clothing

The men are dressed in suits, some with vests and bow ties. The woman is also dressed in formal attire, seemingly Victorian style.

Additional details

A large chandelier is visible above the table. There are some documents or books on the table, and the floor is covered in an ornate rug.

Overall impression

The photograph suggests a meeting or gathering of some importance, possibly a council or board of some kind. The style and dress of the people suggest it was taken in the late 19th or early 20th century.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely from the late 19th or early 20th century, showing a group of men in formal attire seated around a large table in a grand, possibly historical, room. The lighting is somewhat dim, lending a serious and official atmosphere to the scene.

Key Features:

  • The Group: A large group of men are seated around a dark wooden table. They are all formally dressed, likely in suits, coats, and ties.
  • The Room: The setting is a room with detailed wallpaper and a large fireplace. There's an ornate chandelier hanging from the ceiling. A doorway is visible in the background.
  • The Composition: The photograph is well-composed, with the subjects arranged in a way that suggests they are participating in a formal meeting or conference.
  • Details: The men all appear to be middle-aged to elderly. The style of their attire and the décor of the room place the scene in the past.

Possible Interpretations:

Given the setting and the formality of the scene, the photograph likely captures a meeting of important figures, possibly a board of directors, a government committee, or a similar professional group.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a group of men, likely from the late 19th or early 20th century, gathered in a formal setting. The men are dressed in suits and ties, indicative of the formal attire of the period. They are seated and standing around a table, which is covered with a tablecloth and has some documents or books on it. The room has ornate wallpaper, a chandelier, and a fireplace, suggesting it is a well-appointed, possibly official or governmental, meeting room.

The men appear to be engaged in a serious discussion or meeting, with some of them looking directly at the camera while others are looking elsewhere. The overall atmosphere is one of formality and importance, possibly indicating a significant gathering or event. The photograph is in black and white, which is consistent with the time period suggested by their attire and the room's decor.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image depicts a group of men gathered in a formal setting, likely a meeting or a discussion. They are dressed in formal attire typical of the late 19th or early 20th century, including suits, bow ties, and dress shirts. The men are seated around a large, dark wooden table, some with their legs crossed and others with their hands resting on the table. The room has ornate wallpaper with a damask pattern and a decorative chandelier hanging from the ceiling. The overall atmosphere suggests a serious and formal occasion, possibly a business meeting or a political gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph appears to depict a formal gathering or meeting of men in a well-decorated room. The men are dressed in formal attire typical of the late 19th or early 20th century, including suits, bow ties, and some with pocket watches. They are seated around a long table that has papers and possibly a book on it, suggesting a discussion or meeting of some kind.

The room has ornate wallpaper with a floral pattern, a chandelier hanging from the ceiling, and a fireplace on the right side. The men are arranged in a semi-circle around the table, with some standing and others sitting. The overall atmosphere suggests a serious and formal occasion, possibly a business or political meeting. The photograph has a number "1416" written in the top left corner, which might be an archival reference.

Text analysis

Amazon

16