Human Generated Data

Title

Untitled (domestic servants)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.786

Human Generated Data

Title

Untitled (domestic servants)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.786

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.9
Accessories 99.4
Accessory 99.4
Glass 94.5
Furniture 88.9
Table 82.9
Dining Table 81.2
Goblet 77.7
Meal 71
Food 71
Bar Counter 69.7
Pub 69.7
Pottery 65.5
Alcohol 64.5
Beverage 64.5
Drink 64.5
Dish 60
Liquor 58.4
Dining Room 58.2
Indoors 58.2
Room 58.2
Tablecloth 57.4
Wine Glass 56.7
Wine 56.7

Clarifai
created on 2023-10-26

people 99.8
group 98.3
wedding 97.9
man 97.9
adult 97.6
two 96.9
group together 95.8
three 95
woman 94.5
portrait 92.4
several 91.5
hotel 90.4
party 89.9
four 88.4
facial expression 86.5
family 86.3
restaurant 84.6
waiter 84.1
indoors 83.1
five 80.8

Imagga
created on 2022-01-22

waiter 100
dining-room attendant 90.7
employee 69.6
worker 49.7
man 43
person 39.4
male 34.1
people 33.5
business 30.4
businessman 30
adult 28.3
happy 27.6
businesswoman 25.5
meeting 23.6
smiling 22.4
professional 22.1
office 21.7
colleagues 21.4
job 21.2
businesspeople 20.9
working 19.5
portrait 19.4
domestic 19.4
20s 19.3
team 18.8
cheerful 18.7
group 18.6
talking 18.1
corporate 18.1
doctor 16.9
medical 16.8
home 16.8
lifestyle 16.6
30s 16.4
attractive 16.1
together 15.8
couple 15.7
smile 15
work 14.9
teamwork 14.8
indoors 14.1
holding 14
table 13.9
occupation 13.8
success 13.7
suit 13.7
standing 13
sitting 12.9
indoor 12.8
successful 11.9
drink 11.7
men 11.2
women 11.1
coworkers 10.8
care 10.7
medicine 10.6
four 10.6
staff 10.5
health 10.4
computer 10.4
desk 10.4
hospital 10.3
mature 10.2
happiness 10.2
camera 10.2
nurse 10.1
friendly 10.1
handsome 9.8
coat 9.8
40s 9.7
discussion 9.7
mid adult 9.7
lab coat 9.6
executive 9.5
casual 9.3
manager 9.3
coffee 9.3
kitchen 9
boardroom 8.9
four people 8.9
discussing 8.8
busy 8.7
stethoscope 8.7
clinic 8.6
ethnic 8.6
tie 8.5
career 8.5
two 8.5
patient 8.5
color 8.4
laptop 8.2
confident 8.2
life 8.1
associates 7.9
diverse 7.8
boy 7.8
thirties 7.8
expertise 7.8
corporation 7.7
partnership 7.7
expression 7.7
drinking 7.7
child 7.5
wine 7.4
looking 7.2
building 7.1
face 7.1
love 7.1
day 7.1
planner 7
pretty 7

Google
created on 2022-01-22

Photograph 94.3
Black 89.9
Human 88.9
Fashion 87.8
Black-and-white 86.4
Style 84
Tie 83.3
Drinkware 83.2
Smile 82.9
Stemware 81.3
Plate 80.8
Tableware 80.4
Curtain 80
Monochrome 79.7
People 79.5
Monochrome photography 79
Wine glass 76.6
Snapshot 74.3
Happy 73.4
Event 73.1

Microsoft
created on 2022-01-22

person 99.3
clothing 91
smile 64.7
human face 55.5
man 55.1
birthday cake 53.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Female, 100%
Sad 62.9%
Calm 34.4%
Surprised 0.9%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%
Happy 0.4%
Angry 0.3%

Feature analysis

Amazon

Person
Tie

Clarifai

Man
Woman
Tableware
Human face
Picture frame
Human hair
Human arm

AWS Rekognition

Person 99.9%

Categories

Imagga
created on 2022-01-22

paintings art 61.9%
people portraits 34.6%
pets animals 2.6%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

politician and his wife, at the home of person.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man and woman are standing in front of a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This black-and-white image shows a formal dining setup in an elegant setting. The table is adorned with fine silverware, including teapots, a serving tray, candlesticks holding tall candles, and neatly arranged plates, glasses, and cutlery. A woman in a traditional maid's uniform is pouring liquid from a decorative pitcher into a glass, while another person dressed in a white coat is also attending to the table. The room features ornate furnishings, including a framed painting on the wall and a decorative mirror, suggesting a refined environment.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image shows two individuals dressed in formal attire, possibly servants or staff members from a historical time period. One person is wearing a white uniform, while the other is dressed in a traditional maid outfit with an apron. They are standing in a dining room setting, preparing a table with fine dining utensils. The table is elegantly set with silverware, a set of silver or polished metal serving vessels, and fine glassware. The person in the maid outfit is pouring water from a crystal pitcher into a glass, while the other individual is arranging something on the table. There are tall, unlit candlesticks on the table, and a piece of art hangs on the wall in the background. Additionally, a large decorative mirror frames part of the scene, reflecting some details of the room.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows two people, a man and a woman, in what appears to be a formal dining or living room setting. The man is wearing a white suit and the woman is wearing a maid's uniform. They are standing next to a table set with various silver serving dishes, glassware, and other tableware. The room has ornate architectural details, such as a framed painting on the wall. The overall scene suggests a formal, domestic setting from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph showing a formal dining service setup. In the image, there are two people - a man wearing a white jacket and a woman in a traditional maid's uniform with a white apron. They are arranging what appears to be an elegant silver tea or coffee service on a table covered with a white tablecloth. There are several silver serving pieces including teapots, coffee pots, and other vessels, along with tall white candles in candlesticks. The woman is pouring a beverage into a glass while the man oversees the service. The setting appears to be in a formal dining room with framed artwork visible on the wall in the background. The photograph appears to be from an earlier era, likely mid-20th century, and provides a glimpse into formal domestic service of that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a man and woman in a dining room setting. The man, standing on the left, is dressed in a white lab coat, black tie, and white shirt, with short dark hair. He is leaning forward slightly, his hands resting on the table.

The woman, standing on the right, wears a white apron over a dark dress, with her dark hair pulled back. She is pouring water from a glass pitcher into a glass, her hands carefully positioned to avoid spilling.

The table is set with fine china, crystal glasses, and silverware, accompanied by a silver tea set and a white lace tablecloth. Three white candles are placed in silver candelabras, adding a touch of elegance to the scene.

In the background, a painting hangs on the wall, and a mirror reflects the room, including a person standing behind the woman. The overall atmosphere of the image suggests a formal dinner party or special occasion, with the man and woman engaged in a moment of preparation and attention to detail.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a man and woman in a formal dining room setting. The man, dressed in a white coat and tie, stands on the left side of the table, while the woman, wearing a maid's uniform, stands on the right side. She is pouring water from a glass pitcher into a glass.

The table is set with fine china and silverware, accompanied by three lit candles in silver candlesticks. A large silver teapot and other silver serving dishes are also present on the table. In the background, a painting hangs on the wall to the left, and a mirror reflects the back of the man's head to the right. The overall atmosphere suggests a formal dinner party or special occasion.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

A black-and-white photo shows a man and a woman standing behind a table. The man is wearing a white coat and tie, while the woman is wearing a white apron. They are both holding a glass jug and pouring water into a glass. The table has a white tablecloth, plates, cups, and a candle holder with two lit candles. Behind them is a mirror with a reflection of a person and a framed picture on the wall.

Created by amazon.nova-pro-v1:0 on 2025-06-04

A black-and-white photo shows a man and a woman in a room. The man is wearing a white coat, and the woman is wearing an apron. They are standing in front of a table with a teapot, cups, and plates. The woman is holding a wine glass, and she is pouring something into it. There are candles on a candle holder, and a picture frame is mounted on the wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

This black and white photograph depicts a scene of service within what appears to be a formal setting. Two African-American individuals are the primary subjects. A man, wearing a white coat over a dark suit and tie, stands to the left, his expression focused downwards. A woman to the right is in a uniform, she is pouring from a crystal carafe into a water glass that is part of a set table.

The table is set with a formal array of silver service pieces. A candelabra holding lighted candles sits to the left, adding to the elegant ambiance. A decorative framed painting hangs on the wall behind them, enhancing the suggestion of a well-appointed home or establishment. The lighting and composition of the image suggest a moment of quiet service or a formal meal preparation. In the background, a mirror is visible, with a reflection of another individual, adding depth to the scene.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

In this black and white photograph, a formally dressed man and woman are setting the table for a meal. The man, positioned to the left, is dressed in a white coat and a tie. He is focused on the table and appears to be assisting with the setup. To his right, a woman in a maid uniform is pouring a liquid from a crystal pitcher into a glass. She is attentive and focused on the task at hand.

The table is covered with a white cloth and holds an array of silver serving ware including pitchers, teapots, and sugar bowls on a large tray. Three tall candles in an elegant candelabra stand at the edge of the table, adding a touch of formality. A plate and a glass are set out, ready for service.

The background features a framed picture hanging on the wall and a closed door. In the far right, a mirror reflects the scene, showing a portion of a cake or dessert. The overall setting suggests an elegant dining room, and the scene appears to be part of a domestic ritual.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph depicting a formal dining setting. In the scene, two individuals are preparing a table for a meal. The man, dressed in a white jacket and bow tie, appears to be a waiter or butler, and he is supervising or assisting the woman. The woman, wearing a maid's uniform with a white apron, is pouring a liquid from a decorative crystal decanter into a glass.

The table is elaborately set with a variety of silverware, including teapots, coffee pots, and other serving dishes. There are also several tall, white candles in silver candlesticks, adding to the formal atmosphere. In the background, there is a framed picture on the wall, and a wedding cake can be seen on a side table, suggesting that the setting might be for a special occasion, such as a wedding reception. The overall ambiance of the image conveys elegance and sophistication.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a domestic scene, likely from the mid-20th century, judging by the style of clothing and the quality of the photograph. The setting appears to be a dining room, as indicated by the fancy tableware, including silver teapots, cups, and a cake in the background.

In the foreground, a man dressed in a white lab coat is leaning over the table, seemingly engaged in a conversation or observing something. Next to him, a woman is pouring water from a glass pitcher into a glass. She is dressed in a white apron over a dark dress, suggesting she is a domestic helper or maid. The table is set with elegant silverware and a centerpiece with candles.

The room has a formal ambiance, as suggested by the framed picture on the wall, the dark walls, and the decorative elements like the floral arrangement and the elegant table settings. The overall mood of the photograph conveys a sense of domestic tranquility and perhaps a formal occasion.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

The image depicts a formal dining setting from an earlier time period. A man in a white coat, likely a chef or waiter, is arranging silverware and glassware on a table. A woman in a maid's uniform, with a white apron and headscarf, is pouring a liquid from a crystal pitcher into a glass. The table is set with various pieces of silverware, including a silver candelabra with candles, a silver teapot, and a silver coffee pot. The background features a framed picture on the wall and a partially visible mirror. The overall atmosphere suggests a high-end or formal dining experience.