Human Generated Data

Title

Untitled (formal family portrait outdoors with parents seated and children standing)

Date

c. 1905-1915

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3941

Human Generated Data

Title

Untitled (formal family portrait outdoors with parents seated and children standing)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3941

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.9
Apparel 99.9
Human 99.4
Robe 95.3
Fashion 95.3
Gown 94.3
Wedding 90.7
People 86.2
Bridegroom 82.8
Bride 80.6
Face 80.5
Female 79.6
Accessory 72.1
Accessories 72.1
Dress 70.4
Long Sleeve 67.4
Sleeve 67.4
Overcoat 64.1
Coat 64.1
Suit 64.1
Woman 61.5
Photography 61.5
Photo 61.5
Portrait 60.9

Clarifai
created on 2019-06-01

people 99.9
group 98.8
group together 98.4
many 98
man 95.5
adult 94.8
several 92.8
wear 90
uniform 88.4
child 85.7
woman 83
military 82.9
war 80.9
leader 80.5
administration 72.9
outfit 72
veil 67.9
portrait 67.4
ceremony 66.3
memory 64.4

Imagga
created on 2019-06-01

nurse 32
brass 26.8
people 26.8
cornet 25.9
person 24.8
wind instrument 22.5
man 19.5
medical 18.5
male 18.4
adult 18.2
professional 17.9
portrait 16.8
coat 15.9
musical instrument 15.7
bride 14.8
clothing 14.5
doctor 14.1
business 12.7
dress 12.6
health 12.5
businessman 12.4
medicine 12.3
hospital 12.3
lab coat 12.1
men 12
human 12
happy 11.9
happiness 11.7
stethoscope 11.5
job 11.5
drawing 11.4
looking 11.2
attractive 11.2
work 11
black 10.8
laboratory 10.6
worker 10.5
wedding 10.1
face 9.9
team 9.8
handsome 9.8
clinic 9.6
healthy 9.4
day 9.4
smile 9.3
elegance 9.2
occupation 9.2
care 9
suit 9
one 9
cheerful 8.9
posing 8.9
office 8.8
art 8.7
women 8.7
old 8.4
pose 8.2
family 8
employee 7.8
hands 7.8
lab 7.8
groom 7.7
golfer 7.7
marriage 7.6
clothes 7.5
gown 7.4
kin 7.4
player 7.3
confident 7.3
uniform 7.2
celebration 7.2
sketch 7.2
working 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

posing 99.5
window 98.4
wedding dress 94
group 92.4
bride 92.1
old 74
black and white 68.9
black 67.1
smile 64.9
wedding 62.1
person 61.7
white 60.6
clothing 60.4
team 53.8
dressed 28.6
clothes 23

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 52.9%
Surprised 45.9%
Sad 45.7%
Angry 46.2%
Disgusted 45.3%
Calm 49.5%
Happy 47.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Sad 46.1%
Angry 45.5%
Disgusted 45.5%
Surprised 45.7%
Happy 46.2%
Calm 50.7%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Disgusted 45.3%
Calm 49%
Sad 48.9%
Confused 45.3%
Angry 45.3%
Surprised 45.5%
Happy 45.7%

AWS Rekognition

Age 38-59
Gender Male, 50%
Confused 45.4%
Disgusted 45.3%
Calm 47.9%
Angry 46.1%
Sad 48.4%
Happy 46.2%
Surprised 45.7%

AWS Rekognition

Age 23-38
Gender Male, 51.6%
Sad 47.5%
Calm 46.9%
Surprised 45.7%
Angry 45.6%
Disgusted 45.8%
Happy 48.2%
Confused 45.3%

AWS Rekognition

Age 27-44
Gender Female, 52.1%
Disgusted 45.2%
Calm 46.2%
Surprised 45.3%
Angry 45.4%
Happy 45.3%
Sad 52.4%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 45.3%
Surprised 45.6%
Calm 51.3%
Sad 45.8%
Confused 45.2%
Disgusted 45.2%
Happy 46.6%

AWS Rekognition

Age 35-52
Gender Male, 52.1%
Surprised 45.7%
Sad 49.9%
Angry 45.5%
Disgusted 45.5%
Calm 46.8%
Happy 46.1%
Confused 45.5%

AWS Rekognition

Age 38-59
Gender Female, 53.7%
Happy 45.6%
Confused 45.5%
Angry 46%
Disgusted 48.8%
Surprised 45.5%
Sad 48%
Calm 45.5%

Feature analysis

Amazon

Person
Tie
Wedding Gown

Clarifai

No features identified

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 95.5%

AWS Rekognition

Tie 72.1%

AWS Rekognition

Wedding Gown 64.9%

Categories

Imagga
created on 2019-06-01

paintings art 79.5%
pets animals 13.6%
text visuals 5.9%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people in white robes standing in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image is a negative photograph depicting a group of individuals posed outdoors. The group consists of men and women wearing formal attire, with two individuals seated in the front and others standing behind them. The backdrop includes a wooden building with horizontal siding and visible windows. There is grass in the foreground, along with a small tree or shrub to the left. The contrast and inverted colors give the scene a stark visual appearance characteristic of a photographic negative.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a black and white negative of a family posed for a group photograph in front of a wooden house. There are nine individuals in the picture, with four seated in the front and five standing behind them. The individuals in the photograph are dressed in formal attire, suggesting it might be a special occasion or formal gathering. The background features horizontal wooden siding of the house, and there is a window with curtains visible. The photograph also includes a small tree or bush on the left side. The scene is set outdoors, on grass that is faintly visible as the negative image reverses dark and light areas.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph of a group of people, likely a family or community gathering, posing together outdoors in front of a wooden building or structure. The individuals are dressed formally, with the women wearing long dresses and the men wearing suits and ties. They are seated and standing together, with some holding flowers or other objects. The background includes some vegetation, suggesting an outdoor setting. Overall, the image conveys a sense of formality and community.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-18

The black and white photograph shows a group portrait of 8 elderly individuals, likely from the late 19th or early 20th century based on their formal attire. The group is posed in front of a wooden building, with the men wearing suits and the women wearing long white dresses or gowns, suggesting it may be a wedding photo. One woman is seated in the center, possibly the bride, while the others stand around her. There are some plants or shrubbery visible in the foreground.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a vintage black and white photograph, likely from the early 1900s, showing a group of people posed together outside what appears to be a building with wooden siding or shutters visible in the background. The group is wearing light-colored clothing, possibly white or cream colored, which was common for formal photographs of that era. The image has some deterioration and fading typical of photographs from this time period. The subjects are arranged in two rows, with some seated in the front and others standing behind them. There appears to be some foliage or plants visible at the edge of the frame.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a family of ten, including a man, woman, and eight children, posing in front of a house. The family is dressed in formal attire, with the man and woman seated in the center, and the children standing behind them. The background features a house with windows and a door, as well as a tree and grass. The overall atmosphere of the image suggests a formal family portrait, possibly taken in the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a group of people, likely a family, posing in front of a house. The group consists of nine individuals, with eight standing and one seated in the center. They are all dressed in formal attire, with the men wearing suits and ties, and the women wearing long dresses. The group is positioned on a grassy area, with a small tree visible to the left and a window with curtains on the right. The background features horizontal blinds covering the windows of the house. The overall atmosphere suggests a formal gathering or family portrait, possibly taken during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image shows a group of people standing in front of a house. They are dressed in white clothes and appear to be posing for a photograph. The image is in black and white, and it has a blurry effect, giving it a vintage look. The people in the image are standing in a row, and some of them are sitting on a chair. The house behind them has glass windows and a door, and there is a plant on the left side of the image.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo shows a group of people standing in front of a house. They are wearing formal clothing. The man in the middle is sitting on a chair. He is wearing a tie and leather shoes. The woman next to him is wearing a white dress. There is a plant on the left side of the group. On the right side, there is a dog lying on the ground.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-15

Here is a description of the image:

The image appears to be a photographic negative of a family portrait. Nine figures are posed in front of a house with horizontal siding. The figures are all dressed in light-colored clothing, which appears as bright white in this negative image.

In the center, two people, presumably a couple, are seated. The man is in a suit, and the woman is in a long dress or gown. The others are standing behind them. There are four women and three men in the background. There appears to be a young boy wearing a tuxedo. The house has a window behind the group. A small tree is on the left side. The ground is visible, and what appears to be a dog on the right.

Created by gemini-2.0-flash on 2025-05-15

Here's a description of the image provided:

This appears to be a black-and-white photographic negative. It depicts a group portrait of nine individuals of varying ages, seemingly standing or seated in front of a house or building. The house has horizontal siding and at least two windows visible.

In the foreground, an older couple is seated, likely the center of attention. Behind them stand several younger individuals, some of whom appear to be teenagers or young adults. Everyone is dressed in formal attire, suggesting this might be a family portrait taken on a special occasion.

To the left of the group, there's a small tree or bush, adding to the composition of the shot. The surrounding area seems to be a lawn or yard. Due to the nature of a negative, the darker areas in the original scene appear brighter and vice versa, which can make it difficult to discern fine details.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The image is a black-and-white photograph featuring a group of individuals, likely from the late 19th or early 20th century. The group consists of ten people, with nine standing and one seated in the front. The individuals are dressed in formal attire, with the women wearing long dresses and the men in suits.

The setting appears to be outdoors, in front of a wooden building with horizontal siding. The building has a window visible on the right side of the image. There is some vegetation to the left, including a small tree and some shrubs. The group is posed formally, suggesting that this might be a commemorative or official photograph, possibly of a family, a work team, or a community group. The expressions on their faces are neutral, and they are looking directly at the camera. The overall atmosphere of the image is solemn and formal.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-29

The image appears to be a black-and-white photograph of a group of individuals seated in front of a building with horizontal blinds. The group consists of six individuals, with two seated in the front row and four standing in the back row. The individuals are dressed in formal attire, suggesting a formal or ceremonial occasion. The setting includes a grassy area with a small tree and some scattered objects, possibly stones or other items, to the right of the group. The overall tone of the photograph is somewhat light and overexposed, which affects the clarity and contrast of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-29

This is a black and white photograph with an overexposed and ghostly effect. It depicts a family or group portrait, consisting of nine individuals. The group is arranged in two rows: four people are seated in the front, and five people are standing in the back. All the individuals appear to be wearing formal attire, with the men in suits and the women in dresses. The overexposure has caused their features to be washed out, giving them a surreal and ethereal appearance. The background shows a building with siding and windows, and there is a tree and some grass in the foreground. The overall effect of the image is eerie and haunting.