Human Generated Data

Title

Untitled (family portrait)

Date

c. 1945

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1447

Human Generated Data

Title

Untitled (family portrait)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1447

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Tie 99.6
Accessories 99.6
Accessory 99.6
Person 99.1
Human 99.1
Person 99
Person 98.8
Person 98.7
Person 98.6
Person 98.4
Person 98
Person 96.9
Person 96.5
Tie 96.5
Person 95.4
People 93.8
Person 91.5
Person 88.9
Person 81.3
Person 80.9
Kindergarten 79.1
Person 78.5
Person 76.3
Room 75.5
Indoors 75.5
Tie 73.8
Person 73.5
School 69.5
Person 67.2
Classroom 67
Tie 61.2
Family 59.5

Clarifai
created on 2023-10-26

group 99.9
people 99.8
group together 99.6
child 99.1
many 98
son 96.6
boy 96.1
portrait 96.1
uniform 95.9
man 95.7
woman 93.9
education 93.6
wear 92.3
conformity 91
adult 91
school 90
adolescent 86.7
family 85.7
outfit 85.1
five 84.9

Imagga
created on 2022-01-22

nurse 92.2
people 36.2
person 28.4
man 27.5
male 25.5
room 22.3
adult 21.9
men 21.4
women 21.3
smiling 21
hospital 20.6
happy 20
couple 19.1
home 19.1
kin 18.8
family 18.7
group 16.9
indoors 16.7
happiness 16.4
professional 15.9
business 14.6
team 14.3
businessman 14.1
together 14
smile 13.5
standing 13
cheerful 13
child 12.3
two 11.8
mother 11.8
love 11.8
work 11.8
uniform 10.7
interior 10.6
job 10.6
new 10.5
fun 10.5
office 10.4
portrait 10.3
teamwork 10.2
classroom 10.2
businesswoman 10
dress 9.9
holding 9.9
life 9.8
pretty 9.8
education 9.5
teacher 9.5
meeting 9.4
casual 9.3
holiday 9.3
attractive 9.1
fashion 9
medical 8.8
house 8.3
inside 8.3
clothing 8.2
girls 8.2
student 8.2
suit 8.1
success 8
daughter 7.8
old 7.7
elegance 7.5
joy 7.5
friends 7.5
leisure 7.5
occupation 7.3
20s 7.3
school 7.3
lady 7.3
black 7.3
activity 7.2
working 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

posing 100
person 99.8
wall 99.3
group 98.2
clothing 97.6
smile 92.4
boy 89.8
standing 88.6
toddler 84.1
team 84.1
child 80.8
human face 78.4
old 68.4
family 66.8
footwear 66.6
baby 57.2
school 53.5
dressed 26.4
clothes 16.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Male, 99.9%
Calm 98.1%
Sad 0.7%
Confused 0.4%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 87.1%
Surprised 4.8%
Angry 2.8%
Calm 2.7%
Confused 0.9%
Fear 0.7%
Sad 0.5%
Disgusted 0.4%

AWS Rekognition

Age 39-47
Gender Female, 99.9%
Calm 99.1%
Angry 0.3%
Confused 0.3%
Surprised 0.1%
Sad 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Female, 100%
Happy 97.6%
Surprised 0.8%
Fear 0.7%
Angry 0.3%
Confused 0.2%
Calm 0.2%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 4-10
Gender Male, 99.8%
Calm 56.1%
Happy 26.6%
Confused 6.2%
Sad 5.3%
Surprised 3.1%
Angry 1.5%
Fear 0.8%
Disgusted 0.3%

AWS Rekognition

Age 2-10
Gender Male, 100%
Calm 98.6%
Confused 0.4%
Sad 0.4%
Surprised 0.3%
Happy 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Male, 100%
Happy 99%
Calm 0.2%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 18-24
Gender Male, 61.7%
Calm 74.4%
Happy 19.3%
Surprised 2.5%
Angry 1%
Sad 1%
Confused 1%
Fear 0.5%
Disgusted 0.5%

AWS Rekognition

Age 4-10
Gender Male, 98.3%
Calm 98.9%
Happy 0.9%
Confused 0.1%
Angry 0%
Sad 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 1-7
Gender Male, 100%
Happy 79.6%
Calm 8%
Confused 7.9%
Angry 2.4%
Surprised 0.9%
Sad 0.8%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 10-18
Gender Female, 91.3%
Happy 99.4%
Calm 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Happy 98.3%
Surprised 0.7%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Calm 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 4-12
Gender Male, 100%
Happy 98.2%
Calm 0.6%
Sad 0.4%
Confused 0.3%
Surprised 0.3%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 6-16
Gender Female, 99.8%
Calm 76.4%
Happy 8.1%
Sad 5.6%
Surprised 3.3%
Confused 3.2%
Angry 2.1%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 90.8%
Calm 3.5%
Angry 2%
Surprised 1.6%
Confused 0.9%
Sad 0.5%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Female, 50.6%
Calm 86.8%
Happy 10%
Confused 1%
Surprised 0.8%
Sad 0.5%
Angry 0.4%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 0-4
Gender Male, 90.5%
Sad 95.4%
Happy 1.5%
Angry 0.9%
Fear 0.7%
Surprised 0.6%
Calm 0.5%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.7%
Calm 83.9%
Sad 7.4%
Confused 3.9%
Disgusted 2.6%
Angry 0.8%
Surprised 0.5%
Fear 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Tie 99.6%
Tie 96.5%
Tie 73.8%
Tie 61.2%
Person 99.1%
Person 99%
Person 98.8%
Person 98.7%
Person 98.6%
Person 98.4%
Person 98%
Person 96.9%
Person 96.5%
Person 95.4%
Person 91.5%
Person 88.9%
Person 81.3%
Person 80.9%
Person 78.5%
Person 76.3%
Person 73.5%
Person 67.2%

Categories

Imagga

people portraits 97.1%
events parties 2.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people standing in front of a wall -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This image shows a vintage black-and-white group photograph of a family or group of individuals. There are two rows of people, with adults predominantly in the back row and children seated or standing in the front row. The group is dressed in formal or semi-formal attire, featuring button-up shirts, dresses, and ties. A decorative lattice structure is visible on the right side of the background, while the floor is plain, suggesting an indoor setting.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image depicts a large group of people posing for a photograph in a studio setting. There are fifteen individuals in total, with adults and children forming a family group. The adults are standing in the back row, while most of the children are situated in front. They are dressed in formal or semi-formal attire typical of a bygone era, including suits, ties, dresses, and collared shirts. The setting features plain walls and tiled flooring, with a lattice design door visible on the right side. The photograph appears to be taken professionally, capturing a moment likely meant for a formal family portrait.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This appears to be a vintage black and white photograph, likely from the 1950s, showing a large family group. The photo includes what appears to be multiple generations, with adults in the back row and children arranged in the front. The group is formally dressed - the adults are wearing dresses, suits and ties, while the younger children are in dress shirts, bow ties, and formal attire. The setting appears to be indoors with a latticed wall visible in the background. The composition is typical of formal family portraits from this era, with people arranged in height order to ensure everyone is visible. The photograph has the sepia-toned quality characteristic of mid-20th century photography.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-22

The black and white photograph shows a large family posing together, with the adults seated in the center and the children of various ages standing around them. There are 15 children in total, ranging from infants being held to older children and teenagers. The adults appear to be the parents or grandparents. Everyone is dressed nicely, with the females in dresses and the males in collared shirts, ties, and trousers. They are posing in front of a plain wall with a decorative lattice visible on the right side of the frame. It seems to be a formal family portrait taken to capture multiple generations together.

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image appears to be a family portrait. It shows a large group of people, including adults and children, posing together in what seems to be a formal setting. The individuals are dressed in clothing typical of the mid-20th century. The image has a sepia tone, indicating it is an older photograph. The group is arranged in a structured manner, with the adults seated in the front and the children standing behind them. The overall composition and style suggest this is a traditional family portrait from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a vintage family photograph, featuring a group of people posing together. The family appears to be of Asian descent, with the majority of the individuals wearing formal attire, suggesting that this may be a family portrait taken for a special occasion or milestone event.

In the foreground, there are several children and adults standing and sitting together, with some holding babies or infants. The children are dressed in matching outfits, while the adults are wearing more formal clothing, including suits and dresses. The overall atmosphere of the image suggests a sense of unity and togetherness among the family members.

The background of the image is a plain wall with a lattice door on the right side. The floor appears to be made of tile or wood, and the lighting is soft and even, suggesting that the photograph was taken in a studio or well-lit room.

Overall, the image conveys a sense of warmth and closeness among the family members, and the formal attire suggests that this may be a special occasion or milestone event.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a vintage photograph of a large family, likely taken in the mid-20th century. The family consists of three generations, with the oldest generation seated in the center and the younger generations standing or sitting around them.

The family is dressed in formal attire, with the men wearing suits and ties, and the women wearing dresses. The children are also dressed in their Sunday best, with the boys wearing button-down shirts and bow ties, and the girls wearing dresses.

The background of the photograph is a plain wall, with a decorative lattice pattern on the right side. The floor appears to be made of wood or tile, and there is a slight shadow cast by the family on the wall behind them.

Overall, the image conveys a sense of tradition and formality, as well as a strong sense of family unity and togetherness. It is likely that this photograph was taken on a special occasion, such as a holiday or a family reunion.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo features a group of people who seem to be family members. They are all wearing formal attire. The man in the middle is wearing glasses. The baby is sitting on the lap of the woman in the middle. They are probably posing for a family photo. Behind them is a white wall with a window and a door.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of a family gathering. The family is posing for a picture in a room with a white wall and a white door. The family consists of both adults and children. The adults are wearing formal attire, including suits and ties, while the children are dressed in casual clothing. The children are sitting on chairs, while the adults are standing behind them. The family members are smiling and looking at the camera.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

The black-and-white photo depicts a large family posing for a group portrait. The backdrop is a plain, light-colored wall with a decorative door or window frame in the upper right corner.

In the front row, several children are seated or standing. The boys are dressed in collared shirts, some with bow ties, and the girls are in dresses. In the center of the front row is a small girl in a light-colored dress with short sleeves and a flared skirt. She is wearing dark shoes and has her hair styled with pigtails.

In the second row, there are both women and men standing behind the children. One woman is holding a baby, while a man in the center is wearing glasses and a suit. The other women are wearing dresses or blouses with skirts.

The composition of the photo suggests a sense of unity and family pride. The subjects are dressed in their best attire, and their poses indicate a formal occasion. The overall tone of the image is nostalgic and evokes a sense of family history.

Created by gemini-2.0-flash-lite on 2025-05-16

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage black and white photograph of a large family group. It appears to be a studio portrait, as indicated by the plain background and the formal attire of the subjects.

Composition and Subjects:

  • Arrangement: The family is arranged in rows, with some members seated on chairs and others standing. The older generation and a baby are seated in the front.
  • People: There are approximately 17 people in the photograph. The group includes people of various ages, from infants to adults. The men are dressed in suits and ties, the women in dresses, and the children in formal wear.
  • Clothing and Style: The clothing styles suggest a mid-20th-century era. The dresses, suits, and hairstyles are all consistent with that period.
  • Setting: The background is a simple, plain wall. There is a white door on the right with a decorative lattice design.

Mood and Context:

  • Formal: The photograph is clearly meant to be a formal portrait, possibly taken for a special occasion.
  • Family: The image conveys a sense of family unity and importance. It's likely a commemorative picture of a large family.

If you'd like, you can give me a specific aspect to focus on, and I can provide a more detailed description!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a vintage black-and-white photograph of a large family group, likely taken in the mid-20th century. The family is arranged in three rows: standing, seated, and sitting on the floor.

  • Standing Row (from left to right):

    • A young boy in a white shirt and tie.
    • A young woman in a dark dress.
    • A woman in a patterned dress.
    • A young man in a suit and tie.
    • A man in a suit and tie.
    • A woman in a light-colored dress.
    • A woman in a dark dress with a light-colored collar.
    • A young girl in a dress.
    • A young boy in a white shirt and tie.
  • Seated Row (from left to right):

    • A woman holding a baby.
    • A man in a suit and tie.
    • A woman holding a baby.
    • A young boy in a white shirt and tie.
    • A young boy in a white shirt and tie.
    • A young boy in a white shirt and tie.
  • Sitting on the Floor (from left to right):

    • A young boy in a white shirt and tie.
    • A young girl in a dress.
    • A young boy in a white shirt and tie.
    • A young boy in a white shirt and tie.
    • A young boy in a white shirt and tie.

The setting appears to be indoors, with a plain wall and a lattice-patterned door or window in the background. The family members are dressed formally, suggesting that the photograph was taken for a special occasion or a formal family portrait. The overall atmosphere conveys a sense of unity and togetherness.