Human Generated Data

Title

Untitled (large family of eighteen people posing in small room with bookshelf)

Date

1938

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10155

Human Generated Data

Title

Untitled (large family of eighteen people posing in small room with bookshelf)

People

Artist: Martin Schweig, American 20th century

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10155

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Tie 99.3
Accessories 99.3
Accessory 99.3
Family 99.3
People 99.3
Person 99
Person 98.3
Person 98.2
Person 98
Person 97.5
Person 97.5
Person 97.4
Person 97
Tie 96.7
Person 96.3
Tie 96
Tie 95.9
Person 95.4
Person 94.7
Person 94.1
Person 93.3
Suit 92.8
Coat 92.8
Overcoat 92.8
Clothing 92.8
Apparel 92.8
Person 92.4
Person 92.2
Person 87.6
Suit 80.7
Suit 71.9
Tie 71.6
Tie 68.4
Tie 67.2
Person 66.2

Clarifai
created on 2023-10-26

people 100
group 100
leader 98.7
group together 98.5
many 98
adult 97.9
man 97.7
administration 97
woman 95.9
child 94.9
portrait 90.1
outfit 88.5
several 88.5
war 88.5
family 87.6
chair 86.3
actor 86
snapshot 85.9
education 80.5
offspring 80

Imagga
created on 2022-01-22

kin 100
family 28.4
people 27.3
happy 23.8
child 23.6
happiness 23.5
male 23.4
man 22.1
person 21.1
portrait 20.7
adult 19.8
fun 17.9
mother 17
couple 16.5
group 16.1
love 15.8
men 13.7
daughter 13.5
women 13.4
joy 13.3
together 13.1
smiling 13
smile 12.8
youth 12.8
girls 12.7
father 12.4
kid 12.4
outdoor 12.2
boy 12.2
black 12
home 12
childhood 11.6
parent 11.1
casual 11
two 11
leisure 10.8
room 10.3
summer 10.3
face 9.9
dress 9.9
attractive 9.8
cheerful 9.7
human 9.7
married 9.6
park 9
blond 9
active 9
outdoors 8.9
lifestyle 8.7
bride 8.6
enjoying 8.5
friendship 8.4
fashion 8.3
silhouette 8.3
holding 8.2
sport 8.2
playing 8.2
children 8.2
sexy 8
cute 7.9
sepia 7.8
son 7.7
husband 7.6
ball 7.5
emotion 7.4
wedding 7.3
life 7.3
looking 7.2
team 7.2
grass 7.1
to 7.1
interior 7.1
day 7.1

Google
created on 2022-01-22

Coat 85.4
Suit 80.2
Family reunion 78.4
Vintage clothing 75.5
Classic 75.4
Snapshot 74.3
Event 73.7
Crew 73.4
Team 71.4
Formal wear 67
History 65.8
Sitting 59.1
Family 55.1
Oval 54.4
Retro style 54.2

Microsoft
created on 2022-01-22

person 100
posing 99.9
clothing 98.3
wall 96.5
group 95.4
smile 93.6
man 92.2
standing 91.4
old 85.2
woman 81
team 60.1
people 59.4
dressed 31.4
male 15.9
clothes 15.1
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 52%
Happy 33.7%
Surprised 6.7%
Confused 3.6%
Angry 2.1%
Sad 0.9%
Fear 0.8%
Disgusted 0.2%

AWS Rekognition

Age 9-17
Gender Female, 75.9%
Calm 98.6%
Happy 0.7%
Confused 0.3%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 71.3%
Surprised 13.9%
Happy 7.4%
Fear 2.6%
Confused 2.4%
Angry 1.3%
Sad 0.7%
Disgusted 0.4%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.8%
Confused 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 96.9%
Calm 98.2%
Sad 0.4%
Surprised 0.4%
Happy 0.3%
Angry 0.3%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 42-50
Gender Male, 97%
Calm 83%
Confused 4.6%
Happy 3.1%
Surprised 2.3%
Sad 2.2%
Angry 2.2%
Fear 1.5%
Disgusted 1%

AWS Rekognition

Age 42-50
Gender Female, 60.2%
Calm 80.6%
Confused 6.8%
Happy 5.9%
Angry 2.2%
Surprised 2%
Sad 0.9%
Fear 0.8%
Disgusted 0.7%

AWS Rekognition

Age 20-28
Gender Male, 97.4%
Calm 98.8%
Surprised 0.3%
Happy 0.2%
Confused 0.2%
Angry 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 99.5%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Surprised 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Female, 99.6%
Calm 99.2%
Surprised 0.3%
Happy 0.1%
Angry 0.1%
Fear 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 35-43
Gender Female, 98.6%
Happy 55.8%
Calm 28.5%
Confused 8.7%
Angry 2.9%
Surprised 2.2%
Disgusted 0.8%
Sad 0.7%
Fear 0.5%

AWS Rekognition

Age 54-62
Gender Female, 99.6%
Happy 95.1%
Calm 3.1%
Surprised 0.6%
Confused 0.4%
Angry 0.3%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 73-83
Gender Female, 58.8%
Calm 80.6%
Angry 8.8%
Confused 5.2%
Sad 2.1%
Disgusted 0.9%
Fear 0.9%
Surprised 0.8%
Happy 0.6%

AWS Rekognition

Age 4-10
Gender Female, 97.9%
Calm 94.2%
Surprised 3.2%
Fear 0.9%
Confused 0.7%
Happy 0.4%
Angry 0.3%
Sad 0.3%
Disgusted 0.1%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 98.2%
Happy 0.5%
Confused 0.4%
Sad 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-53
Gender Female, 99.8%
Calm 87.4%
Happy 5.2%
Surprised 2%
Angry 1.8%
Confused 1.7%
Sad 0.8%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 4-12
Gender Male, 59.1%
Calm 97%
Confused 1.9%
Sad 0.4%
Angry 0.2%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 99.5%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 53
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 99.4%
Person 99%
Person 98.3%
Person 98.2%
Person 98%
Person 97.5%
Person 97.5%
Person 97.4%
Person 97%
Person 96.3%
Person 95.4%
Person 94.7%
Person 94.1%
Person 93.3%
Person 92.4%
Person 92.2%
Person 87.6%
Person 66.2%
Tie 99.3%
Tie 96.7%
Tie 96%
Tie 95.9%
Tie 71.6%
Tie 68.4%
Tie 67.2%
Suit 92.8%
Suit 80.7%
Suit 71.9%

Categories

Imagga

people portraits 97.5%
events parties 2.3%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people posing for a photo -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image depicts a formal group portrait of people dressed in elegant attire from a past era, possibly the early to mid-20th century. The group is set indoors in a room with classic decor, featuring an arched bookshelf filled with books, wall sconces on either side, and a patterned carpet on the floor. The individuals are arranged in rows, with some seated and others standing behind them, forming a carefully staged composition. A bride wearing a wedding gown is positioned centrally, implying the image might have been taken during a special event, such as a wedding or family gathering.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a formal family portrait with a total of sixteen individuals, comprising various adults and children. The group is posed in what appears to be a living room setting with a decorative archway in the background holding a filled bookshelf. The adults are dressed in formal attire, with the men wearing suits and ties and the women dressed in elegant dresses. The children are also dressed formally, with one boy seated at the front in a sailor-like outfit and another in a sweater with a collared shirt. Two older individuals are seated on armchairs, suggesting a position of honor or seniority in the group. The room is decorated with wall sconces on either side, adding an elegant touch to the setting. A patterned carpet covers the floor in front of the group.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a large family posing for a picture. The family is dressed in formal attire, with the men wearing suits and ties, and the women wearing dresses. They are arranged in a formal pose, with the adults standing in the back row and the children sitting in the front row. The background of the image is a room with white walls and a bookshelf filled with books. The overall atmosphere of the image is one of formality and respectability, suggesting that it was taken for a special occasion or as a family portrait.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a large family gathered in a formal setting, likely taken in the early 20th century. The family is arranged in three rows, with the back row standing, the middle row seated on chairs, and the front row sitting on the floor.

The family members are dressed in formal attire, with the men wearing suits and ties, and the women wearing dresses and blouses. The children are also dressed in formal clothing, with the boys wearing suits and ties, and the girls wearing dresses.

In the background, there is a bookshelf filled with books, and two sconces on either side of the bookshelf. The walls are adorned with decorative molding, and the floor is covered with a patterned rug.

Overall, the image suggests that the family is gathered for a special occasion, such as a wedding or a holiday celebration. The formal attire and the elegant setting suggest a sense of importance and tradition.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photograph of a family gathering shows a group of people in formal attire, sitting and standing in a room. The room has a white wall with a shelf of books and a lamp on either side. The family members are smiling and posing for the camera. The woman in the center, wearing a flower crown, is likely the bride, and the man standing next to her is likely the groom.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photo of a family group, consisting of 16 people, posing for a photograph. The photo was taken indoors, probably in the living room of a house. The family members are wearing formal clothes, and some of them are wearing ties. There are two children sitting on the floor in front. Behind them, there are two men standing on each side, and there is a shelf with books behind them.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

Certainly! Here's a description of the image:

Overall Impression:

The image is a formal, posed group portrait, likely taken in the early to mid-20th century, possibly around the 1930s or 1940s. It's in black and white, which is characteristic of that era. The photo suggests a family gathering or a special occasion.

Composition:

  • Arrangement: The group is tightly arranged, filling the frame. There are people standing at the back and a mixture of seated and kneeling individuals in the front.
  • Setting: The background appears to be a domestic interior. There's a curved architectural detail with bookshelves in the center. The walls are relatively plain, but sconces with candle-style lights are visible.

People and Attire:

  • Diversity of Ages: There is a range of ages, from young children to older adults, indicating a multigenerational family.
  • Clothing: The attire is formal. Men are mostly in suits or suit-like jackets, and the women are wearing dresses. Several women wear floral decorations on their dresses. The children have on outfits appropriate for the era.
  • Expressions: Most people appear to be facing the camera with relatively straight faces, in keeping with the formality of the portrait.

Overall Atmosphere:

The photograph conveys a sense of formality, tradition, and perhaps a hint of nostalgia. It is a snapshot of a family, captured in a moment intended to be preserved.

Created by gemini-2.0-flash on 2025-05-09

The black and white medium shot shows a large family portrait in a room that appears to be in a home. Three seated women and a young boy in a sailor outfit make up the first row. One young boy is cross-legged in front of the woman in the center. Another young boy is cross-legged in front of the woman to the right. The second row consists of seven adults of varying ages. The third row has six adults standing, two of which are standing slightly behind the second row on the left and right. A bookshelf with an arched top can be seen in the background. Three candelabras on the wall can also be seen. Everyone is looking at the camera, but some have slight smiles. The carpet is patterned.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a formal family portrait, likely taken in the early to mid-20th century. The photograph is in black and white and features a large group of individuals, suggesting a multi-generational family gathering.

Here are some detailed observations:

  1. Setting: The photo is taken indoors, in what appears to be a well-decorated living room. The background includes a bookshelf filled with books, wall sconces with candles, and a patterned rug on the floor.

  2. People: There are 16 individuals in the photo, including men, women, and children. They are arranged in three rows:

    • Front Row: Two young boys and a girl are seated on the floor.
    • Middle Row: Several adults are seated on chairs. This row includes both men and women.
    • Back Row: Several adults are standing behind the seated individuals. This row also includes both men and women.
  3. Attire: The attire of the individuals suggests a formal occasion. The men are dressed in suits and ties, while the women are wearing dresses, some with decorative elements like bows and brooches. The children are also dressed formally, with the boys in suits and the girl in a dress.

  4. Poses: The individuals are posed formally, facing the camera. Their expressions are serious, which was common for formal portraits of this era.

  5. Age Range: The group includes a range of ages, from young children to older adults, indicating a family gathering that spans multiple generations.

Overall, the image captures a moment of a family coming together, dressed in their best attire, likely for a special occasion or a formal family portrait session.