Human Generated Data

Title

Untitled (four photographs: family portraits outside house)

Date

c. 1940, printed later

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6802

Human Generated Data

Title

Untitled (four photographs: family portraits outside house)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6802

Machine Generated Data

Tags

Amazon
created on 2019-11-18

Advertisement 99.9
Collage 99.9
Poster 99.9
Human 99.7
Accessories 99.4
Accessory 99.4
Clothing 94.4
Apparel 94.4
Coat 93.2
Overcoat 93.2
Suit 93.2
People 87.1
Face 69.3
Military Uniform 68.4
Military 68.4
Funeral 67.5
Costume 60.7
Sailor Suit 58.7
Team 56.4

Clarifai
created on 2019-11-18

people 99.6
group 98.7
many 97.8
adult 95.6
wear 94.8
outfit 94.4
group together 94.2
man 92.9
offense 92.4
cavalry 91.9
police 91.1
law 91
woman 89.4
street 87.5
military 87.1
administration 85.8
child 84.9
canine 83.4
dog 81.7
vehicle 81.3

Imagga
created on 2019-11-18

hockey stick 25.1
people 22.3
city 21.6
urban 21
stick 20.1
clothing 18.4
man 18.1
person 17.6
passenger 16.8
sports equipment 16.2
black 15.3
street 14.7
motion 14.5
equipment 14.1
transportation 13.4
men 12.9
business 12.7
sport 12.7
silhouette 12.4
male 12.1
fashion 12
covering 11.1
adult 11.1
transport 10.9
walk 10.5
window 10.4
portrait 10.3
helmet 10.3
women 10.3
dress 9.9
travel 9.8
shop 9.8
walking 9.5
blur 9.3
power 9.2
outdoor 9.2
style 8.9
interior 8.8
crowd 8.6
architecture 8.6
consumer goods 8.5
wall 8.5
grunge 8.5
inside 8.3
active 8.1
team 8.1
building 8
life 7.8
move 7.7
old 7.7
sidewalk 7.5
knee pad 7.5
comic book 7.5
group 7.3
sexy 7.2
modern 7

Google
created on 2019-11-18

Microsoft
created on 2019-11-18

clothing 98.3
text 96
man 95.7
outdoor 90.8
person 90.3
posing 71.2
footwear 66.8
different 65.9
group 65
black and white 60.8
bunch 50.2
step 30.8
same 21.8
several 12.2

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 39-57
Gender Male, 54.5%
Fear 45.1%
Angry 47.6%
Calm 47.1%
Surprised 45.1%
Happy 45.1%
Confused 45.3%
Sad 45.3%
Disgusted 49.4%

AWS Rekognition

Age 37-55
Gender Female, 52.7%
Fear 45%
Calm 45%
Surprised 45%
Confused 45%
Disgusted 45.3%
Happy 54.6%
Sad 45%
Angry 45.1%

AWS Rekognition

Age 46-64
Gender Female, 51.5%
Angry 45.3%
Calm 53.5%
Confused 45.2%
Disgusted 45%
Surprised 45%
Happy 45.6%
Sad 45.4%
Fear 45%

AWS Rekognition

Age 25-39
Gender Male, 54.8%
Sad 45.3%
Calm 53.5%
Angry 45.7%
Fear 45%
Happy 45.1%
Surprised 45.1%
Disgusted 45.1%
Confused 45.2%

AWS Rekognition

Age 41-59
Gender Male, 54.9%
Calm 50.2%
Fear 45%
Confused 45%
Happy 45%
Angry 49.6%
Disgusted 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 57-75
Gender Male, 50.2%
Disgusted 45%
Calm 50.6%
Confused 45.7%
Sad 47.5%
Happy 45.1%
Angry 46.1%
Fear 45%
Surprised 45.1%

AWS Rekognition

Age 36-52
Gender Male, 50.4%
Disgusted 49.6%
Angry 49.6%
Calm 49.5%
Surprised 49.5%
Sad 49.8%
Confused 49.9%
Fear 49.6%
Happy 49.6%

AWS Rekognition

Age 23-37
Gender Male, 50.2%
Angry 49.5%
Sad 49.5%
Confused 49.7%
Disgusted 50.1%
Surprised 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.6%

AWS Rekognition

Age 30-46
Gender Male, 54.7%
Surprised 45%
Calm 52.9%
Fear 45%
Disgusted 45.1%
Happy 45%
Angry 46.2%
Sad 45.2%
Confused 45.5%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Disgusted 49.5%
Calm 49.8%
Angry 49.6%
Confused 50.1%
Fear 49.5%
Sad 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 19-31
Gender Male, 50.5%
Disgusted 49.5%
Angry 49.6%
Fear 49.5%
Happy 49.7%
Confused 49.6%
Sad 49.9%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 14-26
Gender Female, 50.5%
Disgusted 49.5%
Happy 50.4%
Surprised 49.5%
Sad 49.5%
Fear 49.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 25-39
Gender Female, 50.1%
Calm 49.5%
Happy 50.5%
Angry 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 41-59
Gender Male, 50.4%
Angry 49.5%
Calm 49.5%
Sad 49.5%
Happy 50.5%
Fear 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Calm 50.1%
Fear 49.5%
Confused 49.6%
Surprised 49.5%
Angry 49.5%
Happy 49.6%
Sad 49.6%
Disgusted 49.6%

AWS Rekognition

Age 37-55
Gender Female, 50.5%
Angry 49.5%
Happy 50.1%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Calm 49.9%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 34-50
Gender Female, 50.1%
Fear 49.5%
Disgusted 49.7%
Calm 49.5%
Happy 49.9%
Surprised 49.5%
Angry 49.5%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 3-9
Gender Female, 50.1%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Sad 50.4%
Happy 49.5%
Surprised 49.5%
Fear 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.5%
Sad 49.7%
Fear 49.6%
Disgusted 49.8%
Angry 49.5%
Happy 49.6%
Confused 49.7%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.1%
Disgusted 49.8%
Happy 49.6%
Angry 49.5%
Fear 49.5%
Calm 49.8%
Confused 49.6%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 15-27
Gender Female, 50.5%
Sad 49.5%
Calm 50.3%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.6%
Fear 49.5%

AWS Rekognition

Age 33-49
Gender Female, 54.9%
Surprised 45.1%
Angry 45.2%
Fear 45%
Calm 45.6%
Confused 45.2%
Sad 45.1%
Disgusted 45.4%
Happy 53.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Angry 49.5%
Calm 49.5%
Happy 50.3%
Sad 49.5%
Fear 49.5%
Surprised 49.5%
Disgusted 49.7%
Confused 49.5%

AWS Rekognition

Age 6-16
Gender Female, 50.5%
Confused 49.5%
Fear 49.5%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 50.4%
Calm 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.5%
Angry 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%
Calm 49.5%
Happy 50.5%
Surprised 49.5%

AWS Rekognition

Age 47-65
Gender Female, 50.5%
Confused 49.6%
Calm 49.6%
Surprised 49.5%
Fear 49.5%
Happy 49.9%
Angry 49.5%
Sad 49.5%
Disgusted 49.8%

AWS Rekognition

Age 1-7
Gender Female, 50.1%
Calm 49.5%
Angry 49.8%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.1%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 3-11
Gender Female, 50.2%
Angry 49.5%
Happy 50.5%
Disgusted 49.5%
Calm 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 5-15
Gender Female, 50.4%
Surprised 49.5%
Sad 49.6%
Calm 49.6%
Happy 49.9%
Confused 49.6%
Disgusted 49.5%
Fear 49.5%
Angry 49.7%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Tie

Clarifai

Man
Footwear
Human face
Woman
Clothing
Picture frame
Window
Person

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 95.9%

AWS Rekognition

Person 94.6%

AWS Rekognition

Person 94.3%

AWS Rekognition

Person 91%

AWS Rekognition

Person 89.4%

AWS Rekognition

Tie 99.4%

Clarifai

Man 78.6%

Clarifai

Man 66%

Clarifai

Man 65.7%

Clarifai

Man 61%

Clarifai

Man 60.2%

Clarifai

Footwear 73.3%

Clarifai

Footwear 70.1%

Clarifai

Footwear 69.6%

Clarifai

Footwear 67.8%

Clarifai

Footwear 66.2%

Clarifai

Footwear 63.8%

Clarifai

Footwear 63.2%

Clarifai

Footwear 60.8%

Clarifai

Footwear 60.8%

Clarifai

Footwear 59.6%

Clarifai

Footwear 57.9%

Clarifai

Footwear 57.4%

Clarifai

Footwear 57%

Clarifai

Footwear 55.5%

Clarifai

Footwear 53.6%

Clarifai

Footwear 50.8%

Clarifai

Footwear 49.4%

Clarifai

Footwear 47.6%

Clarifai

Footwear 39.9%

Clarifai

Footwear 37.5%

Clarifai

Footwear 37.4%

Clarifai

Footwear 34.3%

Clarifai

Footwear 33.1%

Clarifai

Human face 67.8%

Clarifai

Human face 63.9%

Clarifai

Human face 60.8%

Clarifai

Human face 59.1%

Clarifai

Human face 58.8%

Clarifai

Human face 55.6%

Clarifai

Human face 51.1%

Clarifai

Human face 47.5%

Clarifai

Human face 46.6%

Clarifai

Human face 46.5%

Clarifai

Human face 40.2%

Clarifai

Human face 38.8%

Clarifai

Human face 36.9%

Clarifai

Human face 36.2%

Clarifai

Woman 64.1%

Clarifai

Woman 58.3%

Clarifai

Woman 54.8%

Clarifai

Woman 46.5%

Clarifai

Woman 42.8%

Clarifai

Clothing 64%

Clarifai

Clothing 63.8%

Clarifai

Clothing 62.4%

Clarifai

Clothing 60.4%

Clarifai

Clothing 57.8%

Clarifai

Clothing 54.7%

Clarifai

Clothing 41.2%

Clarifai

Clothing 37.8%

Clarifai

Clothing 35.4%

Clarifai

Picture frame 59%

Clarifai

Picture frame 47.1%

Clarifai

Picture frame 34.8%

Clarifai

Window 42.7%

Clarifai

Window 36.3%

Clarifai

Person 42.2%

Categories

Imagga
created on 2019-11-18

paintings art 99.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing around a group of people

Created by general-english-image-caption-blip-2 on 2025-07-10

a group of black and white photos of a family

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This image is a collection of six black-and-white photographs arranged in a grid format. Each photo depicts individuals in formal clothing seated or standing in front of a house with horizontal siding and a window visible. The scenes capture group portraits, with some photos showing family groups of various sizes including adults and children, while others feature pairs seated in chairs. The clothing styles and setting suggest a mid-20th-century time period. Gravel ground is visible in front of the house in all photographs.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image consists of six black-and-white photographs arranged in a grid. Each photograph appears to depict different groupings of people in front of a building with horizontal siding and windows. The photos include combinations of seated individuals and standing people, all dressed in formal attire typical of mid-20th century American fashion. There are people wearing suits, dresses, and formal shoes. The photographs are arranged in two columns and three rows, with each group varying slightly in the number of people present, suggesting different family or group portraits taken at the same location.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a collage of several black and white photographs depicting various groups of people, likely from the same family or community. The photographs show different groups of individuals, some sitting together outdoors, others standing or seated indoors. The people are dressed in formal attire, suggesting these may be portraits or family photographs from a particular time period. The overall composition of the collage suggests these images are meant to capture a sense of the people and their relationships over time.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a collection of five vintage black and white photographs, likely from around the mid-20th century. All the photos are taken outside what seems to be the same white clapboard house or building. The photos show various group arrangements of people in formal attire typical of the era - men in suits and ties, women in dark dresses with white collars. The compositions are similar, with the subjects posed sitting and standing in front of the building. The top left photo shows a larger group, while some of the other photos show pairs or small family groups. The photography style and clothing suggest these may be family portraits from the 1940s or 1950s.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image is a collage of six black-and-white photographs, arranged in two rows of three. The top row features three photos of a man and woman sitting on chairs in front of a house, with the middle photo being a close-up of the couple. The bottom row consists of three photos of a family posing in front of the same house, with the middle photo showing the couple from the top row sitting together.

The background of the image is a light gray color, which provides a neutral contrast to the black-and-white photographs. The overall effect is a nostalgic and intimate portrayal of a family's life, captured through a series of candid moments.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image presents a collection of black-and-white photographs, arranged in a collage format. The photographs are divided into six sections, each featuring a different group of people posing for the camera.

Photograph 1:
The top-left photograph showcases a group of six individuals, comprising three men and three women, standing in front of a white building with a window. The group is dressed in attire from the 1940s, with the men wearing suits and ties, while the women wear dresses and skirts.

Photograph 2:
The top-center photograph depicts a couple sitting on chairs in front of the same white building. The man is attired in a suit and tie, while the woman wears a dress and skirt.

Photograph 3:
The top-right photograph features a couple sitting on chairs in front of the same white building. The man is dressed in a suit and tie, while the woman wears a dress and skirt.

Photograph 4:
The bottom-left photograph shows a family of four, consisting of two adults and two children, posing in front of the same white building. The adults are dressed in attire from the 1940s, with the man wearing a suit and tie, and the woman wearing a dress and skirt. The children are dressed in matching outfits.

Photograph 5:
The bottom-center photograph depicts a couple sitting on chairs in front of the same white building. The man is attired in a suit and tie, while the woman wears a dress and skirt.

Photograph 6:
The bottom-right photograph features a group of five individuals, comprising two men and three women, posing in front of the same white building. The group is dressed in attire from the 1940s, with the men wearing suits and ties, while the women wear dresses and skirts.

Overall, the image presents a nostalgic glimpse into the past, showcasing the fashion and social norms of the 1940s. The photographs are likely from an old family album or scrapbook, capturing moments of everyday life and special occasions.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

A collage of six black-and-white photos of families posing for a photo in front of a house. The first photo shows a group of children sitting on the steps of the house. The second photo shows a couple sitting on chairs in front of the house. The third photo shows a woman sitting on a chair with a man standing behind her. The fourth photo shows a family of three posing for a photo. The fifth photo shows a family of five posing for a photo. The sixth photo shows a family of seven posing for a photo.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph featuring a collage of various family portraits. The collage consists of six distinct images, each capturing different family members in different settings. The first image shows a group of children standing in a row, possibly in a school setting. The second image depicts two adults sitting on a chair, with one holding a baby. The third image shows a woman sitting on a chair with a man standing behind her. The fourth image shows a group of adults and children sitting on chairs in front of a house. The fifth image shows a woman sitting on a chair with a man standing behind her. The sixth image shows a group of adults and children sitting on chairs in front of a house.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

The image is a contact sheet featuring six black and white photographs of people posed in front of what appears to be a house or building with clapboard siding and windows. The photos seem to have been taken on the same day, and the compositions are similar across the set.

Here's a breakdown of each individual photograph:

  1. The first photo (top left) shows a large family group, seated and standing close together, likely a family portrait.
  2. The second photo (top middle) features a man and a woman seated on chairs, both formally dressed.
  3. The third photo (top right) is similar to the second, with a different couple seated on chairs, both formally dressed.
  4. The fourth photo (bottom left) depicts a family group with parents, children, and possibly grandparents, some seated and some standing.
  5. The fifth photo (bottom middle) shows a couple seated on chairs, both formally dressed, posing similarly to the other couples.
  6. The sixth photo (bottom right) features another group, possibly a family, including both seated and standing members.

The photographs appear to be old, likely from the mid-20th century, given the clothing styles and the quality of the image. The composition suggests a focus on the individuals and their relationships, with the building serving as a simple backdrop. The uniformity of the backgrounds indicates the photos were likely taken in a single location, perhaps for a family gathering or special occasion.

Created by gemini-2.0-flash-lite on 2025-04-29

This is a black and white contact sheet composed of several family portraits. Each image is framed in the same style with a white siding house in the background.

Here's a breakdown of the portraits:

  • Top Left: A large group of people are clustered together, possibly multiple families, with many children.
  • Top Middle: A woman and a man are seated side-by-side.
  • Top Right: A woman and a man are seated side-by-side.
  • Bottom Left: A group of several individuals of varying ages, some standing and some sitting.
  • Bottom Middle: A woman and a man are seated side-by-side.
  • Bottom Right: Another family group shot, including people of different generations.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image is a collage of six black-and-white photographs, likely depicting a family over several generations. Here's a detailed summary of each photograph:

  1. Top Left: A group of children and young adults are seated on a set of stairs. They are arranged in multiple rows, with some standing and some sitting. The children are dressed in what appears to be school uniforms or formal attire.

  2. Top Middle: An elderly couple is seated outside a house. The woman is wearing a dark dress with a white collar, and the man is in a suit and tie. They are both seated on chairs, with the woman on the left and the man on the right.

  3. Top Right: The same elderly couple from the top middle photograph is seated in the same location, but the woman is now wearing a different dress, and the man is in a different suit. They are both seated on chairs, with the woman on the left and the man on the right.

  4. Bottom Left: A family group consisting of two adults and three children is seated outside a house. The adults are dressed formally, with the woman in a dark dress and the man in a suit and tie. The children are also dressed formally, with the girls in dresses and the boy in a suit.

  5. Bottom Middle: The same elderly couple from the top middle and top right photographs is seated in the same location, but the woman is now wearing a different dress, and the man is in a different suit. They are both seated on chairs, with the woman on the left and the man on the right.

  6. Bottom Right: A larger family group consisting of multiple adults and children is seated outside a house. The adults are dressed formally, with the women in dresses and the men in suits and ties. The children are also dressed formally, with the girls in dresses and the boys in suits.

The photographs appear to be taken over a span of time, capturing different stages of the family's life. The setting is consistent, with all photographs taken outside a house with a similar background. The attire suggests that these are formal or special occasion photographs.

Qwen

No captions written