Human Generated Data

Title

Untitled (family portrait on steps to porch of house)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3422

Human Generated Data

Title

Untitled (family portrait on steps to porch of house)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3422

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.7
Apparel 99.7
Human 99
Accessories 95
Accessory 95
Dress 89.1
Female 88.8
Face 80.8
People 78.7
Fashion 73.8
Robe 72.9
Woman 71.7
Door 71.6
Gown 69.5
Girl 64.6
Portrait 62.7
Photography 62.7
Photo 62.7
Evening Dress 59.9
Costume 58.1
Sailor Suit 56.3

Clarifai
created on 2023-10-26

people 99.9
group 99
uniform 98.6
adult 98
woman 96.6
man 96.1
medical practitioner 96
group together 94.4
outfit 93.2
wear 92.6
portrait 90.8
several 88.1
outerwear 86.2
three 85.2
coat 83.5
healthcare 82.3
four 81
child 78.1
five 77.7
hospital 76.5

Imagga
created on 2022-01-22

nurse 37.8
kin 33.3
people 29
couple 27.8
man 26.9
groom 24.9
bride 24.9
male 23.5
person 22.7
happiness 21.1
wedding 20.2
dress 18.1
men 18
two 17.8
adult 17.5
happy 16.9
love 16.6
portrait 16.2
married 15.3
bouquet 14.3
marriage 14.2
family 14.2
women 13.4
clothing 13.4
ceremony 12.6
smiling 12.3
patient 12.2
human 12
celebration 12
elegance 11.7
together 11.4
fashion 11.3
old 11.1
traditional 10.8
wed 10.8
husband 10.6
businessman 10.6
wife 10.4
day 10.2
suit 9.9
bridal 9.7
black 9.6
loving 9.5
mother 9.4
smile 9.3
life 9.2
new 8.9
romantic 8.9
matrimony 8.9
model 8.5
youth 8.5
business 8.5
hand 8.3
room 8.3
health 8.3
tradition 8.3
cheerful 8.1
lady 8.1
religion 8.1
group 8.1
romance 8
home 8
lifestyle 7.9
newly 7.9
holiday 7.9
flowers 7.8
pretty 7.7
teacher 7.5
outdoors 7.5
future 7.4
pose 7.2
looking 7.2
art 7.2
face 7.1
to 7.1
summer 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.1
wedding dress 97
posing 96.8
bride 94.9
clothing 93.1
person 89.5
dress 88.1
woman 87.5
wedding 50.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 57.5%
Surprised 87.6%
Calm 6.7%
Happy 3%
Fear 1.1%
Confused 0.7%
Sad 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Male, 60%
Surprised 88.6%
Calm 10.1%
Happy 0.5%
Confused 0.3%
Disgusted 0.2%
Sad 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Male, 91.9%
Calm 96.6%
Surprised 1.9%
Happy 1%
Sad 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 43-51
Gender Male, 97.5%
Calm 99.9%
Angry 0%
Happy 0%
Sad 0%
Fear 0%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 99.7%
Sad 0.2%
Surprised 0%
Happy 0%
Angry 0%
Fear 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 75.8%
Happy 8.5%
Surprised 7.5%
Confused 2.6%
Sad 2.4%
Disgusted 1.7%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 99.8%
Surprised 0.2%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 54%
Calm 94.8%
Surprised 4.8%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses

Clarifai

Man
Woman
Dress
Footwear
Human face
Picture frame
Human hair
Human arm
Fashion accessory

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 89.6%

AWS Rekognition

Person 77%

AWS Rekognition

Sunglasses 95%

Clarifai

Man 86.4%

Clarifai

Man 79.6%

Clarifai

Man 77.3%

Clarifai

Man 54%

Clarifai

Woman 78.7%

Clarifai

Woman 78.7%

Clarifai

Woman 68.2%

Clarifai

Woman 65.3%

Clarifai

Dress 66.4%

Clarifai

Footwear 63.5%

Clarifai

Footwear 50.8%

Clarifai

Footwear 49%

Clarifai

Footwear 43.9%

Clarifai

Footwear 42.8%

Clarifai

Footwear 34.1%

Clarifai

Human face 55.6%

Clarifai

Human face 53.1%

Clarifai

Human face 52.8%

Clarifai

Human face 52%

Clarifai

Human face 49%

Clarifai

Human face 47.2%

Clarifai

Human face 44.2%

Clarifai

Human face 43.3%

Clarifai

Picture frame 54.9%

Clarifai

Human hair 36.6%

Clarifai

Human arm 35.9%

Clarifai

Fashion accessory 35.9%

Clarifai

Fashion accessory 33.5%

Categories

Imagga
created on 2022-01-22

people portraits 92.6%
streetview architecture 3.8%
events parties 2%
paintings art 1.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of the wedding of person and actor.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a group of people in white dresses and hats

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image shows a negative photograph of a group of individuals posing together in a formal arrangement. There are seven figures, with five standing in the back and two seated in the front. The seated man wears a light-colored suit with a tie, and the seated woman is dressed in a darker outfit and holds an object on her lap. The group appears to be positioned outdoors in front of a staircase, with plants and structural details in the background, such as windows or doors. The attire suggests a formal or special occasion.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white negative of a group portrait featuring seven individuals. The group is posed outdoors, possibly on a lawn, with a building and open doors behind them. In the foreground, two people are seated; one is a man dressed in a white suit with a bow tie, and the other is a woman in a dark dress, possibly holding a purse or clutch. Standing behind them are five people, four women and one man, all dressed in what appears to be formal or semi-formal attire typical of an earlier 20th-century style. There are steps leading up to the entrance and some plants near the group.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of a group of people dressed in traditional ceremonial attire. The group includes several individuals wearing white robes and headdresses, as well as one person seated in the center wearing a dark robe. The background suggests an outdoor setting, with some vegetation visible. The overall impression is one of a ceremonial or religious gathering of some kind.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph, likely from the early 20th century. The image shows a group of seven people posed together, with five wearing white uniforms or dresses and two in darker clothing. The composition has two people seated in front and five standing behind them. The white uniforms suggest these might be nurses or medical staff, given the professional and uniform appearance of their attire. The photo appears to be taken outside, with what looks like a building's porch or entrance visible in the background. The image has been captured in a formal, posed style typical of professional photography from that era. The contrast between the white clothing and darker background creates a striking visual effect in the photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a group of people, likely a family, posing for a picture. The photo appears to be from the early 20th century, given the clothing and hairstyles of the individuals.

Here are the details of the image:

  • Group of People:
    • There are nine people in the photo, including two men and seven women.
    • They are all dressed in formal attire, with the men wearing suits and ties, and the women wearing dresses and hats.
    • The group is arranged in three rows, with the two men sitting in the front row and the women standing behind them.
  • Background:
    • The background of the photo is a dark-colored wall or curtain.
    • There is a window or door on the left side of the photo, which allows natural light to enter the room.
    • The floor is made of wood or tile, and there is a small table or bench in front of the group.
  • Overall Atmosphere:
    • The photo appears to be a formal portrait, possibly taken for a special occasion such as a wedding or anniversary.
    • The group's attire and the formal setting suggest that they are trying to present themselves in a dignified and respectable manner.

In summary, the image is a formal portrait of a group of people, likely a family, posing for a photo in the early 20th century. The photo is well-composed, with the group arranged in a clear and symmetrical manner. The formal attire and setting suggest that the photo was taken for a special occasion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a group of eight individuals, likely taken in the early 20th century. The group consists of four men and four women, all dressed in formal attire.

The men are positioned at the back and front of the group, while the women are placed in the middle. The individuals at the back are standing, with two men on either side of two women. The man in the front is seated on a chair, with a woman seated on the ground in front of him.

The group is posed in front of a building with windows and blinds, which are visible behind them. The overall atmosphere of the image suggests that it may be a family portrait or a gathering of friends, possibly taken during a special occasion or event.

The image has a nostalgic quality to it, evoking a sense of nostalgia and historical significance. The formal attire and old-fashioned hairstyles add to the image's vintage charm, making it a fascinating glimpse into the past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image features a family portrait in black and white, with seven people standing and sitting. The man in the center is seated on a chair, while the others are standing behind him. The woman on the right is holding a bag, and the woman on the left is wearing a necklace. The man on the right is wearing a tie, and the man on the left is wearing a suit. The image has a watermark in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of a group of people. There are six people standing and two people sitting. The people are dressed in formal clothing. The people standing are wearing long white dresses and suits. The people sitting are wearing a white suit and a dress. The people are standing on a staircase. There are potted plants on the right side of the image.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a black-and-white film negative that features a group portrait. The subjects include five women and two men standing in the back row, with a man seated on a chair in the front left and a woman seated in the front right. The figures are positioned in front of what seems to be the steps and doorway of a building.

The women in the back row are wearing what appear to be long, light-colored dresses or gowns. The dresses have varying details and trims, such as buttons, belts, and decorative collars. The men in the back are dressed in suits and ties. The seated man in the front left is wearing a suit and has one leg crossed over the other. The seated woman on the right wears a dark dress and glasses.

The overall image is in a negative format, meaning that the light areas would appear dark in a positive print, and vice versa. The background is slightly blurred.

Created by gemini-2.0-flash-lite on 2025-05-16

Here is a description of the image:

Overall: The image is a negative photograph, meaning the tones are inverted: light areas appear dark, and dark areas appear light. It is a portrait of a group of people, likely taken outdoors in front of a building.

Composition: There are nine individuals in the group. They are arranged in multiple rows.

  • In the front, a man is seated on a chair and another woman is seated to his right.
  • Behind the seated man are a group of people, all of whom appear to be standing.

Appearance of the Individuals:

  • Most of the people are dressed in light-colored clothing, possibly white or cream-colored. Some of the men wear suits and ties.
  • The women wear long dresses or skirts and blouses. Some have hats or head coverings.
  • Based on their clothing, the individuals are likely from an earlier time period.

Setting:

  • The photo appears to have been taken on the porch or in front of a building, likely a house or a similar structure.
  • The background has a partial view of a door and some steps.
  • There's greenery, potentially a potted plant, visible on the right side.

Overall Impression: This is a formal group portrait, probably of a family or a social group. The negative format creates a unique, almost ghostly effect.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people, likely taken in the early to mid-20th century. The group appears to be posing for a formal portrait, possibly for a special occasion or event. The setting seems to be outdoors, in front of a building with columns, suggesting a formal or institutional backdrop.

Here is a detailed description of the individuals and their attire:

  1. Seated Individuals:

    • Left: A man dressed in a white suit with a black bow tie. He is holding a cane and wearing a hat.
    • Right: A woman dressed in a dark coat and skirt, holding a large book or binder. She is also wearing glasses.
  2. Standing Individuals (from left to right):

    • First: A woman in a white dress with a high collar and a dark belt.
    • Second: A man in a suit and tie, standing with his hands clasped in front of him.
    • Third: A woman in a white dress with a dark collar and a headpiece.
    • Fourth: A man in a suit and tie, standing with his hands behind his back.
    • Fifth: A woman in a white dress with a dark belt and a headpiece.
    • Sixth: A woman in a white dress with a dark belt and a headpiece.
  3. Additional Details:

    • A small dog is sitting in front of the seated woman.
    • The individuals are arranged in two rows, with three people standing in the back row and four in the front row (including the two seated individuals).
    • The attire and poses suggest a formal or ceremonial occasion.

The photograph has a vintage feel, indicated by the clothing styles and the black-and-white format. The image also has some annotations at the top, which might be related to the photograph's processing or archiving.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-14

The image is a black and white photograph featuring a group of individuals dressed in formal attire, likely for a special occasion such as a wedding or a formal gathering. The group is arranged in a tiered fashion, with some individuals standing in the background and others seated in the foreground. The individuals are wearing white outfits, with some men in suits and ties and women in dresses, some of which include veils or hats. The setting appears to be outdoors, with a backdrop of a building and some decorative elements, such as a flower arrangement. The photograph has a vintage feel, suggesting it may have been taken several decades ago.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-14

This is a black-and-white photograph of a group of people posed in front of a building. The image appears to have been manipulated, as the people are wearing masks and their faces are obscured. The individuals are dressed in formal attire, with some wearing white coats and others in suits. The setting includes a staircase and some potted plants. The overall effect is somewhat surreal and unsettling due to the masks and the contrast between the formal attire and the obscured faces.

Text analysis

Amazon

1
hem 1
hem
.

Google

MAOONTARTIMWAMTRA
MAOONTARTIMWAMTRA