Human Generated Data

Title

Untitled (small family portrait outside home)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2851

Human Generated Data

Title

Untitled (small family portrait outside home)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2851

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Human 99.8
Clothing 99.7
Apparel 99.7
Female 97.3
Accessories 94.4
Accessory 94.4
Skirt 87.7
Woman 85.5
Home Decor 76.7
Girl 69.5
People 67.6
Coat 58.6
Overcoat 58.6
Portrait 58.5
Photography 58.5
Face 58.5
Photo 58.5
Chair 58.1
Furniture 58.1
Icing 57.9
Food 57.9
Dessert 57.9
Cake 57.9
Cream 57.9
Creme 57.9
Dress 56.6
Nurse 56.4

Clarifai
created on 2023-10-26

people 99.9
group 99.6
group together 99
man 97.4
adult 96.4
woman 95
three 94.3
wear 92
four 91.1
interaction 91.1
leader 90.8
actor 90.5
administration 90.4
partnership 89.8
portrait 87.6
several 87
uniform 86.1
many 84.5
five 83.4
education 80.2

Imagga
created on 2022-01-16

bride 40.5
wedding 34.9
brass 32.8
kin 32.7
couple 32.2
groom 31.5
dress 28.9
wind instrument 28.1
love 27.6
man 26.9
bouquet 26.6
people 25.6
married 24.9
happy 21.9
musical instrument 21.8
happiness 20.4
marriage 19.9
gown 19.5
male 19.1
bridal 18.5
flowers 18.2
wed 17.7
person 17.4
adult 16.5
two 16.1
portrait 15.5
wife 15.2
celebration 15.1
day 14.9
outdoors 13.4
life 13.4
flower 13.1
fashion 12.8
women 12.6
ceremony 12.6
world 12.2
smile 12.1
attractive 11.9
romance 11.6
smiling 11.6
summer 11.6
husband 11.4
together 11.4
cornet 10.9
matrimony 10.8
holding 10.7
romantic 10.7
men 10.3
wall 10.3
family 9.8
engagement 9.6
rose 9.4
future 9.3
church 9.2
device 9.1
old 9.1
suit 9
cheerful 8.9
handsome 8.9
veil 8.8
home 8.8
statue 8.6
pair 8.5
dancer 8.5
traditional 8.3
human 8.2
new 8.1
businessman 7.9
business 7.9
engaged 7.9
commitment 7.9
face 7.8
decision 7.8
sitting 7.7
trombone 7.6
elegance 7.6
friends 7.5
relationship 7.5
art 7.5
park 7.4
performer 7.4
bugle 7.3
black 7.2
holiday 7.2
indoors 7
look 7

Google
created on 2022-01-16

Photograph 94.2
Black 89.7
Style 83.8
Suit 78.5
Classic 75.8
Window 75.3
Monochrome 74.8
Monochrome photography 74.7
Snapshot 74.3
Vintage clothing 74.1
Event 72.4
Room 66.1
Uniform 65.7
Sitting 65.3
Team 65.2
History 64.7
Fun 61.8
Crew 61.6
Art 58.5
Formal wear 57.1

Microsoft
created on 2022-01-16

person 99
posing 97.9
window 96.6
smile 92.4
outdoor 89.4
clothing 87.7
standing 87.5
text 81.9
woman 71.9
dress 66.7
black 65.7
old 53.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 97.6%
Calm 98.8%
Sad 0.4%
Happy 0.4%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 99.2%
Happy 0.3%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Calm 98.5%
Sad 0.7%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Female, 87.9%
Happy 48.8%
Calm 46.9%
Fear 1.2%
Surprised 0.9%
Angry 0.9%
Sad 0.6%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 34-42
Gender Male, 77.8%
Calm 99.8%
Happy 0.1%
Surprised 0%
Sad 0%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 67.2%
Calm 57.1%
Happy 31.3%
Disgusted 4.5%
Surprised 2.4%
Confused 1.7%
Sad 1.4%
Angry 0.9%
Fear 0.8%

AWS Rekognition

Age 49-57
Gender Male, 99.2%
Calm 99.2%
Surprised 0.4%
Happy 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 93.8%
Sad 60.4%
Calm 28.6%
Happy 7.5%
Confused 1.7%
Fear 0.7%
Disgusted 0.4%
Angry 0.4%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Tie
Suit

Clarifai

Man
Woman
Human face
Clothing
Footwear
Fashion accessory
Human hair
Window
Human leg

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 85.2%

AWS Rekognition

Person 61.9%

AWS Rekognition

Tie 94.4%

AWS Rekognition

Tie 92.7%

AWS Rekognition

Tie 77.6%

AWS Rekognition

Tie 72.6%

AWS Rekognition

Suit 58.6%

Clarifai

Man 90.4%

Clarifai

Man 86.4%

Clarifai

Man 80.7%

Clarifai

Man 42.7%

Clarifai

Woman 82.9%

Clarifai

Woman 79.1%

Clarifai

Woman 76.9%

Clarifai

Woman 76.3%

Clarifai

Woman 47%

Clarifai

Woman 45.2%

Clarifai

Woman 43.2%

Clarifai

Human face 59.5%

Clarifai

Human face 58.3%

Clarifai

Human face 54.5%

Clarifai

Human face 53%

Clarifai

Human face 51.6%

Clarifai

Human face 51.4%

Clarifai

Human face 48%

Clarifai

Human face 46.9%

Clarifai

Human face 44.3%

Clarifai

Clothing 54.4%

Clarifai

Clothing 53.3%

Clarifai

Footwear 38.5%

Clarifai

Footwear 37.1%

Clarifai

Fashion accessory 37.1%

Clarifai

Human hair 34.6%

Clarifai

Window 33.7%

Clarifai

Human leg 33.5%

Categories

Imagga
created on 2022-01-16

people portraits 98.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

the family in the early 1900s.

Salesforce

Created by general-english-image-caption-blip on 2025-05-06

a photograph of a group of people standing around a man in a suit and tie

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image shows a group of seven individuals arranged in two rows, with the front row seated and the back row standing. They are positioned in front of a wooden building, which features a window on the left side and an open doorway on the right that appears to lead into an interior space. The individuals are dressed formally, with women wearing dresses and men in suits. In the background, a group of children is visible standing near the doorway, observing the scene. The entire image has a negative effect, reversing the colors and tones.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a black and white photograph that has been inverted to appear as a negative. It shows a group of people arranged in two rows, with four seated in the front and three standing behind them. The seated individuals wear dresses with collars and buttoned shirts, while the standing individuals are dressed in suits. The background features a wooden building with visible siding and a window, and a small group of children can be seen standing around a doorway to the right side of the image. The children's outlines and dresses are visible as they look towards the group. The people in the image are positioned outdoors on a dirt surface, and portions of their clothing and the surrounding architecture appear as white due to the negative effect.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of a group of people standing and sitting on the steps of a wooden building. There are six individuals in the image - three men standing in the back row and three women sitting in the front row. The individuals are dressed in formal attire, suggesting this may be an official or ceremonial occasion. The background includes a wooden structure with shuttered windows. The overall scene conveys a sense of formality and tradition.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph, likely from the 1950s, showing a formal group portrait of seven people arranged in two rows. The back row consists of three men wearing light-colored suits with ties. The front row shows four women seated, dressed in period-appropriate attire including skirts and blouses. One woman is wearing a checkered or patterned skirt. The photo appears to be taken on some wooden steps or a porch of a building, with shuttered windows visible in the background. The formal posing and dress style is very characteristic of mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of people posing for a picture in front of a house. The group consists of seven individuals, with three men standing in the back row and four women seated in the front row. The men are dressed in suits, while the women wear dresses and skirts. The background features a house with a window and a staircase leading up to the front door, where two children can be seen standing.

The image appears to be a family photo, possibly taken during a special occasion or event. The formal attire and the setting suggest a sense of importance and celebration. The presence of the children in the background adds a touch of warmth and innocence to the scene.

Overall, the image conveys a sense of nostalgia and tradition, capturing a moment in time that is both personal and universal. It invites the viewer to reflect on the importance of family and the value of preserving memories through photography.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people posing in front of a building. The group consists of seven individuals, with three men standing behind four women who are seated on chairs.

The men are dressed in suits and ties, while the women wear dresses or skirts and blouses. The background of the image features a building with a window and a door, as well as a set of stairs leading up to the entrance. The overall atmosphere of the image suggests that it was taken during a formal event or gathering, possibly in the mid-20th century.

In the top-right corner of the image, there appears to be a ghostly or transparent image of two young girls standing in front of the same building. This could be an error in the scanning or printing process, or it may be a deliberate artistic effect.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image shows a monochromatic photo of a group of people, possibly a family, standing in front of a house. The people are dressed in formal attire, with the men wearing suits and ties, and the women wearing dresses. The photo has a slightly blurry effect, giving it a vintage look. In the background, there is a window with a reflection of a person, possibly a child, standing inside the house.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white image features a group of people standing and sitting in front of a house. The image has a sepia filter, giving it an old-fashioned look. The people are wearing formal attire, with the men in suits and ties and the women in dresses. The group is posing for a photo, with some of them smiling and others looking serious. Behind them, there is a house with a window and a door, and a staircase leading up to the entrance.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-07

Here is a description of the image:

This appears to be a vintage family portrait. The image is a negative, so the tones are inverted – dark areas are light and vice versa.

Composition and Setting:

  • Group: A group of seven people is the focal point, arranged in two rows. There are three men standing in the back and four women sitting in the front.
  • Setting: The group is positioned in front of a building with a wooden exterior. There's a window and what appears to be a door or opening to the right.
  • Children in the Background: Through the window, we can see a group of children, suggesting this might be a porch or entrance area.

People:

  • Men: The men are dressed in suits, suggesting a formal occasion.
  • Women: The women are seated, and appear to be wearing skirts and blouses.
  • Expression: All the members are looking towards the camera.

General Impression:

The image has a classic, formal feel, typical of family photographs from a previous era.

Created by gemini-2.0-flash on 2025-05-07

The image depicts a group portrait of a family. Three men stand at the back, dressed in light-colored suits and ties. Three women sit in front, appearing to be on chairs. One woman sits to the left, wearing a blouse with a bow tie and a patterned skirt. To her right, another woman is dressed in a collared blouse and skirt suit. The third woman in the center has a light-colored dress suit with a button-down top.

The background shows a house with shuttered windows. In one window, there are silhouettes of children looking out. A few steps can be seen on the right side of the image. The image appears to be a black and white negative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image appears to be a vintage black-and-white photograph featuring a group of people posing in front of a building. Here is a detailed summary:

  1. Setting: The photograph is taken outdoors, in front of a building with wooden shutters and a staircase leading up to the entrance. The building has a rustic appearance.

  2. People: There are nine individuals in the photograph, arranged in two rows.

    • Front Row (Seated): Four women are seated on chairs. They are dressed in formal attire, including dresses and skirts, with some wearing accessories like gloves and necklaces.

    • Back Row (Standing): Five men are standing behind the seated women. They are dressed in formal suits and ties.

  3. Additional Details:

    • To the right of the group, there are three young girls standing on the staircase, observing the scene. They are dressed in light-colored dresses.
    • The expressions on the faces of the individuals vary, with some smiling and others looking more serious.
  4. Photographic Style: The photograph has a vintage quality, suggesting it was taken several decades ago. The lighting and composition are typical of formal group portraits from earlier periods.

This image likely captures a significant event or gathering, given the formal attire and the structured arrangement of the individuals.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph featuring a group of individuals seated in a row in front of a wooden building. The group consists of four men and four women, dressed in formal or semi-formal attire. The men are wearing suits and ties, while the women are in dresses and blouses, some of which have collars. The individuals appear to be in a posed group photograph, possibly at a social or formal event.

The building behind them has wooden siding and a window with a visible reflection of what appears to be a photograph or picture of children dressed in vintage clothing. The setting suggests a historical or rural environment, and the style of clothing and the photograph itself give it a vintage feel, likely from the mid-20th century. The lighting in the photograph is soft, with some areas appearing overexposed, which is evident in the faces and some of the clothing. The overall tone of the image is nostalgic and serene.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph of a group of seven individuals, presumably adults, who are posed for a formal group portrait. The image appears to have been taken outdoors, with a wooden building in the background. The group is arranged with three individuals seated in the front row and four standing in the back row.

Details:

  • Front Row (Seated):

    • Four women are seated on white folding chairs.
    • They are dressed in formal attire, including dresses with varying styles of collars and skirts. One woman is wearing a patterned skirt.
    • The women appear to be dressed modestly, typical of a formal or professional setting.
  • Back Row (Standing):

    • Three individuals are standing behind the seated women.
    • Two of the standing individuals appear to be men wearing suits with ties. The suits are light-colored, possibly white or off-white, which contrasts with the darker tones of the image.
    • The third individual in the back row is somewhat obscured by the others.
  • Background:

    • The building behind the group has a wooden exterior with visible vertical planks.
    • There are two windows with dark frames, and the window on the right appears to have a reflection or a transparent overlay showing additional figures, which could be part of a separate image or an artistic effect.
  • Overall Impression:

    • The image has a formal and somewhat staged appearance, suggesting it was taken for a special occasion or event.
    • The lighting and shadows are well-defined, indicating that the photograph was taken in natural light, possibly during the daytime.
    • The photograph has a vintage quality, likely dating back to the mid-20th century based on the clothing styles and photographic techniques.

Text analysis

Amazon

MILE