Human Generated Data

Title

Untitled (old couple)

Date

c. 1920

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.720

Human Generated Data

Title

Untitled (old couple)

People

Artist: Martin Schweig, American 20th century

Date

c. 1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.720

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.8
Apparel 99.8
Person 96.7
Human 96.7
Suit 96.6
Overcoat 96.6
Coat 96.6
Person 87.5
Home Decor 85.1
Sleeve 69.2
Person 62.5
Linen 59.4
Plant 58.8
Tuxedo 58.6
Face 55.7

Clarifai
created on 2023-10-25

people 100
portrait 99.8
group 99.4
two 99.3
adult 97.8
three 97.7
wear 96.7
man 96.7
wedding 96.3
menswear 94.9
leader 94.2
administration 93.9
outfit 93.1
four 93
woman 92.8
group together 87.9
retro 86.7
neckwear 85.6
actor 85.5
groom 84.9

Imagga
created on 2022-01-08

man 46.4
bow tie 44.6
suit 42.9
male 39.9
businessman 36.2
necktie 35.5
kin 34.5
person 32
adult 31.2
business 31
people 30.1
executive 27.4
portrait 26.5
happy 26.3
handsome 23.2
couple 22.7
tie 21.8
professional 21.5
garment 21.3
confident 20.9
office 20.9
standing 20.9
smiling 19.5
corporate 18.9
smile 18.5
success 18.5
men 18
jacket 17.5
senior 16.9
businesswoman 16.4
expression 16.2
family 16
clothing 15.7
successful 15.6
love 14.2
face 14.2
job 14.2
happiness 14.1
attractive 14
cheerful 13.8
lifestyle 13.7
alone 13.7
businesspeople 13.3
indoors 13.2
together 13.1
mature 13
grandma 13
looking 12.8
old 12.6
hand 12.2
home 12
holding 11.6
shirt 11.2
black 11.1
work 11
team 10.8
fashion 10.6
married 10.6
elderly 10.5
boss 10.5
modern 10.5
human 10.5
group 10.5
20s 10.1
friendly 10.1
groom 9.8
lady 9.7
style 9.6
30s 9.6
hair 9.5
two 9.3
teamwork 9.3
pretty 9.1
one 9
color 8.9
worker 8.8
husband 8.8
formal 8.6
elegant 8.6
casual 8.5
company 8.4
occupation 8.3
indoor 8.2
aged 8.2
building 7.9
day 7.9
60s 7.8
businessmen 7.8
colleagues 7.8
sibling 7.7
corporation 7.7
partnership 7.7
confidence 7.7
only 7.6
adults 7.6
meeting 7.5
glasses 7.4
wedding 7.4
room 7.3
women 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99.6
standing 98.2
man 97.1
clothing 96.9
text 96.7
old 96.4
smile 95.2
human face 93.1
posing 93
suit 90.6
black 86.9
white 69.2
tie 66.3
vintage 31.2
clothes 25.4
necktie 16.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 58-66
Gender Female, 99.9%
Happy 91.6%
Calm 5%
Disgusted 1.5%
Surprised 0.4%
Confused 0.4%
Sad 0.4%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 99.7%
Confused 0.1%
Sad 0.1%
Angry 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Female, 66.1%
Fear 77.8%
Calm 15.4%
Sad 2.8%
Surprised 2.4%
Angry 0.5%
Confused 0.4%
Disgusted 0.4%
Happy 0.3%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Person 96.7%
Person 87.5%
Person 62.5%
Suit 96.6%

Categories

Imagga

paintings art 99%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-19

a photograph of a man and woman standing next to each other -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image shows two individuals standing side by side in formal attire. The man on the left is dressed in a three-piece suit with a boutonniere pinned to his lapel, while the woman on the right is wearing a dark dress with a lace scarf and a floral corsage. The background features patterned wallpaper, a framed picture, and decorative curtains, suggesting it is an indoor setting. At the bottom, flowers can be seen, adding a decorative touch to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts an elderly couple standing side by side indoors, dressed in formal attire. The man is wearing a three-piece suit with a jacket, vest, and tie, and has a boutonniere pinned to his lapel. The woman is adorned in a dark dress with long sleeves, complemented by a lace scarf or jabot around her neck, and she also has a floral accessory on her chest. They are standing in front of a patterned wallpaper, with a partially visible large framed artwork hanging on the wall behind them. To the left, a portion of a patterned curtain can be seen, and flowers are visible at the bottom left corner of the image, suggesting a setting such as a portrait studio or a formal event.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows an elderly couple posing for a formal portrait. The man is wearing a suit with a boutonnière on his lapel, while the woman is wearing a dark dress with a lace collar. They both have serious expressions and are standing in what appears to be a room with a patterned curtain in the background. The image has a vintage, sepia-toned quality, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a vintage black and white photograph that appears to be from the early 1900s. It shows an elderly couple in formal attire standing together. The gentleman is wearing a three-piece dark suit with a boutonnière and has a distinguished appearance with a white mustache. The lady is wearing a dark dress with a lace collar and a corsage, and she has round spectacles. Behind them, you can see a framed portrait on the wall and what appears to be patterned wallpaper. The photograph has the formal, posed quality typical of portrait photography from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of an elderly couple standing together in a formal setting. The man, positioned on the left, has a receding hairline and a mustache. He is dressed in a three-piece suit, consisting of a vest, jacket, and trousers, complemented by a white shirt and tie. A flower or brooch adorns his left lapel.

The woman, standing on the right, has short hair and is wearing a dark dress with a lace collar and a flower pinned to her left shoulder. Her attire suggests a more casual yet still formal style compared to the man's outfit.

In the background, a large painting hangs on the wall, and a curtain is visible to the left of the couple. A bouquet of flowers sits on the floor in front of them, adding a touch of elegance to the scene. The overall atmosphere of the image exudes a sense of formality and sophistication, likely capturing a special occasion or event in the couple's lives.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a sepia-toned photograph of an elderly couple, likely taken in the early 20th century. The man on the left is dressed in a dark suit with a vest, white shirt, and tie, complemented by a boutonniere on his lapel. He holds a pair of glasses in his right hand. The woman on the right wears a dark dress adorned with a lace collar and a floral brooch on her left shoulder.

In the background, a portrait hangs on the wall behind them, while flowers are arranged on either side of the couple. The overall atmosphere suggests a formal occasion or a family gathering, capturing a moment in time from the past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

An old black-and-white photo shows a man and a woman standing next to each other. They are both wearing formal attire, with the man dressed in a suit and tie and the woman in a dress with a lace scarf around her neck. They are both smiling and seem to be posing for a photo. Behind them, there is a picture frame on the wall, and a curtain is hanging on the left side.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of an elderly couple standing together. The man is dressed in a dark suit with a white shirt and a tie, and he has a flower pinned on his lapel. He is holding a cigarette in his hand. The woman is wearing a black dress with a white lace scarf around her neck and a flower pinned on her dress. She is wearing glasses. Behind them, there is a framed portrait of a man on the wall. The couple appears to be posing for a photograph, and they are both looking straight ahead. The overall atmosphere of the image is formal and nostalgic, evoking a sense of the past.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

The black and white, full shot photo portrays an elderly couple standing next to each other. The man is positioned to the left, and the woman to the right, in front of a patterned wallpaper. The man is wearing a suit and holding glasses in his right hand. He has a flower pinned to his left lapel and a white mustache. The woman is wearing a dark dress with a lace collar and has glasses on. A flower is pinned to her right shoulder. A portrait hangs behind them on the wall. Flowers are also seen at the bottom left of the frame.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image is a formal black and white portrait, likely from the early 20th century. It depicts a man and a woman standing side-by-side, posed for the photograph. The style of clothing and the overall aesthetic suggest a formal, possibly professional or celebratory occasion.

The Couple:

  • The Man: The man is standing on the left of the image. He is wearing a dark suit, consisting of a jacket, a vest, and trousers. He has a white shirt and tie peeking out, and a flower pinned to his lapel. He has a distinguished air with a full mustache and a receding hairline. He is holding something small in his right hand, potentially a pocket watch.

  • The Woman: The woman is standing on the right of the image. She is wearing a dark dress, possibly made of a velvet-like material. She wears glasses and has a lace scarf or collar. A flower is pinned to her dress.

Background and Setting:

The backdrop is a wallpaper with an ornate floral pattern. A framed portrait is visible in the background behind the woman. The overall setting looks like it could be a home or a studio. There is a large arrangement of flowers in the lower left corner of the image.

Overall Tone:

The image conveys a sense of formality, sophistication, and possibly a sense of tradition or legacy. It is a portrait that captures a moment in time, likely a special occasion.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a vintage black-and-white photograph featuring an elderly couple standing side by side. The man on the left is dressed in a formal suit, complete with a vest and a tie. He is holding a pocket watch or a small object in his right hand. The woman on the right is wearing a dark dress with a lace scarf around her neck and glasses. Both individuals have flowers pinned to their clothing, suggesting a special occasion or formal event.

In the background, there is a framed portrait of a young woman hanging on the wall, and a curtain with a floral pattern is partially visible. To the left of the couple, there is a floral arrangement, adding to the formal ambiance of the setting. The overall tone of the photograph suggests it was taken in a studio or a well-decorated room. The image exudes a sense of formality and tradition, likely capturing a significant moment in the couple's life.

Text analysis

Amazon

SAID2