Human Generated Data

Title

Star's Daughter (Fifth of eleven): While hurrying through Broadway's famed Shubert Alley, Monika runs into an old family friend, actor Walter Matthau. He was on his way to star in another performance of the comedy, "The Odd Couple."

Date

1964-65

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.11

Human Generated Data

Title

Star's Daughter (Fifth of eleven): While hurrying through Broadway's famed Shubert Alley, Monika runs into an old family friend, actor Walter Matthau. He was on his way to star in another performance of the comedy, "The Odd Couple."

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1964-65

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.11

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Person 99.6
Human 99.6
Clothing 94.5
Apparel 94.5
Hat 91.8
Hand 90.1
Person 89.4
Electronics 85.5
Finger 73.7
Face 70
Helmet 63.5
Headphones 58.3
Headset 58.3

Clarifai
created on 2019-03-22

people 99.7
adult 98.6
portrait 98.5
two 97.9
man 97.6
monochrome 95.7
wear 95.1
woman 95
lid 93.4
street 91.3
group 90.9
mirror 90.3
room 89.8
war 89.8
indoors 89.4
three 87.6
wedding 86.1
side view 85.2
facial expression 85.2
one 84.6

Imagga
created on 2019-03-22

man 38.3
male 29.2
person 29.1
people 28.4
hairdresser 21.9
adult 19.8
couple 14.8
mask 14.4
portrait 14.2
love 13.4
salon 13.3
shop 13.1
business 12.8
surgeon 12.6
worker 12.5
men 12
professional 11.7
face 11.4
happy 11.3
black 11
attractive 10.5
sexy 10.4
barbershop 10.3
work 10.2
patient 10.2
women 9.5
sitting 9.4
two 9.3
occupation 9.2
hat 9.1
holding 9.1
businessman 8.8
looking 8.8
indoors 8.8
together 8.8
hands 8.7
smiling 8.7
lifestyle 8.7
day 8.6
husband 8.6
device 8.5
groom 8.4
fashion 8.3
wedding 8.3
indoor 8.2
dress 8.1
handsome 8
job 8
smile 7.8
clothing 7.8
luxury 7.7
industry 7.7
bride 7.7
drinking 7.7
human 7.5
care 7.4
street 7.4
suit 7.3
life 7.1
medical 7.1

Google
created on 2019-03-22

Microsoft
created on 2019-03-22

person 100
man 98.9
indoor 98.6
clothing 6.9
boxing 6.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 99%
Surprised 1.2%
Disgusted 2.2%
Sad 4.5%
Happy 82.4%
Angry 1.6%
Confused 6.4%
Calm 1.8%

AWS Rekognition

Age 30-47
Gender Female, 98.4%
Happy 24.9%
Sad 25.3%
Disgusted 6.3%
Angry 7.1%
Calm 18.7%
Surprised 10.4%
Confused 7.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Helmet
Person 99.6%
Person 89.4%
Hat 91.8%
Helmet 63.5%

Categories

Imagga

food drinks 83.1%
paintings art 8.3%
pets animals 5.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-25

a photograph of a man and woman in a hat and a hat -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The sepia-toned image portrays two individuals engaging in a handshake. The person on the left is wearing a jacket, tie, and a flat cap, while the individual on the right is dressed in a dark outfit and head covering. The background shows a closed door and part of a wall, suggesting an indoor setting.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts two individuals engaged in a handshake. One person is wearing a dark suit or coat and a flat cap, while the other is wearing a dark coat and a headscarf. They are in a room with a plain wall and a visible light switch in the background. The setting appears to be indoors, possibly in a hallway or entrance area.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows two people, a man and a woman, standing close together and smiling at each other. The man is wearing a hat and a suit, while the woman is wearing a coat. They appear to be engaged in a friendly conversation or interaction, with the man reaching out to grasp the woman's arm. The image has a vintage, sepia-toned quality, suggesting it is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph that appears to be from an older era, likely the 1930s or 1940s. It shows a close interaction between two people - a man wearing a fedora hat and dark suit, and a woman in what appears to be professional attire. They are engaged in what seems to be a friendly or flirtatious conversation, with both appearing to smile as they interact. The image has the classic composition and lighting style characteristic of vintage photography from that period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a man and woman shaking hands. The man, positioned on the left, is attired in a flat cap and a dark suit jacket, with his right arm extended to shake the woman's hand. The woman, situated on the right, wears a dark headscarf and a dark jacket. In the background, a door and a wall are visible, with a person standing behind the woman. The overall atmosphere of the image suggests a formal or professional setting, possibly a business meeting or a greeting at a formal event.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image depicts a black and white photograph of two individuals shaking hands. The man on the left is attired in a dark suit jacket, a light-colored hat, and a collared shirt. He has short dark hair and is facing the woman to his right. The woman wears a dark coat and a dark head covering with a light-colored flower or brooch on the right side. Her hair is not visible, and she is also facing the man.

In the background, there appears to be a wall with a door and a light switch. The overall atmosphere suggests a formal or professional setting, possibly a meeting or greeting between the two individuals.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

A black-and-white image shows a man and a woman shaking hands with each other. They are smiling and looking at each other. The man is wearing a hat and a suit, while the woman is wearing a black jacket and a scarf. Behind them is a person wearing a long-sleeve shirt. There is a wall on the left side with a switch and a white door on the right side.

Created by amazon.nova-lite-v1:0 on 2025-06-02

A black-and-white photograph shows a man and a woman standing close to each other. The man is wearing a hat and a suit, while the woman is wearing a black dress and a headscarf. They are both smiling and seem to be posing for a photo. The man is holding the woman's hand, and they are both looking at each other. Behind them, there is a blurry background with a door and a wall.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

The vintage sepia photograph shows two people in profile, facing each other and smiling. The man, on the left, is wearing a cap and a dark suit. His right arm is extended towards the woman. The woman, on the right, is wearing a head covering and a dark coat. Both figures appear to be enjoying a lighthearted moment. Behind them, there are partially visible figures, creating a sense of a crowd or busy environment.

Created by gemini-2.0-flash-lite on 2025-05-29

Here's a description of the image:

Overall Impression:

The image is a vintage-style photograph, likely from the mid-20th century, based on the sepia tone and the subjects' clothing. It appears to be a candid moment, capturing a sense of warmth and interaction between two people.

Subjects:

  • Man (Left): The man is wearing a dark blazer, a white collared shirt, and a light-colored flat cap (newsboy cap). He has a friendly, engaging expression, with a smile suggesting he's sharing a pleasant exchange. He is extending his hand toward the woman, perhaps for a handshake.

  • Woman (Right): The woman is wearing a dark, possibly satin or silk, jacket and a turban-style head covering in a matching dark color. She is looking at the man with a joyful expression, her face lit up with a broad smile, implying laughter.

Setting and Context:

The background is somewhat blurred, suggesting the photograph was taken indoors, possibly in a public place or a room with a simple wall and a door in the background. There appears to be a person behind the woman and a metal fence like structure.

Mood/Atmosphere:

The photograph conveys a feeling of connection, joy, and camaraderie. The subjects seem to be genuinely enjoying each other's company. The warm, sepia tones add to the nostalgic and pleasant feeling.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image is a sepia-toned photograph depicting two individuals engaged in a friendly interaction. The person on the left is an older man wearing a cap and a dark coat. He is smiling broadly and appears to be reaching out with his right hand, possibly to shake hands or greet the person on the right. The person on the right is a woman dressed in a dark coat and a headscarf, also smiling warmly. The background is slightly blurred, but it seems to be an indoor setting with a door and a wall visible. The overall atmosphere of the image is warm and amicable, suggesting a moment of connection or reunion between the two individuals.