Human Generated Data

Title

Untitled (man posed holding two black dogs while sitting on couch)

Date

c. 1960

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10171

Human Generated Data

Title

Untitled (man posed holding two black dogs while sitting on couch)

People

Artist: Martin Schweig, American 20th century

Date

c. 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10171

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Tie 98.4
Accessories 98.4
Accessory 98.4
Clothing 96.9
Apparel 96.9
Person 95.8
Human 95.8
Hair 93.6
Cushion 87.1
Pillow 81.1
Face 62.9
Door 61.5
People 61
Shoe 58.2
Footwear 58.2
Furniture 57.8
Person 52.6

Clarifai
created on 2021-04-03

people 99.7
adult 98
two 97.5
man 97.3
woman 96.5
portrait 93.6
music 93.4
wear 92.9
actress 91
one 89.7
sit 88.4
love 88.2
indoors 87.9
facial expression 87.4
outfit 86.8
family 85.1
furniture 84.2
musician 82.2
monochrome 81.3
actor 80.4

Imagga
created on 2021-04-03

person 38.1
happy 33.2
people 32.9
home 31.9
man 27.6
adult 26.9
portrait 23.3
male 23.2
smiling 23.1
lifestyle 23.1
child 22.7
bow tie 22.6
casual 22
couple 21.8
smile 21.4
family 20.5
attractive 19.6
necktie 19.2
love 18.9
indoors 18.4
together 18.4
happiness 18
cheerful 17.9
clothing 17.7
couch 17.4
sitting 17.2
mother 17
book 16.9
boy 16.5
indoor 16.4
face 16.3
room 15.8
looking 15.2
kid 15.1
women 15
domestic 14.8
senior 13.1
father 12.6
sofa 12.5
leisure 12.5
parent 12.4
garment 12.2
mature 12.1
blond 12.1
one 11.9
pretty 11.9
holding 11.6
professional 11.1
joyful 11
two 11
alone 11
cute 10.8
only 10.5
reading 10.5
old 10.5
living 10.4
expression 10.2
grandma 10.2
20s 10.1
children 10
handsome 9.8
computer 9.7
fun 9.7
interior 9.7
hair 9.5
day 9.4
son 9.3
house 9.2
joy 9.2
playing 9.1
business 9.1
brother 9
technology 8.9
living room 8.8
retired 8.7
eyes 8.6
men 8.6
loving 8.6
laptop 8.6
marriage 8.5
enjoying 8.5
youth 8.5
relaxed 8.4
color 8.3
camera 8.3
fashion 8.3
human 8.2
dad 8.2
teenager 8.2
office 8.2
husband 8.2
dress 8.1
lady 8.1
success 8
job 8
work 8
holiday 7.9
grandmother 7.8
black 7.8
education 7.8
scholar 7.7
1 7.7
read 7.7
retirement 7.7
elderly 7.7
daughter 7.6
laughing 7.6
learning 7.5
relationship 7.5
care 7.4
single 7.4
teen 7.4
businesswoman 7.3
executive 7.3
adolescent 7.1
romantic 7.1
suit 7.1

Google
created on 2021-04-03

Smile 91.7
Gesture 85.3
Happy 85.2
Style 83.9
Tie 82.6
Vintage clothing 74.7
Monochrome photography 72.5
Formal wear 71.7
Monochrome 70.7
Photo caption 70
Room 69.4
Eyewear 69.2
Font 68.4
Sitting 68
Event 68
Pattern 67.3
Suit 66.9
Rectangle 66.1
Romance 65.5
Sunglasses 64.3

Microsoft
created on 2021-04-03

person 99.5
human face 86.2
indoor 85.3
clothing 82.7
text 80.7
window 80.6
smile 70.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 88%
Happy 99.8%
Surprised 0.1%
Calm 0%
Confused 0%
Angry 0%
Sad 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Tie 98.4%
Person 95.8%
Person 52.6%

Categories

Imagga

people portraits 71.4%
paintings art 19.3%
pets animals 7.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a suit and tie is holding two poodles -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image shows a person dressed in a suit, sitting on a couch with two small black curly-haired dogs held up by their hands. The background features horizontal window blinds, and the text "PROOF MARTIN SCHWEIG SAINT LOUIS" is visible at the bottom of the photograph.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image shows a person sitting on a couch, holding two small black poodle puppies. The person is dressed in a textured suit with a tie, and their legs are crossed. In the background, there are shutters on the window, and a bit of a plant is visible at the edge. The photograph includes a watermark reading "PROOF" along with the name "MARTIN SCHWEIG" and location "SAINT LOUIS."

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image shows a man sitting on a chair, wearing a suit and tie. He has a friendly, smiling expression on his face. The man is wearing a patterned sweater or jacket with fur trim around the collar. The background appears to be a room with some wooden blinds or shutters visible. The image has a vintage, black and white aesthetic.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-11

The black and white image shows a smiling man sitting on a couch and holding two small poodle dogs, one in each arm. He is wearing a checkered suit jacket and tie. The dogs have curly black fur. In front of the man is a book titled "PROOF Martin Schweig Saint Louis". Based on his attire and the vintage look of the photograph, this appears to be from several decades ago, likely the mid-20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This is a vintage black and white photograph showing a man sitting on what appears to be a couch or sofa, holding two black poodles, one in each arm. He's wearing a textured sweater or cardigan with a tie, and dress pants. He has a warm smile and appears to be enjoying the company of the dogs. The photo has a "PROOF" watermark and credits "MARTIN SCHWEIG" of "SAINT LOUIS" at the bottom. The image has the characteristic style and quality of mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-06

The image is a black and white photograph of a man sitting on a couch, holding two small dogs.

  • The man is wearing a suit jacket, tie, white shirt, and dark pants. He has short hair that is combed back.
  • He is sitting on a couch with his legs crossed, holding one dog in each hand.
  • The dogs are small and have curly fur. They appear to be poodles or a similar breed.
  • The background of the image shows a window with white blinds, which are partially open. There is also a plant visible behind the man's head.
  • The overall atmosphere of the image suggests that it was taken in a home or office setting, possibly during a photo shoot or as part of a portfolio.

The image appears to be a professional photograph, likely taken for a magazine or advertising campaign. The man's attire and the setting suggest that he may be a businessman or professional, and the dogs may be his pets or part of a marketing campaign.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-06

This image is a black and white photograph of a man sitting on a couch with two small dogs. The man is wearing a tweed jacket, white shirt, dark tie, and dark pants. He has short hair that is combed back. He is holding a small dog in each hand, with the dogs facing each other. The dogs are dark-colored and appear to be poodles.

The man is sitting on a couch with a textured fabric. Behind him is a window with white blinds that are partially open. There is a watermark across the center of the image that says "PROOF" in large letters, with smaller text below that reads "MARTIN SCHWIEIG SAINT LOUIS". The overall atmosphere of the image suggests a relaxed and casual setting, possibly a home or office.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of a man sitting on a couch. He is holding two black poodles in his arms. The man is wearing a suit and tie. The couch is covered in a textured fabric. The image has a watermark with the text "PROOF" and "MARTIN SCHWEIG, SAINT LOUIS" on the bottom. Behind the man is a window with blinds.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white photo features a man sitting on a couch while holding two puppies in both hands. The man is wearing a suit and tie, and he is smiling. The puppies are black, and they are looking at the camera. Behind the man, there is a window with blinds, and the sunlight is shining through the blinds. The photo has a watermark with the text "PROOF" and "MARTIN SCHWEIG SAINT LOUIS" on the bottom.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-10

Here's a description of the image:

The image is a black and white photograph of a man seated on a couch. He's smiling broadly and is holding two small, black, curly-haired dogs, one in each arm. He's wearing a tweed jacket, a tie, and dark trousers. His hair is neatly styled with a side part. The couch has a textured, gray fabric. Behind the man is a window with horizontal blinds. In the bottom right of the image, partially visible, is what appears to be a plant. There is text at the bottom of the image that reads "PROOF" and "MARTIN SCHWEIG, SAINT LOUIS."

Created by gemini-2.0-flash on 2025-05-10

Here is a description of the image:

This is a black and white photograph of a man sitting on a couch, holding two small dogs that appear to be poodles. The man is dressed in a tweed jacket over a white shirt and a dark tie. He is wearing dark pants and shoes. He has neatly styled hair and is smiling.

He sits cross-legged on a couch with a woven pattern. A white cloth or pillow lies on the couch to the left of the man. Behind him is a window with horizontal blinds. To the right of the window, part of a plant is visible.

At the bottom of the image, there are the words "PROOF" in large white capital letters, followed by "MARTIN SCHWEIG" and "SAINT LOUIS" in smaller print. The image appears to be a promotional photograph or proof from a photographer's studio.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image is a black-and-white photograph featuring a man sitting on a couch, holding two small, curly-haired dogs. The man is dressed in a suit with a tie, and he is smiling at the camera. The dogs appear to be poodles or a similar breed, and they are being held close to his chest. The setting appears to be indoors, with a window and shutters visible in the background. The photograph has a watermark that reads "PROOF" and "MARTIN SCHWEIG SAINT LOUIS." The overall atmosphere of the image is warm and friendly, capturing a moment of affection between the man and his pets.

Text analysis

Amazon

SAINT
PROOS
SAINT I_OUIS
I_OUIS
AIRRIN
AIRRIN JDIHMVIEI
JDIHMVIEI

Google

PROCE ARTIN J (CHWEIG SAINT OUIS
PROCE
ARTIN
J
(CHWEIG
SAINT
OUIS