Human Generated Data

Title

Untitled (portrait)

Date

1916

People

Artist: John H. Garo, American 1868 - 1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.823

Human Generated Data

Title

Untitled (portrait)

People

Artist: John H. Garo, American 1868 - 1939

Date

1916

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.823

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Accessories 98.8
Accessory 98.8
Clothing 98.8
Coat 98.8
Overcoat 98.8
Apparel 98.8
Human 98.2
Face 95.5
Head 83.4
Portrait 70.7
Photography 70.7
Photo 70.7
Text 68.2
Jaw 66.7
Military 62.8
Man 60.5
Officer 60.5
Military Uniform 60.5
Attorney 55.3

Clarifai
created on 2023-10-25

portrait 100
people 99.9
one 99.5
leader 98.9
man 98.8
adult 98.5
politician 96.2
wear 93.8
administration 93.7
neckwear 91.2
art 88
profile 88
chair 87
menswear 86.6
diplomat 84.7
mustache 82.9
outfit 82.6
facial hair 77.6
candidate 75.6
eyewear 73.8

Imagga
created on 2022-01-08

bow tie 100
necktie 100
suit 75.5
garment 63.2
businessman 61.9
man 59.3
male 52.6
business 46.9
handsome 43.8
clothing 42.2
person 40.7
tie 39.9
adult 38.9
executive 38.1
professional 34.9
corporate 34.4
portrait 34.4
confident 31.9
success 30.6
expression 28.2
successful 26.6
men 25.8
people 25.2
face 24.9
looking 23.2
guy 22.8
office 22.5
shirt 22.5
manager 20.5
black 19.9
one 19.5
standing 18.3
work 18.1
formal 17.2
smile 17.1
happy 17
modern 16.9
smiling 16.7
boss 16.3
worker 15.9
fashion 15.9
job 15.1
hand 14.5
model 14
jacket 13.8
confidence 13.4
mature 13
human 12.8
serious 12.4
career 12.3
lifestyle 12.3
studio 12.2
company 12.1
elegant 12
occupation 11.9
attractive 11.9
lawyer 11.2
casual 11
employee 10.9
businesspeople 10.5
smart 10.4
head 10.1
alone 10.1
color 10
businessperson 9.8
adolescent 9.5
one person 9.4
happiness 9.4
glasses 9.3
20s 9.2
posing 8.9
look 8.8
hands 8.7
hair 7.9
consumer goods 7.9
covering 7.8
collar 7.7
money 7.7
old 7.7
only 7.7
thinking 7.6
juvenile 7.6

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

man 99.7
person 99.5
suit 99.5
human face 98.2
text 95.9
clothing 93.9
portrait 84
black and white 78.8
wearing 77.9
tie 70.8
smile 69.6
gentleman 59.6
old 49
necktie 42.6
posing 36.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-53
Gender Male, 100%
Happy 81.1%
Calm 11.6%
Surprised 2.2%
Sad 2%
Disgusted 1%
Confused 0.9%
Angry 0.7%
Fear 0.4%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Suit
Person

Clarifai

Man
Human face
Human nose
Human mouth
Human eye

AWS Rekognition

Tie 98.8%

AWS Rekognition

Suit 98.8%

AWS Rekognition

Person 98.2%

Clarifai

Man 94.8%

Clarifai

Human face 93.7%

Clarifai

Human nose 40.5%

Clarifai

Human mouth 35%

Clarifai

Human eye 34.5%

Clarifai

Human eye 33.1%

Categories

Imagga
created on 2022-01-08

people portraits 99.4%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

portrait of politician, a lawyer and politician.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a suit and tie with glasses

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a man wearing a formal suit with a pinstripe pattern. He has a white collared shirt and a tie with a dotted pattern. The background is dark and plain, creating a subdued and focused composition. There are handwritten markings in the upper right corner, possibly noting a date or text.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a black and white portrait photograph of a person wearing formal attire. The individual is dressed in a pinstripe suit, with a white collared shirt and a polka dot tie. The background is plain and dark, typical of traditional portrait photography. There is handwriting in the top right corner of the image, which appears to be a date written as 1911.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a portrait of an older man with a serious expression on his face. He appears to be wearing a suit and tie, and the image is in black and white. The man has a prominent brow and piercing eyes, suggesting an intense or thoughtful demeanor. The image has an air of formality and dignity about it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white portrait photograph that appears to be from the early 20th century. The subject is wearing a formal dark suit with a white collar and tie. They are bald and wearing round glasses. The portrait is taken from a slight angle, showing the subject's face in three-quarter view with a slight smile. The lighting creates dramatic shadows and highlights, which was characteristic of portrait photography from this era. The image has a professional, dignified quality typical of business or academic portraits from that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white portrait of a man, likely taken in the early 20th century. The man is dressed in formal attire, consisting of a suit, tie, and white shirt. He is positioned facing slightly to the right of the camera, with his head turned towards the viewer. His facial expression is neutral, with a slight smile visible on his lips.

The background of the image is dark, which helps to focus attention on the subject. A signature or note is visible in the top-right corner of the image, although it is not legible. The overall atmosphere of the image suggests that it was taken in a professional setting, possibly for a business or formal occasion.

The image appears to be a high-quality photograph, with a clear and detailed representation of the subject. The use of black and white adds a sense of timelessness and classic elegance to the image. Overall, the image presents a dignified and respectful portrayal of the man, capturing his personality and character in a subtle yet effective manner.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man in a suit, with a dark background. The man is bald and wears round glasses, a white collared shirt, a dark tie with white dots, and a dark suit jacket. He faces the camera directly, with his head turned slightly to the right.

The background is dark, with a lighter area on the right side of the image. There are some illegible marks in the top-right corner of the image. The overall atmosphere of the image suggests that it is a formal portrait, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image depicts a monochromatic portrait of a man. He is dressed in a formal suit and tie, with a white shirt underneath. He wears round-rimmed glasses and has a bald head. His expression is serious, and he appears to be looking directly at the camera. The background is dark and plain, with a subtle light source illuminating the man from the upper left corner. There is a signature in the upper right corner of the image.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of a man, likely taken in the early 20th century. The man is bald and wearing glasses. He is dressed in formal attire, including a suit and tie. He is smiling and appears to be posing for the camera. The background is dark, and there is a faint light source to the right of the man. The man's expression and attire suggest that he is a professional or someone of importance. The photograph may have been taken for a formal occasion, such as a portrait or a professional headshot.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

Here's a description of the image:

The image is a black and white portrait of a middle-aged man. He is facing slightly to his left and is wearing a suit, a white collared shirt, and a patterned tie. A pince-nez (a type of eyeglasses) rests on his nose. He has a mostly bald head and a serious, almost stern, expression. The lighting is soft, creating a classic, formal portrait feel. The background is a plain, dark color. There is handwriting in the upper right corner.

Created by gemini-2.0-flash on 2025-05-09

Here is a description of the image:

The image is a black and white portrait of a man. He is bald and wearing glasses with a round rim on one eye. He is wearing a suit with a white shirt and a polka dot tie. His expression is serious and he is looking to the right of the frame. The background is a blurry, dark shade. There are markings in the top right corner of the image, possibly a date.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white portrait photograph of a man. He appears to be middle-aged, with a bald head and wearing round, wire-rimmed glasses. The man is dressed in formal attire, including a dark suit jacket, a white dress shirt with a wingtip collar, and a dark tie with a polka-dot pattern. The photograph has a classic, early 20th-century style, with soft lighting and a focus on the man's face, which is centered in the frame. The background is dark and nondescript, emphasizing the subject. The photograph has a signature or notation in the top right corner, which reads "Pach Bros. N.Y." This suggests it was taken by Pach Brothers, a well-known photography studio in New York City during that era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

The image is a black and white portrait of a man, taken in a formal and serious style, typical of early 20th-century photography. The man appears to be balding with a receding hairline and is wearing round glasses. He is dressed in a formal suit with a white shirt and a dark tie, suggesting a professional or authoritative demeanor. The background is dark and plain, which helps to emphasize the subject. There is a signature in the upper right corner, along with the year "1916," indicating when the photograph was taken. The overall aesthetic and clothing suggest a historical context, possibly from the early 1900s.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This is a black-and-white portrait of a man wearing a suit and tie, with a polished, professional appearance. He is bald with a clean-shaven face and is wearing round-framed glasses. The background is plain and dark, which highlights the subject. The photograph has a classic, formal style typical of early 20th-century portraiture.