Human Generated Data

Title

Untitled (unidentified sitter)

Date

c. 1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2004

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2004

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.7
Art 98.5
Painting 97.1
Drawing 77.3
Text 69.4
Photography 67.1
Photo 67.1
Portrait 66.4
Face 66.4

Clarifai
created on 2023-10-25

people 100
portrait 100
one 99.9
adult 99.8
art 99.7
wear 99.6
man 99.5
veil 98.8
lid 97.7
administration 96.7
profile 96.1
two 95.9
painting 94.8
woman 94.3
leader 94.3
side view 93.3
music 91.1
print 91.1
mustache 90.7
facial hair 90.4

Imagga
created on 2022-01-08

black 27.3
person 27
man 25.5
face 24.8
male 24.2
portrait 23.9
adult 23.9
people 20.1
phonograph record 17.9
expression 17.9
dark 17.5
one 17.2
head 16.8
model 15.5
attractive 15.4
toilet seat 14.8
hand 14.5
sexy 14.4
punching bag 14.4
human 14.2
body 13.6
fashion 13.6
serious 13.3
skin 12.8
money 12.8
currency 12.6
handsome 12.5
studio 12.1
close 12
fitness 11.7
seat 11.7
look 11.4
training 11.1
game equipment 11
lifestyle 10.8
eyes 10.3
furniture 10.2
casual 10.2
art 9.8
health 9.7
mug shot 9.7
muscular 9.5
dollar 9.3
emotion 9.2
cash 9.1
sport 9.1
business 9.1
posing 8.9
masculine 8.8
banknote 8.7
athlete 8.7
makeup 8.6
bill 8.6
mouth 8.5
professional 8.4
alone 8.2
exercise 8.2
equipment 8.1
light 8
looking 8
hair 7.9
finance 7.6
healthy 7.6
photograph 7.5
paper 7.4
closeup 7.4
lips 7.4
banking 7.3
competition 7.3
sensuality 7.3
make 7.3
pose 7.2
representation 7.2
financial 7.1
night 7.1
modern 7
bodybuilder 7

Google
created on 2022-01-08

Forehead 98.5
Hair 98.3
Face 98.3
Chin 96.8
Eyebrow 95.3
Hairstyle 95.1
Facial expression 93.3
Oval 92.1
Jaw 88.1
Coat 87.1
Collar 83.5
Headgear 80.9
Vintage clothing 78.9
Art 77.2
Tints and shades 77.1
Formal wear 71.2
History 68.7
Facial hair 68.6
Circle 67.8
Portrait 64

Microsoft
created on 2022-01-08

human face 97.4
man 97
wall 96.9
black 95.9
clothing 90.4
text 89.5
person 88.4
white 80.6
drawing 73.2
portrait 71
sketch 68.3
posing 46.8
old 41.6
vintage 36.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 82.4%
Calm 90.9%
Sad 8.1%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 98.7%

Categories

Imagga
created on 2022-01-08

paintings art 68.6%
food drinks 19.8%
people portraits 10.8%

Captions

Microsoft
created by unknown on 2022-01-08

a vintage photo of a person 83.1%
a vintage photo of a person 81.2%
a person posing for the camera 81.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a man in a suit and tie is shown in this photo

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

This image depicts a sepia-toned oval portrait, featuring an individual dressed in formal attire. The clothing includes a dark suit or coat and a bow tie, indicative of a classic or vintage fashion style. The soft vignette effect around the edges of the portrait gives it an aged, timeless quality.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image is a sepia-toned oval photograph featuring a person with a classic, formal attire characteristic of 19th-century portraits. The individual is wearing a dark suit or jacket, with a visible bow tie or cravat around the neck. The photograph is set against a plain, softly graduated background that becomes darker towards the edges, a common style for portraits of this era. The person's hair is styled neatly, and overall, the image suggests a formal and timeless quality typical of historical photographic portraits.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white portrait photograph of a young man with short, dark hair and a serious expression. He is wearing a suit with a bow tie. The image has an oval shape and a slightly faded, antique appearance, suggesting it is an old photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical oval-framed portrait photograph, appearing to be from the mid-19th century based on its sepia tone and photographic style. The subject is wearing formal attire typical of that era, including a dark jacket and bow tie. The image shows a young person with a clean-shaven face, neatly styled short dark hair parted to the side, and a direct gaze toward the camera. The photograph has the distinctive characteristics of early photography, with its soft focus and subtle gradients from light to dark. The oval frame and formal pose were very common in portrait photography of that period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image is an old sepia-toned photograph of a young man in a suit and bow tie, likely taken in the 19th century. The photograph is oval-shaped and features a dark background with a light source emanating from behind the subject's head, creating a halo effect.

  • The young man has short dark hair that is parted on the side and combed over to one side. He wears a dark suit jacket, a white shirt, and a dark bow tie. His facial expression is neutral, and he looks directly at the camera.
  • The background of the photograph is dark, with a light source emanating from behind the subject's head, creating a halo effect. The overall atmosphere of the photograph is formal and serious, suggesting that it may have been taken for a professional or official purpose.

The image is an old sepia-toned photograph of a young man in a suit and bow tie, likely taken in the 19th century. The photograph is oval-shaped and features a dark background with a light source emanating from behind the subject's head, creating a halo effect. The young man has short dark hair that is parted on the side and combed over to one side. He wears a dark suit jacket, a white shirt, and a dark bow tie. His facial expression is neutral, and he looks directly at the camera. The background of the photograph is dark, with a light source emanating from behind the subject's head, creating a halo effect. The overall atmosphere of the photograph is formal and serious, suggesting that it may have been taken for a professional or official purpose.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image is an oval-shaped portrait of a man, likely from the 19th century. The man has dark hair that is parted on the side and styled neatly. He wears a dark jacket with a white shirt and a dark bow tie. The background of the portrait is a gradient of light to dark, with the lightest area behind the man's head and the darkest areas around the edges of the oval. The overall effect is one of elegance and sophistication, suggesting that the man was a member of the upper class or a professional.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image features a vintage-style portrait of a man in black and white. The portrait is oval-shaped, with a slightly faded and worn appearance, suggesting its age. The man is dressed in a formal suit, complete with a bow tie, and has short, neatly styled hair. His facial expression is serious, and he is looking directly at the camera. The portrait is set against a plain, light-colored background, which helps to emphasize the subject's features.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image shows a portrait of a man. The man is wearing a bow tie and a suit. He has short hair and a mustache. The portrait is circular, with a dark brown border. The background of the portrait is plain and white. The portrait has a vintage look, with a sepia tone and a slightly blurred effect. The man's face is slightly turned to the left, and he is looking directly at the camera.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here is a description of the image:

Overall Impression:

The image is a sepia-toned portrait of a young man. It has an aged appearance, likely due to its vintage nature. The portrait is enclosed within a dark oval.

Subject:

  • The subject is a young man, likely in his late teens or early twenties.
  • He has dark hair, neatly styled with a side part.
  • He is gazing directly at the viewer with a serious, almost introspective expression.
  • He appears to be wearing formal attire, consisting of a dark coat, a white shirt, and a bow tie.

Technical Aspects:

  • The photograph is in sepia tone, giving it a warm, vintage feel.
  • The lighting is soft, creating a gentle gradient from a lighter center to a darker oval border.
  • The image is an older photograph, showing signs of age and wear.

Context and Possible Interpretation:

  • The portrait likely dates back to the 19th century, given the style and technique.
  • The subject's formal attire suggests that he may have belonged to a family of wealth or standing.
  • The formality of the portrait suggests that it was likely commissioned.

Created by gemini-2.0-flash on 2025-05-16

The image is an oval portrait of a young man with dark hair and eyes. He's wearing a dark suit with a white shirt and a dark bowtie. The portrait is sepia-toned and appears to be an old photograph. The man is positioned in the center of the oval, looking directly at the viewer with a serious expression. The background of the portrait is a soft, blurred gradient of brown.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a vintage portrait of a young man, likely from the mid-19th century. The photograph is oval-shaped and has a sepia tone, which is characteristic of early photographic techniques such as daguerreotypes or ambrotypes.

The man in the portrait has short, dark hair that is neatly combed. He is wearing formal attire, including a dark jacket, a white shirt, and a bow tie. His expression is serious and composed, typical of the formal portraiture style of the era. The background is plain and dark, which helps to focus attention on the subject. The overall quality of the image suggests it is an old photograph, possibly taken in a studio setting.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This image is a sepia-toned, oval-framed portrait of a young man. He is dressed in formal attire, wearing a suit jacket, a white shirt, and a bow tie. His hair is neatly combed, with a side part. The lighting is soft, highlighting his face and giving the image a classic, vintage appearance. The background is plain and dark, which draws attention to the subject. The overall style suggests that this could be a photograph from the 19th century.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image is a sepia-toned portrait of a young man. The photograph is oval-shaped and framed within a larger oval border, giving it a traditional and formal appearance characteristic of 19th-century portraiture. The young man is dressed in formal attire, wearing a dark suit with a white shirt and a bow tie. His hair is neatly combed, and he has a serious, contemplative expression. The background is plain, which draws attention to the subject. The overall tone of the image is subdued, with a focus on the subject's dignified demeanor.