Human Generated Data

Title

Rufus Choate

Date

c. 1855-1860

People

Artist: Josiah Johnson Hawes, American 1808 - 1901

Sitter: Rufus Choate,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, On loan from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 119.1976.413

Human Generated Data

Title

Rufus Choate

People

Artist: Josiah Johnson Hawes, American 1808 - 1901

Sitter: Rufus Choate,

Date

c. 1855-1860

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, On loan from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 119.1976.413

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Human 94.4
Clothing 93.4
Apparel 93.4
Face 89.4
Art 81.1
Sitting 74.8
Coat 71.5
Portrait 70.2
Photo 70.2
Photography 70.2
Overcoat 69.2
Suit 69.1
Text 67
Female 64.4
Performer 63.5
People 62.7

Clarifai
created on 2018-02-09

people 100
one 99.9
portrait 99.9
adult 99.6
man 99.3
leader 99
wear 97.5
administration 96.2
scientist 96.1
music 95.4
facial hair 94.6
writer 93.2
neckwear 91.3
mustache 91
outfit 90.5
sit 89.8
two 89.7
chair 89.1
menswear 89.1
art 89

Imagga
created on 2018-02-09

person 40.2
portrait 37.6
necktie 34.1
comedian 32.4
man 30.3
performer 29.9
male 29.2
attractive 25.9
people 25.7
black 25
face 22.7
adult 22.7
suit 21.9
fashion 21.1
entertainer 21.1
model 21
hair 20.6
expression 19.6
garment 19.5
sexy 18.5
lady 17.9
looking 16
clothing 15.6
handsome 15.2
studio 14.4
smile 14.3
human 14.3
pretty 14
eyes 13.8
dark 13.4
businessman 13.2
glasses 13
business 12.8
serious 12.4
look 12.3
shirt 12.1
sitting 12
one 12
youth 11.9
guy 11.3
happy 11.3
elegant 11.1
posing 10.7
smiling 10.1
lifestyle 10.1
confident 10
make 10
dress 9.9
tie 9.5
senior 9.4
cute 9.3
casual 9.3
alone 9.1
hand 9.1
style 8.9
cool 8.9
success 8.9
jacket 8.8
home 8.8
couple 8.7
love 8.7
seductive 8.6
thinking 8.5
costume 8.5
passion 8.5
head 8.4
lips 8.3
vintage 8.3
friendly 8.2
sensual 8.2
office 8
brunette 7.8
happiness 7.8
evil 7.8
masculine 7.8
corporate 7.7
men 7.7
professional 7.7
old 7.7
executive 7.6
room 7.4
family 7.1
to 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

person 98.9
man 98.2
wall 97.7
old 93
white 71.3
posing 55.1
vintage 48.7
older 23.4
necktie 18.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 49-69
Gender Male, 97.7%
Confused 6.1%
Calm 10.7%
Sad 69.8%
Angry 8.2%
Disgusted 0.4%
Surprised 2.9%
Happy 1.8%

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Clothing
Human face
Human arm
Human hand
Footwear
Human eye
Human nose
Human mouth

AWS Rekognition

Person 94.4%

AWS Rekognition

Painting 81.1%

Clarifai

Clothing 91.7%

Clarifai

Human face 84.5%

Clarifai

Human arm 47.3%

Clarifai

Human arm 46.9%

Clarifai

Human hand 42.2%

Clarifai

Human hand 38.6%

Clarifai

Footwear 40.3%

Clarifai

Human eye 35.7%

Clarifai

Human eye 33.3%

Clarifai

Human nose 33.2%

Clarifai

Human mouth 33%

Categories

Imagga
created on 2018-02-09

people portraits 99.7%
events parties 0.1%
food drinks 0.1%
paintings art 0.1%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-12

a photograph of a man in a suit and tie sitting in a chair

Created by general-english-image-caption-blip-2 on 2025-06-30

an old photo of a man in a suit

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This is an old sepia-toned photograph of a man seated in an ornately decorated chair. He is dressed in formal attire, including a dark suit, white shirt, and a bow tie. The overall style and attire suggest that the photograph is from the 19th century. The man’s posture is composed and suggests a formal setting.

Created by gpt-4 on 2024-11-28

The image shows a seated individual wearing a formal, dark-colored 19th-century suit with a waistcoat and a large bow tie. The person is resting their arms on the upholstered arms of an ornate chair, which appears to have a carved wooden frame. The photograph has a sepia tone, indicative of early photographic processes, and there are some signs of age such as spots and fading, suggesting it is a historical photo. The person's clothing and the style of the chair convey a sense of antiquity.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-26

This is a historical sepia-toned photograph from what appears to be the mid-19th century. The image shows a middle-aged or elderly gentleman seated in an ornate wooden chair with carved details. He is wearing formal attire typical of the era - a dark jacket, white shirt, and bow tie. He has curly hair and a stern, intense expression. The photograph appears to be a formal portrait, which was common during this period when photography was still a relatively new technology. The lighting and composition are characteristic of early photographic techniques, with a plain dark background that helps emphasize the subject.

Created by claude-3-haiku-20240307 on 2024-11-27

The image shows a portrait photograph of an elderly man with a serious expression on his face. He has curly, unkempt hair and a thick mustache. The man is wearing a dark suit and bowtie, and appears to be seated in an ornate chair. The image has a sepia-toned, vintage appearance, suggesting it is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This is a black and white photograph that appears to be from the mid-19th century. It shows a distinguished-looking gentleman seated in what appears to be an ornate wooden chair. He is wearing formal attire typical of the era, including a dark jacket, white shirt, and bow tie. His expression is serious and contemplative, and he has curly, somewhat disheveled hair. The photograph has the sepia tones and formal portrait style characteristic of early photography. The lighting and composition create a dramatic effect, with the subject positioned against a dark background, which was common in portrait photography of that period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a sepia-toned photograph of an older man sitting in a chair. The man has curly hair and is wearing a dark suit with a white shirt and a dark bow tie. He is seated in a dark-colored chair with ornate carvings on the backrest. His right arm is resting on the arm of the chair, while his left arm is resting on his lap.

The background of the image is a plain wall, which appears to be a studio backdrop. The overall atmosphere of the image suggests that it was taken in a formal setting, possibly for a portrait or official photograph.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-25

The image is a sepia-toned photograph of a man sitting in a chair, likely taken in the 19th century. The man has curly hair and is dressed in formal attire, consisting of a dark suit jacket, vest, white shirt, and bow tie. He sits with his left arm resting on the arm of the chair, while his right arm is bent at the elbow, with his hand resting on his lap.

The chair he sits in appears to be ornate, with a high back and carved details. The background of the image is a plain wall, which helps to focus attention on the subject. The overall atmosphere of the image suggests that it was taken for a formal portrait or as a professional photograph, possibly for use in a studio or as a personal keepsake.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image depicts an old black-and-white portrait of a man. He is seated on a chair with a high backrest, and his posture is upright, giving the impression of dignity and seriousness. The man has curly hair and is dressed in a formal suit, complete with a bow tie and a white shirt. His facial expression is stern, and he appears to be looking directly at the camera with a somewhat intense gaze. The background is dark and blurred, which helps to emphasize the man in the foreground.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of a man sitting on a chair. The man is wearing a coat and a bow tie. He is looking straight ahead, and his expression is serious. He is resting his left hand on the armrest of the chair, while his right hand is resting on his lap. He has short hair, and he is wearing a collared shirt underneath his coat.

Google Gemini

Created by gemini-2.0-flash on 2025-05-24

Here is a description of the image:

The image is a sepia-toned, full-length portrait of an older man seated in a large armchair. He is dressed in a dark suit with a light-colored vest visible beneath his jacket. A loosely tied bow tie adorns his neck, and a high-collared shirt peeks out from beneath his suit. His hair is dark, somewhat unkempt, and curly or wavy.

The man has a stern expression on his face, with furrowed brows and a serious gaze directly at the camera. His skin appears weathered, with visible lines and wrinkles. His hands rest casually on the arms of the chair.

The chair itself is ornate with dark wooden detailing and appears to be upholstered, possibly in leather. The background is a simple, dark and muted tone, which puts the focus squarely on the subject. The overall impression is of a formal, historical portrait capturing a man with a strong and somewhat imposing presence. The image has the characteristics of a mid-19th century photograph.

Created by gemini-2.0-flash-lite on 2025-05-24

Here's a description of the image:

Overall:

The image is a vintage, sepia-toned photograph. It appears to be a portrait of an older man. The subject is seated in an ornate chair and is dressed in formal attire from the mid-19th century.

Subject:

  • Appearance: The man is older, with wrinkles and a serious expression. He has dark, curly hair.
  • Attire: He is wearing a dark suit, with a white collared shirt and a bow tie. He also has a vest underneath his jacket.
  • Pose: He's seated with a relaxed posture, one arm resting on the armrest of the chair, and the other resting on his lap.

Setting:

  • Background: The background is a plain, dark canvas.
  • Chair: The chair has a dark finish and is ornately carved.

Atmosphere:

The photograph has a historical feel due to its sepia tone and the subject's clothing. The man's serious expression contributes to a formal and perhaps slightly imposing atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a sepia-toned photograph of a man seated in an ornate chair. The man appears to be dressed in formal attire from the 19th century, including a dark suit, a white shirt, and a bow tie. His hair is curly and slightly disheveled, and he has a serious expression on his face. The background is plain, which helps to focus attention on the subject. The photograph has an aged appearance, suggesting it is quite old, likely from the mid-to-late 1800s. The overall tone and style of the image indicate it might be a portrait of a notable figure from that era.

Qwen