Human Generated Data

Title

Riley Allen Brick, New York (1837-1889)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1991

Human Generated Data

Title

Riley Allen Brick, New York (1837-1889)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1991

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.4
Clothing 93.7
Apparel 93.7
Overcoat 92.1
Coat 92.1
Text 88.1
Face 87.1
Label 77.5
Accessories 69.4
Accessory 69.4
Photography 67.1
Photo 67.1
Portrait 66.1
Head 65.4
Art 60.7
Man 59.5

Clarifai
created on 2023-10-25

one 99.6
portrait 99.5
people 99.4
adult 99.3
man 99.2
wear 98.1
two 97.1
art 96.2
woman 95.3
music 95.1
veil 95.1
no person 95
facial expression 93.8
side view 90.4
profile 90
retro 87.6
sculpture 87.3
musician 82.9
mammal 82.4
menswear 80.5

Imagga
created on 2022-01-08

hat 43.4
headdress 27.9
cowboy hat 24.9
money 23
sombrero 20.9
clothing 20.1
currency 18.8
finance 15.2
dollar 13.9
cash 13.7
close 13.7
financial 13.4
one 12.7
covering 12.6
object 11.7
bill 11.4
old 11.1
black 10.8
coin 10.5
vintage 10.1
art 9.9
world 9.8
us 9.6
consumer goods 9.5
paper 9.5
symbol 9.4
man 9.4
globe 9.3
bank 9.2
planet 9
wealth 9
metal 8.8
closeup 8.8
shiny 8.7
space 8.5
energy 8.4
economy 8.3
earth 8.3
sign 8.3
banking 8.3
device 8.1
silver 8
business 7.9
male 7.8
banknote 7.8
map 7.6
rich 7.4
portrait 7.1

Google
created on 2022-01-08

Handwriting 85.4
Collar 83.5
Sleeve 82
Oval 81.8
Facial hair 81.6
Suit 78.6
Blazer 77.8
Vintage clothing 77.7
Tints and shades 75.1
Font 74.9
Moustache 72.4
Signature 71.7
Collectable 68.5
Formal wear 68.1
History 64.8
Circle 64.1
Paper product 63.5
Paper 61.5
Beard 61.3
Art 60.3

Microsoft
created on 2022-01-08

text 99.8
man 95.9
person 94.2
human face 91.5
clothing 87

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 97.6%
Confused 1%
Surprised 0.5%
Sad 0.3%
Angry 0.2%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%

Feature analysis

Amazon

Person
Suit
Tie

Clarifai

Clothing
Human face
Human eye
Human nose

AWS Rekognition

Person 99.4%

Categories

Imagga
created on 2022-01-08

paintings art 97%
food drinks 2.1%

Captions

Microsoft
created by unknown on 2022-01-08

a close up of a person holding a book 25.7%
a person holding a book 25.6%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a portrait of politician, a man who served as the first president.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man in a suit and tie is shown in this photo

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This image appears to be an oval-shaped sepia-toned photograph of an individual in formal attire, including a jacket and cravat. The photograph has handwritten text below it that reads "R.W. Brick," along with the date "October 7th, 1857" and the location "New York, N.Y."

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a sepia-toned oval photograph depicting an individual dressed in 19th-century attire, including a suit with a bow tie. The image has a diagonal light streak across it from the top left to the bottom right. Beneath the photograph, the name "R. H. Brick" is handwritten. In the bottom left corner, the date "October 7th, 1857" is written, while the bottom right corner reads "New York N.Y." The overall appearance suggests a formal portrait typical of that era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a portrait photograph of a man in formal attire, likely from the 19th century. The man has a serious expression and is wearing a suit with a bow tie. The image is oval-shaped and has the name "R.H. Brick" written below it, along with the date "October 7th, 1837" and the location "New York, N.Y."

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical sepia-toned photograph from 1857, taken in New York, N.Y. The oval-shaped portrait shows a young gentleman in formal Victorian-era attire, wearing a dark jacket, white shirt, and dark bow tie. His hair is neatly styled according to the fashion of the time. The photograph is signed "R.H. Brick" at the bottom, with the date "October 7th 1857" written beneath it. The image has the characteristic look of an early photographic process, likely a daguerreotype or similar early photographic technique, with its distinctive warm brown tones and oval composition typical of mid-19th century portrait photography.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This image presents a sepia-toned photograph of a man, likely taken in the 19th century. The oval-shaped portrait is centered within the frame, showcasing the subject's formal attire, which includes a dark jacket, white shirt, and black bow tie. His hair is neatly styled, and he gazes directly at the camera with a serious expression.

Below the photograph, the name "R.H. Brick" is inscribed in elegant cursive script. Further down, the date "October 7th, 1837" is written in a similar style, accompanied by the location "New York, N.Y." in smaller text. The background of the image features a plain, off-white color, which provides a subtle contrast to the rich tones of the photograph. Overall, the image exudes a sense of formality and historical significance, capturing a moment in time from the past.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is an old photograph of a man, likely from the 19th century, with a sepia-toned oval frame. The man has dark hair and is dressed in a suit jacket, vest, and bow tie. He is looking directly at the camera with a neutral expression.

Below the photograph, the name "R.H. Brick" is written in cursive script. At the bottom of the image, two lines of handwritten text are visible: "October 7th 1837" on the left and "New York N.Y." on the right. The background of the image is a light beige color.

Overall, the image appears to be a formal portrait of a man from the 19th century, possibly taken for professional or personal purposes.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

This image is a portrait of a man in formal attire, possibly from the 19th century. The man is standing in front of a white background and is wearing a suit and tie. He has short hair and a serious expression on his face. The image has a vintage look, with a slightly blurry and faded appearance. There is a handwritten signature on the bottom right corner of the image, which reads "RH Brick." The date "October 7th, 1887" is also written in the same handwriting.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is an old photograph of a man in formal attire. The photograph is circular, with a slightly faded and aged appearance, suggesting it is from an earlier era. The man is dressed in a dark suit with a white shirt and a black bow tie. His hair is neatly combed back, and he has a serious expression on his face. He is standing, and his posture is upright. The background of the photograph is plain, focusing attention on the subject. Below the photograph, there is a handwritten signature that reads "R. H. Brick," followed by the date "October 7th, 1887," and the location "New York, N. Y." The handwriting appears to be done with a pen, adding to the antique feel of the image. The photograph is mounted on a piece of paper, which is also slightly aged and has a textured surface. The overall presentation of the photograph suggests it was taken for formal purposes, possibly for a professional or official document.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

The image shows an old portrait of a man named R.M. Brick. The portrait is sepia-toned and oval-shaped. The man has a serious expression and is wearing a dark suit with a bow tie. There is a streak of brighter light across the top of the oval. Underneath the portrait, his name is written in cursive. Below that are the words "October 7th, 1837" and "New York, N.Y." also written in cursive. The portrait appears to be quite old and has some signs of wear.

Created by gemini-2.0-flash-lite on 2025-05-07

Here's a description of the image:

The image is a sepia-toned portrait of a man, set within an oval frame. The man is facing the viewer with a serious expression. He's dressed in a dark suit with a bow tie and a collared shirt. The background of the oval has a slightly hazy, blurred effect, and there is a bright vertical streak running from the top right to the lower right.

Below the oval, the name "R.B.Brick" is written in elegant cursive script. Further down, the date "October 7th 1837" is written on the left, and "New York N.Y." is on the right, both also in cursive. The overall aesthetic suggests a vintage photograph, likely from the mid-19th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a vintage photograph of a man, likely taken in the 19th century. The photograph is oval-shaped and features a formal portrait of a young man with short, neatly combed hair. He is wearing a suit with a white shirt and a bow tie, and he is posed in a three-quarter view, facing slightly to the left. The background is plain, which was common in early studio portraits.

Below the photograph, there is handwritten text that reads:

"R.M. Brick
October 7th 1837
New York N.Y."

This suggests that the photograph is of a man named R.M. Brick, and it was taken on October 7th, 1837, in New York, New York. The style of the photograph and the clothing indicate that it is from the mid-19th century, consistent with the date provided.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image is a vintage portrait photograph featuring a man dressed formally in a suit and bow tie. The photograph has an oval shape, typical of the style of the late 19th or early 20th century. The man is standing with his body facing slightly to the left of the frame, but his head is turned to face the viewer directly. His expression is serious and composed. The background is plain, likely to emphasize the subject.

The photograph is signed at the bottom left with the name "R.M. Brick" and dated "October 7th 1887." To the right of the signature, it is marked "New York, N.Y." This suggests that the photograph was taken in New York City on the specified date in 1887.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This image depicts a formal photograph of a man, presented within an oval frame. The photograph has a sepia tone, suggesting it is an older picture, likely from the 19th century. The man is dressed in formal attire, including a suit, a bow tie, and a white shirt. The photograph appears to be mounted on a piece of paper, and there are handwritten inscriptions below the photograph. The inscriptions include the name "R. H. Brick," the date "October 7th, 1887," and the location "New York N.Y." The overall style and presentation suggest that this is a portrait from the late 19th century.

Text analysis

Amazon

October
New
RtBrick
New York ch.y.
York
ch.y.
October the 1887
1887
the

Google

RtMrick Actober 183 Urew York ch. yo
RtMrick
Actober
183
Urew
York
ch.
yo