Human Generated Data

Title

Colonel Hamblin (and unidentified man)

Date

1861-1865

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.83

Human Generated Data

Title

Colonel Hamblin (and unidentified man)

People

Artist: Unidentified Artist,

Date

1861-1865

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.83

Machine Generated Data

Tags

Amazon
created on 2022-02-19

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 95.6
Sitting 87.8
Sleeve 81.5
Art 80.8
Long Sleeve 77
Boot 73
Footwear 73
Home Decor 65.7
Overcoat 63
Coat 63
Advertisement 62.7
Portrait 60.6
Photography 60.6
Face 60.6
Photo 60.6
Poster 59.3
Painting 57.3
Text 55.8

Clarifai
created on 2023-10-28

painting 99.6
art 98.9
people 98.5
adult 96.9
man 96.3
wear 96.1
easel 96.1
painter 95.9
portrait 95.3
illustration 95.2
woman 95.2
two 92.5
print 90.7
one 87.1
family 87.1
paintbrush 85.5
furniture 85.2
picture frame 84.9
wall 83
outerwear 82.6

Imagga
created on 2022-02-19

person 35.4
people 31.8
man 31.6
happy 28.8
male 28.6
home 25.5
smiling 23.9
automaton 23.6
adult 23.1
professional 19.5
lifestyle 18.8
smile 18.5
job 17.7
work 17.3
portrait 16.2
clothing 15.8
holding 15.7
repair 15.3
women 15
occupation 14.7
business 14.6
worker 14.3
happiness 14.1
senior 13.1
couple 13.1
men 12.9
builder 12.6
attractive 12.6
tools 12.4
together 12.3
standing 12.2
mature 12.1
carpenter 12.1
construction 12
modern 11.9
contractor 11.7
cheerful 11.4
lady 11.4
industry 11.1
kimono 11
foreman 11
hardhat 10.8
businessman 10.6
collar 10.5
indoors 10.5
jeans 10.5
brunette 10.5
safety 10.1
model 10.1
electrician 9.9
handyman 9.8
handsome 9.8
mother 9.7
building 9.7
office 9.6
electrical 9.6
profession 9.6
hair 9.5
child 9.4
casual 9.3
two 9.3
businesswoman 9.1
fashion 9
engineer 9
robe 8.9
journeyman 8.9
looking 8.8
fix 8.8
improvement 8.7
garment 8.7
shirt 8.6
enjoying 8.5
youth 8.5
life 8.4
fun 8.2
technology 8.2
husband 8
active 8
computer 8
family 8
to 8
plumber 7.9
labor 7.8
full length 7.8
retired 7.8
corporate 7.7
blond 7.7
wife 7.6
build 7.6
human 7.5
leisure 7.5
uniform 7.4
friendly 7.3
laptop 7.3
protection 7.3
industrial 7.3
group 7.3
body 7.2
repairman 7.2
cute 7.2
face 7.1
working 7.1
equipment 7

Google
created on 2022-02-19

Furniture 95.2
Chair 91.4
Coat 88.5
Table 88.1
Art 86.8
Suit 78.7
Painting 78.6
Vintage clothing 75.8
Bottle 72
Illustration 71.4
Poster 69
Sitting 68.9
Visual arts 68.6
Conversation 66.3
Rectangle 65.9
Formal wear 64.8
Room 64
Font 62.3
Recreation 58.5
Vintage advertisement 58.3

Microsoft
created on 2022-02-19

text 99.1
clothing 97.1
painting 90.6
person 85.1
man 80
drawing 70.3
cartoon 54.8

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 71%
Sad 23.6%
Confused 2.6%
Angry 0.7%
Disgusted 0.6%
Happy 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 43-51
Gender Male, 96%
Disgusted 38.6%
Calm 25.5%
Angry 8.2%
Surprised 7.4%
Confused 6.4%
Happy 5.7%
Sad 5.2%
Fear 3.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Poster
Person 99.5%
Person 95.6%
Poster 59.3%

Categories

Captions

Microsoft
created by unknown on 2022-02-19

a man and woman posing for a photo 33.5%
a man and a woman posing for a photo 33.4%
an old photo of a man 33.3%

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a man in a blue uniform is sitting at a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image depicts two individuals positioned near a table. One person is dressed in formal civilian attire with a jacket, waistcoat, and bow tie, standing next to the table. The other individual is seated, wearing a vivid blue military uniform with gold buttons and accents, along with red detailing on the inside of the coat and tall black boots. The seated figure also has a sword resting by their side. The table holds several items, including books, a bottle, and other objects. The setting suggests a historical or staged scene.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a vintage, hand-colored photograph featuring two men. The man on the left is standing beside a wooden table, wearing a brown suit, vest, and a white shirt with a bow tie. On the table, there are several items, including a stack of books, a bottle, and a porcelain cup or mug. The man on the right is seated on a chair beside the table, dressed in a blue military uniform with gold buttons and accents, alongside red interior detailing. He is wearing knee-high black boots and has a sword resting at an angle next to him, its tip on the ground. The background of the photograph is plain.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to depict two men in a casual setting. One man is standing and appears to be a person of color, wearing a light-colored suit. The other man is seated, wearing a blue uniform with gold epaulettes, suggesting he may be a military or naval officer. They appear to be engaged in some kind of informal interaction, possibly sharing a meal or drink. The image has an old, vintage-like quality, suggesting it may be an older photograph or illustration.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This appears to be a historical photograph, likely from the American Civil War era (1860s). The image shows two men - one wearing formal civilian attire including a light-colored suit jacket and bow tie, and the other in a Union Army military uniform with distinctive blue coat, red sash, and tall boots. The military officer is seated at what appears to be a table or desk with some items on it, including what looks like a bottle. The photograph appears to be hand-colored, which was a common practice for photographs from this time period. The composition suggests this may have been taken in a photography studio. The image provides an interesting glimpse into the social interactions of the Civil War period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts a vintage photograph of two men, one standing and one seated, in a formal setting. The standing man is dressed in a light-colored suit with a dark vest and bow tie, while the seated man wears a blue military uniform with gold buttons and a red sash.

The standing man is positioned behind a table, which appears to hold various items such as books, a bottle of wine, and a plate of food. The seated man sits in a chair, leaning forward slightly, with his right hand resting on the table. He holds a sword in his left hand, with the blade pointing downwards.

The background of the image is a plain white wall, and the overall atmosphere suggests a formal or professional setting, possibly a studio or office. The image may be a historical document or artifact, given its age and the clothing worn by the individuals depicted.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image depicts a vintage photograph of two men, one African American and the other Caucasian, seated at a table. The African American man is standing behind the table, while the Caucasian man is seated in a chair.

Key Features:

  • African American Man: He is dressed in a light-colored suit with a dark vest and bow tie. His attire suggests a formal or professional setting.
  • Caucasian Man: He wears a blue military uniform adorned with gold buttons and epaulets, indicating his rank or position. A red sash is visible beneath his coat, adding to his military appearance. He holds a sword in his right hand, which rests on the floor beside him.
  • Table and Surroundings: The table is cluttered with various items, including books, papers, and a bottle. The floor features a patterned rug, and the background of the image is a plain wall.
  • Overall Impression: The photograph appears to be from the 19th century, given the style of clothing and the presence of a sword. The scene may depict a meeting or discussion between the two individuals, possibly related to military or official business.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The picture depicts two men, one sitting and the other standing, in an indoor setting. The seated man is dressed in a blue military uniform with a red lining and a black belt. He is holding a sword in his right hand, and his left hand is resting on the table. The standing man is wearing a suit with a bow tie and a white shirt. He is holding a bottle in his left hand.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image is an old photograph featuring two men in a room. The man in the foreground is sitting on a chair, dressed in a blue uniform with a red sash, and holding a sword. He appears to be writing or reading something on a desk. The man in the background is standing and appears to be conversing with the man in the foreground. The desk is cluttered with books, a bottle, and other items. The photograph has a vintage look and feel, with a white border around the edges.

Google Gemini

Created by gemini-2.0-flash on 2025-05-21

Here is a description of the image:

The image appears to be a colorized print or photograph, possibly a trade card or historical illustration. It features two figures in a room setting.

On the left side of the image stands an African-American man, dressed in a formal suit with a waistcoat, bow tie, and pocket square. He has a serious expression. He is standing beside a round wooden table.

On the right, a white man sits at the table wearing a military uniform. The uniform consists of a blue jacket adorned with gold buttons, red pants or chaps over his legs, and tall leather boots. A white cloth is tucked into his belt, and a saber leans against his chair. He is seated on a wooden chair and appears to be writing on a document or paper on the table.

The table has several books, a bottle of what appears to be wine, and other objects. The background is a plain, neutral color, and there is a hint of a rug pattern on the floor. The overall style suggests the image is from the 19th century.

Created by gemini-2.0-flash-lite on 2025-05-21

Here's a description of the image:

The image is a vintage-style, possibly hand-colored, depiction of two men in what appears to be a historical setting. The overall tone suggests a mid-19th century or early 20th-century context.

Main Elements:

  • Figure 1 (Left): A Black man is standing. He's wearing a formal suit with a bow tie. He has a serious expression.
  • Figure 2 (Right): A white man in military uniform is seated and leaning over a small, round table, writing. He is wearing a blue coat with gold buttons, a red sash, and tall black boots. A saber lies near his legs and a white glove rests on the table.
  • Table: A small, round wooden table sits in the foreground. There are some books, a bottle, and possibly other items on the table.

Setting & Context:

  • The overall impression is of a business or possibly a legal or military context.
  • The presence of the Black man and the white military officer suggests a time when racial dynamics were different.
  • The image appears to be an old print, possibly a photograph or lithograph, due to the color and age.

Overall:

The image is a fascinating glimpse into a past era and raises questions about the relationship between the two men and the circumstances surrounding their meeting. The style of the image is distinctive, with the hand-painted coloring, giving it a unique charm.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a hand-colored photograph from the 19th century, likely from the American Civil War era. It features two men in a staged setting.

  1. Man Standing (Left):

    • He is dressed in civilian attire, wearing a light-colored suit with a vest and a bow tie.
    • He appears to be an African American man.
    • He is standing behind a small table, holding a bottle in his right hand.
    • On the table, there are several items, including a bottle, a glass, and what appears to be a plate with food.
  2. Man Seated (Right):

    • He is dressed in a Union Army uniform, which includes a blue coat with gold buttons, red sash, and gray trousers tucked into tall boots.
    • He has a sword resting against his chair.
    • He appears to be a Caucasian man with a mustache.
    • He is seated on a wooden chair, looking downwards.
  3. Background and Setting:

    • The setting appears to be indoors, with a simple backdrop.
    • The floor is covered with a patterned rug.

The photograph seems to capture a moment of interaction between a civilian and a soldier, possibly highlighting the social dynamics of the period. The hand-coloring adds a vivid and lifelike quality to the image.