Human Generated Data

Title

Untitled (Frances Clayton in uniform)

Date

19th century

People

Artist: Samuel Masury, American 1818 - 1874

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2019.149

Human Generated Data

Title

Untitled (Frances Clayton in uniform)

People

Artist: Samuel Masury, American 1818 - 1874

Date

19th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2019.149

Machine Generated Data

Tags

Amazon
created on 2019-10-04

Hat 99.6
Clothing 99.6
Apparel 99.6
Human 98.4
Person 98.4
Furniture 95.8
Military Uniform 68.4
Military 68.4
People 63.8
Standing 59.9
Home Decor 57
Linen 57

Clarifai
created on 2019-10-04

people 99.6
one 98
lid 97.3
military 97.2
adult 96.9
wear 96.8
uniform 96.8
outfit 95.7
man 95.4
portrait 95.1
retro 92.7
veil 92.7
soldier 92.4
administration 91.4
military uniform 89.7
war 89
gun 88.2
weapon 84.7
music 76.9
child 75.8

Imagga
created on 2019-10-04

helmet 100
armor plate 94.1
plate 53.7
statue 31.1
shield 31
sculpture 24.1
man 21.5
people 18.4
art 18.3
religion 17.9
adult 17.5
male 17
old 16
model 14.8
culture 13.7
portrait 13.6
monument 13.1
person 12.4
antique 12.1
ancient 12.1
stone 11.8
catholic 11.7
history 11.6
black 11.4
clothing 11.3
dress 10.8
fashion 10.5
god 10.5
religious 10.3
architecture 10.2
city 10
travel 9.9
human 9.7
body 9.6
outdoor 9.2
posing 8.9
traditional 8.3
sky 8.3
vintage 8.3
tourism 8.2
sport 8.2
detail 8
sexy 8
face 7.8
marble 7.7
military 7.7
holy 7.7
attractive 7.7
saint 7.7
faith 7.7
hand 7.6
decoration 7.5
holding 7.4
style 7.4
hat 7.4
figure 7.3
women 7.1

Google
created on 2019-10-04

Standing 82.8
Uniform 75.5
Headgear 67.5
Gentleman 65.1
Soldier 53.7
Gun 50.1

Microsoft
created on 2019-10-04

person 97.4
clothing 92.8
text 82.8
wearing 76.6
uniform 59.6
coat 57.2
man 54.7
old 51.4
posing 35
dressed 27.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Female, 60.1%
Angry 0.3%
Sad 4%
Confused 0.1%
Fear 0%
Happy 0%
Disgusted 0%
Calm 95.5%
Surprised 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat
Person
Hat 99.6%
Person 98.4%

Categories

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-31

The image depicts a person dressed in a historical military uniform, standing and resting one hand on a decorative piece of furniture. The uniform includes a full-buttoned jacket, trousers, and a wide-brimmed hat adorned with a small badge or emblem. The individual is holding a sword with a scabbard in their other hand. The overall setting suggests a formal portrait from a bygone era, likely from the 19th or early 20th century.

Created by gpt-4 on 2024-11-16

This is a sepia-toned, vintage photograph. It features an individual standing to the left side of the image, dressed in a traditional military uniform that consists of a double-breasted coat with round buttons running down the front. This attire suggests a 19th-century military style, possibly from the American Civil War era. The person is holding a sword vertically with the hilt at shoulder height and the point resting on the ground. They are wearing trousers that match the coat and what appear to be polished boots. To the right of the individual is an ornate armchair with carved, wooden details and a fringed textile draped over the back. The photograph has a plain backdrop and shows signs of aging with spots and imperfections on the surface.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-27

This is a historical black and white photograph that appears to be from the American Civil War era (1860s). The image shows a soldier in a Union Army uniform, consisting of a military jacket with buttons down the front and light-colored trousers. They are wearing a wide-brimmed hat and are standing next to an ornate chair with fringe decoration. The soldier is holding what appears to be a sword or saber. The photograph was taken in a studio setting, which was common for portrait photography of that period, with a plain background and formal pose. The image quality and style is typical of Civil War-era photography, with the sepia toning and formal studio composition that was characteristic of that time.

Created by claude-3-haiku-20240307 on 2024-11-14

The image shows a man standing and wearing a military-style uniform with a long coat and buttons down the front. He is also wearing a large hat with a brim. The man is standing in front of what appears to be an ornate chair or piece of furniture. The image has a sepia tone, indicating it is an old photograph.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

This sepia-toned photograph depicts a young man in a military uniform, standing confidently with his left hand resting on the back of an ornate chair. The man's attire consists of a wide-brimmed hat adorned with a decorative emblem, a long-sleeved jacket featuring epaulets and buttons down the front, light-colored pants, and dark shoes. He grasps a sword in his right hand, its hilt visible as he holds it at his side. The chair, positioned to the right of the man, boasts an intricately carved wooden frame and is upholstered with a dark fabric. A fringe trim adorns the bottom edge of the chair's seat, adding a touch of elegance to the overall scene. The background of the photograph is a plain wall, which serves to focus attention on the subject. The overall atmosphere of the image exudes a sense of pride and dignity, capturing a moment in time when the young man was proud to serve his country.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-21

The image is a sepia-toned photograph of a young man in a military uniform, holding a sword and standing next to a chair. The man has dark hair and is wearing a wide-brimmed hat, a jacket with buttons down the front, and pants. He is holding a sword in his right hand and resting his left hand on the back of a chair. The chair has a fringe along the bottom of its seat and back. The background of the image is a plain wall, and the floor appears to be made of wood. The overall atmosphere of the image suggests that it was taken in a studio or other formal setting, possibly during the 19th century. The man's military uniform and the presence of a sword suggest that he may have been a soldier or officer in the Confederate Army during the American Civil War.

Text analysis

Google

CLTR
CLTR