Human Generated Data

Title

James Gallatin (1796-1876)

Date

1837

People

Artist: George Linen, American 1802 - 1888

Previous attribution: Henry Inman, American 1801 - 1846

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.134

Human Generated Data

Title

James Gallatin (1796-1876)

People

Artist: George Linen, American 1802 - 1888

Previous attribution: Henry Inman, American 1801 - 1846

Date

1837

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.134

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 96.6
Person 93.7
Human 93.7
Painting 78.8

Clarifai
created on 2020-04-24

portrait 99.3
people 98.7
art 96.9
woman 96.1
one 95.4
light 90.5
adult 90
girl 88.2
no person 88.1
indoors 88
man 87.5
shadow 87
window 86.3
face 85.8
painting 83.7
music 83.7
moon 82.1
model 81.5
wear 81.3
street 80.3

Imagga
created on 2020-04-24

cloak 50.8
covering 39.8
face 35.5
black 34.8
portrait 34.3
person 32
eyes 29.3
phonograph record 29.2
adult 29.1
fashion 27.1
dark 26.7
model 22.5
attractive 22.4
hair 22.2
people 19.5
sexy 18.5
expression 17.9
lips 17.6
pretty 17.5
lady 16.2
sensual 15.5
youth 15.3
head 15.1
smile 14.2
man 14.1
looking 13.6
one 13.4
male 12.8
make 12.7
look 12.3
cute 12.2
brunette 12.2
makeup 11.9
skin 11.8
eye 11.6
posing 11.5
serious 11.4
lifestyle 10.8
happy 10.7
window 10.5
human 10.5
ethnic 10.5
hood 9.8
close 9.7
scary 9.7
mystery 9.6
women 9.5
closeup 9.4
smiling 9.4
hat 9.2
studio 9.1
sensuality 9.1
dress 9
religion 9
style 8.9
elegance 8.4
hand 8.4
gorgeous 8.2
handsome 8
clothing 8
witch 7.9
art 7.8
evil 7.8
horror 7.8
mysterious 7.8
culture 7.7
feminine 7.5
long 7.3
pose 7.2
fantasy 7.2
body 7.2
cool 7.1

Google
created on 2020-04-24

Portrait 75.3
Circle 66.4
Art 65.5
Space 54.2

Microsoft
created on 2020-04-24

human face 98.7
person 97.4
painting 90.5
art 88
text 59.2
clothing 57
colored 11.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Male, 92.1%
Fear 0.4%
Surprised 3.6%
Angry 1.3%
Sad 2.4%
Calm 88.2%
Happy 2.7%
Disgusted 0.9%
Confused 0.6%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 93.7%
Painting 78.8%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-04

The image appears to be an old, oval-shaped portrait with visible signs of age and wear, such as scratches and deteriorated edges. The background is dark, and there are areas where the paint has faded or chipped away, revealing the underlying canvas or material. The portrait is set within what looks to be a dark, textured backdrop, giving the impression of a genuinely aged piece. The central figure in the portrait is obscured by a blurred rectangle, preventing identification of the subject. The overall dark tones and the aged state of the portrait suggest it may be an artifact from a past era.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This is a historical portrait painting in an oval format. The subject is wearing a black coat or jacket and appears to be a young man from the early-to-mid 1800s based on the style and fashion. The painting has a dark, moody background with what appears to be a landscape visible through a window or opening on the left side. The painting technique is characteristic of the Romantic period, with smooth brushwork and attention to subtle facial features and expression. The painting shows some age-related wear around its edges but is otherwise well-preserved. The composition is formal but intimate, with the subject positioned slightly turned towards the viewer against the deep, rich dark background.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait painting of a man. The portrait is framed in a circular format, with a dark, somber background that contrasts with the subject's face. The man has a serious expression, with dark, intense eyes, and his features appear to be well-defined. The painting style suggests it is an older work, possibly from the 19th century or earlier. The overall atmosphere of the portrait is one of introspection and contemplation.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

This image is a portrait of a man, likely from the 19th century, based on the style of clothing and the painting technique. The man is depicted wearing a dark-colored coat or jacket, which is typical of men's fashion during that era. His hair is styled in a way that was common during the Victorian period, with a center parting and neatly combed sides. The background of the painting is dark and indistinct, which suggests that the artist focused more on capturing the subject's likeness rather than creating a detailed setting. The overall mood of the painting is somber and introspective, with the man's expression appearing thoughtful and contemplative. The painting itself appears to be an oil on canvas work, given the texture and brushstrokes visible in the image. The frame surrounding the painting is also visible, although it is not clear what material it is made of. Overall, this image provides a glimpse into the artistic styles and cultural norms of the 19th century, and offers a fascinating insight into the life and times of the subject.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a portrait of a man, likely a self-portrait by the artist, painted in 1855. The man has dark hair and is dressed in dark clothing, which is typical of the attire during the mid-19th century. The background of the painting is not clearly visible due to the circular frame that surrounds the subject, which is a common feature in many portraits from this era. The overall style of the painting suggests that it was created during the Romanticism period, which was characterized by an emphasis on emotion, individualism, and the beauty of nature. The use of dark colors and the focus on the subject's face and attire are also consistent with the artistic movements of the time. It is worth noting that the artist's identity is not specified in the image, but based on the style and the date of the painting, it is likely that the artist was a European painter from the 19th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image shows a painting of a man in a black coat. He is standing in front of a dark background, with a light source illuminating his face. The man's face is slightly turned to the side, and his eyes are looking directly at the viewer. The painting has a dark, almost black, border around it, which adds to the overall dramatic effect of the image. The man's expression is calm and composed, with a hint of a smile on his face.

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a portrait of a man with a serious expression. He is wearing a black coat and has short, dark hair. The portrait is painted in a dark, moody style with a blurred background. The man's face is illuminated by a light source, which creates a dramatic effect. The painting is framed in a dark oval frame, which adds to the overall mood of the image.