Human Generated Data

Title

William Whistler (brother of James Abbott McNeill Whistler)

Date

1847-1849

People

Artist: William Edward Kilburn, British active 1846-1862

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. John H. Kennard, P1978.94

Human Generated Data

Title

William Whistler (brother of James Abbott McNeill Whistler)

People

Artist: William Edward Kilburn, British active 1846-1862

Date

1847-1849

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. John H. Kennard, P1978.94

Machine Generated Data

Tags

Amazon
created on 2021-10-27

Person 99.1
Human 99.1
Art 82
Text 76.8
Wood 66
Book 63
Painting 62.6
Plant 61.3
Clothing 55.1
Apparel 55.1

Clarifai
created on 2023-10-13

no person 98.7
picture frame 98.5
retro 97.9
art 97.9
painting 97.4
antique 96
vintage 95.9
wear 95.8
desktop 95.7
margin 95.4
old 95.2
one 94.6
texture 93.3
decoration 92.9
blank 91.6
empty 91.3
dirty 91.1
people 90.8
wall 88.3
abstract 86.4

Imagga
created on 2021-10-27

frame 67.2
vintage 58.8
wallet 58.2
old 57.9
grunge 52
retro 48.4
blank 47.2
antique 45.3
empty 43.9
case 43.7
aged 43.5
container 40.4
texture 40.3
border 39.8
paper 36.9
ancient 32
design 30
art 29
wall 25.7
brown 25.1
decoration 23.3
textured 22.8
wallpaper 22.2
wood 20.9
dirty 20.8
wooden 20.2
decorative 20.1
rusty 20
old fashioned 20
binding 19
backdrop 19
material 18.8
board 18.6
framework 17.7
black 17.5
gold 17.3
grungy 17.1
album 16.6
parchment 16.3
damaged 16.2
photograph 15.8
template 15.6
museum 15.5
notebook 15.5
painting 15.4
worn 15.3
pattern 15.1
memory 14.7
stains 14.6
blackboard 14.2
element 14.1
page 13.9
ornate 13.7
chalkboard 13.7
frames 13.7
ragged 13.7
spot 13.4
space 13.2
tray 13
ornament 12.9
scrapbook 12.6
style 12.6
film 12.5
obsolete 12.5
structure 12.3
grain 12
historic 11.9
object 11.7
grime 11.7
crumpled 11.7
crack 11.6
stained 11.6
used 11.5
copy 11.5
decorate 11.4
rough 10.9
broad 10.8
deco 10.8
crease 10.8
book 10.7
faded 10.7
decay 10.6
rustic 10.6
receptacle 10.5
ornamental 10.5
golden 10.3
card 10.2
cover 10.2
dark 10
square 10
instant 9.8
framed 9.8
tracery 9.8
mottled 9.8
fracture 9.7
succulent 9.7
rust 9.6
photography 9.5
leather 9.5
nobody 9.3
note 9.2
letter 9.2
backgrounds 8.9
grubby 8.9
interior 8.9
decor 8.9
shabby 8.8
exhibition 8.8
surface 8.8
home 8.8
chalk 8.8
text 8.7
revival 8.7
torn 8.7
education 8.7
weathered 8.6
study 8.4
school 8.1
binder 8
vintage art 7.9
framing 7.9
gallery 7.9
artistic 7.8
covering 7.8
announcement 7.8
past 7.8
room 7.4
effect 7.3
business 7.3
history 7.2
information 7.1

Google
created on 2021-10-27

Picture frame 94.4
Rectangle 86.3
Art 84.5
Wood 73.4
Painting 71.4
Illustration 65
Antique 64.8
Visual arts 64.6
Book cover 64.2
History 62.4
Book 60
Portrait 56.4
Room 55.6
Self-portrait 54.6
Leather 53.1
Facial hair 52.5
Still life 51.3
Metal 51.3
Modern art 50.7

Microsoft
created on 2021-10-27

text 88.6
human face 87.5
person 85.4
picture frame 74.6
old 61.8
painting 59.7
clothing 52.6
painted 46.3
accessory 45
case 34.4
decorated 33.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-28
Gender Female, 95.6%
Calm 93.9%
Confused 2.9%
Sad 2.4%
Angry 0.3%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

Feature analysis

Amazon

Person
Book
Painting
Person 99.1%

Categories

Imagga

paintings art 66.2%
interior objects 28.5%
food drinks 4.3%

Captions

Microsoft
created on 2021-10-27

a painting on the wall 83.4%
a painting on a wall 82.6%
a painting hanging on a wall 82.5%

OpenAI GPT

Created by gpt-4 on 2024-11-16

The image depicts an antique case, which appears to be made of wood with a burgundy exterior and faded red edging. The case is open, revealing its two sections connected by a hinge. The left side is lined with worn red velvet, giving it a plush, luxurious feel, despite the visible signs of age and use. On the right side of the case is an oval frame bordered with a gilded, ornate design, surrounding a portrait of a figure dressed in period clothing, which includes a dark-colored jacket and a white shirt with a large, dark bowtie. The person's hands are visible, resting together gently. The image has an aged look, suggesting it could be a daguerreotype or another early form of photography, presenting a rich historical ambiance. The portrait's surrounding mat is faded with a gold tone at the edges transitioning to greenish-yellow towards the center, complementing the gilded frame. The case conveys a sense of time passed and serves as a form of preservation for the photograph inside, a common practice for portraits from the 19th century.

Created by gpt-4o-2024-05-13 on 2025-01-01

The image displays an antique, likely 19th-century, photograph set in an oval frame. The photograph is encased in a lined, red velvet-covered case, which is open to reveal the image on the right side while the left side shows the inner lining of the case. The photograph appears to be a formal portrait of an individual dressed in period-appropriate attire, with a white shirt, dark suit jacket, and a large bow tie.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a historical daguerreotype photograph in its original red velvet-lined case from what appears to be the mid-19th century. The image is in an oval format with a gold-colored mat surrounding it. The photograph shows a young person in formal Victorian-era attire, wearing a dark jacket, white shirt with a high collar, and a large black bow tie. The daguerreotype process, popular in the 1840s and 1850s, produced these distinctive silvery images on metal plates. The case has two parts - one side displays the photograph while the other side is empty, lined with red velvet, which was typical of how these precious early photographs were protected and displayed.

Created by claude-3-haiku-20240307 on 2024-11-14

The image shows a framed portrait of a man in a formal outfit with a bow tie. The man has a serious expression on his face and is looking directly at the camera. The portrait is housed in a red velvet-covered frame and appears to be an old daguerreotype or early photographic print. The frame has a gold-colored oval mat around the portrait, adding a decorative element to the overall presentation.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

The image presents a vintage photograph of a young boy, encased in a red velvet-covered box. The photograph is an oval-shaped daguerreotype, featuring the boy dressed in formal attire, including a dark jacket, white shirt, and black bow tie. His hair is styled neatly, and he appears to be around 10-12 years old. The photograph is set against a gold-colored background within the box, which is open to display both the front and back sides. The back of the box is covered in red velvet, while the front features the photograph. The overall atmosphere of the image suggests that it may be a family heirloom or a historical artifact, capturing a moment in time from the past.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-01

The image presents a photograph of a young boy encased in a red velvet box, with the lid open to reveal the portrait. * The photograph is an oval-shaped tintype, featuring a young boy with short brown hair and a serious expression. + He is dressed in a black jacket with a white shirt and a black bow tie. + His hands are clasped together in front of him. * The photograph is set against a gold-colored background within the red velvet box. * The box itself has a distressed appearance, with visible signs of wear and tear. * The background behind the box is a plain gray color. In summary, the image showcases a vintage photograph of a young boy, encased in a worn red velvet box, with a serious expression and dressed in formal attire.