Human Generated Data

Title

William Whistler (brother of James Abbott McNeill Whistler)

Date

1847-1849

People

Artist: William Edward Kilburn, British active 1846-1862

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. John H. Kennard, P1978.94

Human Generated Data

Title

William Whistler (brother of James Abbott McNeill Whistler)

People

Artist: William Edward Kilburn, British active 1846-1862

Date

1847-1849

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. John H. Kennard, P1978.94

Machine Generated Data

Tags

Amazon
created on 2021-10-27

Person 99.1
Human 99.1
Art 82
Text 76.8
Wood 66
Book 63
Painting 62.6
Plant 61.3
Clothing 55.1
Apparel 55.1

Clarifai
created on 2023-10-13

no person 98.7
picture frame 98.5
retro 97.9
art 97.9
painting 97.4
antique 96
vintage 95.9
wear 95.8
desktop 95.7
margin 95.4
old 95.2
one 94.6
texture 93.3
decoration 92.9
blank 91.6
empty 91.3
dirty 91.1
people 90.8
wall 88.3
abstract 86.4

Imagga
created on 2021-10-27

frame 67.2
vintage 58.8
wallet 58.2
old 57.9
grunge 52
retro 48.4
blank 47.2
antique 45.3
empty 43.9
case 43.7
aged 43.5
container 40.4
texture 40.3
border 39.8
paper 36.9
ancient 32
design 30
art 29
wall 25.7
brown 25.1
decoration 23.3
textured 22.8
wallpaper 22.2
wood 20.9
dirty 20.8
wooden 20.2
decorative 20.1
rusty 20
old fashioned 20
binding 19
backdrop 19
material 18.8
board 18.6
framework 17.7
black 17.5
gold 17.3
grungy 17.1
album 16.6
parchment 16.3
damaged 16.2
photograph 15.8
template 15.6
museum 15.5
notebook 15.5
painting 15.4
worn 15.3
pattern 15.1
memory 14.7
stains 14.6
blackboard 14.2
element 14.1
page 13.9
ornate 13.7
chalkboard 13.7
frames 13.7
ragged 13.7
spot 13.4
space 13.2
tray 13
ornament 12.9
scrapbook 12.6
style 12.6
film 12.5
obsolete 12.5
structure 12.3
grain 12
historic 11.9
object 11.7
grime 11.7
crumpled 11.7
crack 11.6
stained 11.6
used 11.5
copy 11.5
decorate 11.4
rough 10.9
broad 10.8
deco 10.8
crease 10.8
book 10.7
faded 10.7
decay 10.6
rustic 10.6
receptacle 10.5
ornamental 10.5
golden 10.3
card 10.2
cover 10.2
dark 10
square 10
instant 9.8
framed 9.8
tracery 9.8
mottled 9.8
fracture 9.7
succulent 9.7
rust 9.6
photography 9.5
leather 9.5
nobody 9.3
note 9.2
letter 9.2
backgrounds 8.9
grubby 8.9
interior 8.9
decor 8.9
shabby 8.8
exhibition 8.8
surface 8.8
home 8.8
chalk 8.8
text 8.7
revival 8.7
torn 8.7
education 8.7
weathered 8.6
study 8.4
school 8.1
binder 8
vintage art 7.9
framing 7.9
gallery 7.9
artistic 7.8
covering 7.8
announcement 7.8
past 7.8
room 7.4
effect 7.3
business 7.3
history 7.2
information 7.1

Google
created on 2021-10-27

Picture frame 94.4
Rectangle 86.3
Art 84.5
Wood 73.4
Painting 71.4
Illustration 65
Antique 64.8
Visual arts 64.6
Book cover 64.2
History 62.4
Book 60
Portrait 56.4
Room 55.6
Self-portrait 54.6
Leather 53.1
Facial hair 52.5
Still life 51.3
Metal 51.3
Modern art 50.7

Microsoft
created on 2021-10-27

text 88.6
human face 87.5
person 85.4
picture frame 74.6
old 61.8
painting 59.7
clothing 52.6
painted 46.3
accessory 45
case 34.4
decorated 33.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-28
Gender Female, 95.6%
Calm 93.9%
Confused 2.9%
Sad 2.4%
Angry 0.3%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Book 63%
Painting 62.6%

Categories

Imagga

paintings art 66.2%
interior objects 28.5%
food drinks 4.3%

Captions

Microsoft
created on 2021-10-27

a painting on the wall 83.4%
a painting on a wall 82.6%
a painting hanging on a wall 82.5%

Azure OpenAI

Created by gpt-4 on 2024-11-16

The image depicts an antique case, which appears to be made of wood with a burgundy exterior and faded red edging. The case is open, revealing its two sections connected by a hinge. The left side is lined with worn red velvet, giving it a plush, luxurious feel, despite the visible signs of age and use. On the right side of the case is an oval frame bordered with a gilded, ornate design, surrounding a portrait of a figure dressed in period clothing, which includes a dark-colored jacket and a white shirt with a large, dark bowtie. The person's hands are visible, resting together gently. The image has an aged look, suggesting it could be a daguerreotype or another early form of photography, presenting a rich historical ambiance. The portrait's surrounding mat is faded with a gold tone at the edges transitioning to greenish-yellow towards the center, complementing the gilded frame. The case conveys a sense of time passed and serves as a form of preservation for the photograph inside, a common practice for portraits from the 19th century.

Anthropic Claude

Created on 2024-11-14

The image shows a framed portrait of a man in a formal outfit with a bow tie. The man has a serious expression on his face and is looking directly at the camera. The portrait is housed in a red velvet-covered frame and appears to be an old daguerreotype or early photographic print. The frame has a gold-colored oval mat around the portrait, adding a decorative element to the overall presentation.

Meta Llama

Created on 2024-12-01

The image presents a photograph of a young boy encased in a red velvet box, with the lid open to reveal the portrait. * The photograph is an oval-shaped tintype, featuring a young boy with short brown hair and a serious expression. + He is dressed in a black jacket with a white shirt and a black bow tie. + His hands are clasped together in front of him. * The photograph is set against a gold-colored background within the red velvet box. * The box itself has a distressed appearance, with visible signs of wear and tear. * The background behind the box is a plain gray color. In summary, the image showcases a vintage photograph of a young boy, encased in a worn red velvet box, with a serious expression and dressed in formal attire.