Human Generated Data

Title

William Whistler (brother of James Abbott McNeill Whistler)

Date

1847-1849

People

Artist: William Edward Kilburn, British active 1846-1862

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. John H. Kennard, P1978.94

Human Generated Data

Title

William Whistler (brother of James Abbott McNeill Whistler)

People

Artist: William Edward Kilburn, British active 1846-1862

Date

1847-1849

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. John H. Kennard, P1978.94

Machine Generated Data

Tags

Amazon
created on 2021-10-27

Person 99.1
Human 99.1
Art 82
Text 76.8
Wood 66
Book 63
Painting 62.6
Plant 61.3
Clothing 55.1
Apparel 55.1

Clarifai
created on 2023-10-13

no person 98.7
picture frame 98.5
retro 97.9
art 97.9
painting 97.4
antique 96
vintage 95.9
wear 95.8
desktop 95.7
margin 95.4
old 95.2
one 94.6
texture 93.3
decoration 92.9
blank 91.6
empty 91.3
dirty 91.1
people 90.8
wall 88.3
abstract 86.4

Imagga
created on 2021-10-27

frame 67.2
vintage 58.8
wallet 58.2
old 57.9
grunge 52
retro 48.4
blank 47.2
antique 45.3
empty 43.9
case 43.7
aged 43.5
container 40.4
texture 40.3
border 39.8
paper 36.9
ancient 32
design 30
art 29
wall 25.7
brown 25.1
decoration 23.3
textured 22.8
wallpaper 22.2
wood 20.9
dirty 20.8
wooden 20.2
decorative 20.1
rusty 20
old fashioned 20
binding 19
backdrop 19
material 18.8
board 18.6
framework 17.7
black 17.5
gold 17.3
grungy 17.1
album 16.6
parchment 16.3
damaged 16.2
photograph 15.8
template 15.6
museum 15.5
notebook 15.5
painting 15.4
worn 15.3
pattern 15.1
memory 14.7
stains 14.6
blackboard 14.2
element 14.1
page 13.9
ornate 13.7
chalkboard 13.7
frames 13.7
ragged 13.7
spot 13.4
space 13.2
tray 13
ornament 12.9
scrapbook 12.6
style 12.6
film 12.5
obsolete 12.5
structure 12.3
grain 12
historic 11.9
object 11.7
grime 11.7
crumpled 11.7
crack 11.6
stained 11.6
used 11.5
copy 11.5
decorate 11.4
rough 10.9
broad 10.8
deco 10.8
crease 10.8
book 10.7
faded 10.7
decay 10.6
rustic 10.6
receptacle 10.5
ornamental 10.5
golden 10.3
card 10.2
cover 10.2
dark 10
square 10
instant 9.8
framed 9.8
tracery 9.8
mottled 9.8
fracture 9.7
succulent 9.7
rust 9.6
photography 9.5
leather 9.5
nobody 9.3
note 9.2
letter 9.2
backgrounds 8.9
grubby 8.9
interior 8.9
decor 8.9
shabby 8.8
exhibition 8.8
surface 8.8
home 8.8
chalk 8.8
text 8.7
revival 8.7
torn 8.7
education 8.7
weathered 8.6
study 8.4
school 8.1
binder 8
vintage art 7.9
framing 7.9
gallery 7.9
artistic 7.8
covering 7.8
announcement 7.8
past 7.8
room 7.4
effect 7.3
business 7.3
history 7.2
information 7.1

Google
created on 2021-10-27

Picture frame 94.4
Rectangle 86.3
Art 84.5
Wood 73.4
Painting 71.4
Illustration 65
Antique 64.8
Visual arts 64.6
Book cover 64.2
History 62.4
Book 60
Portrait 56.4
Room 55.6
Self-portrait 54.6
Leather 53.1
Facial hair 52.5
Still life 51.3
Metal 51.3
Modern art 50.7

Microsoft
created on 2021-10-27

text 88.6
human face 87.5
person 85.4
picture frame 74.6
old 61.8
painting 59.7
clothing 52.6
painted 46.3
accessory 45
case 34.4
decorated 33.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-28
Gender Female, 95.6%
Calm 93.9%
Confused 2.9%
Sad 2.4%
Angry 0.3%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Book 63%
Painting 62.6%

Categories

Imagga

paintings art 66.2%
interior objects 28.5%
food drinks 4.3%

Captions

Microsoft
created on 2021-10-27

a painting on the wall 83.4%
a painting on a wall 82.6%
a painting hanging on a wall 82.5%