Human Generated Data

Title

Untitled (young woman with glasses, seated, half-length, three-quarter view)
Date

1840s-1850s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.23

Human Generated Data

Title

Untitled (young woman with glasses, seated, half-length, three-quarter view)

People

Artist: Unidentified Artist,

Date

1840s-1850s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.23

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Human 99.3
Person 99.3
Art 97.7
Painting 97.7
Apparel 87.3
Clothing 87.3
Photography 62.9
Portrait 62.9
Face 62.9
Photo 62.9
Text 59.7

Clarifai
created on 2019-11-05

art 99.7
painting 99.5
picture frame 99.2
gold 98.5
decoration 97.9
old 97.3
ornate 96.8
antique 95.7
margin 95.2
museum 95
design 94.8
desktop 94.6
illustration 94
gilt 93.7
people 93.6
exhibition 93.5
retro 91.6
ancient 91.2
no person 91.1
one 90.9

Imagga
created on 2019-11-05

prayer rug 100
rug 98.6
floor cover 74.2
furnishing 74.1
covering 51.7
old 48.8
vintage 48
frame 41.7
antique 37.1
retro 34.5
art 31.1
grunge 29.8
binding 29.4
ancient 27.7
gold 27.2
empty 26.7
decoration 26.1
blank 24
texture 22.3
border 21.7
decorative 21.7
ornate 21.1
wall 20.6
design 19.7
museum 19.4
aged 19
painting 19
golden 18.9
post 18.1
postage 17.7
stamp 17.4
mail 17.3
wood 15.9
paper 15.7
ornament 15.5
wooden 15
postmark 14.8
brown 14.7
letter 14.7
pattern 14.4
interior 14.2
style 14.1
postal 13.8
tray 13.7
icon 13.5
symbol 13.5
religion 13.5
ornamental 13.3
historic 12.8
culture 12.8
black 12.6
old fashioned 12.4
paintings 11.8
object 11.7
history 11.6
rustic 11.5
obsolete 11.5
textured 11.4
receptacle 11.1
collection 10.8
chalkboard 10.8
carved 10.8
wallpaper 10.7
decor 10.6
rusty 10.5
stamps 9.9
gallery 9.8
framework 9.8
exhibition 9.8
delivery 9.7
one 9.7
carving 9.7
metal 9.7
home 9.6
decorated 9.6
fine 9.6
container 9.4
finance 9.3
portrait 9.1
board 9.1
dirty 9.1
masterpiece 8.9
gilded 8.9
shows 8.9
printed 8.9
renaissance 8.9
office 8.8
painter 8.8
envelope 8.8
stain 8.7
worn 8.6
decorate 8.6
close 8.6
unique 8.6
rich 8.4
classic 8.4
church 8.3
post mail 7.9
zigzag 7.9
fame 7.9
known 7.9
deco 7.8
frames 7.8
architecture 7.8
cutting 7.7
communications 7.7
painted 7.6
damaged 7.6
grungy 7.6
backdrop 7.4
sculpture 7.4
backgrounds 7.3
global 7.3
business 7.3
material 7.1

Google
created on 2019-11-05

Picture frame 94.1
Antique 72.2
Portrait 55.1
History 54.1
Metal 51.1
Art 50.2

Microsoft
created on 2019-11-05

person 95.3
human face 95
indoor 94
clothing 87.8
text 74
museum 73.5
old 71.6
painting 52.9
picture frame 49.9
case 33

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 87%
Disgusted 0.1%
Confused 0.7%
Sad 35.9%
Surprised 0.3%
Fear 0.9%
Calm 61.3%
Angry 0.7%
Happy 0.1%

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 97.7%

Categories

Imagga

paintings art 97.8%
streetview architecture 2%

Captions

Microsoft
created on 2019-11-05

a painting on the wall 81.8%
a painting on a wall 81.1%
a painting on the side 77.7%