Human Generated Data

Title

Untitled (woman with lace collar and bow, seated in a chair, half-length, three-quarter view)

Date

1840s-1850s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.14

Human Generated Data

Title

Untitled (woman with lace collar and bow, seated in a chair, half-length, three-quarter view)

People

Artist: Unidentified Artist,

Date

1840s-1850s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Person 99.5
Human 99.5
Art 99.1
Painting 99.1
Photo 68.1
Face 68.1
Portrait 68.1
Photography 68.1

Clarifai
created on 2019-11-05

art 99.2
painting 99
people 98.2
picture frame 96.7
retro 93.4
portrait 93.4
print 92.7
antique 92.4
monarch 90.6
old 90.4
illustration 89.2
museum 88.8
woman 88.1
gold 87.8
vintage 85.8
decoration 84.1
one 82.9
leader 82
adult 80.8
exhibition 80.7

Imagga
created on 2019-11-05

prayer rug 100
rug 100
floor cover 83
furnishing 82.8
covering 60.1
old 36.3
vintage 35.6
art 34.5
ancient 29.4
antique 27.5
stamp 26.2
gold 25.5
mail 24.9
frame 24.3
retro 23.8
postage 23.6
post 22
postmark 21.7
culture 21.4
letter 21.1
decoration 21
golden 19.8
religion 19.7
postal 19.7
ornate 18.3
mosaic 17
design 16.9
museum 16.7
envelope 16.6
history 16.1
paintings 15.7
paper 14.9
printed 14.8
grunge 14.5
pattern 14.4
icon 14.3
shows 13.8
painter 13.7
aged 13.6
symbol 13.5
close 13.1
masterpiece 12.9
wall 12.8
book jacket 12.7
delivery 12.7
decorative 12.5
texture 12.5
architecture 12.5
painted 12.4
fine 12.4
binding 12.2
church 12
blank 12
style 11.9
stamps 11.9
renaissance 11.8
border 11.8
painting 11.8
currency 11.7
god 11.5
unique 11.4
office 11.3
detail 11.3
religious 11.3
one 11.2
money 11.1
historic 11
global 11
post mail 10.9
zigzag 10.9
fame 10.9
known 10.9
black 10.8
cutting 10.6
communications 10.6
ornament 10.3
empty 10.3
sculpture 10.1
face 10
collection 9.9
jacket 9.9
philately 9.9
interior 9.7
artist 9.7
palace 9.6
statue 9.5
ornamental 9.5
wood 9.2
travel 9.2
cash 9.2
decor 8.8
wooden 8.8
closeup 8.8
letters 8.7
saint 8.7
obsolete 8.6
decorate 8.6
finance 8.5
carving 8.4
rich 8.4
paint 8.2
object 8.1
home 8
canceled 7.9
business 7.9
portrait 7.8
prayer 7.7
decorated 7.7
temple 7.6
wrapping 7.5
classic 7.4
dollar 7.4
tourism 7.4
banking 7.4
metal 7.2
dirty 7.2

Google
created on 2019-11-05

Microsoft
created on 2019-11-05

human face 97.2
person 96
clothing 95.7
indoor 93.4
victorian 80.3
painting 74.3
old 73.9
text 65.5
picture frame 59.9
man 58.5
posing 52.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 46-64
Gender Female, 84.9%
Angry 0.9%
Happy 0.6%
Surprised 0.1%
Sad 1.9%
Calm 96.3%
Confused 0.2%
Fear 0%
Disgusted 0.1%

Microsoft Cognitive Services

Age 49
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 99.1%

Captions

Microsoft

a painting of a person 94.2%
a painting of a person posing for a photo 91.5%
a painting of a man and a woman posing for a photo 63.1%