Human Generated Data

Title

Untitled (Countess of Fife [from a reproduction])

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.62

Human Generated Data

Title

Untitled (Countess of Fife [from a reproduction])

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Porcelain 95.7
Art 95.7
Pottery 95.7
Human 85.2
Drawing 85.2
Pattern 81.5
Graphics 81.5
Floral Design 81.5
Person 79.1
Person 78.9
Person 76.2
Doodle 69.5
Sketch 61.7
Indoors 59.6
Furniture 57.6
Sideboard 57.6
Canvas 56.7
Painting 56.2

Clarifai
created on 2018-04-19

decoration 96.1
picture frame 96.1
vintage 95.5
retro 95
illustration 94.6
art 94.2
design 93.2
desktop 92.3
antique 92.1
no person 91.7
ornate 90.6
old 89.7
architecture 89
vector 88.3
style 88.1
travel 86.3
pattern 86
building 86
card 84.4
margin 83.5

Imagga
created on 2018-04-19

earthenware 42.1
ceramic ware 37.1
design 28.7
art 28
plate rack 25.1
graphic 24.8
utensil 24.2
decoration 24
retro 23.8
decorative 23.4
frame 23.3
stucco 22.9
old 20.9
element 20.7
rack 19.9
vintage 19
artwork 18.3
decor 17.7
cover 17.6
framework 17.5
grunge 17
pattern 16.4
ornament 16.4
border 16.3
antique 15.7
delft 15.6
data 15.5
collection 15.3
floral 15.3
creative 15
backdrop 14.8
business 14.6
majolica 14
carpet 13.6
sign 13.5
composition 13.2
circle 12.9
letter 12.8
ornate 12.8
advertisement 12.5
collage 12.5
texture 12.5
information 12.4
flower 12.3
curve 12.2
shape 11.9
style 11.9
associated 11.8
paper 11.8
association 11.8
definition 11.8
brochure 11.7
advertise 11.7
idea 11.6
advertising 11.5
copy 11.5
conceptual 11.5
symbol 11.4
artistic 11.3
modern 11.2
cloud 11.2
drawing 11.2
china 10.9
supporting structure 10.6
round 10.4
arabesque 10
wallpaper 10
ancient 9.5
blank 9.4
colorful 9.3
banner 9.2
cash 9.1
keywords 8.9
colors 8.8
porcelain 8.7
money 8.5
card 8.5
color 8.3
silhouette 8.3
currency 8.1
financial 8
device 7.8
black 7.8
mosaic 7.8
elegant 7.7
wall 7.7
mix 7.7
label 7.5
gold 7.4
paint 7.2
measuring instrument 7.2
bank 7.2

Google
created on 2018-04-19

picture frame 75.9
porcelain 51.8
oval 50.1

Microsoft
created on 2018-04-19

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-25
Gender Female, 51%
Surprised 45.8%
Happy 45.6%
Sad 49.4%
Confused 45.4%
Angry 45.9%
Disgusted 45.4%
Calm 47.4%

Microsoft Cognitive Services

Age 14
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 79.1%

Captions

Microsoft

a close up of a sign 62.8%
a sign on a wall 47.9%
a sign above a door 34%

Text analysis

Amazon

Cirli
Cirli hde
hde