Human Generated Data

Title

Untitled (three photographs, clockwise from the top, Countess of Bective, Lady Olivia Taylour; Honorable Lady Filmer; Earl and Countess of Shrewsbury; verso: Sir Edmund Filmer, Bart.)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.87

Human Generated Data

Title

Untitled (three photographs, clockwise from the top, Countess of Bective, Lady Olivia Taylour; Honorable Lady Filmer; Earl and Countess of Shrewsbury; verso: Sir Edmund Filmer, Bart.)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.87

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 99.3
Human 99.3
Person 97.7
Person 87
Person 85.5
Person 85.1
Text 83.1
Art 75.1
Leisure Activities 61.6
Diary 57.2

Clarifai
created on 2018-04-19

people 100
print 99.5
group 99.5
adult 99.5
wear 98.7
illustration 98.6
art 98.6
portrait 97.9
one 97.9
leader 97.5
man 97.3
painting 94.8
woman 94.5
many 93.3
music 93.2
furniture 92.1
veil 91.4
text 89.1
two 87.6
administration 85.8

Imagga
created on 2018-04-19

vintage 52.2
old 47.4
paper 36.9
retro 36.1
stamp 35.7
grunge 34.9
antique 34.1
bookmark 32.8
texture 30.6
letter 24.8
aged 24.5
ancient 23.4
envelope 23
mail 21.1
postage 19.7
dirty 18.1
frame 17.5
book 17.3
design 17.2
post 17.2
postmark 16.8
border 16.3
page 15.8
card 15.8
insulating material 15.5
blank 15.4
wallpaper 15.3
art 14.8
historic 14.7
empty 14.6
damaged 14.3
book jacket 13.9
postal 13.8
pattern 13.7
collection 13.5
grungy 13.3
brown 12.5
material 12.5
parchment 12.5
document 12.1
money 11.9
cash 11.9
rough 11.9
jacket 11.8
faded 11.7
currency 11.7
history 11.6
building material 11.6
note 11
global 11
philately 10.9
structure 10.7
stained 10.6
worn 10.5
brass 10.5
bill 10.5
wall 10.3
cover 10.2
die 10.2
symbol 10.1
bank 9.9
manuscript 9.8
backgrounds 9.7
binding 9.7
torn 9.7
drawing 9.7
stain 9.6
cardboard 9.6
international 9.6
rusty 9.5
old fashioned 9.5
memorial 9.5
sheet 9.4
printed 8.9
obsolete 8.6
canvas 8.5
finance 8.5
container 8.4
communication 8.4
sketch 8.4
dollar 8.4
decorative 8.4
grain 8.3
wrapping 8.2
map 8.1
decoration 8.1
world 8
museum 7.9
text 7.9
product 7.9
shabby 7.9
correspondence 7.8
grime 7.8
ragged 7.8
album 7.8
crumpled 7.8
decay 7.7
shaping tool 7.7
age 7.6
banking 7.4
artwork 7.3
paint 7.2
stucco 7.1

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

old 98.3
gallery 78.2
different 57.9
vintage 44.2

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 17-27
Gender Male, 66.9%
Disgusted 1%
Confused 1.1%
Sad 3.1%
Calm 90.4%
Happy 0.3%
Angry 2%
Surprised 2.1%

AWS Rekognition

Age 23-38
Gender Male, 93.1%
Surprised 1.5%
Disgusted 0.6%
Happy 0.2%
Sad 2.4%
Calm 89.3%
Angry 2.5%
Confused 3.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.6%
Angry 49.6%
Surprised 49.5%
Disgusted 50%
Confused 49.5%
Sad 49.7%
Happy 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.5%
Disgusted 49.6%
Happy 49.5%
Confused 49.6%
Calm 49.6%
Angry 49.7%
Surprised 49.6%
Sad 49.9%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 49.6%
Happy 49.6%
Calm 49.7%
Surprised 49.6%
Disgusted 49.8%
Confused 49.6%
Angry 49.8%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

a vintage photo of a person 63%
a vintage photo of a box 53.2%
an old photo of a person 53.1%

Text analysis

Amazon

le
Couutu
ilu
BBecdrn
Lus
Lade
6libe
Laily Couutu o Fhnhay Nsu le Lade
Laily
Fhnhay
Gulcar BBecdrn tro 6libe Tayw Lus
(apsgy
o
Gulcar
(apsgy lad
Nsu
Tayw
tro
lad