Human Generated Data

Title

Untitled (eight photographs, clockwise from upper left, Colonel Burnaby; Miss Mackenzie; Colonel Murray; Lady Alfred Murray; Lady ? Duff; Mrs. Farher(?) of Howe; Miss Oswald; Mrs. Burnaby)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.57

Human Generated Data

Title

Untitled (eight photographs, clockwise from upper left, Colonel Burnaby; Miss Mackenzie; Colonel Murray; Lady Alfred Murray; Lady ? Duff; Mrs. Farher(?) of Howe; Miss Oswald; Mrs. Burnaby)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Book 98.2
Bird 90.8
Animal 90.8
Envelope 80.4
Bird 79.9
Person 77.5
Human 77.5
Mail 69.4
Text 66
Advertisement 64.3
Collage 64.3
Poster 64.3
Person 46.4

Clarifai
created on 2018-04-19

illustration 95.4
no person 95.4
people 94.6
retro 93.9
art 92.6
painting 92.5
paper 91.8
vintage 90.7
picture frame 90.7
print 89.7
old 87.9
one 87.7
antique 86.5
card 86.2
man 84.2
adult 83.5
indoors 83.5
text 83.1
group 82.8
book bindings 82.8

Imagga
created on 2018-04-19

envelope 50.8
bookmark 44.7
old 40.4
vintage 39
paper 36.9
grunge 31.5
retro 29.5
container 28.8
antique 28.6
texture 28.5
blank 24.9
frame 20.9
page 20.4
aged 19.9
ancient 19.9
stamp 19.9
money 19.6
letter 19.3
card 19.1
note 17.5
book 17.2
cash 16.5
border 16.3
dirty 16.3
currency 16.2
wallpaper 15.3
sheet 15
design 14.9
document 14.9
empty 14.6
parchment 14.4
art 13
manuscript 12.7
collection 12.6
rusty 12.4
finance 11.8
album 11.7
bank 11.7
business 11.5
notes 11.5
symbol 11.5
floral 11.1
pattern 10.9
decorative 10.9
material 10.7
cardboard 10.6
mail 10.5
sign 10.5
worn 10.5
text 10.5
brown 10.3
cover 10.2
decoration 10
notebook 9.9
postage 9.8
shabby 9.8
torn 9.7
post 9.5
banking 9.2
product 9.2
rough 9.1
burnt 8.8
invitation 8.7
stained 8.7
ornament 8.6
exchange 8.6
coin 8.6
bill 8.6
flower 8.5
dollar 8.4
birthday 8.3
artwork 8.2
gold 8.2
celebration 8
yellow 8
banknotes 7.8
leaf 7.8
banknote 7.8
wall 7.7
payment 7.7
stain 7.7
obsolete 7.7
international 7.6
die 7.5
savings 7.5
element 7.4
backdrop 7.4
historic 7.3
backgrounds 7.3
board 7.2
history 7.2

Google
created on 2018-04-19

font 65

Microsoft
created on 2018-04-19

envelope 80.4
stationary 66.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 55%
Angry 45.2%
Happy 45%
Confused 45.3%
Calm 52.3%
Sad 47%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.9%
Happy 45.1%
Angry 45.3%
Confused 45.1%
Calm 53.6%
Surprised 45.2%
Disgusted 45.2%
Sad 45.5%

AWS Rekognition

Age 45-65
Gender Male, 54.9%
Calm 50.2%
Confused 45.6%
Angry 45.9%
Sad 46.1%
Surprised 45.5%
Disgusted 45.1%
Happy 46.5%

AWS Rekognition

Age 14-23
Gender Female, 50.3%
Calm 49.5%
Angry 50.1%
Surprised 49.5%
Disgusted 49.8%
Confused 49.5%
Sad 49.6%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Surprised 45.2%
Happy 45.1%
Sad 50.3%
Disgusted 45.2%
Angry 45.5%
Calm 48.4%
Confused 45.3%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Calm 50.1%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.6%
Angry 49.7%
Confused 49.5%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Book 98.2%
Bird 90.8%
Person 77.5%

Captions

Microsoft

a envelope on the wall 33%
a envelope on the floor 32.9%
a envelope on the ground 32.8%

Text analysis

Amazon

e
p
Hrald
p achinge CrameSory
Suual
achinge
CrameSory
Sieuy
cag
oboun sureg olrut Suual
olrut
Sae
Carls
oboun sureg
farli
eue
yp