Human Generated Data

Title

Untitled (three photographs, top center, Earl of Fife [from a reproduction]; bottom left, Miss Moncrieff; bottom right, Mrs. Farquharson of Invercauld; verso: twelve names inscribed, unrelated to photographs on recto or facing page)
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.64

Human Generated Data

Title

Untitled (three photographs, top center, Earl of Fife [from a reproduction]; bottom left, Miss Moncrieff; bottom right, Mrs. Farquharson of Invercauld; verso: twelve names inscribed, unrelated to photographs on recto or facing page)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.64

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 94.4
Human 94.4
Art 78.5
Person 77.8
Mail 67.8
Envelope 67.8
Person 60.3
Painting 59.6
Furniture 58.9
Greeting Card 57.6
Text 55.6

Clarifai
created on 2018-04-19

painting 98.9
art 98.1
illustration 98
people 97.2
woman 93.7
retro 93.3
print 92.9
picture frame 91.8
adult 90.8
wear 90.1
veil 89.2
vintage 89.2
religion 88.5
museum 88.4
group 87.6
no person 85.7
old 85.1
portrait 83.7
architecture 83.2
man 81.9

Imagga
created on 2018-04-19

stamp 44.1
envelope 43.9
vintage 33.9
bookmark 33.4
mail 30.7
old 30
letter 28.4
postage 26.6
container 25.8
postmark 25.6
retro 24.6
paper 22.8
money 22.1
postal 21.6
post 21
currency 19.8
cash 19.2
philately 18.8
antique 17.5
ancient 16.4
bank 16.1
banking 15.6
collection 15.3
card 14.5
aged 14.5
symbol 14.2
circa 13.8
design 13.6
finance 13.5
notes 13.4
art 13.1
global 11.9
printed 11.8
business 11.5
dollar 11.1
texture 11.1
message 11
stamps 10.9
shows 10.8
financial 10.7
international 10.5
bill 10.5
savings 10.3
wealth 9.9
foreign 9.9
decoration 9.8
bills 9.7
dollars 9.7
exchange 9.6
packet 9.5
grunge 9.4
box 9.2
frame 9.2
history 9
philatelic 8.9
pattern 8.9
collect 8.9
unique 8.5
pencil box 8.5
notebook 8.4
communication 8.4
die 8.3
drawing 8.3
post office 7.9
banknotes 7.8
banknote 7.8
flag 7.8
cutting 7.7
pound 7.7
payment 7.7
communications 7.7
sign 7.5
east 7.5
note 7.4
package 7.3
paint 7.2
covering 7.2

Google
created on 2018-04-19

picture frame 87.1
pattern 55.9
art 54.1

Microsoft
created on 2018-04-19

gallery 97.1
room 94.2
scene 90.4
decorated 62.2
painting 53
old 51.5
painted 27.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 94.6%
Calm 65.5%
Angry 12%
Confused 8.2%
Sad 6.6%
Disgusted 2.2%
Surprised 3.7%
Happy 1.7%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Happy 49.6%
Disgusted 49.7%
Sad 49.6%
Angry 49.9%
Calm 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Calm 50.3%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.7%
Happy 49.5%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.4%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

a painting hanging on a wall 80.5%
a painting on the wall 80.2%
a painting on a wall 79.5%

Text analysis

Amazon

Imeresult
Farguharson
udls
onerissse
Farl
7
Farl fife
ifs
fife
ifs onerissse S Farguharson Imeresult
Ctiu udls
Ctiu
S