Human Generated Data

Title

Untitled (six photographs, clockwise from upper left, Lord Graham; Lord Hillsborough; Hon. Crespigny Vivian; Victor van de Wise(?); Captain Hood; Sir Samuel Hope(?))
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.46

Human Generated Data

Title

Untitled (six photographs, clockwise from upper left, Lord Graham; Lord Hillsborough; Hon. Crespigny Vivian; Victor van de Wise(?); Captain Hood; Sir Samuel Hope(?))

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 92.7
Person 92.7
Person 85.2
Person 81.4
Text 81.3
Person 80.2
Poster 65
Advertisement 65
Paper 64.5
Book 60.7
Furniture 57.4
Flyer 55.8
Brochure 55.8
Person 44.8

Clarifai
created on 2018-04-19

paper 97.3
retro 94.9
card 93.4
no person 92.7
picture frame 92.3
vintage 92.3
people 90.6
print 90.6
collection 90
desktop 89.9
one 88.8
old 88.3
wealth 88.1
money 88
art 87.8
antique 87.7
painting 85.4
luck 85.2
business 84.9
nostalgia 84

Imagga
created on 2018-04-19

padlock 43.8
lock 35
book 35
paper 29
fastener 28.6
package 26.1
money 25.5
container 25.5
packet 25.2
cash 24.7
currency 24.2
product 21.2
old 20.2
envelope 19.4
restraint 19.2
finance 17.7
business 17.6
stamp 17.5
vintage 17.4
creation 16.4
dollar 15.8
bookmark 15.3
wealth 14.4
bank 14.3
retro 13.9
card 13.8
notebook 13
banking 12.9
book jacket 12.7
payment 12.5
bill 12.4
box 12.2
gift 12.1
letter 11.9
jacket 11.8
design 11.7
decoration 11.6
financial 11.6
mail 11.5
symbol 11.4
page 11.1
note 11
investment 11
postage 10.8
holiday 10.8
banknote 10.7
device 10.3
ribbon 10.2
frame 10
collection 9.9
covering 9.8
bow 9.5
wrapping 9.5
blank 9.4
grunge 9.4
birthday 9.3
present 9.1
border 9
texture 9
sign 9
binder 9
success 8.9
celebration 8.8
bills 8.7
hundred 8.7
antique 8.7
ancient 8.7
exchange 8.6
post 8.6
communication 8.4
savings 8.4
day 7.9
notes 7.7
document 7.4
close 7.4
brown 7.4
object 7.3
message 7.3
yellow 7.3
valentine 7.3
aged 7.2
color 7.2
binding 7.2

Google
created on 2018-04-19

product design 62.4
font 61.3
brand 51.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Angry 45.3%
Confused 45.3%
Calm 53%
Sad 45.2%
Happy 45.1%
Surprised 46%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Male, 55%
Angry 46.8%
Confused 45.2%
Happy 45%
Sad 45.7%
Disgusted 45%
Calm 52.1%
Surprised 45.2%

AWS Rekognition

Age 27-44
Gender Male, 53.4%
Calm 50.8%
Confused 46%
Disgusted 45.2%
Sad 46.5%
Happy 45.1%
Surprised 45.7%
Angry 45.7%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.7%

Captions

Microsoft

a photo of himself in the mirror 10.8%
a photo of himself in a mirror 10.6%
a close up of different sizes 10.5%

Text analysis

Amazon

Aord
de
7
A Aord
loftar
Coouelwr
hara 7 Coouelwr
A
loftar ciu baa de de
llrimug
ebid grhem
baa de
hp
nd llrimug
nd
hara
bran
ciu
te
te luliny
luliny
Jhnnel
lfifr
lfifr Us
Us

Google

vi 50
50
vi