Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Honorable Miss Cadogan; Lord Camoys; Honorable Harriet Stonor; Captain (?); center, Major Alison)
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.18

Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Honorable Miss Cadogan; Lord Camoys; Honorable Harriet Stonor; Captain (?); center, Major Alison)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.18

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Advertisement 98.8
Poster 98.8
Collage 98.8
Human 97.6
Person 97.6
Person 91.5
Person 78
Home Decor 67.1
Outdoors 64.7
Mammal 64.2
Animal 64.2
Wood 62.5
Photo 60.1
Photography 60.1
Person 58.9
Person 54

Clarifai
created on 2018-04-19

people 97.1
no person 96.9
painting 96.8
art 94.1
illustration 94
retro 93.6
adult 90.1
man 90.1
woman 90
print 89.6
wear 87.2
old 86.9
museum 86.2
group 84.8
paper 84.4
one 84
two 83.5
vintage 82.8
antique 82.1
picture frame 81.7

Imagga
created on 2018-04-19

bookmark 40.9
vintage 40.5
paper 40
old 39
book 36.8
texture 27.8
antique 27.7
grunge 27.2
retro 25.4
aged 20.8
product 19.9
book jacket 19.6
envelope 18.3
letter 17.4
ancient 17.3
jacket 17.2
money 17
cash 16.5
container 16.4
design 16.3
currency 16.1
wallpaper 16.1
page 15.8
creation 15.5
dirty 15.4
bank 15.2
note 14.7
empty 14.6
border 14.5
collection 14.4
worn 14.3
frame 14.2
covering 13.9
cover 13.9
blank 13.7
finance 13.5
cardboard 13.4
stamp 13.1
material 12.5
document 12.1
art 11.8
binder 11.7
wrapping 11.6
mail 11.5
bill 11.4
sign 11.3
sheet 11.3
brown 11
rough 10.9
postage 10.8
symbol 10.8
album 10.7
torn 10.6
parchment 10.6
damaged 10.5
decoration 10.5
rusty 10.5
business 10.3
binding 10.3
shabby 9.8
pattern 9.6
post 9.5
card 9.5
wall 9.4
banking 9.2
artwork 9.2
wealth 9
text 8.7
notes 8.6
international 8.6
age 8.6
decorative 8.4
protective covering 8.2
backgrounds 8.1
financial 8
postmark 7.9
manuscript 7.8
pages 7.8
ragged 7.8
fastener 7.8
leaf 7.8
bills 7.8
stained 7.7
stain 7.7
used 7.7
exchange 7.6
weathered 7.6
canvas 7.6
dollar 7.4
historic 7.3
color 7.2
world 7.2

Google
created on 2018-04-19

picture frame 75.3
product design 62.3
collection 53.9
font 52.6

Microsoft
created on 2018-04-19

gallery 85.6
room 57.5
various 51
different 42.6
painting 21.9
several 15.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 52.8%
Angry 51.6%
Surprised 45.1%
Calm 47.7%
Sad 45.2%
Happy 45%
Disgusted 45.3%
Confused 45.1%

AWS Rekognition

Age 26-44
Gender Male, 51.8%
Calm 52.7%
Angry 45.7%
Disgusted 45.1%
Confused 45.1%
Happy 45.1%
Sad 46.3%
Surprised 45.1%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Angry 49.5%
Happy 49.5%
Sad 49.6%
Disgusted 49.5%
Surprised 49.5%
Calm 50.2%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.6%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Calm 50.4%
Happy 49.5%
Angry 49.5%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

a painting on the wall 66.1%
a painting on a wall 65.2%
a painting hanging on a wall 65.1%

Text analysis

Amazon

un
gord
hnuit
gord ert lanng
Anihe hnuit un
ert lanng
Anihe
aim
arrfes