Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Lord Berkeley Paget; Mrs. Erskine of Cardels(?) with infant; Alfred de Rothschild, Esq.; full-length portrait of unidentified woman; center, Miss Blanche (?))
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.30

Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Lord Berkeley Paget; Mrs. Erskine of Cardels(?) with infant; Alfred de Rothschild, Esq.; full-length portrait of unidentified woman; center, Miss Blanche (?))

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.30

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Collage 99.6
Advertisement 99.6
Poster 99.6
Human 98.4
Person 98.4
Person 97.4
Person 96.3
Art 84
Painting 66.5

Clarifai
created on 2018-04-19

painting 99.8
art 98.7
print 98.3
museum 98.2
people 98
illustration 96.9
exhibition 95.2
retro 94.8
no person 93.6
adult 93.5
woman 93.5
old 93.2
portrait 92.6
picture frame 92.3
vintage 91.9
antique 91.5
two 90.6
man 89.6
religion 87
architecture 86.2

Imagga
created on 2018-04-19

bookmark 100
old 45.3
vintage 43
antique 34.6
texture 31.3
paper 30.6
grunge 29
ancient 26.8
retro 26.2
frame 23.3
aged 22.6
wall 22.2
door 20
blank 17.1
art 16.6
design 16.1
border 15.4
wallpaper 15.3
book 14.5
dirty 14.5
pattern 14.4
empty 13.7
decoration 13.3
brown 13.3
building 13
page 13
letter 12.8
wood 12.5
architecture 12.5
rusty 12.4
faded 11.7
worn 11.5
wooden 11.4
structure 11.4
cover 11.1
material 10.7
entrance 10.6
parchment 10.6
rough 10
stamp 10
gold 9.9
history 9.8
mail 9.6
damaged 9.5
weathered 9.5
symbol 9.4
culture 9.4
ornate 9.1
card 9
style 8.9
postage 8.8
torn 8.7
stain 8.7
ornament 8.6
sheet 8.5
decorative 8.3
backdrop 8.2
collection 8.1
religion 8.1
doorway 7.9
shabby 7.8
carved 7.8
grime 7.8
album 7.8
crumpled 7.8
museum 7.8
stained 7.7
cardboard 7.7
post 7.6
old fashioned 7.6
temple 7.6
window 7.5
traditional 7.5
stone 7.4
envelope 7.4
classic 7.4
historic 7.3
graphic 7.3
painting 7.2
carving 7.2

Google
created on 2018-04-19

picture frame 86.7
art 72.8
painting 69.8
collection 59.7
window 56.5

Microsoft
created on 2018-04-19

gallery 98.3
scene 95.6
room 95.4
old 72.6
different 63.1
various 47.7
painting 18.6
several 10.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 54.7%
Disgusted 45.1%
Happy 45.1%
Surprised 45.1%
Angry 45.5%
Calm 51.2%
Confused 45.1%
Sad 47.9%

AWS Rekognition

Age 29-45
Gender Male, 54.5%
Happy 45%
Sad 45.3%
Calm 54.4%
Angry 45.1%
Disgusted 45%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 26-44
Gender Male, 50.5%
Disgusted 49.5%
Surprised 49.6%
Angry 49.6%
Confused 49.5%
Calm 50.1%
Sad 49.6%
Happy 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.3%
Calm 50.3%
Surprised 49.5%
Confused 49.5%
Angry 49.5%
Sad 49.6%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Sad 49.6%
Confused 49.5%
Happy 49.5%
Calm 50.3%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Surprised 49.6%
Angry 49.6%
Sad 49.7%
Happy 49.5%
Disgusted 49.6%
Confused 49.7%
Calm 49.8%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 66.5%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

a painting on the wall 74.7%
a painting on a wall 73.9%
a painting hanging on a wall 73.8%

Text analysis

Amazon

de
apr
Sinlly
rl Sinlly
rl
Ydlu
tind
apr r asi tind
cll
asi
KLauclil. cll
r
KLauclil.
wyae
wyae de Ydlu olill et
olill
et