Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Sir Archibald Hope; Lady Hope; Lady Edwin Hill; Mrs. Goff; center, Viscountess Holmesdale)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.31

Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Sir Archibald Hope; Lady Hope; Lady Edwin Hill; Mrs. Goff; center, Viscountess Holmesdale)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 99.3
Human 99.3
Poster 91
Collage 91
Advertisement 91
Art 89.9
Painting 80.6
Person 77.4
Person 69
Art Gallery 56.6
Wall 56

Clarifai
created on 2018-04-19

painting 99.5
print 99.2
people 99.1
art 98.2
illustration 97.6
no person 96.8
museum 95.3
adult 95.3
group 95.1
portrait 94.4
woman 92.5
retro 92
picture frame 90.9
one 90.8
indoors 90.2
lithograph 90.2
exhibition 89.6
antique 87.8
text 87.4
religion 87.2

Imagga
created on 2018-04-19

bookmark 39.1
old 36.2
vintage 28.1
wall 24.2
door 22
antique 21.6
architecture 21.4
building 20.7
texture 20.1
paper 19.6
grunge 17.9
ancient 17.3
retro 17.2
structure 15.6
frame 15
art 14.9
window 14.3
house 14.2
aged 13.6
stamp 13.5
travel 13.4
tourism 13.2
entrance 12.6
brown 12.5
design 12.3
religion 11.7
history 11.6
pattern 10.9
material 10.7
blank 10.3
city 10
stone 9.6
decoration 9.4
symbol 9.4
historical 9.4
page 9.3
town 9.3
historic 9.2
traditional 9.1
book jacket 9.1
drawing 9
detail 8.8
wooden 8.8
urban 8.7
book 8.7
worn 8.6
empty 8.6
facade 8.5
wood 8.3
cover 8.3
letter 8.3
rough 8.2
dirty 8.1
jacket 8.1
faded 7.8
arch 7.8
culture 7.7
stain 7.7
wallpaper 7.7
covering 7.6
temple 7.6
exterior 7.4
street 7.4
yellow 7.3
landmark 7.2
home 7.2

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

gallery 99.7
room 99.7
scene 99.7
old 72.9
different 45
various 42.6
painting 21.5
several 10.2

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-38
Gender Female, 54.7%
Disgusted 45.1%
Angry 47.7%
Sad 45.9%
Confused 45.2%
Calm 50.9%
Surprised 45.1%
Happy 45%

AWS Rekognition

Age 48-68
Gender Male, 55%
Sad 47%
Surprised 45.7%
Confused 47.4%
Disgusted 45.1%
Calm 47.4%
Happy 46.5%
Angry 45.9%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Confused 49.5%
Happy 50%
Surprised 49.5%
Calm 49.5%
Disgusted 49.7%
Sad 49.8%
Angry 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Happy 49.5%
Angry 49.8%
Confused 49.5%
Calm 49.7%
Surprised 49.5%
Disgusted 49.5%
Sad 49.9%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Sad 50.1%
Calm 49.8%
Happy 49.5%
Confused 49.5%
Angry 49.6%
Disgusted 49.5%
Surprised 49.5%

Microsoft Cognitive Services

Age 36
Gender Female

Feature analysis

Amazon

Person 99.3%
Painting 80.6%

Captions

Microsoft

a painting on the wall 79.5%
a painting hanging on a wall 79.4%
a painting on a wall 78.8%

Text analysis

Amazon

ectudale
r
r ectudale se
reruy
reruy grlus
grlus
se

Google

28
しん
En しん 28
En