Human Generated Data

Title

Untitled (five photographs, clockwise from top left, name illegible, full length of man standing, right hand resting on cabinet, left hand in trouser pocket; Viscount Malden; Honorable Augustus Sandys; Major Alison; center, Viscountess Malden)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.11

Human Generated Data

Title

Untitled (five photographs, clockwise from top left, name illegible, full length of man standing, right hand resting on cabinet, left hand in trouser pocket; Viscount Malden; Honorable Augustus Sandys; Major Alison; center, Viscountess Malden)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Collage 99.9
Advertisement 99.9
Poster 99.9
Person 99.6
Human 99.6
Person 99.2
Person 99.2
Person 99.1
Art 76
Person 67.6
Clothing 67.5
Apparel 67.5
Coat 66.2
Overcoat 66.2
Wall 62.7
Flyer 56.3
Paper 56.3
Brochure 56.3
Suit 55.4

Clarifai
created on 2018-04-19

people 99.6
no person 99.2
one 97.1
adult 97.1
man 95.4
wear 94.9
group 94.8
many 94.8
print 94.3
two 94.2
indoors 93.3
woman 91.7
architecture 90.3
painting 89.6
military 88.8
home 88.6
portrait 87.4
travel 86.3
art 86.1
doorway 85.3

Imagga
created on 2018-04-19

padlock 50.1
old 44.6
lock 41.5
fastener 36.5
door 35.3
wall 31.8
building 28.3
architecture 27.4
vintage 26.7
restraint 24.6
device 24.3
antique 24.2
texture 23.6
house 21.7
aged 21.7
ancient 20.8
window 20.5
paper 17.2
grunge 17
structure 16.9
bookmark 14.8
entrance 14.5
worn 14.3
frame 14.1
retro 13.9
history 13.4
stone 12.6
wooden 12.3
brick 11.6
weathered 11.4
empty 11.2
town 11.1
brown 11
arch 10.7
travel 10.6
detail 10.5
blank 10.3
exterior 10.1
historic 10.1
rough 10
dirty 9.9
tourism 9.9
cover 9.2
facade 9.1
city 9.1
border 9
material 8.9
pattern 8.9
doorway 8.8
surface 8.8
home 8.8
windows 8.6
damaged 8.6
glass 8.6
construction 8.6
wood 8.3
street 8.3
medicine chest 8.1
decoration 8.1
design 8
urban 7.9
gate 7.8
architectural 7.7
culture 7.7
painted 7.6
rusty 7.6
grungy 7.6
historical 7.5
page 7.4
art 7.3
yellow 7.3

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

gallery 97.8
scene 92.1
room 85.7
different 67.7
various 47.8
several 11.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Sad 49.5%
Calm 50.3%
Angry 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Surprised 49.5%
Happy 49.5%
Sad 50.1%
Confused 49.5%
Angry 49.6%
Disgusted 49.5%
Calm 49.8%

AWS Rekognition

Age 23-38
Gender Male, 54.3%
Happy 45.1%
Calm 54.4%
Angry 45.1%
Sad 45.1%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Happy 49.5%
Angry 49.9%
Sad 49.6%
Surprised 49.5%
Disgusted 49.6%
Calm 49.8%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Disgusted 49.5%
Calm 49.8%
Happy 49.5%
Surprised 49.5%
Sad 49.7%
Angry 50%
Confused 49.5%

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a person taking a selfie in front of a mirror posing for the camera 60.8%
a person posing for a photo in front of a mirror 60.7%
a man and woman posing for a photo in front of a mirror 29%

Text analysis

Amazon

Lord
(ounb
LoLol
Mrnty
lin
Lord Esiy
Nirert LoLol
LuE
Rn Ha
Bauti
f' Bauti
f'
Loe
Nirert
FLa
Esiy
up lin Rn Ha lyoe
lige:
Laot
Mrnty H FLa LuE
up
Loe w
lyoe
w
H