Human Generated Data

Title

Untitled (five photographs, clockwise from top left, Hon. Henniker Major; Horatio Hood; Lord Arthur Hill; Hon. Augustus Sandys; center, Viscount Holmesdale)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.13

Human Generated Data

Title

Untitled (five photographs, clockwise from top left, Hon. Henniker Major; Horatio Hood; Lord Arthur Hill; Hon. Augustus Sandys; center, Viscount Holmesdale)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99.1
Person 99.1
Poster 98.8
Advertisement 98.8
Collage 98.8
Person 97.9
Person 96
Person 95.1
Person 94.2
Art 89.3
Person 75.5
Painting 58.6
Flyer 57.7
Paper 57.7
Brochure 57.7

Clarifai
created on 2018-04-19

people 99.9
print 99.7
adult 99.3
group 98.8
portrait 97.8
man 97.4
one 97.4
no person 96.5
painting 96.3
art 95.7
wear 95.6
woman 95.1
illustration 93.7
two 93.6
leader 93.4
lithograph 92.6
many 91.6
military 85.7
several 84.1
text 84

Imagga
created on 2018-04-19

old 38.3
padlock 30.8
vintage 29
wall 26.6
lock 26.1
building 25.4
antique 25.1
bookmark 24.7
ancient 24.2
door 22.8
fastener 22.8
paper 22.7
architecture 21.2
grunge 20.4
texture 20.1
retro 19.7
structure 18
window 18
aged 17.2
house 16.8
device 16.7
frame 16.6
brown 15.5
restraint 15.4
tourism 13.2
entrance 12.6
history 12.5
stone 12.5
wooden 12.3
art 12.2
blank 12
travel 12
worn 11.5
city 10.8
historical 10.4
empty 10.3
town 10.2
historic 10.1
dirty 9.9
religion 9.9
decoration 9.8
book jacket 9.5
weathered 9.5
jacket 9.3
page 9.3
cover 9.2
wood 9.2
rough 9.1
facade 8.9
pattern 8.9
home 8.8
stained 8.7
construction 8.6
design 8.5
medicine chest 8.5
religious 8.4
church 8.3
exterior 8.3
textured 7.9
arch 7.8
album 7.8
faded 7.8
torn 7.7
architectural 7.7
damaged 7.6
temple 7.6
grungy 7.6
destination 7.5
famous 7.4
street 7.4
box 7.3
yellow 7.3
tourist 7.2
detail 7.2
landmark 7.2

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

scene 100
gallery 100
room 100
different 60.6
posing 45
various 42.2
same 18.1
several 11.6

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 55%
Angry 45.1%
Calm 54.6%
Sad 45.1%
Disgusted 45%
Surprised 45%
Confused 45%
Happy 45%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 50.2%
Confused 49.5%
Calm 49.5%
Sad 49.7%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 29-45
Gender Male, 51%
Surprised 45.2%
Confused 45.3%
Sad 47.4%
Angry 48.2%
Calm 48.7%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.6%
Disgusted 45.4%
Confused 45.5%
Sad 46.1%
Surprised 46%
Calm 51.1%
Angry 45.7%
Happy 45.3%

AWS Rekognition

Age 30-47
Gender Male, 50.4%
Happy 49.6%
Calm 49.9%
Angry 49.6%
Sad 49.9%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

an old photo of a person in a room 68.8%
an old photo of a person 59.9%
an old photo of a room 59.8%

Text analysis

Amazon

rate
mop
hile
emoe
Jautis
erirt
lithuir
erirt rheuvsel
hpa Jautis 'n lithuir hile
Ame femaer mop rate emoe
rheuvsel
hpa
'n
femaer
eb
Ame

Google

4
九de 4r 及,4 74
74
4r
de
,