Human Generated Data

Title

Untitled (clockwise from top left, Capt. Hardy; Lady Buckhurst; Lord Albert Leverson Gower; Hon. Violet Sandys; Col. Marshall; Miss Chetwynd; center, Miss Van der Wise; verso: Earl of Yarmouth; Countess of Yarmouth; Col. Gordon; ctr. William Hood)
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.84

Human Generated Data

Title

Untitled (clockwise from top left, Capt. Hardy; Lady Buckhurst; Lord Albert Leverson Gower; Hon. Violet Sandys; Col. Marshall; Miss Chetwynd; center, Miss Van der Wise; verso: Earl of Yarmouth; Countess of Yarmouth; Col. Gordon; ctr. William Hood)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.84

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Collage 99.4
Advertisement 99.4
Person 98.7
Human 98.7
Person 93.2
Word 83.5
Person 78.9
Art 78.6
Person 73.2
Person 70.8
Text 67.7
Person 65.9
Face 62.5
Photo 58.8
Photography 58.8
Wall 57.9
Flyer 56.9
Paper 56.9
Brochure 56.9
Drawing 56.4
Poster 52.4

Clarifai
created on 2018-04-19

people 99.5
adult 97.8
man 95.5
art 95.1
illustration 95
group 93.4
portrait 93.3
painting 91.9
one 91
woman 90.7
wear 90.6
print 90.4
veil 87
vintage 86.7
old 85.2
retro 84.3
antique 84.2
picture frame 84.2
leader 84
no person 83.1

Imagga
created on 2018-04-19

bookmark 61.1
vintage 36.5
old 32.7
retro 29.5
antique 28
ancient 23.3
texture 22.9
wall clock 22.6
frame 22.5
design 21.7
grunge 21.3
clock 20.3
art 19.7
pattern 17.8
paper 17.2
decoration 15.8
stamp 15.3
flower 14.6
floral 13.6
timepiece 13.6
aged 13.6
style 13.3
graphic 13.1
border 12.7
gold 12.3
wall 12
banner 11.9
letter 11.9
card 11.7
framework 11.7
plate rack 11.7
element 11.6
symbol 11.4
drawing 11.4
blank 11.1
dirty 10.8
measuring instrument 10.8
collection 10.8
wallpaper 10.7
door 10.6
ornament 10.3
painting 9.9
backdrop 9.9
currency 9.9
religion 9.8
postage 9.8
decor 9.7
detail 9.6
mail 9.6
icon 9.5
set 9.5
golden 9.4
page 9.3
rack 9.3
historic 9.2
cash 9.1
traditional 9.1
insulating material 8.9
postmark 8.9
artistic 8.7
parchment 8.6
post 8.6
elegant 8.6
money 8.5
artwork 8.2
ornate 8.2
history 8
covering 8
wooden 7.9
colorful 7.9
stained 7.7
culture 7.7
rusty 7.6
sign 7.5
decorative 7.5
wood 7.5
classic 7.4
church 7.4
swirl 7.4
cap 7.4
brown 7.4
banking 7.3
paint 7.2

Google
created on 2018-04-19

picture frame 81.8
collection 67.7

Microsoft
created on 2018-04-19

different 36.3
several 10.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 50.9%
Calm 54.2%
Angry 45.1%
Happy 45.1%
Disgusted 45%
Surprised 45.2%
Sad 45.2%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.2%
Disgusted 45.1%
Happy 46.5%
Sad 45.4%
Confused 45.2%
Calm 51.8%
Surprised 46%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Angry 46.1%
Calm 47%
Sad 49.8%
Disgusted 45.2%
Surprised 45.7%
Confused 46.1%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 51.7%
Confused 45.2%
Happy 45.1%
Surprised 45.2%
Calm 52.7%
Disgusted 45.2%
Sad 46.3%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 45%
Sad 45%
Calm 54.7%
Angry 45.2%
Disgusted 45%
Surprised 45.1%
Confused 45%

AWS Rekognition

Age 26-43
Gender Male, 51.6%
Disgusted 45.2%
Confused 45.3%
Sad 46%
Surprised 45.3%
Calm 52.2%
Angry 45.8%
Happy 45.1%

AWS Rekognition

Age 19-36
Gender Female, 50.1%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%
Calm 54.2%
Angry 45.1%
Surprised 45.1%
Sad 45.3%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Poster 52.4%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

a close up of a white wall 58.4%
close up of a white wall 54.1%
an old photo of Nadezhda Krupskaya 31.5%

Text analysis

Amazon

de
dr
d
chhul
apte
Hes
6ag
rtf
6ag bu chhul
Mashale
/rl Mashale
/rl
ef VA de Hes
ami
ef
In
rtf Llyl fl
fl
apte dr d hul elsine Ja
bu
D In ami
Llyl
elsine
hul
D
VA
Ja