Human Generated Data

Title

Untitled (seven photographs, clockwise from upper left, Lady Marion Loftus; Captain Anstruther; Hon. Mrs. Vivian; Earl of Tyrone; Hon. Harry Bourke; Hon. Walter Harbold; center, Alice Hale(?))
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.50

Human Generated Data

Title

Untitled (seven photographs, clockwise from upper left, Lady Marion Loftus; Captain Anstruther; Hon. Mrs. Vivian; Earl of Tyrone; Hon. Harry Bourke; Hon. Walter Harbold; center, Alice Hale(?))

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.50

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Collage 99.8
Advertisement 99.8
Person 97
Human 97
Person 93.9
Poster 89.8
Art 58.3
Person 58
Brochure 57.8
Flyer 57.8
Paper 57.8
Text 57.1
Person 55.4
Person 47.3

Clarifai
created on 2018-04-19

no person 95.6
retro 94.4
antique 94
old 92.6
illustration 86.7
art 86.6
symbol 83.8
vintage 83.7
architecture 82.9
design 82.6
business 82.5
ancient 80.9
indoors 80.1
paper 79.8
traditional 78.9
love 76
travel 75.3
dirty 73.7
decoration 73.1
people 72.6

Imagga
created on 2018-04-19

bookmark 48.7
paper 29
old 24.4
money 23
currency 22.4
cash 20.1
dollar 19.5
ancient 16.4
bill 15.2
decoration 14.7
business 14.6
envelope 14.4
bank 14.3
page 13.9
antique 13.8
finance 13.5
symbol 13.5
wealth 13.5
vintage 13.3
padlock 13.1
retro 13.1
banking 12.9
stamp 12.5
grunge 11.9
building 11.7
book 11.6
fastener 11.4
card 11.3
lock 11.2
savings 11.2
architecture 10.9
payment 10.6
book jacket 10.4
ribbon 10.2
aged 10
design 9.9
hundred 9.7
pay 9.6
exchange 9.5
house 9.2
art 9.2
investment 9.2
jacket 9.1
device 9
container 8.8
object 8.8
dollars 8.7
gift 8.6
wall 8.5
frame 8.3
religion 8.1
financial 8
holiday 7.9
bills 7.8
banknote 7.8
box 7.8
us 7.7
culture 7.7
loan 7.7
restraint 7.7
texture 7.6
package 7.6
bow 7.6
adornment 7.6
sign 7.5
city 7.5
rich 7.4
greeting 7.4
birthday 7.4
light 7.3
note 7.3
historic 7.3
new 7.3
present 7.3
success 7.2
history 7.2

Google
created on 2018-04-19

product design 62.1
font 57.6

Microsoft
created on 2018-04-19

envelope 81.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Angry 45%
Surprised 45%
Happy 45%
Calm 54.9%
Sad 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 19-36
Gender Male, 50.2%
Happy 49.6%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.8%
Angry 50%
Sad 49.6%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Sad 46.4%
Confused 45.5%
Disgusted 45%
Surprised 45.1%
Calm 52.6%
Angry 45.3%
Happy 45%

AWS Rekognition

Age 23-38
Gender Male, 50.5%
Sad 50.1%
Confused 49.5%
Disgusted 49.5%
Calm 49.6%
Surprised 49.5%
Happy 49.5%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Calm 49.3%
Angry 45.5%
Happy 45.2%
Surprised 45.3%
Disgusted 45.1%
Sad 47.7%
Confused 47%

AWS Rekognition

Age 10-15
Gender Female, 54.7%
Calm 53%
Angry 45.3%
Happy 45.2%
Disgusted 45.3%
Surprised 45.2%
Confused 45.2%
Sad 46%

AWS Rekognition

Age 26-43
Gender Female, 55%
Disgusted 47.5%
Confused 45.2%
Calm 45.4%
Happy 45.4%
Sad 50.6%
Surprised 45.2%
Angry 45.6%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Poster 89.8%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

a piece of paper 38.1%
a close up of a piece of paper 28.3%
a photo of a piece of paper 27.5%

Text analysis

Amazon

tf
Suinc
rit
arin
Copfai
ail
Viran
Wallin
rit Wallin Suinc ail Ene iyn grme
grme
Copfai litlen
eay arin tf
litlen
nte hs Viran
nte
hs
Ene iyn
eay