Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Mr. Vivian; Honorable Captain Edwards; Colonel Murray; Mr. Farquharson; center, Honorable Mary Stuart)
Date

1862-1888
People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.56

Human Generated Data

Title

Untitled (five photographs, clockwise from upper left, Mr. Vivian; Honorable Captain Edwards; Colonel Murray; Mr. Farquharson; center, Honorable Mary Stuart)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.56

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 99.1
Human 99.1
Person 99
Collage 97.8
Advertisement 97.8
Person 97.2
Person 91.9
Poster 84.7
Art 67.6
Envelope 56.7
Mail 56.6
Wood 56.3

Clarifai
created on 2018-04-19

people 96.9
architecture 94.3
travel 94.2
no person 93.2
door 93
painting 90.8
vertical 90.7
outdoors 90.2
art 89.8
religion 88.9
building 86.2
city 85.4
doorway 85
woman 84.5
wall 83.9
adult 83.9
old 83.8
window 83.7
man 83.6
home 82.6

Imagga
created on 2018-04-19

bookmark 78.9
vintage 44.1
old 40.4
paper 34.5
grunge 32.4
antique 31.3
texture 29.9
retro 29.5
ancient 24.2
aged 22.6
dirty 17.2
wallpaper 16.9
design 16.5
wall 15.4
letter 14.7
stamp 14.6
pattern 14.4
material 14.3
book 14.2
frame 14.2
symbol 14.1
art 13.7
page 13
empty 12.9
container 12.9
collection 12.6
mail 12.4
worn 12.4
damaged 12.4
box 12.1
blank 12
decoration 12
historic 11.9
postage 11.8
border 11.8
parchment 11.5
international 11.5
post 11.4
cover 11.1
brown 11
decorative 10.9
faded 10.7
ornament 10.3
card 10.2
document 10.2
traditional 10
ragged 9.8
envelope 9.7
money 9.4
country 9.2
board 9.2
artwork 9.2
ornate 9.2
rough 9.1
national 9.1
postmark 8.9
world 8.9
torn 8.7
drawing 8.7
door 8.7
stained 8.7
cardboard 8.6
cash 8.2
structure 8.2
painting 8.1
history 8.1
graphic 8
business 7.9
shabby 7.8
manuscript 7.8
grime 7.8
album 7.8
stains 7.8
travel 7.7
decay 7.7
stain 7.7
used 7.7
rustic 7.7
floral 7.7
age 7.6
weathered 7.6
grungy 7.6
communication 7.6
sign 7.5
sheet 7.5
jacket 7.5
wood 7.5
building 7.4
note 7.4
banking 7.4
binder 7.2
color 7.2
book jacket 7.2
currency 7.2
holiday 7.2

Google
created on 2018-04-19

picture frame 77.4
font 52.5

Microsoft
created on 2018-04-19

old 54.1

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Angry 45.6%
Disgusted 45.1%
Happy 45.2%
Confused 45.2%
Sad 45.9%
Calm 52.9%
Surprised 45.2%

AWS Rekognition

Age 27-44
Gender Male, 50.1%
Sad 49.5%
Calm 50.4%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.8%
Calm 50.1%
Surprised 49.5%

AWS Rekognition

Age 30-47
Gender Male, 50.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Calm 50.4%
Angry 49.5%
Sad 49.6%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Sad 50.1%
Confused 49.5%
Disgusted 49.5%
Calm 49.8%
Surprised 49.5%
Happy 49.5%
Angry 49.5%

Microsoft Cognitive Services

Age 39
Gender Male

Feature analysis

Amazon

Person 99.1%
Poster 84.7%

Categories

Imagga

Captions

Microsoft
created on 2018-04-19

an old photo of a person 49%
an old photo of a refrigerator 26.7%
old photo of a person 26.6%

Text analysis

Amazon

oubin
ent
Col
On
On ar ent
hheran
ar
oubin lifmus Lworl
Lworl
naghaine
lifmus
Col haun
haun
at hheran
at