Human Generated Data

Title

George Howard Monks (1853-1933)

Date

1874-1875

People

Artist: William Notman, Canadian 1826 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3908

Human Generated Data

Title

George Howard Monks (1853-1933)

People

Artist: William Notman, Canadian 1826 - 1891

Date

1874-1875

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 98.6
Person 98.6
Accessory 97.1
Accessories 97.1
Tie 97.1
Mustache 82
Photo Booth 74.3

Clarifai
created on 2019-11-10

people 99.1
retro 94.2
one 93.2
adult 91.3
portrait 91
man 90.8
paper 88.9
wear 88.2
art 87.7
woman 86.8
desktop 75.7
facial expression 75
veil 72.9
vintage 71.6
music 71.5
blank 67.6
empty 67
square 66.9
illustration 64.6
nostalgia 63.8

Imagga
created on 2019-11-10

bow tie 70.9
necktie 55.7
portrait 42.1
attractive 40.6
model 38.1
sexy 37
adult 34.3
hair 34.1
fashion 33.9
pretty 32.2
person 31.4
lady 30
face 29.9
garment 29.7
sensual 28.2
skin 27.5
black 26.2
make 25.4
clothing 22.8
people 22.3
style 22.3
cute 22.3
sensuality 20
body 20
cover girl 19.7
eyes 18.9
brunette 18.3
lips 17.6
long 16.5
human 16.5
studio 16
women 15.8
makeup 15.2
erotic 14.4
smile 14.3
posing 14.2
cosmetics 14.1
happy 13.8
blond 13.7
elegant 13.7
elegance 12.6
lovely 12.5
hairstyle 12.4
expression 11.9
bride 11.3
one 11.2
clean 10.9
lifestyle 10.8
hand 10.6
sexual 10.6
modern 10.5
smiling 10.1
healthy 10.1
dark 10
gorgeous 10
pose 10
dress 9.9
look 9.6
looking 9.6
love 9.5
feminine 9.3
relaxation 9.2
wedding 9.2
stylish 9
nude 8.7
naked 8.7
seductive 8.6
art 8.6
bathtub 8.5
casual 8.5
head 8.4
care 8.2
fresh 7.9
veil 7.8
bathroom 7.7
youth 7.7
health 7.6
man 7.5
passion 7.5
holding 7.4
pure 7.4
brown 7.4
nice 7.3
cheerful 7.3
color 7.2
spa 7.2
eye 7.2
bright 7.2
romantic 7.1
suit 7
indoors 7

Google
created on 2019-11-10

Microsoft
created on 2019-11-10

human face 98
clothing 98
person 97.9
text 97.7
man 95.3
portrait 87.6
suit 75.6
old 73.3
gentleman 56.2
vintage 46.6
picture frame 9.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 89.2%
Disgusted 0.4%
Sad 1.4%
Confused 3.5%
Angry 1.6%
Fear 0.1%
Calm 92.6%
Surprised 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Tie 97.1%

Captions

Microsoft

a vintage photo of a person 74.1%
a vintage photo of a person 74%
a vintage photo of a person in a suit and tie 73.9%

Text analysis

Amazon

TORONTO
NOTMAN
WILLIAM
HALIFAX.
WILLIAM NOTMAN MONTREAL TORONTO & HALIFAX.
MONTREAL
&

Google

WILLIAM
HALIFAX.
NOTMAN
TORONTO
MONTREAL
WILLIAM NOTMAN MONTREAL TORONTO & HALIFAX.
&