Human Generated Data

Title

Robert Walter Weir (1803-1889)
Date

1866-1871
People

Artist: Napoleon Sarony, American 1821 - 1896

Sitter: Robert Walter Weir, American 1803-1889

Artist: Henry Theodore Tuckerman, American 1813-1871
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.411.35

Human Generated Data

Title

Robert Walter Weir (1803-1889)

People

Artist: Napoleon Sarony, American 1821 - 1896

Sitter: Robert Walter Weir, American 1803-1889

Artist: Henry Theodore Tuckerman, American 1813-1871

Date

1866-1871

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 97.2
Person 95.8
Face 90
Art 83.5
Clothing 79.5
Apparel 79.5
Senior Citizen 76.8
Photography 71.5
Photo 71.5
Portrait 69
Finger 67.8
Overcoat 60.2
Coat 60.2
Text 59.5
Sitting 56.9
Female 55.8
Flooring 55.8
Wood 55.7
Suit 55.5

Clarifai
created on 2019-02-18

people 97.6
retro 95.8
art 93.9
portrait 93.6
picture frame 93.3
adult 93.2
one 92.3
blank 90.2
paper 88.6
old 86.6
empty 85.8
painting 85
nostalgia 84.9
wear 84.8
bill 84.1
man 83.9
desktop 83.1
vintage 81.5
card 80.6
illustration 80.1

Imagga
created on 2019-02-18

portrait 40.8
hair 32.5
grandma 30.8
person 29.7
face 28.4
blond 27.4
adult 25.9
mother 23.5
people 23.4
attractive 21.7
old 20.9
senior 20.6
lady 20.3
model 20.2
fashion 19.6
pretty 19.6
elderly 18.2
makeup 17.5
smile 17.1
expression 17.1
mature 16.8
women 16.6
sexy 16.1
cute 15.8
retired 15.5
bow tie 15.4
skin 15.4
head 15.1
happy 14.4
retirement 14.4
looking 14.4
wig 13.8
eyes 13.8
make 13.6
one 13.4
human 12.8
clothing 12.4
man 12.1
grandmother 11.8
older 11.7
black 11.6
smiling 11.6
hairstyle 11.4
necktie 11.4
look 11.4
casual 11
sculpture 11
close 10.8
closeup 10.8
representation 10.6
parent 10.5
health 10.4
cosmetics 10.3
love 10.3
happiness 10.2
lifestyle 10.1
aged 10
gray 9.9
statue 9.9
studio 9.9
body 9.6
age 9.5
hairpiece 9.5
healthy 9.5
child 9.4
pensioner 9.3
male 9.3
hand 9.2
sketch 9.2
lovely 8.9
pension 8.9
garment 8.8
curly 8.7
hands 8.7
art 8.7
elegant 8.6
females 8.5
lips 8.3
holding 8.3
care 8.2
alone 8.2
style 8.2
cheerful 8.1
antique 8
posing 8
attire 7.7
culture 7.7
youth 7.7
elegance 7.6
passion 7.5
fun 7.5
natural 7.4
sensuality 7.3
gorgeous 7.3
pose 7.3
home 7.2
eye 7.2
indoors 7

Google
created on 2019-02-18

Photograph 96.5
Picture frame 89.2
Drawing 73.4
Illustration 71
Portrait 70.8
Art 69.5
Stock photography 65.4
Photography 62.4
Vintage clothing 58
Black-and-white 56.4
Sketch 50.1

Microsoft
created on 2019-02-18

gallery 94.7
room 74
picture frame 30.4
art 30.4
museum 28.9
portrait 10.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-90
Gender Male, 98.2%
Calm 60.5%
Surprised 3%
Angry 3%
Happy 1.4%
Disgusted 1.6%
Confused 27%
Sad 3.5%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.8%

Captions

Microsoft

an old photo of a man 60.2%
old photo of a man 54.6%
an old photo of a man in a room 54.5%

Text analysis

Amazon

altv
rir
rfert altv rir
rfert