Human Generated Data

Title

William Hart (1823-1894)
Date

1860-1871
People

Artist: Unidentified Artist,

Sitter: William Hart, American 1823 - 1894

Artist: Henry Theodore Tuckerman, American 1813-1871
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.411.15

Human Generated Data

Title

William Hart (1823-1894)

People

Artist: Unidentified Artist,

Sitter: William Hart, American 1823 - 1894

Artist: Henry Theodore Tuckerman, American 1813-1871

Date

1860-1871

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Face 100
Human 100
Beard 97.5
Person 96.7
Coat 85.5
Apparel 85.5
Clothing 85.5
Suit 85.5
Overcoat 85.5
Drawing 85.2
Art 85.2
Floor 78.3
Wood 73
Portrait 72.8
Photo 72.8
Photography 72.8
Flooring 72.5
Text 56.8
Sketch 56

Clarifai
created on 2019-02-18

people 97.5
portrait 97.4
adult 94.2
art 92.7
man 92.5
one 92.4
retro 91.9
wear 87.5
old 87
facial hair 82.6
elderly 81.3
painting 78.3
vintage 76.7
picture frame 75.8
nostalgia 73.7
leader 73.5
mustache 71.3
fashion 67.8
elegant 67.8
wedding 67.2

Imagga
created on 2019-02-18

man 32.3
person 28.4
senior 25.3
portrait 25.2
male 22.7
adult 22.2
old 21.6
face 21.3
people 21.2
elderly 20.1
sculpture 20
statue 15.2
one 14.9
mature 14.9
looking 14.4
expression 13.7
home 13.6
head 13.4
happy 13.2
alone 12.8
hair 12.7
older 12.6
retired 12.6
close 12.6
covering 12.4
businessman 12.4
mug shot 12.2
business 12.2
handsome 11.6
clothing 11.4
grandma 11.1
mask 11
representation 11
antique 10.6
retirement 10.6
serious 10.5
black 10.3
glasses 10.2
smiling 10.1
wall clock 10
currency 9.9
human 9.8
art 9.6
photograph 9.5
closeup 9.4
clock 9.3
suit 9.1
studio 9.1
gray 9
professional 8.9
marble 8.8
sad 8.7
lifestyle 8.7
work 8.6
happiness 8.6
eyes 8.6
smile 8.6
culture 8.5
emotion 8.3
historic 8.3
aged 8.1
history 8.1
look 7.9
standing 7.8
hand 7.7
disguise 7.7
casual 7.6
shirt 7.5
bust 7.3
cash 7.3
bank 7.2

Google
created on 2019-02-18

Photograph 96.3
Picture frame 84.4
Portrait 79.9
Gentleman 79.6
Facial hair 78.2
Moustache 74.5
Vintage clothing 74
Illustration 70.1
Drawing 68.4
Stock photography 67.6
Art 62.5
Photography 62.4
Black-and-white 56.4
Beard 55.1
Style 51
Self-portrait 50.9

Microsoft
created on 2019-02-18

picture frame 10.4
art 10.4
museum 4.4
portrait 2.1
old 1.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 99.2%
Happy 2.7%
Confused 13.9%
Calm 68.1%
Surprised 5%
Disgusted 0.6%
Sad 4.3%
Angry 5.4%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%
Suit 85.5%

Captions

Microsoft

an old photo of a person 57.2%
old photo of a person 49.4%
an old photo of a person 49.3%

Text analysis

Amazon

illiamn
illiamn Sart
Sart