Human Generated Data

Title

Mary Todd Lincoln (1818-1882) (untitled spirit photograph with Abraham Lincoln's shadow)
Date

1870s
People

Artist: William H. Mumler, American 1832 - 1884
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.88

Human Generated Data

Title

Mary Todd Lincoln (1818-1882) (untitled spirit photograph with Abraham Lincoln's shadow)

People

Artist: William H. Mumler, American 1832 - 1884

Date

1870s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Bonnet 100
Hat 100
Clothing 100
Apparel 100
Person 97.6
Human 97.6

Clarifai
created on 2018-04-18

people 99.9
one 99.5
portrait 99.4
adult 98.7
wear 97.8
man 97.3
veil 94.4
art 93.6
lid 93
leader 92.2
print 91
administration 90.5
outerwear 89.1
military 87.6
retro 85.9
soldier 85.9
painting 85.4
facial hair 83.5
war 78.1
outfit 77.8

Imagga
created on 2018-04-18

mask 59
covering 54
disguise 38.1
face 31.3
portrait 29.8
person 28.8
child 26.5
clothing 26.1
attire 24.4
eyes 23.2
people 22.9
boy 17.4
doll 17.3
plaything 17
expression 16.2
adult 16.2
hat 16
hair 15.9
cute 15.8
old 15.3
cloak 14.8
model 14.8
ski mask 14.3
childhood 14.3
blond 13.5
kid 13.3
fashion 12.8
children 12.8
human 12.7
attractive 12.6
male 12.3
black 12.1
sexy 12
youth 11.9
pretty 11.9
head 11.8
face mask 11.5
sculpture 11.4
man 11.4
smile 11.4
happy 11.3
culture 11.1
studio 10.6
consumer goods 10.6
costume 10.6
girls 10
religion 9.9
cheerful 9.8
lady 9.7
look 9.6
art 9.4
fun 9
one 9
little 8.8
looking 8.8
smiling 8.7
lifestyle 8.7
happiness 8.6
close 8.6
dark 8.4
closeup 8.1
antique 7.8
cold 7.8
world 7.7
ethnicity 7.7
winter 7.7
serious 7.6
casual 7.6
hairstyle 7.6
statue 7.6
traditional 7.5
lips 7.4
book 7.3
decoration 7.2
coat 7.2
eye 7.1
handsome 7.1

Google
created on 2018-04-18

photograph 95.4
portrait 87.2
vintage clothing 76.7
art 66.3
headgear 63.8
visual arts 53.7
painting 53.1
girl 51.9

Microsoft
created on 2018-04-18

person 99
old 76.8
white 70.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 80.4%
Confused 4%
Calm 70.7%
Disgusted 2.1%
Surprised 1.9%
Sad 8.7%
Angry 5.1%
Happy 7.4%

Microsoft Cognitive Services

Age 73
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Captions

Microsoft

a black and white photo of Mary Todd Lincoln 86.2%
Mary Todd Lincoln sitting on a white surface 74%
Mary Todd Lincoln sitting on a white background 73.9%