Human Generated Data

Title

Loammi Baldwin, Jr. (1780-1838); verso: Study for Female Head
Date

1823
People

Artist: Washington Allston, American 1779 - 1843
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. Robert Rantoul Endicott, 1955.168

Human Generated Data

Title

Loammi Baldwin, Jr. (1780-1838); verso: Study for Female Head

People

Artist: Washington Allston, American 1779 - 1843

Date

1823

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Art 98
Painting 98
Person 75.3
Human 75.3
Portrait 60.1
Face 60.1
Photography 60.1
Photo 60.1

Clarifai
created on 2018-03-23

people 100
painting 99.8
one 99.7
adult 99.5
portrait 99.5
art 99.3
man 96.9
wear 95.6
elderly 93.5
scientist 93.2
side view 92.9
leader 92.4
poetry 90.2
illustration 87.7
Renaissance 87.6
print 86.4
profile 82.4
old 82.1
facial hair 80.1
writer 79.7

Imagga
created on 2018-03-23

neck brace 48.2
man 47
brace 38.5
male 34.8
portrait 31.7
strengthener 28.9
face 28.4
support 28.3
person 26.3
people 25.7
handsome 24.1
adult 23.7
couple 20.9
love 20.5
black 20.3
happy 20.1
hair 19.8
senior 18.7
eyes 18.1
beard 17.1
attractive 16.8
look 16.6
smile 16.4
old 16
together 14.9
close 14.8
husband 14.5
smiling 13.7
guy 13.7
expression 13.6
looking 12.8
casual 12.7
mustache 12.5
elderly 12.4
wife 12.3
lifestyle 12.3
head 11.8
hands 11.3
human 11.2
grandmother 10.8
romance 10.7
family 10.7
world 10.6
married 10.5
grandfather 10.3
men 10.3
confident 10
lady 9.7
one 9.7
mother 9.7
serious 9.5
shirt 9.3
mature 9.3
gray 9
sexy 8.8
skin 8.8
home 8.8
closeup 8.8
retired 8.7
sad 8.7
grandma 8.7
nose 8.6
pretty 8.4
fashion 8.3
friendly 8.2
outdoors 8.2
citizen 7.9
elder 7.9
happiness 7.8
boy 7.8
masculine 7.8
model 7.8
sitting 7.7
retirement 7.7
loving 7.6
age 7.6
marriage 7.6
dark 7.5
father 7.5
cipher 7.5
glasses 7.4
business 7.3
professional 7.2

Google
created on 2018-03-23

portrait 96.6
painting 90
art 81.4
chin 79.1
self portrait 74.5
gentleman 67.2
visual arts 58.6

Microsoft
created on 2018-03-23

person 98.1
man 96.2
dark 54.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 95.6%
Calm 31.3%
Confused 5%
Angry 4.8%
Happy 2.5%
Disgusted 5.9%
Surprised 2.2%
Sad 48.5%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98%
Person 75.3%

Captions

Microsoft

a man that is standing in the dark 51.4%
a man looking at the camera 51.3%
a man standing in the dark 45.1%