Human Generated Data

Title

Jedidiah Morse (1761-1826)
Date

1823
People

Artist: Samuel Finley Breese Morse, American 1791 - 1872
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.142

Human Generated Data

Title

Jedidiah Morse (1761-1826)

People

Artist: Samuel Finley Breese Morse, American 1791 - 1872

Date

1823

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 98.7
Art 98.7
Person 94.5
Human 94.5
Wood 56.9

Clarifai
created on 2018-03-23

people 99.9
portrait 99.8
one 99.4
adult 99.1
painting 98.9
art 97.7
man 96.9
leader 96.8
illustration 91.9
old 91
wear 88.1
elderly 88
print 85.2
politician 83
mustache 82.7
administration 82.6
chair 81.7
writer 81.6
facial hair 80.8
poet 80.3

Imagga
created on 2018-03-23

man 51.8
senior 43.1
male 40.5
portrait 39.5
old 34.9
elderly 33.5
judge 32.6
person 32.1
adult 30.4
mature 29.8
businessman 28.3
baron 27.2
grandfather 26.8
handsome 26.8
people 24
face 23.5
executive 23.1
looking 21.6
expression 21.3
black 21
suit 20.3
hair 19.8
glasses 19.5
business 19.4
happy 19.4
retired 18.4
professional 18.3
older 17.5
retirement 17.3
men 17.2
gray 17.1
smile 16.4
tie 16.1
eyes 15.5
one 14.9
manager 14.9
confident 14.6
age 14.3
metropolitan 14
ruler 13.8
grandmother 13.7
aged 13.6
head 13.4
boss 13.4
serious 13.4
couple 13.1
smiling 12.3
look 12.3
friendly 11.9
casual 11.9
grandma 11.8
60s 11.7
studio 11.4
standing 11.3
work 11
husband 10.5
close 10.3
love 10.3
lifestyle 10.1
guy 10.1
closeup 10.1
citizen 9.9
gray hair 9.9
corporate 9.5
occupation 9.2
successful 9.2
alone 9.1
hand 9.1
elevator 9
human 9
worker 8.9
elder 8.9
wrinkles 8.9
success 8.9
pensioner 8.8
masculine 8.8
wife 8.5
beard 8.5
attractive 8.4
dark 8.4
job 8
working 8
aging 7.7
marriage 7.6
shirt 7.5
lifting device 7.2
office 7.2

Google
created on 2018-03-23

portrait 95.2
painting 86.3
gentleman 82.2
elder 74.9
art 72.5
picture frame 69.8
stock photography 53.1

Microsoft
created on 2018-03-23

man 90.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 95.3%
Sad 3%
Calm 76.1%
Confused 8.6%
Disgusted 1.4%
Surprised 2.6%
Happy 4.8%
Angry 3.5%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.7%
Person 94.5%

Captions

Microsoft

a man standing in front of a door 67.2%
a man standing on top of a wooden door 52%
a man standing in front of a wooden door 51.9%