Human Generated Data

Title

John Winthrop (1588-1649)

Date

c. 1750-1775

People

Artist: Unidentified Artist,

Sitter: John Winthrop, 1588-1649

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Gift of Adam Winthrop, 1840, H8

Human Generated Data

Title

John Winthrop (1588-1649)

People

Artist: Unidentified Artist,

Sitter: John Winthrop, 1588-1649

Date

c. 1750-1775

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 96.4
Painting 96.4
Human 90.7
Person 90.7
Portrait 56.1
Face 56.1
Photo 56.1
Photography 56.1

Clarifai
created on 2018-03-16

people 99.7
portrait 99.2
one 99
adult 99
painting 97.4
art 96.5
wear 94.6
woman 94.6
lid 92.2
man 90.3
indoors 89.4
illustration 87
knitwear 84.7
veil 84.2
winter 83.3
print 82.2
popularity 81
sweater 80.5
musician 80
cap 76.4

Imagga
created on 2018-03-16

portrait 31.1
face 28.4
person 27.9
man 27.5
male 27
people 24.5
black 23.8
adult 23.4
chain mail 23.3
covering 19.3
body armor 18.7
fashion 16.6
attractive 16.1
mask 15.7
armor 15.5
protective covering 15.5
model 14.8
old 14.6
book jacket 14.3
dark 14.2
eyes 13.8
religion 13.4
serious 13.3
costume 13.3
jacket 13.3
clothing 13.1
sexy 12.8
hair 12.7
ski mask 12.1
human 12
one 11.9
expression 11.9
pretty 11.9
lady 11.4
hat 11
hand 10.6
religious 10.3
world 10.2
ruler 9.9
guy 9.9
handsome 9.8
evil 9.7
face mask 9.7
beard 9.5
happy 9.4
lifestyle 9.4
casual 9.3
smile 9.3
holding 9.1
posing 8.9
looking 8.8
look 8.8
horror 8.7
scary 8.7
hands 8.7
love 8.7
mystery 8.6
spiritual 8.6
wrapping 8.5
head 8.4
fantasy 8.1
brunette 7.8
pray 7.8
sitting 7.7
prayer 7.7
culture 7.7
style 7.4
disguise 7.3
sensuality 7.3
smiling 7.2
work 7.1

Google
created on 2018-03-16

portrait 91.8
facial hair 91.5
painting 88.5
gentleman 82.9
art 76
beard 69.2
artwork 54.4

Microsoft
created on 2018-03-16

person 98.3
man 93.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 90.8%
Angry 4.5%
Calm 29.6%
Happy 9.3%
Disgusted 4.2%
Surprised 6.3%
Sad 28.4%
Confused 17.7%

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.4%
Person 90.7%

Captions

Microsoft

John Winthrop holding a cat 16.5%
John Winthrop looking at the camera 16.4%
a close up of John Winthrop 16.3%