Human Generated Data

Title

Samuel Winthrop (1716-1779)
Date

c. 1773
People

Artist: John Singleton Copley, American 1738 - 1815

Sitter: Samuel Winthrop, 1716 - 1779
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Gift to Harvard College by the executors of the estate of John Winthrop and heirs of Mrs. Andrews, 1894, H21

Human Generated Data

Title

Samuel Winthrop (1716-1779)

People

Artist: John Singleton Copley, American 1738 - 1815

Sitter: Samuel Winthrop, 1716 - 1779

Date

c. 1773

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 97
Human 97
Art 95.9
Painting 92.9
Bird 60.3
Animal 60.3

Clarifai
created on 2018-03-23

people 99.5
adult 98.8
portrait 98.6
gown (clothing) 97.5
one 96.7
gown 96.5
wear 96.2
woman 96.2
two 95
painting 94.9
man 92.6
book series 91.9
religion 91.9
lid 89.1
dress 88.9
ceremony 88.8
administration 88.2
cape 87.2
royalty 86.2
theater 86.1

Imagga
created on 2018-03-23

man 49.1
suit 47.2
male 41.9
person 36.7
businessman 34.5
portrait 33
executive 31
black 28.7
business 28.6
people 28.5
adult 27.8
tie 24.7
professional 23.3
face 22
handsome 21.4
success 20.1
clothing 19.8
fashion 19.6
corporate 18.9
model 17.1
hand 16.7
men 16.3
happy 16.3
expression 16.2
office 16.1
metropolitan 16
attractive 15.4
baron 14.6
confident 14.6
manager 14
studio 13.7
guy 13.5
job 13.3
couple 13.1
hands 13
garment 13
hair 12.7
work 12.6
dark 12.5
smile 12.1
dress 11.8
serious 11.4
look 11.4
sexy 11.3
successful 11
covering 11
lifestyle 10.8
senior 10.3
elegant 10.3
love 10.3
glasses 10.2
smiling 10.1
worker 10.1
holding 9.9
looking 9.6
formal 9.6
jacket 9.6
judge 9.6
eyes 9.5
money 9.4
head 9.2
old 9.1
director 9
style 8.9
posing 8.9
standing 8.7
partnership 8.6
happiness 8.6
relationship 8.4
occupation 8.3
alone 8.2
lady 8.1
shirt 8.1
together 7.9
pretty 7.7
boss 7.7
two 7.6
career 7.6
meeting 7.5
human 7.5
clothes 7.5
robe 7.5
one 7.5
sensual 7.3
ruler 7.2
consumer goods 7.1
to 7.1

Google
created on 2018-03-23

portrait 90.2
gentleman 83.6
painting 81.2
art 61.8
modern art 60.2
elder 57.4
barrister 56.7
official 51

Microsoft
created on 2018-03-23

person 96.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-66
Gender Male, 99.4%
Happy 0.3%
Confused 1.9%
Sad 1.9%
Angry 1.1%
Calm 94.2%
Disgusted 0.2%
Surprised 0.3%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Painting 92.9%
Bird 60.3%

Captions

Microsoft

a person wearing a suit and tie 87.5%
a person holding a cat 30%
a person in a suit and tie 29.9%