Human Generated Data

Title

John Knowles Paine (1839-1906)
Date

c. 1885-1890
People

Artist: Caroline A. Cranch, American 1853 - 1931

Sitter: John Knowles Paine, 1839 - 1906
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Bequest of Mrs. Mary E. Paine to Harvard College, 1920, H243

Human Generated Data

Title

John Knowles Paine (1839-1906)

People

Artist: Caroline A. Cranch, American 1853 - 1931

Sitter: John Knowles Paine, 1839 - 1906

Date

c. 1885-1890

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2022-06-10

Art 99
Art 98.1
Human 93.4
Person 93.4
Human 92.1
Person 92.1
Accessories 91.8
Accessory 91.8
Glasses 91.8
Painting 84.1
Accessories 75.7
Glasses 75.7
Accessory 75.7
Painting 62.7
Face 62.4
Photography 57.6
Photo 57.6
Portrait 57.6
Face 55.7
Portrait 55
Photo 55
Photography 55

Clarifai
created on 2020-04-24

people 99.8
portrait 99.8
one 99.6
mustache 99.2
facial hair 99.1
man 99
adult 98.9
wear 95.5
leader 88.6
profile 86.5
writer 86.3
elderly 85.6
painting 85.2
art 84.3
eyeglasses 83.7
scientist 82.8
eyewear 82.6
side view 80.8
music 78.5
goatee 75.8

Imagga
created on 2022-06-10

man 62.6
man 60.6
male 54.7
male 52.6
person 50.4
portrait 47.3
person 46.3
portrait 44.7
face 36.3
handsome 35.7
adult 35.7
handsome 34.8
suit 34.1
businessman 33.6
adult 33.1
people 33
suit 32.5
expression 32.5
face 32
businessman 31.8
senior 29.1
mature 28.9
looking 28.8
people 27.9
expression 27.3
looking 27.2
executive 25.9
tie 25.7
executive 25.3
guy 25
business 25
black 24.7
tie 23.8
black 23.6
head 23.6
head 23.5
manager 23.3
business 23.1
serious 22.9
eyes 22.4
old 22.3
necktie 22
eyes 21.5
bow tie 21.4
mature 21.4
glasses 21.3
one 20.9
men 20.6
hair 20.6
men 20.6
professional 20.2
professional 19.7
one 19.4
confident 19.1
happy 18.8
human 18.8
smile 18.6
look 18.4
guy 18.4
necktie 18.3
serious 18.2
beard 17.9
shirt 17.8
close 17.7
confident 17.3
human 17.3
baron 17.2
corporate 17.2
corporate 17.2
happy 16.9
manager 16.8
look 16.7
grandfather 16.1
dark 15.9
hair 15.9
smile 15.7
elderly 15.3
judge 15.3
office 15.3
dark 15.1
senior 15
shirt 15
glasses 14.8
attractive 14.7
successful 14.7
old 14.7
success 14.5
smiling 14.5
smiling 14.5
bow tie 14.3
beard 13.7
success 13.7
judge 13.7
older 13.6
boss 13.4
age 13.4
baron 13
clothing 13
office 12.9
casual 12.7
casual 12.7
gray 12.6
close 12.6
retirement 12.5
garment 12.5
studio 12.2
sad 11.6
lifestyle 11.6
studio 11.4
standing 11.3
work 11
successful 11
jacket 10.9
masculine 10.7
retired 10.7
jacket 10.6
cheerful 10.6
attractive 10.5
thinking 10.5
thinking 10.5
mustache 10.4
work 10.2
aged 10
scholar 9.9
intellectual 9.9
hand 9.9
pensive 9.8
sad 9.7
think 9.6
supporter 9.6
confidence 9.6
emotion 9.2
emotion 9.2
friendly 9.2
hand 9.1
clothing 9
speaker 8.8
pensive 8.8
masculine 8.8
closeup 8.8
tired 8.8
husband 8.7
standing 8.7
hands 8.7
hands 8.7
collar 8.6
happiness 8.6
boss 8.6
garment 7.9
worried 7.9
boy 7.8
sadness 7.8
sadness 7.8
angry 7.8
problems 7.8
father 7.8
thoughtful 7.8
hope 7.7
laugh 7.7
confidence 7.7
facial 7.7
stress 7.7
elderly 7.7
grandfather 7.4
occupation 7.3
worker 7.3
aged 7.2
lifestyle 7.2
gray 7.2
articulator 7.2
cool 7.1
metropolitan 7.1
happiness 7.1

Google
created on 2022-06-10

Forehead 98.5
Portrait 97.8
Glasses 96.6
Self-portrait 95.9
Eyebrow 94.2
Beard 92
Jaw 87.9
Chin 86.5
Painting 85.9
Facial hair 84.6
Art 83.3
Collar 82.5
Suit 81
Moustache 78.6
Blazer 78.1
Tie 78
Self-portrait 76.2
Painting 74.2
Art 67.7
Formal wear 66.6
No expression 66.3
Visual arts 64.8
Dress shirt 61.7
Illustration 57.9
Jaw 57.4
Portrait 56.4

Microsoft
created on 2020-04-24

painting 99.9
drawing 99.7
sketch 99.2
person 99.1
man 99
person 98.9
human face 98.7
man 98.5
painting 97.7
art 95.6
human face 95.5
portrait 91.5
drawing 89.5
portrait 88
text 82.6
sketch 81.3
face 80.6
art 75.6
human beard 74.7
face 69.6
child art 69.5
dark 57.8
clothing 53.4
beard 51.8
self-portrait 50.9
staring 16.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Male, 96.2%
Sad 1.3%
Happy 0.8%
Confused 3%
Angry 0.6%
Calm 93.4%
Surprised 0.6%
Fear 0.1%
Disgusted 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99%
Calm 85.2%
Surprised 6.8%
Fear 6.2%
Sad 5.8%
Confused 3%
Angry 1.2%
Disgusted 1.1%
Happy 0.5%

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.4%
Glasses 91.8%
Painting 84.1%

Captions

Microsoft

a man looking at the camera 80.4%
a man looking at the camera 78.1%
a man in a dark room 77.4%
a man wearing glasses 67.1%
a man wearing a suit and tie 67%
a man taking a selfie in a dark room 57.9%