Human Generated Data

Title

Portrait of an Elderly Man
Date

17th century
People

Artist: Diego Rodriguez Velázquez, Spanish 1599 - 1660
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Edwin H. Abbot, 1966.30

Human Generated Data

Title

Portrait of an Elderly Man

People

Artist: Diego Rodriguez Velázquez, Spanish 1599 - 1660

Date

17th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 94.6
Person 94.6
Art 92.2
Face 76.9
Painting 74.5
Photo 70.9
Portrait 70.9
Photography 70.9

Clarifai
created on 2020-04-24

people 100
portrait 99.9
one 99.8
adult 99.5
scientist 98.7
facial hair 98.6
leader 98.6
man 98.4
print 97.4
mustache 97.2
engraving 97.1
wear 96.8
art 96.8
administration 94.1
poet 93.2
writer 93.2
elderly 92
painting 91.2
professor 91.1
politician 90.2

Imagga
created on 2020-04-24

man 49.8
senior 47.8
male 41.9
person 40.5
portrait 38.9
old 34.9
grandma 34.6
adult 34.3
mature 31.6
grandfather 31.2
people 30.2
elderly 26.8
handsome 25
face 24.9
black 24.3
businessman 23.9
looking 23.2
suit 22.2
hair 21.4
gray 20.7
expression 20.5
glasses 19.5
older 19.4
happy 18.8
retired 18.4
business 18.2
professional 18.2
serious 18.1
eyes 18.1
men 17.2
executive 16.4
work 14.9
manager 14.9
confident 14.6
old-timer 14.4
age 14.3
smile 14.3
look 14
one 13.5
couple 13.1
beard 12.9
office 12.9
human 12.8
head 12.6
dark 12.5
retirement 12.5
smiling 12.3
mug shot 12.1
close 12
success 11.3
corporate 11.2
aged 10.9
elder 10.8
grandmother 10.8
depression 10.7
husband 10.7
tie 10.4
lifestyle 10.1
successful 10.1
baron 10
citizen 9.9
gray hair 9.9
modern 9.8
masculine 9.8
sad 9.7
aging 9.6
wife 9.5
love 9.5
photograph 9.4
casual 9.3
friendly 9.2
lady 8.9
wrinkles 8.9
star 8.9
sadness 8.8
boss 8.6
sitting 8.6
shirt 8.5
pensioner 8.4
hand 8.4
alone 8.2
mother 8.1
eye 8
job 8
working 8
depressed 7.9
worried 7.8
hands 7.8
60s 7.8
actor 7.8
hope 7.7
attractive 7.7
married 7.7
formal 7.6
nose 7.6
guy 7.5
outdoors 7.5
microphone 7.4
representation 7.3
jacket 7.3
worker 7.1
pretty 7

Google
created on 2020-04-24

Photograph 95.8
Portrait 92.8
Self-portrait 83.1
Art 62.5
Stock photography 62.1
Historian 57.9
Facial hair 55.5
Physicist 52.1
Painting 51.9
Picture frame 50.8

Microsoft
created on 2020-04-24

drawing 99.8
sketch 99.8
painting 99.6
text 99.5
person 98.5
man 97.6
human face 93.8
portrait 90.6
art 84.1
old 71.3
child art 70.8
posing 47.6
staring 28.9
picture frame 7.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 98.3%
Sad 1.5%
Surprised 0.1%
Calm 92.6%
Angry 0.5%
Fear 0%
Confused 5.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 67
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.6%
Painting 74.5%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 66.2%
a man that is standing in front of a mirror posing for the camera 56%
an old man standing in front of a mirror posing for the camera 55.6%