Human Generated Data

Title

Charles IV, King of Spain
Date

c. 1789-1792
People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Loan from Nicholas Boyle, Edward Friedman, Gary Friedman, Theodore Mirvis, Matthew Rutenberg and Eric Seiler, 3.2017

Human Generated Data

Title

Charles IV, King of Spain

People

Artist: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

c. 1789-1792

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Art 96.8
Painting 93.3
Person 76.8
Human 76.8

Clarifai
created on 2018-02-19

people 100
famous 99.2
portrait 98.8
popularity 97.6
person 97
one 96.7
adult 95.5
man 91
mustache 90.8
jacket 89.5
wear 89.2
pop 88
leader 85.1
goatee 84.6
talent 84.4
bald 83.8
facial hair 82.1
facial expression 80.2
event 78.8
painting 78.1

Imagga
created on 2018-02-19

man 55.1
portrait 46
person 45.6
male 44
senior 36.6
face 35.5
handsome 34.8
adult 33
mature 30.7
beard 30.6
old 29.3
people 28.5
serious 25.8
looking 25.6
elderly 24.9
hair 24.6
expression 22.2
casual 21.2
black 21
guy 20.5
happy 20.1
glasses 19.5
confident 19.1
grandfather 19
smile 18.5
older 18.5
retired 18.4
one 17.9
eyes 17.2
men 17.2
age 17.2
head 16.8
look 16.7
model 16.3
retirement 16.3
attractive 15.4
grandma 14.8
professional 14.5
studio 14.4
gray 14.4
human 14.3
smiling 13.8
grandmother 13.7
close 13.1
bust 13
aged 12.7
businessman 12.4
lifestyle 12.3
love 11.1
dark 10.9
executive 10.8
baron 10.8
closeup 10.8
planner 10.5
thinking 10.5
shirt 10.5
sculpture 10.3
elder 9.9
modern 9.8
masculine 9.7
success 9.7
couple 9.6
standing 9.6
suit 9.3
successful 9.2
friendly 9.2
life 9
pensioner 8.9
gentleman 8.9
wrinkle 8.9
depression 8.8
boy 8.7
youth 8.5
smart 8.5
manager 8.4
mustache 8.2
skin 8.2
eye 8
sexy 8
cool 8
wrinkles 7.9
work 7.9
pensive 7.8
thoughtful 7.8
aging 7.7
collar 7.7
boss 7.7
marriage 7.6
wife 7.6
power 7.6
emotion 7.4
business 7.3
pose 7.3

Google
created on 2018-02-19

portrait 95.4
painting 90.1
chin 89.2
gentleman 81.3
forehead 79.5
elder 75.3
senior citizen 66.2
self portrait 66.1
art 60.3
facial hair 54.5
artwork 50.2

Microsoft
created on 2018-02-19

person 99.5
man 98.3
wall 96.4
old 55

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 99.7%
Angry 7%
Calm 52.4%
Confused 16.6%
Surprised 10.2%
Sad 6%
Disgusted 2.2%
Happy 5.6%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 93.3%
Person 76.8%

Captions

Microsoft

a man looking at the camera 85.8%
a man wearing a black shirt 76.1%
a man wearing a suit and tie 76%