Human Generated Data

Title

Portrait of a Monk
Date

17th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.104

Human Generated Data

Title

Portrait of a Monk

People

Artist: Unidentified Artist,

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.104

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 98.5
Painting 98.5
Person 88.3
Human 88.3

Clarifai
created on 2018-02-09

people 99.9
portrait 99.7
one 99.4
adult 99.1
man 97.6
painting 97
art 96.3
old 94
leader 93.8
print 90.6
wear 90.4
writer 90
side view 89.4
poet 88.4
scientist 87.8
mustache 86.6
politician 85.3
facial hair 84.8
vintage 83.1
profile 82.5

Imagga
created on 2018-02-09

man 45.7
male 42.1
portrait 40.1
person 36.7
people 29.6
adult 27.8
face 27.7
black 24.3
handsome 22.3
serious 21
old 18.1
happy 17.5
eyes 17.2
expression 17.1
senior 16.9
close 16
dark 15.9
mature 15.8
couple 14.8
grandfather 14.6
smiling 14.5
casual 14.4
hair 14.3
smile 14.3
guy 14.1
model 14
looking 13.6
one 13.4
head 13.4
look 13.1
men 12.9
human 12.7
love 12.6
attractive 12.6
beard 12.4
glasses 12
retired 10.7
studio 10.6
elderly 10.5
together 10.5
age 10.5
wife 10.4
confident 10
boy 9.7
husband 9.5
lifestyle 9.4
grandma 9.3
depression 8.8
professional 8.7
aged 8.1
closeup 8.1
work 8
grandmother 7.8
hands 7.8
think 7.7
retirement 7.7
married 7.7
god 7.7
cipher 7.6
loving 7.6
hand 7.6
ruler 7.6
alone 7.3
lady 7.3
gray 7.2
clothing 7.2
baron 7.2
double 7.1
cool 7.1

Google
created on 2018-02-09

portrait 96.5
head 86
chin 85.3
painting 82
self portrait 79.3
forehead 78.8
art 76
gentleman 74.8
facial hair 73.4
elder 59.2
visual arts 54.9
stock photography 50.9

Microsoft
created on 2018-02-09

person 99.2
man 98.3
wall 96.1
indoor 86.1
old 49.6
posing 36.7
older 21.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 99.7%
Angry 1.7%
Calm 61.7%
Sad 34.3%
Happy 0.1%
Confused 1.6%
Surprised 0.4%
Disgusted 0.2%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.5%
Person 88.3%

Categories

Imagga

people portraits 94.6%
paintings art 5.4%

Captions

Microsoft
created on 2018-02-09

a man looking at the camera 86.8%
a person posing for the camera 86.7%
a man posing for the camera 86.6%