Human Generated Data

Title

Morris Gest (1881-1942)
Date

20th century
People

Artist: Boris Grigoryev, Russian 1886 - 1939
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of James N. Rosenberg, 1929.122

Human Generated Data

Title

Morris Gest (1881-1942)

People

Artist: Boris Grigoryev, Russian 1886 - 1939

Date

20th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-17

Painting 98.8
Art 98.8
Person 87.3
Human 87.3

Clarifai
created on 2019-04-17

people 99.8
painting 99.8
adult 99.7
one 98.9
illustration 98.4
furniture 98
man 98
art 97.1
wear 96.7
book series 96.6
print 96.5
religion 96.2
veil 96.2
facial expression 95.3
text 94.5
seat 94.5
lid 93.5
book bindings 93.4
group 92.7
portrait 92.5

Imagga
created on 2019-04-17

man 49.7
person 38.5
male 38.4
office 28.6
people 27.3
business 26.1
adult 25.2
computer 23.6
laptop 23
happy 22.6
senior 22.5
working 22.1
businessman 21.2
sitting 20.6
smiling 20.3
indoors 20.2
portrait 20.1
smile 19.2
desk 18.9
handsome 18.7
student 18.4
work 18.1
suit 17.9
professional 17.8
home 17.5
scholar 17.1
glasses 16.7
intellectual 16.6
elderly 16.3
reading 16.2
mature 14.9
table 14.7
old 14.6
corporate 14.6
retired 14.5
tie 14.2
executive 13.8
paper 13.3
men 12.9
friendly 12.8
face 12.8
book 12.7
retirement 12.5
lifestyle 12.3
looking 12
happiness 11.8
guy 11.7
job 11.5
jacket 11.4
worker 11.1
painter 11.1
room 11
attractive 10.5
hair 10.3
confident 10
education 9.5
inside 9.2
successful 9.2
teacher 9
one 9
together 8.8
older 8.7
couple 8.7
writing 8.5
sit 8.5
casual 8.5
relaxed 8.4
black 8.4
study 8.4
technology 8.2
school 8.1
success 8
money 7.7
serious 7.6
workplace 7.6
hand 7.6
one person 7.5
manager 7.5
holding 7.4
teen 7.4
relaxing 7.3
businesswoman 7.3
grandfather 7.3
notebook 7.2
religion 7.2
look 7

Google
created on 2019-04-17

Painting 86.4
Art 81.8
Visual arts 66.9
Self-portrait 62.6
Artist 56.3

Microsoft
created on 2019-04-17

person 92.2
indoor 86.4
art 86.4
book 46.7
illustration 24.8
museum 23.5
painting 16.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 98.8%
Angry 10.7%
Calm 43%
Surprised 5.4%
Disgusted 4.6%
Confused 12.1%
Sad 22.9%
Happy 1.4%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.8%
Person 87.3%

Captions

Microsoft

a man sitting at a table with a cake 42.8%
a man holding a piece of cake on a table 32.5%
a man sitting on a table 32.4%

Text analysis

Amazon

oi
oi GesOR
GesOR