Human Generated Data

Title

Grenville Lindall Winthrop (1864-1943)
Date

1932
People

Artist: Augustus Vincent Tack, American 1870 - 1949
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.161

Human Generated Data

Title

Grenville Lindall Winthrop (1864-1943)

People

Artist: Augustus Vincent Tack, American 1870 - 1949

Date

1932

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 96.5
Person 96.5
Art 96
Painting 95
Furniture 78.3
Photo 56.2
Face 56.2
Photography 56.2
Portrait 56.2

Clarifai
created on 2018-04-19

one 99.5
people 99.5
adult 98.3
portrait 97.9
painting 97.7
man 96.4
elderly 94.2
art 93.8
sit 92.2
facial hair 91.3
indoors 91.3
leader 90.2
wear 89.9
furniture 86.8
chair 84.1
administration 83.9
religion 83.7
writer 83.5
mustache 83.5
seat 80.9

Imagga
created on 2018-04-19

man 57.8
executive 49.7
male 48.3
person 43.7
senior 43.1
businessman 41.5
suit 41.2
portrait 38.8
old 31.4
adult 31.1
mature 30.7
business 30.4
glasses 29.6
elderly 28.7
handsome 28.5
people 26.2
grandfather 26.1
black 25.9
professional 25.5
manager 24.2
looking 24
older 23.3
tie 22.8
face 22
office 21.7
speaker 20.2
confident 20
men 19.8
work 19.6
serious 19.1
hair 19
expression 18.8
ruler 18.2
boss 18.2
corporate 18
articulator 16.5
happy 16.3
worker 15.1
one 14.2
working 14.1
look 14
60s 13.7
hand 13.7
retired 13.6
human 13.5
job 13.3
lifestyle 13
smile 12.8
communicator 12.6
formal 12.4
smiling 12.3
studio 12.2
baron 12
modern 11.9
successful 11.9
laptop 11.8
judge 11.8
head 11.8
aged 10.9
gray hair 10.8
retirement 10.6
age 10.5
success 10.5
couple 10.5
desk 10.4
casual 10.2
occupation 10.1
friendly 10.1
expertise 9.7
computer 9.7
spiritual 9.6
standing 9.6
hands 9.6
eyes 9.5
smart 9.4
secretary 9.2
dark 9.2
alone 9.1
gray 9
leader 8.7
businesspeople 8.5
teacher 8
pensive 7.8
sitting 7.7
elegant 7.7
collar 7.7
thinking 7.6
communication 7.6
shirt 7.5
mustache 7.5
entrepreneur 7.4
room 7.3
stylish 7.2
pensioner 7.2
love 7.1

Google
created on 2018-04-19

portrait 93.8
painting 87.3
gentleman 85.1
art 71.8
elder 68.2
self portrait 59.1
human behavior 56.6
modern art 53
paint 52.1

Microsoft
created on 2018-04-19

person 92.1
old 69.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 99.6%
Calm 90.3%
Angry 1.2%
Confused 2.5%
Sad 3.1%
Disgusted 0.6%
Surprised 1.6%
Happy 0.7%

Microsoft Cognitive Services

Age 64
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.5%
Painting 95%

Captions

Microsoft

a man sitting in front of a building 83.1%
a man sitting in front of a brick wall 80.9%
a man sitting in front of a brick building 78.5%