Human Generated Data

Title

Denman W. Ross (1853-1935)
Date

1928
People

Artist: Kanji Nakamura, American 1887 - 1932
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Paul J. Sachs, 1938.125

Human Generated Data

Title

Denman W. Ross (1853-1935)

People

Artist: Kanji Nakamura, American 1887 - 1932

Date

1928

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.5
Person 97.5
Apparel 95.8
Clothing 95.8
Face 93.5
Overcoat 92.1
Coat 92.1
Suit 92.1
Text 91
Portrait 70.9
Photography 70.9
Photo 70.9
Photo Booth 57.9
Tuxedo 56.5

Clarifai
created on 2020-04-24

people 99.9
portrait 99.8
one 99.7
adult 98.8
leader 98.2
man 96.7
wear 95.5
administration 94.3
scientist 90.1
print 87
politician 85.9
engraving 85.7
writer 85
elderly 82.5
art 79
chair 76.5
facial hair 75
poet 74.5
old 73.2
bald 70.3

Imagga
created on 2020-04-24

suit 61.9
businessman 60.1
man 54.5
male 49.7
person 49.6
handsome 46.4
portrait 40.8
business 40.8
executive 40.3
professional 35.3
senior 33.8
tie 33.3
adult 31.8
people 29.6
confident 29.2
mature 28.9
face 28.5
corporate 27.5
looking 27.2
manager 26.1
success 25
office 24.9
old 24.4
glasses 24.1
men 24.1
expression 23.1
successful 22.9
happy 20.7
boss 20.1
black 20.1
garment 19.8
elderly 19.2
modern 19
one 18.7
grandma 18.4
clothing 17.4
work 17.3
gray 17.2
shirt 16.8
serious 16.2
casual 16.1
job 15.9
formal 15.3
smiling 15.2
human 15
smile 15
occupation 14.7
hair 14.3
businesspeople 14.3
alone 13.7
confidence 13.4
standing 13.1
lifestyle 13
necktie 12.9
friendly 12.8
worker 12.6
cheerful 12.2
grandfather 12.2
gray hair 11.8
baron 11.6
age 11.4
close 11.4
look 11.4
happiness 11
businessperson 10.7
only 10.5
attractive 10.5
jacket 10.4
company 10.2
guy 10.1
head 10.1
secretary 9.9
planner 9.8
older 9.7
expertise 9.7
1 9.7
mobile 9.4
outside 9.4
communication 9.3
hand 9.1
stylish 9.1
working 8.9
40s 8.8
retired 8.7
leader 8.7
retirement 8.7
leadership 8.7
collar 8.6
fashionable 8.5
call 8.5
covering 8.4
consumer goods 8.3
phone 8.3
indoor 8.2
building 7.9
love 7.9
couple 7.9
scholar 7.8
color 7.8
cellphone 7.8
lawyer 7.8
eyes 7.8
content 7.7
corporation 7.7
mid adult 7.7
studio 7.6
smart 7.5
one person 7.5
aged 7.3
computer 7.2
intellectual 7.2
teacher 7
model 7

Google
created on 2020-04-24

Photograph 96.7
Portrait 91.2
Self-portrait 78.4
Art 67.7
Stock photography 65.4
Photography 62.4
Black-and-white 56.4
Painting 54.7
Picture frame 50.8

Microsoft
created on 2020-04-24

text 99.5
person 98.9
man 98.6
human face 96.8
wall 95
sketch 94.8
drawing 93.4
portrait 90.4
posing 85.7
wearing 85.5
black 82.7
suit 81.9
clothing 79.9
white 77.2
old 75.3
painting 74.8
door 63.5
black and white 62.5
tie 52.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-65
Gender Male, 95.4%
Calm 97.7%
Disgusted 0.1%
Happy 0%
Surprised 0.1%
Sad 0.8%
Confused 0.4%
Fear 0%
Angry 0.9%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Suit 92.1%

Captions

Microsoft

a black and white photo of a man 93.6%
a black and white photo of a man wearing a suit and tie 93.5%
a man wearing a suit and tie 93.4%