Human Generated Data

Title

Portrait of a Man
Date

18th-19th century
People

Artist: Unidentified Artist,

Previous attribution: John Trumbull, American 1756 - 1843
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Herbert Daniel Stone, 1959.152

Human Generated Data

Title

Portrait of a Man

People

Artist: Unidentified Artist,

Previous attribution: John Trumbull, American 1756 - 1843

Date

18th-19th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Herbert Daniel Stone, 1959.152

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.8
Human 98.8
Text 96
Clothing 93
Apparel 93
Art 87.3
Painting 77.9
Portrait 64.1
Photography 64.1
Photo 64.1
Face 64.1
Drawing 55.5

Clarifai
created on 2020-04-24

people 100
portrait 99.9
one 99.7
adult 99.2
man 99
leader 97.2
engraving 96.8
print 95.7
wear 93.9
music 93.8
art 92.6
scientist 92.1
administration 90.5
exploration 86.6
facial hair 83.8
two 83.3
retro 80.8
actor 79.6
facial expression 79.2
musician 76.7

Imagga
created on 2020-04-24

gong 62.4
percussion instrument 54.4
musical instrument 40.9
person 36.5
adult 31.7
portrait 28.5
people 26.8
attractive 23.1
happy 21.3
business 21.2
man 19.5
sexy 19.3
face 19.2
model 18.7
pretty 18.2
suit 17.6
lady 17
hair 16.6
lifestyle 16.6
disk jockey 16.5
male 16.3
fashion 15.8
smile 15.7
office 15.3
human 15
device 14.9
work 14.9
businessman 14.1
smiling 13.7
looking 13.6
black 13.5
broadcaster 13.2
computer 12.8
one 12.7
handsome 11.6
communicator 11.4
love 11
casual 11
professional 11
modern 10.5
success 10.5
sitting 10.3
expression 10.2
groom 10.2
happiness 10.2
laptop 10.2
car 10.1
cute 10
hand 9.9
body 9.6
brunette 9.6
healthy 9.4
clothes 9.4
guy 9.3
alone 9.1
confident 9.1
businesswoman 9.1
dress 9
gramophone 8.9
lovely 8.9
working 8.8
half length 8.8
executive 8.6
corporate 8.6
drive 8.5
desk 8.5
manager 8.4
ventilator 8.4
color 8.3
blond 8.2
posing 8
interior 8
women 7.9
couple 7.8
eyes 7.7
men 7.7
luxury 7.7
elegant 7.7
old 7.7
health 7.6
serious 7.6
tie 7.6
dark 7.5
holding 7.4
inside 7.4
friendly 7.3
sensual 7.3
gorgeous 7.2
record player 7.1
machine 7.1
call 7

Google
created on 2020-04-24

Photograph 96.4
Portrait 91.2
Self-portrait 77.7
Stock photography 69.8
Picture frame 65.1
Painting 63
Photography 62.4
Art 58.1

Microsoft
created on 2020-04-24

text 99.9
book 97.6
human face 96.1
person 96
man 95.7
clothing 92.4
drawing 78
portrait 70.7
painting 65.1
old 56
sketch 54.9
posing 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-61
Gender Male, 96.6%
Disgusted 0.2%
Sad 2%
Happy 0%
Calm 95.4%
Confused 0.4%
Angry 1.8%
Surprised 0.1%
Fear 0%

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 77.9%

Categories

Imagga

people portraits 79.3%
paintings art 12.2%
events parties 7.8%

Captions

Microsoft
created on 2020-04-24

a man holding a book 48.3%
an old photo of a man holding a book 42.4%