Human Generated Data

Title

Portrait of a Man
Date

18th-19th century
People

Artist: John Hoppner, British 1758 - 1810
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Helen Warren Richardson in memory of her mother, Helen Thomas Warren (Mrs. Samuel Dennis Warren), 1978.600

Human Generated Data

Title

Portrait of a Man

People

Artist: John Hoppner, British 1758 - 1810

Date

18th-19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 99
Person 99
Clothing 97.4
Apparel 97.4
Art 84.2
Coat 82.6
Painting 81.7
Text 81.1
Overcoat 73.1
Photo 67.2
Face 67.2
Photography 67.2
Portrait 67.2
Suit 59.7
Jacket 58.2
Advertisement 55.7
Photo Booth 55.5

Clarifai
created on 2020-04-24

people 100
portrait 99.8
adult 99.4
one 99.2
art 98.6
engraving 95.3
leader 94.9
wear 93.5
administration 92.6
print 91.9
man 91.3
woman 91.2
painting 90.3
music 90.3
retro 90
vintage 89.5
furniture 87.8
poet 87.7
sit 87.4
book series 86.5

Imagga
created on 2020-04-24

bow tie 58
necktie 44.9
person 29.7
portrait 29.1
people 24.5
adult 23.9
man 22.8
garment 22.2
male 20.2
old 18.8
call 18.7
hair 16.6
human 16.5
one 16.4
clothing 15.6
black 15.3
happy 14.4
fashion 14.3
pretty 14
lifestyle 13
sexy 12.8
face 12.8
model 12.4
vintage 12.4
businessman 12.4
business 12.1
looking 12
family 11.6
suit 11.5
room 11.4
office 11.2
attractive 11.2
love 11
lady 10.5
standing 10.4
style 10.4
professional 10.1
alone 10
child 10
smile 10
dress 9.9
world 9.6
couple 9.6
building 9.5
wall 9.4
smiling 9.4
modern 9.1
hand 9.1
employee 9.1
waiter 9
blond 8.8
home 8.8
cute 8.6
worker 8.6
expression 8.5
two 8.5
senior 8.4
make 8.2
posing 8
interior 8
women 7.9
urban 7.9
ancient 7.8
corporate 7.7
men 7.7
youth 7.7
casual 7.6
tie 7.6
clothes 7.5
city 7.5
sensuality 7.3
dining-room attendant 7.2
jacket 7.2
happiness 7.1
architecture 7
indoors 7

Google
created on 2020-04-24

Photograph 95.9
Portrait 84.9
Picture frame 71.7
Stock photography 70.4
Photography 62.4
Vintage clothing 61.7
Art 50.2

Microsoft
created on 2020-04-24

window 98.9
person 96.7
clothing 95.7
monitor 95.5
text 95.4
human face 93.4
painting 93.3
television 90.2
screen 86.9
photograph 83
old 81.8
portrait 77.4
man 77.4
drawing 71.3
gallery 69.7
sketch 65.8
blackboard 60.2
picture frame 56.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Male, 91%
Calm 96.8%
Surprised 0.1%
Angry 0.9%
Happy 0.1%
Sad 1.4%
Disgusted 0.1%
Fear 0%
Confused 0.5%

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 81.7%

Captions

Microsoft

a person standing in front of a window 82%
an old man standing in front of a window 81.6%
a man and a woman standing in front of a window 60.8%

Text analysis

Google

cOLLEMTIOPpa
cOLLEMTIOPpa