Human Generated Data

Title

John Robinson of Denston Hall, Suffolk
Date

1779
People

Artist: George Romney, British 1734 - 1802
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. William Tudor Gardiner, 1973.7

Human Generated Data

Title

John Robinson of Denston Hall, Suffolk

People

Artist: George Romney, British 1734 - 1802

Date

1779

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.7
Human 98.7
Accessory 79.5
Accessories 79.5
Tie 79.5
Apparel 74.4
Clothing 74.4
Art 68.4
Advertisement 64.8
Overcoat 63.1
Coat 63.1
Suit 63.1
Text 63
Photo 60.1
Face 60.1
Portrait 60.1
Photography 60.1
Jaw 57.8

Clarifai
created on 2020-04-24

portrait 100
people 100
one 99.6
adult 99.5
art 95.4
man 95.1
wear 94.7
leader 93.7
music 91.4
actor 88.4
administration 87.4
engraving 87.1
outfit 86.4
writer 85.6
retro 84.3
vintage 83.6
monochrome 83.4
outerwear 81.3
scientist 81
politician 80.4

Imagga
created on 2020-04-24

bow tie 74.1
necktie 68.2
suit 63.1
businessman 54.8
man 51.1
business 45
executive 43
garment 42.4
male 41.9
person 39.8
handsome 39.3
professional 33.6
portrait 32.4
clothing 31.5
adult 31.1
tie 30.4
corporate 29.3
office 29
people 28.5
confident 27.3
looking 24
expression 23.1
men 22.4
manager 21.4
success 20.9
face 20.6
work 20.4
modern 19.7
successful 19.2
shirt 18.7
jacket 18.1
businesspeople 18.1
smile 17.8
black 17.6
formal 17.2
boss 16.3
senior 16
one 15.7
happy 15.7
standing 15.7
alone 15.5
lifestyle 15.2
job 15.1
corporation 14.5
smiling 14.5
hand 14.5
computer 14.4
confidence 14.4
human 14.3
company 14
mature 14
old 14
businesswoman 13.6
only 13.4
businessperson 12.7
attractive 12.6
worker 12.5
elderly 12.5
glasses 12.1
1 11.6
leader 11.6
leadership 11.5
desk 11.3
casual 11
laptop 10.9
serious 10.5
smart 10.4
elegant 10.3
groom 9.8
fashion 9.8
good looking 9.8
working 9.7
guy 9.5
secretary 9.5
one person 9.4
attire 9.4
communication 9.2
friendly 9.2
color 8.9
gray hair 8.9
40s 8.8
older 8.8
building 8.7
hair 8.7
employee 8.6
outside 8.6
model 8.6
power 8.4
director 8.3
occupation 8.3
20s 8.3
indoor 8.2
outdoors 8.2
cheerful 8.1
gray 8.1
determined 7.9
busy 7.7
lawyer 7.7
career 7.6
holding 7.4
look 7

Google
created on 2020-04-24

Photograph 96.9
Portrait 89.5
Snapshot 84.5
Standing 81.9
Photography 62.4
Stock photography 59.4
Self-portrait 56.1

Microsoft
created on 2020-04-24

text 99.9
human face 98.2
person 94.4
portrait 93.6
clothing 93.2
sketch 83.7
drawing 81.1
suit 69.9
painting 62.1
man 59.7
old 58.9
posing 58
photograph 53.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 93.5%
Angry 0.9%
Calm 95.8%
Happy 0.2%
Confused 1.1%
Surprised 0.3%
Fear 0.1%
Sad 1.4%
Disgusted 0.2%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 79.5%
Suit 63.1%

Captions

Microsoft

a vintage photo of a person in a suit and tie 92.1%
a vintage photo of a person wearing a suit and tie 90.4%
a person wearing a suit and tie 90.3%