Human Generated Data

Title

Portrait of an Actor
Date

18th-19th century
People

Artist: Unidentified Artist,

Previous attribution: Antoine-Jean Gros, French 1771 - 1835
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Mrs. Akrata von S. Shaw in memory of her late husband, Arthur Hunnewell Shaw, 1952.85

Human Generated Data

Title

Portrait of an Actor

People

Artist: Unidentified Artist,

Previous attribution: Antoine-Jean Gros, French 1771 - 1835

Date

18th-19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 93.8
Human 93.8
Art 93.4
Painting 90.3
Clothing 86.6
Apparel 86.6
Suit 80.3
Overcoat 80.3
Coat 80.3
Text 55.8

Clarifai
created on 2020-04-24

people 99.9
one 99.2
portrait 99.1
adult 98.1
wear 96.8
woman 95
administration 90.2
retro 89.9
man 87.1
leader 86.1
art 85.1
writer 79.6
music 78.1
book series 77.6
science 72.1
scientist 71.6
musician 69.9
outfit 64.8
actor 62.4
chair 62.3

Imagga
created on 2020-04-24

suit 84.3
businessman 52.2
garment 49.5
man 48.5
business 47.4
person 41.6
clothing 39.2
male 39.1
necktie 37.3
professional 34.8
bow tie 34.6
corporate 31.8
office 31.4
tie 31.4
adult 30.7
executive 29.3
handsome 28.6
people 27.9
portrait 26.6
success 25.8
men 24.1
job 23.9
work 22.8
confident 22.8
businesswoman 22.7
successful 22
employee 20.9
happy 19.5
jacket 19.4
smiling 18.8
expression 18.8
manager 18.6
businesspeople 18.1
black 17.8
attractive 17.5
worker 17.4
guy 17.3
consumer goods 17.1
covering 17.1
standing 16.5
corporation 16.4
boss 16.3
waiter 16.2
smile 15.7
hand 15.2
shirt 15
looking 14.4
face 14.2
groom 13.4
dining-room attendant 13
fashion 12.8
human 12.8
scholar 12.7
confidence 12.5
serious 12.4
meeting 12.3
elegant 12
one 12
casual 11.9
team 11.7
working 11.5
career 11.4
lifestyle 10.9
cheerful 10.6
collar 10.6
modern 10.5
formal 10.5
group 10.5
smart 10.4
intellectual 10.4
company 10.2
mature 10.2
model 10.1
communication 10.1
friendly 10.1
holding 9.9
businessmen 9.8
leadership 9.6
workplace 9.5
love 9.5
happiness 9.4
secretary 9.4
teamwork 9.3
positive 9.2
lawyer 8.7
partner 8.7
partnership 8.7
money 8.5
dress 8.1
indoors 7.9
brunette 7.9
couple 7.9
color 7.8
sitting 7.7
outside 7.7
glasses 7.4
alone 7.3
lady 7.3
sexy 7.2
building 7.1
posing 7.1

Google
created on 2020-04-24

Portrait 78.5
Sitting 57.5

Microsoft
created on 2020-04-24

person 96.5
human face 96.4
clothing 95.1
text 88
portrait 86.6
black and white 85.3
sketch 78.2
man 74.8
tie 71.6
drawing 68.5
suit 63.2
coat 53.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 85.1%
Disgusted 2.2%
Surprised 2.7%
Fear 0.5%
Sad 8%
Angry 2%
Happy 1.6%
Calm 78.5%
Confused 4.5%

Microsoft Cognitive Services

Age 42
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.8%
Suit 80.3%

Captions

Microsoft

a person in a suit and tie 96.7%
a person posing for the camera 94.8%
a person sitting posing for the camera 87.6%

Text analysis

Amazon

le
Richelir
mion
D
L
Cans
Der le Cans
Riledemr
Der

Google

Due
een
Rae L Due de Rihelier dans des een prisoniers
Rihelier
prisoniers
dans
L
Rae
de
des