Human Generated Data

Title

Portrait of a Man

Date

1828

People

Artist: Asa Warren, American 1794-1860

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Daniel A. Pollack, Class of 1960, American Art Acquisition Fund, 2007.134

Human Generated Data

Title

Portrait of a Man

People

Artist: Asa Warren, American 1794-1860

Date

1828

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 97.7
Person 97.7
Clothing 97
Apparel 97
Art 90.2
Coat 84.9
Overcoat 84.9
Suit 78.1
Painting 71.9
Photography 61.1
Face 61.1
Portrait 61.1
Photo 61.1
Man 60.5

Clarifai
created on 2018-03-23

people 99.6
one 99.5
portrait 99.4
adult 99.1
wear 99.1
outerwear 97.6
jacket 97.4
man 97
neckwear 95.7
facial expression 95.3
business 95.1
indoors 94.4
sweater 89.6
confidence 87.1
knitwear 86.8
outfit 85.7
fashionable 84.2
fashion 83.8
tie 83.3
menswear 81.8

Imagga
created on 2018-03-23

bow tie 75.6
necktie 73.7
suit 71.9
garment 63
man 55.8
male 49.7
neck brace 48.4
business 44.4
clothing 42.6
businessman 41.5
brace 38.7
handsome 33.9
tie 33.2
person 32.9
corporate 32.7
portrait 31.1
support 29.5
strengthener 29
adult 28.5
executive 28.2
office 28.2
professional 28
people 27.4
confident 24.6
face 23.5
smile 22.1
success 21.8
guy 21.3
happy 20.1
looking 20
work 19.6
shirt 19.6
smiling 19.6
expression 17.9
manager 17.7
attractive 17.5
successful 17.4
men 16.3
consumer goods 14.7
covering 14.6
black 14.6
casual 13.6
human 13.5
hair 13.5
worker 12.9
job 12.4
one 12
jacket 11.8
head 11.8
boss 11.5
hand 11.4
modern 11.2
eyes 11.2
businesswoman 10.9
working 10.6
career 10.4
mature 10.2
studio 9.9
fashion 9.8
old 9.8
cheerful 9.8
serious 9.5
employee 9.3
glasses 9.3
look 8.8
standing 8.7
lifestyle 8.7
formal 8.6
model 8.6
pretty 8.4
phone 8.3
friendly 8.2
laptop 8.2
sitting 7.7
gesture 7.6
fashionable 7.6
beard 7.5
company 7.5
occupation 7.3
posing 7.1

Google
created on 2018-03-23

photograph 94.8
portrait 90.7
chin 82.6
gentleman 81
standing 77.3
forehead 74.1
smile 61.7
girl 52.7
painting 51.4
vintage clothing 51.4

Microsoft
created on 2018-03-23

person 99.8
wall 96.1
man 95.5
suit 95.3
posing 37.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 99.9%
Sad 3%
Calm 76.5%
Happy 0.4%
Confused 11.2%
Disgusted 1.3%
Angry 5%
Surprised 2.7%

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

a man wearing a suit and tie 97.9%
a man standing in front of a mirror posing for the camera 71.3%
a man wearing a suit and tie looking at the camera 71.2%