Human Generated Data

Title

Portrait of Count Charles-Robert Nesselrode
Date

1815
People

Artist: Jean Baptiste Isabey, French 1767 - 1855
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. George Richmond Fearing, 1944.36

Human Generated Data

Title

Portrait of Count Charles-Robert Nesselrode

People

Artist: Jean Baptiste Isabey, French 1767 - 1855

Date

1815

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-04-26

Human 96.3
Person 96.3
Art 95.2
Painting 93.5
Porcelain 88
Pottery 88

Clarifai
created on 2020-04-26

people 99.8
art 99.6
portrait 99.5
one 99.4
painting 99.3
adult 98.8
wear 98
man 97.2
illustration 96.5
retro 92.8
print 92.7
vintage 91.7
jacket 91.6
veil 90.7
outerwear 90.1
woman 87.8
facial hair 87.1
leader 86.7
gown (clothing) 85
facial expression 83.8

Imagga
created on 2020-04-26

toilet seat 47.3
seat 40.9
furniture 28.8
person 26.8
adult 22.6
man 20.8
furnishing 19.3
portrait 18.1
car 17.5
attractive 17.5
people 17.3
business 16.4
face 16.3
male 16.3
happy 16.3
looking 15.2
work 14.9
pretty 14.7
smile 14.2
inside 12.9
one 12.7
businessman 12.3
smiling 12.3
fashion 12
sitting 12
interior 11.5
brunette 11.3
vehicle 11.3
hair 11.1
cute 10.7
driver 10.7
room 10.5
fun 10.5
old 10.4
home 10.4
model 10.1
suit 9.9
office 9.9
lady 9.7
working 9.7
sexy 9.6
drive 9.4
holding 9.1
human 9
transportation 9
job 8.8
lifestyle 8.7
automobile 8.6
elegant 8.6
washer 8.6
expression 8.5
window 8.4
worker 8.1
to 8
women 7.9
toilet 7.8
wall 7.7
youth 7.7
auto 7.6
casual 7.6
gong 7.6
service 7.4
percussion instrument 7.4
color 7.2
dress 7.2
handsome 7.1
indoors 7

Google
created on 2020-04-26

Painting 79
Portrait 78
Art 77.7
Oval 72.7
Picture frame 70
Self-portrait 50.9

Microsoft
created on 2020-04-26

human face 98.6
painting 98.2
wall 97.8
person 95.5
indoor 92.4
drawing 91.2
clothing 81.4
man 80.6
portrait 72.8
sketch 57.3
round 28.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Female, 88.5%
Confused 1.7%
Fear 0.1%
Angry 0.3%
Happy 1.7%
Calm 80%
Surprised 1.2%
Sad 14.9%
Disgusted 0.2%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.3%
Painting 93.5%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 52.7%
a man standing in front of a mirror 52.6%
a man sitting in front of a mirror posing for the camera 36.5%

Text analysis

Amazon

J.Jarbey

Google

ty
J. Jo ty
J.
Jo