Human Generated Data

Title

King of Twelfth-Night

Date

1769

People

Artist: J. F. Poletnich, French active in Paris 1750-80

Artist after: Jacques Jordaens, Flemish 1593 - 1678

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3703

Human Generated Data

Title

King of Twelfth-Night

People

Artist: J. F. Poletnich, French active in Paris 1750-80

Artist after: Jacques Jordaens, Flemish 1593 - 1678

Date

1769

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3703

Machine Generated Data

Tags

Amazon
created on 2019-06-17

Person 99.6
Human 99.6
Art 97.4
Painting 97.2
Person 95.3
Person 94.4
Person 94.4
Person 90.8
Person 87.4
Person 82.2
Person 79
Person 71.9
Person 68.7
Person 65
Person 61.8
Archaeology 57.9

Clarifai
created on 2019-06-17

people 100
art 99.6
group 99.4
print 99.2
man 98.9
adult 98.5
painting 98.4
illustration 98
woman 96.4
many 95.6
portrait 95.3
engraving 94.9
leader 94.7
facial hair 90.4
museum 87.8
religion 86.7
antique 83.9
administration 83.4
one 83.3
child 83

Imagga
created on 2019-06-17

money 46.8
cash 43
currency 42.2
dollar 39.9
sculpture 36.4
finance 33.8
bank 32.4
carving 31.6
wealth 31.4
paper 31.4
dollars 30.9
bill 30.4
banking 30.3
financial 28.5
business 27.3
hundred 27.1
art 24.3
savings 24.2
us 23.1
loan 23
comic book 22.5
close 21.7
pay 21.1
rich 20.5
one 20.2
franklin 19.7
sketch 18.6
bills 18.5
finances 18.3
exchange 18.1
banknotes 17.6
statue 17.6
banknote 16.5
history 16.1
treasury 16
ancient 15.6
old 15.3
drawing 15.1
architecture 14.8
investment 14.7
religion 14.3
stone 13.6
states 13.5
representation 13.4
funds 12.7
plastic art 12.7
depository 12.5
profit 12.4
capital 12.3
closeup 12.1
economy 12.1
culture 12
note 11.9
economic 11.6
temple 11.5
success 11.3
antique 10.7
debt 10.6
god 10.5
commerce 10.3
figure 10.1
sign 9.8
market 9.8
facility 9.7
payment 9.6
price 9.6
united 9.5
symbol 9.4
memorial 9.3
number 9.3
print media 9
concepts 8.9
detail 8.8
president 8.8
wages 8.8
building 8.8
legal 8.8
value 8.7
brass 8.7
sales 8.6
spirituality 8.6
save 8.5
church 8.3
vintage 8.3
federal 7.9
face 7.8
dough 7.8
income 7.8
paying 7.8
holy 7.7
notes 7.7
structure 7.6
column 7.6
religious 7.5
monument 7.5

Google
created on 2019-06-17

Microsoft
created on 2019-06-17

text 97.1
wall 95.8
person 94.2
indoor 88.7
drawing 88.7
posing 88.4
clothing 83.9
painting 77.1
museum 76.8
book 72.9
old 69.7
gallery 62.2
art 53.7
vintage 28.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 54.1%
Disgusted 46.4%
Surprised 45.8%
Confused 46.4%
Sad 47.3%
Calm 45.9%
Angry 47.6%
Happy 45.6%

AWS Rekognition

Age 60-90
Gender Male, 54.4%
Confused 46%
Happy 45.4%
Sad 50.9%
Surprised 45.3%
Calm 46.5%
Disgusted 45.2%
Angry 45.7%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Surprised 45.1%
Sad 45.1%
Angry 45.1%
Confused 45%
Disgusted 45.1%
Happy 54.5%
Calm 45.1%

AWS Rekognition

Age 38-57
Gender Male, 52.6%
Happy 45.5%
Disgusted 45.7%
Sad 46.5%
Angry 45.9%
Calm 49.9%
Surprised 45.6%
Confused 46%

AWS Rekognition

Age 11-18
Gender Female, 54.7%
Sad 50.6%
Calm 45.9%
Happy 46.3%
Disgusted 45.3%
Surprised 45.8%
Confused 45.6%
Angry 45.6%

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Disgusted 45.2%
Happy 45.3%
Sad 52.8%
Angry 45.8%
Calm 45.3%
Confused 45.4%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Male, 75.7%
Calm 33.3%
Angry 6%
Happy 5.8%
Sad 3.2%
Confused 5.6%
Surprised 40.2%
Disgusted 5.8%

AWS Rekognition

Age 23-38
Gender Female, 51.4%
Sad 45.5%
Confused 45.6%
Angry 46.6%
Disgusted 47.6%
Surprised 45.6%
Happy 45.7%
Calm 48.4%

AWS Rekognition

Age 48-68
Gender Female, 50.8%
Disgusted 46.3%
Calm 46%
Sad 46.5%
Surprised 45.8%
Confused 48.3%
Happy 45.3%
Angry 46.7%

AWS Rekognition

Age 26-43
Gender Male, 51.5%
Sad 49.2%
Surprised 45.2%
Disgusted 45.1%
Calm 45.1%
Angry 45.3%
Confused 45.1%
Happy 50%

AWS Rekognition

Age 35-53
Gender Female, 50.9%
Calm 53%
Sad 45.8%
Happy 45.2%
Angry 45.2%
Confused 45.1%
Surprised 45.3%
Disgusted 45.5%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Angry 45.3%
Disgusted 45.1%
Happy 45.1%
Surprised 45.3%
Sad 50.7%
Confused 45.3%
Calm 48.3%

AWS Rekognition

Age 45-66
Gender Male, 54%
Confused 45.4%
Angry 45.5%
Calm 51.5%
Surprised 45.5%
Sad 45.8%
Disgusted 46.2%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Female, 53.8%
Sad 53.6%
Happy 45.1%
Confused 45.2%
Calm 45.2%
Surprised 45.1%
Angry 45.2%
Disgusted 45.5%

AWS Rekognition

Age 35-52
Gender Male, 50.6%
Confused 45.1%
Surprised 45%
Disgusted 45%
Calm 45.2%
Angry 45.2%
Happy 45.1%
Sad 54.4%

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 97.2%

Text analysis

Amazon

ROY
LE ROY
Honoraire
LE
Imperule
EXCELLENCE
DE
TRES
DEDIR
de
MINISTRE
DINTTRY
DE LA FEVE DE
PRIN
Manbre
DEDIR SON EXCELLENCE DINTTRY PRIN DE Gzn MINISTRE
DE LA FEVE
Geontithemme la dambre Manbre Honoraire
dambre
la
de LAatdomie Imperule de Jaunt Petersbonurg.
AMAJESTE TRES CHRET
Jaunt
Geontithemme
AMAJESTE
CHRET
Petersbonurg.
SON
LAatdomie
Gzn

Google

LA
FEVE
PLENIPOTENTLAIRE
COLURDE
DE
SA
CHRETIENNE
de
Imperale
Pelersbourg.
MINISTRE
Gentilhomme
1Honoraue
vin
le
comble
Caf
DE LA FEVE PLENIPOTENTLAIRE DE LA COLURDE RUSSIE AUPRES DE SA MAESTE TRES CHRETIENNE de Mademie Imperale de Sunt Pelersbourg. LE ROY IN CE DE GALITZIN MINISTRE EXCELLENCI DEDIE Gentilhomme de chambre etManbre 1Honoraue Le vin le fait regaer, le vin comble Caf uler usqnams s vorux, CLR
RUSSIE
AUPRES
MAESTE
TRES
Mademie
Sunt
LE
ROY
IN
CE
GALITZIN
EXCELLENCI
DEDIE
chambre
etManbre
Le
fait
regaer,
uler
usqnams
s
vorux,
CLR