Human Generated Data

Title

S. Carlo Borromeo

Date

c. 1805

People

Artist: Benedetto Bordiga, Italian active 1805

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R14046

Human Generated Data

Title

S. Carlo Borromeo

People

Artist: Benedetto Bordiga, Italian active 1805

Date

c. 1805

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R14046

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Art 98.4
Human 96.8
Person 96.8
Painting 94.1
Person 92
Furniture 89.4
Person 82.4
Drawing 61.6
Table 55.2
Wood 55

Clarifai
created on 2019-08-08

furniture 99.7
chair 99.5
seat 99.3
people 99.2
sit 98.1
room 98
indoors 98
one 96.3
adult 95.8
print 95.7
illustration 95.3
art 94.6
table 93.9
man 92.3
painting 90.1
leader 87.5
family 87.1
administration 85.9
two 85.8
portrait 82.6

Imagga
created on 2019-08-08

room 33.8
interior 29.2
chair 27.4
home 24.7
furniture 23.1
table 23.1
person 21.7
man 21.5
indoors 21.1
harmonica 19.7
television 19.1
sitting 18
house 17.5
people 16.7
free-reed instrument 15.9
male 15.6
adult 14.9
inside 14.7
wind instrument 14.7
indoor 13.7
musical instrument 13.4
attractive 13.3
couch 12.5
living 12.3
telecommunication system 12.3
luxury 12
pretty 11.9
sofa 11.9
lifestyle 11.6
modern 11.2
window 11.2
apartment 10.5
old 10.4
style 10.4
design 10.3
happiness 10.2
device 10.2
work 10.1
wood 10
portrait 9.7
sexy 9.6
happy 9.4
light 9.3
business 9.1
relaxing 9.1
stylish 9
lady 8.9
book 8.8
smiling 8.7
love 8.7
computer 8.6
comfortable 8.6
glass 8.5
relax 8.4
seat 8.4
black 8.4
relaxation 8.4
fireplace 8.3
wine 8.3
suit 8.1
decor 7.9
wall 7.9
face 7.8
antique 7.8
reading 7.6
laptop 7.6
bed 7.6
fire 7.5
vintage 7.4
floor 7.4
office 7.4
bedroom 7.3
lamp 7.3
cheerful 7.3
domestic 7.2
dress 7.2
looking 7.2
armchair 7.1
working 7.1

Google
created on 2019-08-08

Painting 85.4
Art 77.7
Furniture 74.3
Table 71.7
Room 71.4
Visual arts 71.1
Still life 66
Photography 62.4
Artwork 52.3

Microsoft
created on 2019-08-08

text 98.7
wall 98.4
table 98
furniture 97.5
floor 96.8
indoor 95.6
chair 92.2
drawing 92.2
sketch 81.8
cartoon 67.9
illustration 64.6
old 61.2
painting 57.9
clothing 53.9
book 53.4
dining table 6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 94.9%
Disgusted 0%
Angry 0.4%
Calm 5.6%
Fear 0.8%
Confused 0.3%
Happy 0.1%
Surprised 0%
Sad 92.8%

AWS Rekognition

Age 23-35
Gender Male, 54.9%
Calm 54.8%
Surprised 45%
Fear 45%
Sad 45.1%
Happy 45%
Confused 45%
Disgusted 45%
Angry 45%

AWS Rekognition

Age 22-34
Gender Male, 53.1%
Happy 45.2%
Surprised 45%
Calm 54.7%
Disgusted 45%
Angry 45%
Sad 45%
Confused 45%
Fear 45%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%
Painting 94.1%

Captions

Text analysis

Amazon

POTUM
S.CARLO
S.CARLO BORROMEO
BORROMEO
MEA.
MISCEBAM
FUERUNT
AC
MIHI
DIE
Pal
FLETU
NOCTE
FUERUNT MIHI LACRY MA. MEA.
PANES DIE AC NOCTE POTUM MEUM CUM FLETU MISCEBAM Pal 101
PANES
CUM
MEUM
LACRY
MA.
101

Google

S.CARLO BORROME O POTUM MEUM CUM FL.ETU MISCEBAM Pal 101 FUERUNT MIHI LACRY MN. MEA. PANES DIE AC NOCTE Psal
S.CARLO
BORROME
O
POTUM
MEUM
CUM
FL.ETU
MISCEBAM
Pal
101
FUERUNT
MIHI
LACRY
MN.
MEA.
PANES
DIE
AC
NOCTE
Psal