Human Generated Data

Title

Birth of Memnon

Date

1558

People

Artist: Giorgio Ghisi, Italian 1520 - 1582

Artist after: Giulio Romano, Italian 1499? - 1546

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1628

Human Generated Data

Title

Birth of Memnon

People

Artist: Giorgio Ghisi, Italian 1520 - 1582

Artist after: Giulio Romano, Italian 1499? - 1546

Date

1558

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.1
Person 99.1
Painting 99
Art 99
Person 87.5
Person 84.4
Person 66.1
Archaeology 65.3
Person 62.8
Person 46.3

Clarifai
created on 2019-11-16

people 100
group 99.9
art 99.9
print 99.8
adult 99.6
illustration 99.6
man 99
furniture 98.5
seat 98.4
many 97.2
engraving 96.9
woman 96.7
kneeling 96.3
position 96.1
two 95.6
weapon 95.4
Renaissance 94.6
painting 94.4
baroque 94.2
reclining 94.1

Imagga
created on 2019-11-16

sculpture 52.6
statue 41.6
art 35.8
sketch 31.8
architecture 28.4
ancient 25.9
drawing 25.7
religion 24.2
god 22
representation 21.3
carving 21.2
old 20.2
relief 19.8
antique 19.6
column 18.9
history 18.8
stone 18.6
building 18.3
marble 17.8
temple 16.7
church 16.6
tourism 16.5
landmark 16.2
travel 16.2
spirituality 15.4
fountain 15.3
religious 15
culture 14.5
figure 14.5
city 14.1
famous 14
decoration 12.6
holy 12.5
monument 12.1
symbol 12.1
design 11.9
spiritual 11.5
historical 11.3
historic 11
statues 10.8
catholic 10.7
detail 10.5
gold 9.9
angel 9.8
plastic art 9.7
saint 9.6
cathedral 9.6
faith 9.6
artistic 9.6
man 9.4
roman 9.3
museum 8.8
pray 8.7
oriental 8.5
dollar 8.4
pattern 8.2
bronze 8.2
tourist 8.2
water 8
antiquity 8
face 7.8
baroque 7.8
worship 7.7
prayer 7.7
style 7.4
treasury 7.3
color 7.2
sky 7

Google
created on 2019-11-16

Art 90.8
Painting 88
Mythology 80.6
Textile 72.9
Tapestry 71.4
Stock photography 69.8
Illustration 69.1
History 68.8
Visual arts 66.9
Artwork 54.3
Antique 51.7

Microsoft
created on 2019-11-16

text 99.1
person 89.2
outdoor 87.8
drawing 85.6
painting 80.2
sketch 67.2
old 62.8
clothing 58.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Female, 54.7%
Disgusted 45.2%
Angry 46.9%
Confused 45.3%
Sad 50%
Calm 47.1%
Happy 45.2%
Fear 45.3%
Surprised 45.1%

AWS Rekognition

Age 31-47
Gender Female, 54.7%
Angry 45.5%
Surprised 45.1%
Sad 45.1%
Happy 45.1%
Disgusted 45%
Confused 45%
Calm 54.1%
Fear 45%

AWS Rekognition

Age 31-47
Gender Female, 54.1%
Confused 45.1%
Calm 52.9%
Surprised 45.7%
Fear 45.4%
Happy 45.1%
Angry 45.3%
Sad 45.4%
Disgusted 45.2%

AWS Rekognition

Age 23-35
Gender Female, 54.4%
Confused 45%
Fear 45.1%
Calm 52.4%
Happy 45.3%
Sad 46.9%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 23-35
Gender Male, 52%
Happy 45%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45%
Surprised 45%
Calm 54.8%
Angry 45.1%

AWS Rekognition

Age 50-68
Gender Male, 52.8%
Angry 45.1%
Calm 54.1%
Fear 45%
Disgusted 45%
Surprised 45.1%
Happy 45.8%
Sad 45%
Confused 45%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 99%

Captions

Microsoft

a vintage photo of a person 80.9%
a vintage photo of a person 79.6%
a vintage photo of an old building 75.2%

Text analysis

Amazon

ACCENDAT
QVOGENIO
MEMNONIS
MATER
VITA ACCENDAT
MEMNONIS AFFLET
AD OMNLAREVERT
VITA
AFFLET
QVOGENIO EXC EPTY TE MATER
TE
EXC
EPTY

Google

ICTAIN
MAN
TE
ACCENDAT
eNe
GEORGIV
GRISMAN
ATFLET.
FACES
AD
OMNIAREYERT
QvO
INIVL RO ICTAIN ALATIO eNe MAN GEORGIV GRISMAN QvO GENIO XCEPTV M TE MATER MEMNONIS ATFLET. VASQ FACES TIBLVITA ACCENDAT AD OMNIAREYERT Acao usalS
INIVL
ALATIO
M
MATER
TIBLVITA
Acao
RO
GENIO
XCEPTV
MEMNONIS
VASQ
usalS