Human Generated Data

Title

Pilgrim with a Hat
Date
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1953.205

Human Generated Data

Title

Pilgrim with a Hat

People

Artist: Unidentified Artist,

Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Hat 94.8
Clothing 94.8
Apparel 94.8
Person 93.7
Human 93.7
Art 92.6
Drawing 80.6
Painting 78.3
Sketch 66.9
Text 66.7

Clarifai
created on 2020-04-24

people 99.9
one 99.5
print 99.4
art 99
adult 98.7
portrait 98.7
engraving 98.6
leader 97.4
monarch 96.9
veil 96.4
man 94.7
wear 93.7
royalty 92.4
administration 90.6
illustration 90.3
lid 90.1
book series 89.7
painting 88.1
writer 86.5
facial hair 84.7

Imagga
created on 2020-04-24

memorial 54.2
brass 42.8
structure 37.3
religion 29.6
art 28.8
stone 27.1
ancient 26.8
architecture 26
sculpture 25
temple 23.2
gravestone 23.2
currency 21.5
statue 20.7
building 20.3
money 19.6
old 19.5
god 18.2
dollar 17.6
church 17.6
cash 17.4
cemetery 17.4
religious 16.9
monument 16.8
bill 16.2
bank 16.1
culture 15.4
carving 15.3
history 15.2
famous 14.9
finance 14.4
antique 13.9
holy 13.5
wealth 13.5
financial 13.4
banking 12.9
spirituality 12.5
historical 12.2
travel 12
landmark 11.7
business 11.5
pay 11.5
golden 11.2
historic 11
close 10.8
face 10.7
dollars 10.6
figure 10.4
icon 10.3
wall 10.3
paper 10.2
vintage 9.9
bible 9.8
bills 9.7
museum 9.7
heritage 9.7
mosaic 9.4
rich 9.3
city 9.1
one 9
book jacket 8.9
column 8.9
franklin 8.9
century 8.8
sacred 8.8
symbol 8.8
hundred 8.7
exchange 8.6
economy 8.3
tourism 8.3
newspaper 8.1
closeup 8.1
prophet 7.9
orthodox 7.8
carved 7.8
painter 7.8
worship 7.7
finances 7.7
payment 7.7
middle 7.7
spiritual 7.7
loan 7.7
faith 7.7
profit 7.7
capital 7.6
note 7.4
decoration 7.2
detail 7.2
aged 7.2

Google
created on 2020-04-24

Stock photography 77.3
History 70.9
Picture frame 70.2
Art 67.7
Prophet 62.1
Painting 58.3
Stone carving 51.3

Microsoft
created on 2020-04-24

text 99.3
sketch 91.5
drawing 91.4
person 84.6
clothing 83.7
newspaper 82.6
human face 75.4
book 73.8
old 64.7
cartoon 60.8
man 60.4
handwriting 52.5
poster 52
picture frame 17.7
window 15.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-70
Gender Male, 93%
Surprised 0.7%
Angry 1.3%
Disgusted 0.4%
Happy 0.2%
Sad 11.1%
Calm 81.5%
Confused 2.8%
Fear 2.1%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat 94.8%
Person 93.7%

Captions

Microsoft

a person sitting in front of a window 46.4%
an old photo of a person 46.3%
a person standing in front of a window 46.2%

Text analysis

Amazon

damar
ioh:
mnt
OIDISQTE mh ioh:
mh
OIDISQTE
100
fim
Ie
100 Dicen Ie mnt Mi
Mflslsgr
csaiad
csaiad Mflslsgr rar
lir.nl
rar
Deotsm nrhs fim damar
Dicen
lir.nl trMNE
nrhs
rahs
trMNE
Mi
Dtod
Deotsm

Google

clamar
matur clamar mitn
matur
mitn