Human Generated Data

Title

Fortitude (Fortitudio)

Date

1560

People

Artist: Pieter Bruegel, the Elder, Netherlandish 1526/30 - 1569

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Collection of Edouard Sandoz, 26.1965

Human Generated Data

Title

Fortitude (Fortitudio)

People

Artist: Pieter Bruegel, the Elder, Netherlandish 1526/30 - 1569

Date

1560

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Loan from the Collection of Edouard Sandoz, 26.1965

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Art 100
Painting 100
Archaeology 99.8
Person 97.1
Person 97.1
Adult 97.1
Male 97.1
Man 97.1
Person 97
Person 96.4
Adult 96.4
Bride 96.4
Female 96.4
Wedding 96.4
Woman 96.4
Person 95.8
Person 94.8
Person 94.2
Person 90.9
Person 90.5
Adult 90.5
Male 90.5
Man 90.5
Person 87
Person 85.2
Baby 85.2
Person 82.7
Head 70.2
Animal 67.7
Horse 67.7
Mammal 67.7
Person 67.7
Person 65.9
Person 65.4
Person 64.7
Face 64.2
Person 61.2
Person 60.4
Person 57.1
Person 56.5
Angel 55

Clarifai
created on 2019-02-18

many 99.6
people 99.2
group 98.3
war 97.8
no person 96.6
military 96.3
illustration 94.5
skirmish 94
weapon 93.5
cavalry 93.3
man 93
art 92
print 91.5
engraving 88.1
adult 87
force 86.2
old 86.1
vehicle 83.3
interaction 82.7
one 82.4

Imagga
created on 2019-02-18

old 39
ancient 29.4
antique 28.3
vintage 25.6
travel 23.9
map 23.8
art 22.9
atlas 22.7
history 21.5
paper 18.8
grunge 18.7
wall 17.3
world 16.5
architecture 15.7
tourism 15.7
sculpture 15.6
retro 15.6
aged 15.4
temple 15.1
city 15
texture 13.9
stone 13.8
culture 13.7
geography 13.5
historical 13.2
monument 13.1
historic 12.8
dirty 12.6
money 11.9
currency 11.7
wreckage 11.4
capital 11.4
jigsaw puzzle 11.2
representation 11
cash 11
carving 10.9
symbol 10.8
discovery 10.7
navigation 10.6
decoration 10
landmark 9.9
newspaper 9.9
religion 9.9
puzzle 9.8
sepia 9.7
weathered 9.5
part 9.5
journey 9.4
globe 9.3
country 9.2
letter 9.2
bank 9.1
structure 9.1
border 9
textured 8.8
tour 8.7
bill 8.6
china 8.5
finance 8.4
graffito 8.4
east 8.4
town 8.3
note 8.3
building 8
expedition 7.9
navigate 7.8
creation 7.8
guide 7.8
continent 7.8
stamp 7.7
us 7.7
wallpaper 7.7
frame 7.6
direction 7.6
grungy 7.6
nation 7.6
planet 7.5
famous 7.4
dollar 7.4
closeup 7.4
gold 7.4
tile 7.4
brown 7.4
paint 7.2
drawing 7.1
product 7.1

Google
created on 2019-02-18

Microsoft
created on 2019-02-18

text 98.7
book 95.9
old 69
painting 21
art 21
archaeology 14.3
illustration 13.3
relief 12.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Female, 88.1%
Calm 75.4%
Confused 22.8%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 98.8%
Fear 70.3%
Calm 33.6%
Happy 7.2%
Surprised 7%
Sad 2.3%
Confused 1.3%
Disgusted 1%
Angry 0.8%

AWS Rekognition

Age 29-39
Gender Male, 92.2%
Calm 66.9%
Sad 30.2%
Surprised 6.8%
Fear 6.4%
Angry 5.7%
Disgusted 1.8%
Happy 1.2%
Confused 1.2%

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Calm 82.3%
Angry 11.4%
Surprised 7.2%
Fear 6.1%
Sad 2.6%
Disgusted 1.7%
Confused 0.8%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 86.7%
Calm 76%
Surprised 8.5%
Disgusted 8.3%
Fear 6.2%
Sad 5.5%
Angry 1.8%
Happy 1.4%
Confused 1.1%

AWS Rekognition

Age 19-27
Gender Male, 97.3%
Calm 62.3%
Happy 27.3%
Surprised 6.5%
Fear 6.4%
Angry 6.1%
Sad 2.5%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 9-17
Gender Female, 53.3%
Calm 96%
Surprised 6.3%
Fear 6.1%
Sad 2.3%
Happy 1.5%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Adult 97.1%
Male 97.1%
Man 97.1%
Bride 96.4%
Female 96.4%
Woman 96.4%
Baby 85.2%
Horse 67.7%

Categories

Captions

Microsoft
created on 2019-02-18

a vintage photo of a painting 73.5%
a painting of a book 62.8%
a vintage photo of a person 62.7%

Text analysis

Amazon

VERA
COHIBERE
VITIA
A
ETAFFEC
FORTITVDO
VINCERE
ETAFFEC TVS
TVS
INVENTOR
A NIMVM
NIMVM
IRACVNDIAM
VERA FORTITVDO EST-
BRVEGEL
COCK
CAETERAQ
EST-

Google

FORTITVDO VE ANIMVAA VINCERE, IR AC VNDIAM COHIB.ERE CAE TERAQ. -VI TIA ETAFFECTys COHIBERE VERA FORTITVDO EST
FORTITVDO
VE
ANIMVAA
VINCERE
,
IR
AC
VNDIAM
COHIB.ERE
CAE
TERAQ
.
-
VI
TIA
ETAFFECTys
COHIBERE
VERA
EST