Human Generated Data

Title

Faith
Date

1559
People

Artist: Pieter Bruegel, the Elder, Netherlandish 1526/30 - 1569
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles Bain Hoyt, M8597

Human Generated Data

Title

Faith

People

Artist: Pieter Bruegel, the Elder, Netherlandish 1526/30 - 1569

Date

1559

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles Bain Hoyt, M8597

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Art 100
Painting 100
Cross 98.5
Symbol 98.5
Adult 95.7
Bride 95.7
Female 95.7
Person 95.7
Wedding 95.7
Woman 95.7
Adult 95.3
Bride 95.3
Female 95.3
Person 95.3
Woman 95.3
Person 93.7
Person 93.2
Person 93
Person 92.1
Person 91.7
Person 91.5
Person 91.1
Altar 89.5
Architecture 89.5
Building 89.5
Church 89.5
Prayer 89.5
Person 89.4
Person 89.2
Person 89
Baby 89
Person 88.4
Adult 87.8
Bride 87.8
Female 87.8
Person 87.8
Woman 87.8
Person 87.5
Person 86.6
Person 86.4
Person 86.3
Person 86.1
Person 84.8
Person 78.7
Person 77.3
Person 74.9
Person 73.3
Person 73
Person 72
Person 70.3
Person 69.7
Person 67.8
Face 67.6
Head 67.6
Person 62.1
Person 57.9
Drawing 57.6
Person 57.2
Person 55.6

Clarifai
created on 2019-02-18

people 100
engraving 99.3
print 99.2
group 99.1
man 98.6
many 98.6
adult 98.5
art 97.8
illustration 97
administration 96.9
weapon 92.4
soldier 92
war 91.6
military 90
lithograph 89.5
leader 88
woodcut 88
one 86.3
etching 83.5
woman 82.5

Imagga
created on 2019-02-18

wind instrument 28.9
brass 22
old 19.5
sax 18.8
glass 17.8
musical instrument 16.5
food 14.8
building 14.3
vessel 14.2
history 12.5
architecture 12.5
ladle 12.5
container 12.4
statue 12.4
cooking 12.2
monument 12.1
ancient 12.1
life 11.5
detail 11.3
sculpture 10.8
vintage 10.7
travel 10.6
art 10.5
wine 10.3
tourism 9.9
texture 9.7
sketch 9.5
device 9.5
drawing 9.4
stone 9.3
antique 9.1
brown 8.8
textured 8.8
objects 8.7
grain 8.6
restaurant 8.6
spoon 8.6
famous 8.4
dry 8.3
wineglass 8.3
city 8.3
still 8.3
landmark 8.1
decoration 8
steel 7.9
table 7.8
culture 7.7
plant 7.7
set 7.6
drink 7.5
traditional 7.5
close 7.4
kitchen 7.1
work 7
ingredient 7

Google
created on 2019-02-18

Art 80.8
History 69.9
Painting 68.7
Illustration 60.2

Microsoft
created on 2019-02-18

text 94.2
old 74.8
group 70.7
posing 64.8
white 64.2
vintage 25.2
black and white 25.2
street 13
monochrome 10.2
music 7.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-31
Gender Male, 74.1%
Calm 52.3%
Sad 17.2%
Fear 12.9%
Surprised 7.8%
Disgusted 7.4%
Confused 4.7%
Angry 2.8%
Happy 1.5%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 98%
Surprised 6.3%
Fear 6%
Sad 2.7%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Happy 0%

AWS Rekognition

Age 21-29
Gender Male, 93.3%
Calm 87.6%
Surprised 6.7%
Fear 6%
Sad 4.8%
Confused 2.9%
Angry 1.2%
Disgusted 1.1%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 66.2%
Calm 47.2%
Happy 25%
Fear 15.7%
Surprised 6.8%
Sad 4.7%
Confused 1.9%
Disgusted 1.6%
Angry 1.4%

AWS Rekognition

Age 6-14
Gender Male, 100%
Calm 79.2%
Fear 7.5%
Surprised 6.9%
Disgusted 5.9%
Angry 4.5%
Happy 3.8%
Sad 2.3%
Confused 0.8%

AWS Rekognition

Age 20-28
Gender Female, 93.9%
Calm 38.5%
Sad 26.9%
Angry 16.2%
Surprised 9.6%
Fear 7.9%
Disgusted 6.7%
Confused 5.3%
Happy 3.2%

AWS Rekognition

Age 23-33
Gender Male, 95.1%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Sad 99.9%
Calm 19.5%
Fear 7.8%
Surprised 6.5%
Angry 0.7%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Female, 64%
Calm 68.1%
Angry 27.8%
Surprised 6.6%
Fear 6.1%
Sad 2.3%
Disgusted 1.2%
Confused 0.7%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Male, 94.2%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Female, 88.2%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 23-31
Gender Male, 98.8%
Sad 99.6%
Calm 29.6%
Surprised 6.5%
Fear 6.2%
Happy 1.3%
Angry 1%
Disgusted 0.6%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 52%
Calm 69.8%
Sad 16.9%
Surprised 7.9%
Fear 7.2%
Happy 2.9%
Disgusted 2.6%
Confused 2.4%
Angry 0.7%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 98.1%
Surprised 6.4%
Fear 6%
Sad 2.2%
Disgusted 0.3%
Angry 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 100%
Calm 55.6%
Sad 16.6%
Fear 10.7%
Surprised 8.2%
Confused 5.7%
Angry 5.1%
Disgusted 4.2%
Happy 0.8%

AWS Rekognition

Age 2-10
Gender Female, 61.3%
Calm 98.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Female, 99.2%
Calm 68.2%
Fear 13.5%
Sad 8.4%
Surprised 6.6%
Angry 3%
Disgusted 2.1%
Happy 1.4%
Confused 1.1%

AWS Rekognition

Age 21-29
Gender Male, 87.6%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Female, 64%
Calm 54.6%
Fear 16.4%
Happy 14.3%
Disgusted 7.1%
Surprised 6.8%
Sad 2.6%
Angry 2.4%
Confused 2.1%

AWS Rekognition

Age 21-29
Gender Female, 98%
Calm 97%
Surprised 6.5%
Fear 5.9%
Sad 2.2%
Angry 0.7%
Happy 0.6%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 23-31
Gender Female, 50.6%
Calm 82.4%
Fear 13.2%
Surprised 6.3%
Sad 2.5%
Confused 1.5%
Angry 0.9%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 94.4%
Calm 98.8%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.3%
Disgusted 0.3%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 59.7%
Calm 92.3%
Surprised 6.3%
Fear 6.3%
Sad 3.9%
Disgusted 0.8%
Angry 0.8%
Happy 0.4%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Male, 84%
Calm 65.3%
Sad 21.2%
Confused 8.1%
Surprised 6.6%
Fear 6.1%
Angry 4.3%
Disgusted 2.8%
Happy 0.8%

AWS Rekognition

Age 20-28
Gender Male, 74.9%
Calm 94.3%
Surprised 6.7%
Fear 6%
Sad 2.7%
Angry 1.3%
Disgusted 1.1%
Happy 0.4%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Sad 32.7%
Happy 20.3%
Calm 19.3%
Fear 11.6%
Surprised 10.1%
Disgusted 7.7%
Angry 7.5%
Confused 6.6%

AWS Rekognition

Age 25-35
Gender Male, 67.8%
Calm 86.4%
Surprised 7.1%
Fear 6.4%
Disgusted 3.3%
Sad 3.1%
Angry 2.8%
Confused 0.9%
Happy 0.9%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Calm 64.1%
Fear 37.3%
Surprised 6.5%
Sad 2.3%
Happy 0.4%
Disgusted 0.4%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 6-14
Gender Female, 88.3%
Calm 60.9%
Fear 15.7%
Sad 9.3%
Surprised 7.7%
Angry 4.1%
Confused 1.9%
Disgusted 1.9%
Happy 1.4%

AWS Rekognition

Age 21-29
Gender Male, 79.2%
Happy 50.6%
Sad 38%
Calm 21.8%
Surprised 6.8%
Fear 6.1%
Confused 1.1%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 34-42
Gender Male, 94.1%
Happy 41.5%
Fear 23.5%
Calm 18.6%
Surprised 11.7%
Angry 3.4%
Sad 2.5%
Disgusted 1.9%
Confused 1.8%

AWS Rekognition

Age 24-34
Gender Male, 50.2%
Calm 62.1%
Disgusted 32.3%
Surprised 6.5%
Fear 6.1%
Angry 2.7%
Sad 2.5%
Happy 0.6%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 48.7%
Angry 11.2%
Surprised 10.6%
Fear 9.3%
Sad 8.1%
Confused 7.2%
Happy 6.3%
Disgusted 2.8%

AWS Rekognition

Age 16-24
Gender Male, 98.3%
Calm 77.4%
Sad 8.9%
Surprised 6.4%
Fear 6%
Confused 4.9%
Disgusted 3.3%
Angry 1.9%
Happy 1.4%

AWS Rekognition

Age 18-26
Gender Male, 99.4%
Calm 95%
Surprised 6.4%
Fear 6%
Sad 3%
Disgusted 0.8%
Angry 0.6%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 73%
Angry 9.7%
Fear 8%
Surprised 6.7%
Sad 3.9%
Happy 3.8%
Confused 1.7%
Disgusted 1.6%

Feature analysis

Amazon

Adult 95.7%
Bride 95.7%
Female 95.7%
Person 95.7%
Woman 95.7%
Baby 89%

Text analysis

Amazon

EST
PRIOR
QVAM
IN
PRIOR ET
Brugel
NOBIS
QVIA
ET
Brugel Inu
QVIA DEVS
Inu
DEVS
FIDES
POTENTIOR
NSERVANDA
MAXIME
FIDE
FIDE S
RRAECIPVE IN
S
POTENTIOR EST QVAM HOMO-
RRAECIPVE
exc
Cock exc
Cock
A NOBIS
со NSERVANDA
RELIGIONEM,
HOMO-
со
A

Google

FIDES Inu MAXIME NO B IS CO N $ ERVAN D A EST RRAECIPV EIN RELIGIONE FIDES A
FIDES
Inu
MAXIME
NO
B
IS
CO
N
$
ERVAN
D
A
EST
RRAECIPV
EIN
RELIGIONE