Human Generated Data

Title

The Catechism
Date

1777
People

Artist: Pierre Étienne Moitte, French 1722 - 1780

Artist after: Pierre-Antoine Baudouin, French 1723 - 1769
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7308

Human Generated Data

Title

The Catechism

People

Artist: Pierre Étienne Moitte, French 1722 - 1780

Artist after: Pierre-Antoine Baudouin, French 1723 - 1769

Date

1777

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7308

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Painting 99.7
Art 99.7
Person 99.1
Human 99.1
Person 96.1
Person 94.4
Person 93.9
Person 93
Person 77.3
Person 77
Person 76.8
Person 75.8
Person 74
Person 51.3
Person 50.1

Clarifai
created on 2023-10-28

people 100
group 99.9
many 99.3
print 99.1
art 98.9
adult 98.9
child 97.7
engraving 97.3
man 96.9
woman 95.8
illustration 94.8
leader 94.4
monarch 94.4
royalty 93.1
administration 93
painting 92.5
lithograph 92.1
kneeling 91.8
sit 91
music 89.3

Imagga
created on 2022-01-30

sculpture 39.3
architecture 35.4
art 32
statue 31.6
treasury 31
fountain 29.8
structure 28.5
old 27.9
history 26.8
landmark 26.2
building 25.3
depository 24.4
ancient 23.4
stone 22.3
antique 21.7
column 21.7
marble 21.6
monument 21.5
city 20.8
sketch 20
drawing 19.6
facility 18.5
famous 17.7
travel 17.6
vintage 17.4
tourism 17.3
culture 17.1
historic 16.5
carving 15.9
religion 15.2
historical 15.1
god 14.4
decoration 14.1
arch 13.8
representation 13.7
newspaper 13.2
temple 12.9
memorial 12.9
facade 12.8
paper 12.5
retro 12.3
church 12
style 11.9
baroque 11.7
symbol 11.4
palace 11.4
pattern 10.9
product 10.8
cathedral 10.7
balcony 10.7
grunge 10.2
money 10.2
frame 10.1
ornate 10.1
creation 10
tourist 10
texture 9.7
detail 9.7
architectural 9.6
design 9.6
capital 9.5
rich 9.3
exterior 9.2
letter 9.2
paint 9.1
roman 9
statues 8.9
figure 8.8
catholic 8.8
artistic 8.7
detailed 8.7
religious 8.4
classic 8.4
currency 8.1
bank 8.1
water 8
sculptures 7.9
wall 7.8
us 7.7
classical 7.6
finance 7.6
decorative 7.5
destination 7.5
cash 7.3
business 7.3
national 7.2
aged 7.2
dirty 7.2

Google
created on 2022-01-30

Art 83.9
Painting 82.5
Line 81.9
Rectangle 75.8
Illustration 70.4
Visual arts 69.3
Drawing 68.2
History 67.4
Room 66.7
Holy places 65.6
Antique 65.5
Stock photography 64.3
Artwork 59.4
Paper product 59.2
Collection 56.4
Vintage clothing 54.3
Picture frame 52.8
Mythology 52.6
Paper 51.5
Printmaking 50.1

Microsoft
created on 2022-01-30

text 96.7
old 95.6
person 92.8
drawing 80.6
clothing 78
black 76
vintage 39.7
altar 24.3
painting 15.2
picture frame 10

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Calm 86.1%
Fear 3.9%
Happy 2.9%
Surprised 2.1%
Disgusted 1.5%
Confused 1.5%
Angry 1%
Sad 0.9%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 98%
Sad 0.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.7%
Calm 98.5%
Confused 0.5%
Sad 0.3%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 6-14
Gender Female, 63.5%
Calm 94.1%
Confused 2.5%
Sad 1.5%
Disgusted 0.6%
Surprised 0.6%
Angry 0.4%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 60.1%
Calm 82.6%
Disgusted 8.3%
Sad 5.1%
Angry 1.6%
Happy 0.8%
Surprised 0.6%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 12-20
Gender Female, 99.5%
Calm 95.3%
Sad 2%
Confused 0.7%
Angry 0.6%
Happy 0.5%
Fear 0.3%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Calm 98.1%
Fear 0.8%
Surprised 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 99%
Fear 0.6%
Sad 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%

AWS Rekognition

Age 14-22
Gender Female, 100%
Calm 89.8%
Happy 7.8%
Disgusted 1%
Sad 0.4%
Fear 0.4%
Surprised 0.3%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Female, 71.6%
Fear 33.3%
Calm 22.7%
Happy 16.5%
Disgusted 10.2%
Confused 6.2%
Surprised 5.5%
Sad 3.7%
Angry 1.9%

AWS Rekognition

Age 2-10
Gender Female, 83.3%
Calm 84.7%
Happy 4.4%
Sad 3.7%
Surprised 2.3%
Fear 2%
Disgusted 1.1%
Confused 1%
Angry 0.8%

AWS Rekognition

Age 33-41
Gender Female, 99.2%
Calm 96.2%
Sad 1.2%
Surprised 0.7%
Happy 0.6%
Disgusted 0.4%
Confused 0.4%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 16-24
Gender Male, 91.9%
Calm 96.5%
Confused 1.5%
Happy 0.8%
Surprised 0.4%
Disgusted 0.3%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 70.5%
Fear 36.9%
Calm 27.9%
Disgusted 16.3%
Happy 6.1%
Angry 5.6%
Confused 4.1%
Sad 2.1%
Surprised 1%

AWS Rekognition

Age 21-29
Gender Female, 99.2%
Calm 94.4%
Confused 2.1%
Sad 1.1%
Disgusted 0.7%
Surprised 0.5%
Angry 0.5%
Fear 0.5%
Happy 0.2%

AWS Rekognition

Age 2-10
Gender Female, 57.8%
Calm 39.1%
Surprised 25.7%
Sad 15.6%
Fear 7.4%
Confused 7.2%
Disgusted 3.2%
Happy 1%
Angry 0.7%

AWS Rekognition

Age 25-35
Gender Male, 98.9%
Calm 56.2%
Fear 32.5%
Sad 5.7%
Disgusted 2.3%
Angry 1.8%
Happy 0.7%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 89.2%
Calm 70.8%
Happy 11%
Sad 7.6%
Surprised 3.1%
Disgusted 2.9%
Confused 2.1%
Angry 1.3%
Fear 1.2%

AWS Rekognition

Age 23-31
Gender Male, 94.5%
Calm 98%
Confused 1.1%
Sad 0.2%
Angry 0.2%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Fear 48.4%
Calm 40.2%
Sad 4%
Disgusted 1.9%
Confused 1.7%
Surprised 1.3%
Angry 1.3%
Happy 1.2%

AWS Rekognition

Age 19-27
Gender Female, 94.2%
Calm 95.9%
Disgusted 3%
Angry 0.4%
Surprised 0.3%
Sad 0.1%
Happy 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 6-16
Gender Female, 93.3%
Calm 98.4%
Confused 0.5%
Fear 0.5%
Surprised 0.4%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Sad 0%

AWS Rekognition

Age 23-33
Gender Male, 98.4%
Calm 85.4%
Fear 4.6%
Sad 2.2%
Confused 2%
Surprised 1.9%
Disgusted 1.7%
Angry 1.3%
Happy 1%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 96.5%
Sad 3.3%
Fear 0.1%
Angry 0%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 18-24
Gender Male, 99.6%
Calm 69.7%
Sad 15.6%
Disgusted 5.8%
Angry 3.2%
Confused 1.8%
Surprised 1.7%
Fear 1.3%
Happy 0.9%

AWS Rekognition

Age 27-37
Gender Male, 84.3%
Calm 66.1%
Confused 14.2%
Disgusted 6.5%
Sad 4%
Surprised 3.7%
Fear 2.5%
Happy 1.6%
Angry 1.2%

AWS Rekognition

Age 6-12
Gender Female, 81.3%
Calm 94.7%
Sad 2.7%
Confused 0.8%
Disgusted 0.7%
Surprised 0.3%
Angry 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Female, 80.7%
Calm 97.1%
Confused 1.2%
Sad 1%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 90.2%
Calm 71.4%
Confused 8%
Happy 5.1%
Surprised 4.1%
Disgusted 4%
Sad 3.2%
Angry 2.4%
Fear 1.8%

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 87.3%
Fear 5.8%
Happy 3%
Disgusted 1.1%
Surprised 1%
Confused 0.9%
Angry 0.4%
Sad 0.4%

AWS Rekognition

Age 23-31
Gender Male, 91.1%
Calm 99.8%
Confused 0.1%
Happy 0%
Disgusted 0%
Sad 0%
Fear 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 22-30
Gender Male, 99%
Calm 100%
Happy 0%
Disgusted 0%
Surprised 0%
Sad 0%
Fear 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 23-33
Gender Female, 100%
Calm 69.5%
Surprised 24.9%
Happy 1.4%
Angry 1.3%
Fear 1%
Disgusted 0.9%
Sad 0.6%
Confused 0.4%

AWS Rekognition

Age 2-10
Gender Female, 98.2%
Calm 75.7%
Happy 15.2%
Sad 2.5%
Confused 2.2%
Disgusted 1.6%
Surprised 1.2%
Fear 1%
Angry 0.6%

AWS Rekognition

Age 16-24
Gender Female, 94.2%
Fear 63.6%
Sad 20.2%
Calm 11.6%
Disgusted 1.3%
Confused 0.9%
Angry 0.9%
Surprised 0.8%
Happy 0.7%

AWS Rekognition

Age 18-24
Gender Female, 99.2%
Calm 98.9%
Fear 0.4%
Happy 0.2%
Surprised 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 22-30
Gender Female, 96.8%
Calm 98.2%
Surprised 1.2%
Fear 0.2%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Female, 97%
Angry 63.4%
Calm 15.4%
Sad 6%
Disgusted 5.2%
Happy 3.6%
Surprised 2.7%
Confused 2.4%
Fear 1.3%

AWS Rekognition

Age 26-36
Gender Male, 73.1%
Calm 98.6%
Fear 0.3%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Sad 0.1%

Feature analysis

Amazon

Painting
Person
Painting 99.7%
Person 99.1%
Person 96.1%
Person 94.4%
Person 93.9%
Person 93%
Person 77.3%
Person 77%
Person 76.8%
Person 75.8%
Person 74%
Person 51.3%
Person 50.1%

Captions

Microsoft
created on 2022-01-30

a vintage photo of an old building 86.2%
a vintage photo of a person 84.7%
a vintage photo of a building 83.5%

Text analysis

Amazon

Royal
des
Royale
Commerce
Conseiller
au
Intendant
Conseil
de
Sciences
la
et
Honoraire
Honoraire de l'Académie Royale des Sciences de Paris,
l'Académie
et au Conseil Royal des Finance&,
Paris,
au Canseil Royal de Commerce et Intendant дез Finances
et de la Société Royale
Crudaine
Finances
de Londrer
дез
OlMonsieur Crudaine Conseiller PEtat
PEtat
Londrer
Moille
Société
Canseil
-
OlMonsieur
SW
free
- SW this Mombile - free Moille
Finance&,
this
Tradition
- USD Restrict
Mombile
the California de Tradition
the
California
USD
Restrict

Google

AMonsieur Trudaine Conseiller PCtat zu Consal Royal de Commerce et Intendant der Finances, et de la Sci Royale et au Consel Royal des Financeo, Honeraire de lAcadémie Royale ds Spuences de Londrer Paras, ir Mandie e ahanane dre Moille
AMonsieur
Trudaine
Conseiller
PCtat
zu
Consal
Royal
de
Commerce
et
Intendant
der
Finances,
la
Sci
Royale
au
Consel
des
Financeo,
Honeraire
lAcadémie
ds
Spuences
Londrer
Paras,
ir
Mandie
e
ahanane
dre
Moille