Human Generated Data

Title

Tinker
Date

1763
People

Artist: Jacob Matthias Schmutzer, German 1733 - 1811

Artist after: Georg Melchior Kraus, German 1737 - 1806
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3387

Human Generated Data

Title

Tinker

People

Artist: Jacob Matthias Schmutzer, German 1733 - 1811

Artist after: Georg Melchior Kraus, German 1737 - 1806

Date

1763

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Person 99.7
Human 99.7
Person 98.6
Art 94.6
Painting 91.1

Clarifai
created on 2019-08-10

people 99.9
art 98.1
adult 98
one 96.7
print 95
man 93.5
group 93
illustration 91.3
engraving 91.3
two 90.3
woman 89.3
portrait 87.2
wear 86.1
child 82.9
religion 79.4
son 78.7
three 77.1
facial hair 75
old 74.9
leader 73.3

Imagga
created on 2019-08-10

column 66.4
statue 65.5
sculpture 62
architecture 41.4
art 35.6
ancient 32.1
stone 31.5
monument 30.9
history 30.5
temple 28.6
culture 27.4
religion 27
building 26.7
old 25.8
travel 24.7
marble 24.6
famous 24.3
landmark 23.5
tourism 23.2
fountain 22.3
city 21.7
carving 20.6
sketch 19.4
historic 19.3
detail 18.5
cemetery 18.3
god 18.2
historical 17.9
structure 16.9
figure 16.9
roman 16.6
palace 16.5
tourist 15.5
religious 15
drawing 14.9
church 13.9
heritage 13.6
statues 12.8
decoration 12.8
antique 12.1
face 12.1
facade 12.1
representation 12
carved 11.8
memorial 11.4
exterior 11.1
museum 10.9
catholic 10.7
spiritual 10.6
spirituality 10.6
traditional 10
sculptures 9.9
baroque 9.8
artistic 9.6
mythology 8.9
symbol 8.8
worship 8.7
arch 8.7
holy 8.7
attraction 8.6
relief 8.4
bronze 7.9
sightseeing 7.8
cathedral 7.8
golden 7.8
faith 7.7
sky 7.7
outdoor 7.7
town 7.4
holiday 7.2

Google
created on 2019-08-10

Art 82.6
Illustration 77.2
Painting 74.6
Stock photography 70.4
Antique 64.7
Visual arts 55
History 54.1
Drawing 51.1

Microsoft
created on 2019-08-10

person 97.4
clothing 96.8
drawing 91.9
text 79
sketch 78.4
woman 62
engraving 53.1
painting 52.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Female, 90.2%
Calm 9.6%
Fear 0%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Sad 0.2%
Happy 89.9%

AWS Rekognition

Age 14-26
Gender Female, 51.4%
Angry 45%
Calm 53.7%
Disgusted 45%
Confused 45%
Surprised 45%
Fear 45%
Sad 45.1%
Happy 46.1%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 91.1%

Captions

Microsoft

an old photo of a boy 36%
an old photo of a person 35.9%
an old photo of two men 35.8%

Text analysis

Amazon

Th
aris
enne
peint par
par
1763
Th Mender.
lettle
grar aris par Johmurer 1763
peint par Kraw. ra.
Mender.
se renda enne par FScockl.
Kraw.
19723
ra.
FScockl.
ot
Johmurer
grar
e
se renda
ot B 19723 7272
0.
7272
B
0. e E
E

Google

pueint par M.Kraus. grav, a ars par 2Jehmuzer. 1763 232 e rend a le par rl.
M.Kraus.
grav,
le
a
2Jehmuzer.
rl.
par
232
e
rend
pueint
ars
1763