Human Generated Data

Title

Heinrich Gottfried Koch
Date

18th century
People

Artist: Johann Friedrich Bause, German 1738 - 1814
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3332

Human Generated Data

Title

Heinrich Gottfried Koch

People

Artist: Johann Friedrich Bause, German 1738 - 1814

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3332

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Person 99.6
Human 99.6
Art 94.8
Painting 71.8
Drawing 71.5

Clarifai
created on 2019-08-10

people 98.3
art 98.2
antique 96.3
ornate 96
one 95.8
picture frame 95.2
portrait 94.7
decoration 94.2
painting 93
old 89.9
vintage 89.6
sculpture 89
ancient 88.8
architecture 88.4
retro 88.4
classic 88.3
adult 88.1
no person 87
design 86.8
engraving 86.6

Imagga
created on 2019-08-10

stucco 100
old 42.5
architecture 33.9
ancient 27.7
vintage 26.5
antique 26
building 25.5
art 25.4
history 25
door 20.9
wall 20.5
decoration 20.3
sculpture 18.5
detail 18.5
travel 18.3
texture 17.4
culture 17.1
religion 17
historic 16.5
entrance 16.4
stone 16.2
paper 15.9
ornament 14.6
house 14.3
tourism 14
metal 13.7
grunge 13.6
design 13.5
carving 13.1
palace 12.6
style 12.6
brown 12.5
frame 12.5
retro 12.3
religious 12.2
monument 12.1
temple 11.8
wood 11.7
city 11.6
wooden 11.4
structure 11.3
historical 11.3
famous 11.2
classic 11.1
ornate 11
pattern 10.9
close 10.8
landmark 10.8
arch 10.7
window 10.6
architectural 10.6
handle 10.5
ornamental 10.4
details 10.4
aged 10
gold 9.9
gate 9.7
statue 9.5
church 9.2
letter 9.2
blank 8.6
decorative 8.3
exterior 8.3
border 8.1
symbol 8.1
decor 8
interior 8
doorway 7.9
carved 7.8
golden 7.7
construction 7.7
obsolete 7.7
rusty 7.6
traditional 7.5
east 7.5
museum 7.1

Google
created on 2019-08-10

Photograph 95.6
Picture frame 90.2
Stock photography 77.5
Art 72.1
Painting 63.8
History 60.4
Illustration 57.7
Visual arts 55

Microsoft
created on 2019-08-10

human face 98
wall 97.3
person 95.7
clothing 90.8
indoor 90.4
old 80.7
text 80.4
man 61.6
drawing 58.7
picture frame 46.7
painting 33.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-52
Gender Male, 95.6%
Surprised 0.7%
Angry 42%
Fear 0.8%
Happy 9.8%
Disgusted 2.8%
Confused 3.7%
Calm 34.7%
Sad 5.4%

AWS Rekognition

Age 26-42
Gender Female, 53.7%
Disgusted 0.8%
Sad 19.6%
Fear 3.4%
Surprised 7%
Confused 1.4%
Calm 42.1%
Angry 21%
Happy 4.6%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 71.8%

Categories

Imagga

paintings art 95.7%
streetview architecture 4.3%

Captions

Microsoft
created on 2019-08-10

a painting of a person 80.5%
a vintage photo of a painting 69.1%
a vintage photo of a person 69%

Text analysis

Amazon

Thalien
ind
trie
pelpemnenens ind Thalien Goiimr
pelpemnenens
th trie Bause Duel F. .2.011.
F.
Bause
th
Duel
Goiimr
.2.011.

Google

ch.Fried Bause, Dad, Blle 738 y
ch.Fried
Bause,
Dad,
Blle
738
y