Human Generated Data

Title

Copernicus

Date

19th century

People

Artist: Antoni Oleszczyński, Polish 1794 - 1879

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1070NA

Human Generated Data

Title

Copernicus

People

Artist: Antoni Oleszczyński, Polish 1794 - 1879

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R1070NA

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 97.8
Human 97.8
Art 96
Person 85.5
Person 81.8
Person 77.8
Person 71.8
Painting 70.8
Person 69.6
Drawing 64.4

Clarifai
created on 2023-10-22

art 99.5
painting 99.3
people 98.5
picture frame 96.9
print 96.4
portrait 96.3
retro 96.2
vintage 96.1
old 95.8
wear 95.5
one 94.9
antique 93.9
religion 93.5
illustration 92.7
adult 92.3
man 91.8
museum 91.6
veil 90.3
furniture 88.7
church 88.3

Imagga
created on 2022-02-25

stucco 50.9
old 40.4
architecture 32.3
ancient 30.3
wall 29.3
vintage 29
antique 28.6
art 27.9
window 25.1
building 24.1
door 23.8
religion 23.3
history 22.4
church 19.4
decoration 19.1
culture 18.8
historic 18.4
entrance 17.4
texture 17.4
structure 16.8
frame 16.7
retro 16.4
design 16.3
travel 16.2
detail 16.1
religious 15.9
sill 15.9
sculpture 15.9
ornate 15.6
grunge 15.3
stone 15.3
brass 15.2
tourism 14.9
wood 14.2
framework 14.1
structural member 13.6
house 13.5
gold 13.2
arch 13.1
monument 13.1
style 12.6
decor 12.4
pattern 12.3
wooden 12.3
memorial 12.3
ornament 12.1
device 11.8
paper 11.8
gate 11.7
historical 11.3
aged 10.9
decorative 10.9
cathedral 10.6
painted 10.5
post 10.5
wall clock 10.4
brown 10.3
icon 10.3
blank 10.3
classic 10.2
exterior 10.1
traditional 10
painting 9.9
support 9.7
stamp 9.7
palace 9.6
holy 9.6
architectural 9.6
facade 9.6
symbol 9.4
city 9.2
clock 9.1
landmark 9
knocker 8.9
metal 8.9
postage 8.9
tile 8.8
carved 8.8
temple 8.8
textured 8.8
medieval 8.6
mail 8.6
god 8.6
carving 8.5
letter 8.3
one 8.2
border 8.1
material 8
catholic 7.8
museum 7.8
timepiece 7.6
details 7.6
mosaic 7.4
town 7.4
doormat 7
glass 7

Google
created on 2022-02-25

Headgear 82.5
Art 80.9
Hat 76.3
Collar 75.9
Tints and shades 72.9
Font 71.2
Rectangle 70.9
Vintage clothing 69
Circle 68.7
Painting 68.5
Visual arts 66.8
Fedora 65.4
Sleeve 64.9
Paper product 63.8
Suit 63.2
Paper 62
Illustration 62
History 61.8
Facial hair 60.4
Portrait 55.4

Microsoft
created on 2022-02-25

person 92.3
clothing 90.9
gallery 90.9
drawing 87.9
indoor 85.2
room 79.9
old 73.3
text 69.8
human face 55.6
picture frame 53.4
decorated 31.6
painted 31.2
painting 25.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 58-66
Gender Male, 99.4%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Fear 0%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 54-64
Gender Female, 61.8%
Calm 42.4%
Angry 22.1%
Sad 11.7%
Disgusted 11.1%
Confused 5.3%
Fear 2.8%
Surprised 2.4%
Happy 2.2%

AWS Rekognition

Age 56-64
Gender Male, 99.4%
Disgusted 54.5%
Sad 25.7%
Calm 12.7%
Fear 2.4%
Angry 2.4%
Surprised 1.1%
Confused 0.6%
Happy 0.6%

AWS Rekognition

Age 11-19
Gender Female, 96.7%
Calm 95%
Disgusted 2.8%
Fear 0.7%
Happy 0.5%
Angry 0.4%
Surprised 0.3%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Calm 44.7%
Happy 15.7%
Sad 15.6%
Disgusted 14.3%
Surprised 2.8%
Angry 2.7%
Fear 2.5%
Confused 1.7%

AWS Rekognition

Age 57-65
Gender Male, 99%
Calm 66.2%
Disgusted 18%
Fear 6.6%
Sad 6.5%
Confused 1.1%
Angry 0.8%
Surprised 0.4%
Happy 0.4%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 99.6%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Sad 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 87.3%
Fear 78.4%
Calm 7.3%
Happy 7%
Angry 2.6%
Sad 1.5%
Disgusted 1.4%
Surprised 1%
Confused 0.7%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Calm 97.7%
Sad 0.8%
Disgusted 0.7%
Angry 0.3%
Fear 0.2%
Surprised 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 7-17
Gender Male, 92.9%
Calm 54.1%
Fear 40.6%
Disgusted 2.3%
Sad 0.9%
Surprised 0.6%
Happy 0.6%
Confused 0.5%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 83.4%
Angry 7.7%
Sad 2.9%
Happy 2.3%
Disgusted 1.9%
Fear 1%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 85.2%
Surprised 7.1%
Sad 2.8%
Fear 2%
Confused 1.8%
Disgusted 0.5%
Angry 0.4%
Happy 0.2%

AWS Rekognition

Age 4-12
Gender Male, 91.8%
Calm 48.5%
Angry 31%
Disgusted 7.7%
Surprised 4.2%
Sad 3.9%
Fear 2.7%
Confused 1.1%
Happy 1.1%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Disgusted 94%
Calm 2.2%
Happy 1.1%
Surprised 0.7%
Angry 0.6%
Confused 0.5%
Sad 0.4%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Female, 83.1%
Calm 96.2%
Sad 1.1%
Happy 0.9%
Fear 0.7%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 97.8%
Person 85.5%
Person 81.8%
Person 77.8%
Person 71.8%
Person 69.6%
Painting 70.8%

Categories

Captions

Microsoft
created on 2022-02-25

a painting on the wall 77.8%
a painting on a wall 77.2%
a painting hanging on a wall 77.1%

Text analysis

Amazon

SAFERE
de
DE
POURES de SPEAT وسر DE
DEST
IN
ARASTRA
وسر
TATIA
SPEAT
non ARASTRA
IN 19112 TATIA DEST SVILLE MAY quessions PROFEMARES
19112
SVILLE
non
POURES
quessions
PROFEMARES
part
MAY
nation
part PAR
PAR

Google

SAPERE Ie IC ITUR AD NSTAA eLA ANa asce .T aoa IARDaYE ea,a aa as u. aa A 1OSER La0 caar.pes oa ae aoe ant Percaages
SAPERE
Ie
IC
ITUR
AD
NSTAA
eLA
ANa
asce
.T
aoa
IARDaYE
ea,a
aa
as
u.
A
1OSER
La0
caar.pes
oa
ae
aoe
ant
Percaages