Human Generated Data

Title

Landscape with Skaters
Date

1653
People

Artist: Jan van Goyen, Dutch 1596 - 1656
Classification

Drawings
Credit Line

The Maida and George Abrams Collection, Fogg Art Museum, Harvard University, Cambridge, Massachusetts, Gift of George Abrams in memory of George P. Bates, Harvard College '54, Harvard Business School '58, 2023.634

Human Generated Data

Title

Landscape with Skaters

People

Artist: Jan van Goyen, Dutch 1596 - 1656

Date

1653

Classification

Drawings

Credit Line

The Maida and George Abrams Collection, Fogg Art Museum, Harvard University, Cambridge, Massachusetts, Gift of George Abrams in memory of George P. Bates, Harvard College '54, Harvard Business School '58, 2023.634

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Person 98.4
Human 98.4
Art 88.8
Clothing 88.3
Hat 88.3
Apparel 88.3
Text 86
Painting 81.5
Wood 68.1
Portrait 62.7
Face 62.7
Photography 62.7
Photo 62.7

Clarifai
created on 2021-04-03

people 99.8
print 99.7
art 99.4
group 99.3
illustration 98.5
adult 98.3
wear 97.7
painting 96.9
man 96.2
cavalry 95.6
many 95.3
weapon 94
veil 93.9
engraving 93.4
watercraft 93.3
vintage 92
mammal 91.4
sepia pigment 90.1
lithograph 89.8
military 89.1

Imagga
created on 2021-04-03

sketch 84.7
drawing 74.4
representation 52.7
grunge 48.6
vintage 38.1
texture 36.1
antique 35.7
old 31.4
graffito 29.7
aged 29
decoration 26.8
retro 24.6
paper 24.3
grain 23.1
art 22.9
grungy 22.8
frame 22.5
pattern 21.9
ancient 21.6
wallpaper 21.5
material 21.4
dirty 20.8
graphic 20.4
structure 20
grime 18.6
flower 18.5
decay 18.3
edge 18.3
paint 18.1
floral 17.9
space 17.9
design 17.5
stain 17.3
text 16.6
silhouette 16.6
damaged 16.2
mottled 15.6
fracture 15.6
rough 15.5
brown 15.5
detailed 15.4
border 15.4
worn 15.3
artistic 14.8
old fashioned 14.3
smudged 13.8
effect 13.7
aging 13.4
obsolete 13.4
canvas 13.3
style 12.6
leaf 12.5
textured 12.3
color 12.2
page 12.1
plants 12.1
painterly 11.8
distressed 11.8
crack 11.6
wall 11.4
textures 11.4
blank 11.1
decorative 10.9
crumpled 10.7
rust 10.6
forest 10.5
black 10.2
architecture 10.2
water 10
surface 9.7
landscape 9.7
messy 9.7
detail 9.7
stained 9.6
empty 9.5
element 9.1
shabby 8.8
noise 8.8
parchment 8.6
holiday 8.6
dirt 8.6
season 8.6
snow 8.5
tree 8.5
travel 8.5
stucco 8.3
backgrounds 8.1
history 8.1
feature 7.9
surrounding 7.9
scratch 7.8
ragged 7.8
ornament 7.8
freight car 7.3
digital 7.3
computer 7.2
sand 7.1
sky 7

Google
created on 2021-04-03

Hair 98.3
Hat 90.9
Sleeve 87.2
Coat 85.8
Collar 82.4
Fedora 81.1
Vintage clothing 75.4
Cap 74.9
Art 72.8
Tints and shades 72
Facial hair 70.4
Portrait 61.3
Font 60.8
Sitting 60.8
Book 60.5
Picture frame 59.9
Illustration 58.7
Collectable 58.4
Sun hat 57.4
Retro style 55.6

Microsoft
created on 2021-04-03

clothing 99.2
person 98.5
text 98.3
hat 96.8
human face 95.8
man 92.4
fashion accessory 87.7
old 87.1
photograph 80
fedora 75.3
cowboy hat 73.5
drawing 57.9
portrait 53.1
picture frame 9.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Male, 96.3%
Calm 96.3%
Angry 1.3%
Sad 1.1%
Confused 0.9%
Surprised 0.2%
Disgusted 0%
Happy 0%
Fear 0%

Microsoft Cognitive Services

Age 25
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Hat 88.3%

Categories

Imagga

paintings art 58.9%
beaches seaside 39.9%

Captions

Microsoft
created on 2021-04-03

an old photo of a man 80.9%
old photo of a man 76.5%
an old photo of a man holding a sign 61.6%

Text analysis

Amazon

Wilie
rrurs
rrurs sc. Wilie nvell
nvell
sc.

Google

Yours e. Veie Fewils
Yours
e.
Veie
Fewils