Human Generated Data

Title

The Nieuwmarkt, Amsterdam
Date

17th century
People

Artist: Job Berckheyde, Dutch 1630 - 1693

Artist: Gerrit Adriaensz Berckheyde, Dutch 1638 - 1698
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of James P. Warburg, 1969.60

Human Generated Data

Title

The Nieuwmarkt, Amsterdam

People

Artist: Job Berckheyde, Dutch 1630 - 1693

Artist: Gerrit Adriaensz Berckheyde, Dutch 1638 - 1698

Date

17th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.9
Human 98.9
Person 98.5
Person 97.1
Wheel 94.3
Machine 94.3
Person 93.6
Person 93.5
Person 93
Person 91.4
Person 88.9
Building 87.3
City 87.1
Urban 87.1
Town 87.1
Person 86.7
Downtown 86.3
Canine 85.6
Mammal 85.6
Animal 85.6
Dog 85.6
Pet 85.6
Art 83.8
Architecture 82.7
Wheel 81.6
Road 79.3
Person 78.5
Nature 76.8
Person 70.7
Painting 70.2
Transportation 69.3
Person 68
Vehicle 65.7
Dog 65.5
Outdoors 65.4
Weather 63.5
Path 62.9
Person 61
Tower 59.8
Spire 59.8
Steeple 59.8
Street 59
Horse 57.7
Person 46.3

Clarifai
created on 2020-04-24

people 99.9
many 99.1
group 99.1
home 99
group together 98.8
street 97.5
adult 97.2
no person 97.1
vehicle 96.3
several 95.4
man 95.2
architecture 93.1
town 90.4
building 89.6
transportation system 89
two 89
child 88.2
house 87.3
cavalry 87
print 85.2

Imagga
created on 2020-04-24

snow 100
weather 95.9
winter 39.2
city 33.3
sky 30.8
cold 29.3
landscape 29
architecture 28.3
building 28.1
trees 27.6
tree 24.7
street 21.2
ice 20.5
travel 20.4
season 20.3
forest 18.3
frost 18.3
park 18.1
road 18.1
snowy 17.5
urban 16.6
frozen 16.3
old 16
structure 15.5
scene 14.7
outdoor 14.5
house 14.3
scenic 14.1
tourism 14
outdoors 13.5
scenery 13.5
town 13
church 13
freeze 12.6
history 12.5
culture 12
clouds 11.8
country 11.4
obelisk 11
frosty 10.8
light 10.7
england 10.5
landmark 9.9
night 9.8
new 9.7
rural 9.7
seasonal 9.6
column 9.6
ancient 9.5
cloud 9.5
cityscape 9.5
wood 9.2
historic 9.2
peaceful 9.2
morning 9.1
religion 9
tower 9
mountain 8.9
snowfall 8.9
day 8.6
famous 8.4
tourist 8.4
ski 7.9
stone 7.8
center 7.7
buildings 7.6
monument 7.5
countryside 7.3
sun 7.3
square 7.2
holiday 7.2
cool 7.1

Google
created on 2020-04-24

Town 90.7
Snapshot 82.5
Street 81.1
Building 75.1
City 75
Architecture 72.6
History 70.9
Photography 67.8
Monochrome 60.1
Paper product 57.7
Thoroughfare 57.7
Black-and-white 56.4
Vehicle 54.4
Road 52.7
Town square 52.7
Almshouse 52.1

Microsoft
created on 2020-04-24

building 99.6
outdoor 98.6
road 95.9
text 91.3
old 86.7
sky 84.7
horse 80.9
street 78.2
white 72.6
house 72.4
drawn 72.2
town 68
cloud 59.2
black and white 58.6
carriage 31.4

Face analysis

Amazon

AWS Rekognition

Age 10-20
Gender Female, 50%
Disgusted 49.6%
Confused 49.5%
Calm 49.5%
Angry 49.5%
Fear 50.1%
Surprised 49.5%
Happy 49.6%
Sad 49.7%

Feature analysis

Amazon

Person 98.9%
Wheel 94.3%
Dog 85.6%
Painting 70.2%
Horse 57.7%

Captions

Microsoft

a horse drawn carriage in front of a building 90.7%
a close up of a horse drawn carriage in front of a building 86.7%
a vintage photo of a horse drawn carriage 86.6%

Text analysis

Google

SUCASGED
SUCASGED