Human Generated Data

Title

Harbor Scene with a Watchtower and Beacon

Date

1636

People

Artist: Jan van Goyen, Dutch 1596 - 1656

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of James P. Warburg, 1969.54

Human Generated Data

Title

Harbor Scene with a Watchtower and Beacon

People

Artist: Jan van Goyen, Dutch 1596 - 1656

Date

1636

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Painting 99.9
Art 99.9
Human 98.2
Person 98.2
Person 98.2
Person 96
Person 89
Person 83.7
Person 79.6
Person 76.4
Person 68.2
Person 66.7
Person 59.1
Person 47.8

Clarifai
created on 2018-02-10

water 98.8
no person 98.1
sky 94.7
travel 94.5
outdoors 93.2
landscape 92.5
vehicle 89.5
sea 88
tree 86.8
river 86.3
nature 85.7
seashore 85.6
daylight 85.6
beach 85.3
ocean 84.6
sunset 84.2
dawn 82.4
people 81.8
environment 81.3
storm 80.1

Imagga
created on 2018-02-10

sky 57.3
landscape 41.7
tree 30.9
atmosphere 30.3
water 28.1
travel 26.8
structure 22.8
river 22.3
lake 22
beach 21.5
outdoors 20.2
sunset 19.8
fountain 19.5
rural 19.4
scenery 18.1
sea 18
trees 17.8
clouds 17.8
park 16.5
ocean 16.2
snow 16.2
sun 16.1
tourism 15.7
forest 15.7
environment 15.6
lighting 15.1
scenic 14.9
old 14.6
ship 14.3
cloud 13.8
sunrise 13.1
scene 13
field 12.6
woods 12.4
apparatus 12.3
outdoor 12.2
weather 12
calm 11.9
countryside 11.9
grass 11.9
vacation 11.5
country 11.4
winter 11.1
summer 10.9
mountain 10.7
autumn 10.6
pier 10
yellow 9.9
rock 9.6
swamp 9.4
outside 9.4
wind 9.4
architecture 9.4
equipment 9.4
season 9.4
building 9.4
boat 9.3
orange 9.2
island 9.2
vessel 9.1
national 9.1
morning 9.1
coast 9
support 8.7
light 8.7
hill 8.4
land 8.4
waves 8.4
silhouette 8.3
fall 8.2
reflection 8.1
natural 8
shore 7.9
holiday 7.9
sand 7.8
cold 7.8
port 7.7
tower 7.5
branch 7.3
wreck 7.3
device 7.2
farm 7.1
day 7.1

Google
created on 2018-02-10

sky 93.1
waterway 92.1
painting 90.5
calm 80.2
wetland 76.7
shore 74.8
bayou 73.8
water 71.8
cloud 68.3
sea 68.2
visual arts 65.4
bank 62.4
impressionist 60.1
watercolor paint 59.4
tree 53.5
horizon 50.6

Microsoft
created on 2018-02-10

outdoor 93.5
plant 44.6
several 12.7

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Surprised 49.5%
Happy 50.1%
Sad 49.8%
Calm 49.5%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Happy 49.5%
Disgusted 49.5%
Angry 49.6%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 50.3%

Feature analysis

Amazon

Painting 99.9%
Person 98.2%

Captions

Microsoft

a group of people walking through a cloudy sky 34.1%
a group of people walking on a cloudy day 27.6%
a group of tall buildings 27.5%