Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.1

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 98.6
Person 98.6
Person 97.7
Person 96.7
Vehicle 96.6
Transportation 96.6
Watercraft 95.9
Vessel 95.9
Rowboat 95.8
Outdoors 95.7
Person 93.3
Person 92.9
Person 92.9
Person 90
Water 89.2
Nature 85
Canoe 78.7
Boat 73.9
Dinghy 73.2
Oars 64.5
Paddle 64.5
Bird 57.4
Waterfowl 57.4
Animal 57.4

Clarifai
created on 2019-06-06

watercraft 99.8
rowboat 99.6
vehicle 99.6
canoe 99.3
transportation system 99.2
boatman 99.2
oar 98.6
water 98.5
people 97.4
boat 96
fisherman 95.8
recreation 95.7
group 94.6
boat paddle 94.5
river 94.2
adult 90.7
sea 89.9
lake 89.5
paddle 88.9
group together 88.7

Imagga
created on 2019-06-06

oar 100
sweep 69.5
scull 66.9
outrigger 54
water 49.5
boat 49.2
stabilizer 43.2
sea 39.9
ocean 34.2
lake 32.1
device 31.6
travel 27.5
sunset 27
sky 26.2
beach 25.3
fishing 24.1
river 23.2
landscape 21.6
summer 21.3
island 21.1
vacation 20.5
coast 18
fisherman 17.3
reflection 17.1
recreation 17.1
sun 16.9
clouds 16.9
silhouette 16.6
tourism 16.5
outdoors 16.5
outdoor 16.1
shore 15.8
coastline 15.1
sport 14.9
holiday 14.4
bay 14.2
evening 14
horizon 13.5
transportation 13.5
calm 12.8
transport 12.8
tranquil 12.7
leisure 12.5
peaceful 11.9
relax 11.8
boats 11.7
ship 11.4
sunrise 11.3
scenic 10.5
dusk 10.5
wave 10.4
cloud 10.4
people 10.1
trees 9.8
sail 9.7
sand 9.6
rock 9.6
man 9.4
paddle 9.4
waves 9.3
relaxation 9.2
romantic 8.9
light 8.7
harbor 8.7
pond 8.7
sunny 8.6
tropical 8.5
trip 8.5
fish 8.2
peace 8.2
active 8.1
wet 8.1
port 7.7
tree 7.7
orange 7.7
resort 7.5
destination 7.5
bird 7.5
park 7.4
tourist 7.3
scenery 7.2
activity 7.2
mountain 7.1

Microsoft
created on 2019-06-06

water 100
watercraft 98.3
lake 97.9
outdoor 97
vehicle 92.3
boat 91.5
canoe 88.4
paddle 77.6
boating 60.1
ship 54

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.6%
Confused 49.5%
Happy 49.6%
Sad 49.7%
Surprised 49.6%
Calm 49.9%
Angry 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Sad 50.2%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%
Happy 49.6%
Calm 49.5%
Confused 49.5%

Feature analysis

Amazon

Person
Boat
Person 98.6%
Person 97.7%
Person 96.7%
Person 93.3%
Person 92.9%
Person 92.9%
Person 90%
Boat 73.9%

Categories

Imagga

beaches seaside 94.9%
nature landscape 4.8%

Captions

Microsoft
created by unknown on 2019-06-06

a small boat in a body of water 89.8%
a small boat in a large body of water 87.3%
a boat on a body of water 87.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of people in a row boat on a lake -100%

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

The image is a vintage black and white photograph showing a rowboat on a calm body of water, likely a lake. The boat is carrying six people. One person at the front of the boat is holding a paddle, as if he's steering the boat. The boat is heading towards the right. The people in the boat all seem to be wearing light-colored clothing.

In the background, a large hill covered in trees rises up from the water. A small white building is visible on the edge of the hill, adding a touch of human presence to the landscape. The sky is overcast, adding to the vintage feel of the photograph. In the upper left corner of the photo, the date "SE 23" is written, indicating the date the photo was taken.

Created by gemini-2.0-flash on 2025-05-22

Here is a description of the image:

The black and white photograph captures a scene of people rowing on a lake. A rowboat, holding around 6 individuals, is visible on the water. One person at the back of the boat is actively rowing.

In the background, a hill covered with trees creates a natural backdrop to the scene. On the top left corner, there is a handwriting of "September 23" on the picture. The lake appears calm, reflecting the sky and the surrounding landscape.

Text analysis

Amazon

2
SE

Google

SE 23
SE
23