Human Generated Data

Title

Defectives, Epileptics: United States. Massachusetts. Palmer. State Hospital for Epileptics: Employees' Cottage 1906.

Date

1906

People

Artist: Woodhead Studio, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3376

Human Generated Data

Title

Defectives, Epileptics: United States. Massachusetts. Palmer. State Hospital for Epileptics: Employees' Cottage 1906.

People

Artist: Woodhead Studio, American active 1900s

Date

1906

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3376

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Transportation 91.5
Vehicle 91.5
Building 89.1
Nature 87.8
Outdoors 87.6
Housing 87.6
Home Decor 81.8
Plant 75.3
House 71.4
Land 68.8
Tree 65.3
Grass 62.2
Countryside 60.6
Wood 60.1
Poster 59.2
Advertisement 59.2
Villa 56.6

Clarifai
created on 2019-06-05

museum 99.3
landscape 98.3
tree 97.5
people 97.2
window 96.6
house 95.9
art 95
no person 94.3
painting 94.2
home 94
picture frame 93.4
light 92.5
wood 91.4
sky 91
weather 89.3
wall 89
building 88.8
family 88.1
storm 87.3
city 87.2

Imagga
created on 2019-06-05

freight car 88.6
car 77.8
wheeled vehicle 60.4
vehicle 45.1
track 32.3
old 25.1
transportation 22.4
conveyance 19.3
road 19
train 18.3
railway 17.7
landscape 17.1
grunge 17
railroad 16.7
sky 16.7
transport 16.4
travel 16.2
vintage 15.7
locomotive 15.3
trees 15.1
retro 14.8
structure 14.7
billboard 14.6
frame 14.2
antique 13.8
rail 13.7
border 13.6
rural 13.2
snow 13.1
rust 12.5
space 12.4
television 11.8
signboard 11
rough 10.9
dirty 10.8
weathered 10.5
industry 10.2
tracks 9.8
material 9.8
art 9.8
texture 9.7
building 9.6
empty 9.4
journey 9.4
clouds 9.3
way 9.2
city 9.1
paint 9.1
black 9
horizon 9
outdoors 9
designed 8.9
frames 8.8
noise 8.8
film 8.8
strip 8.7
water 8.7
edge 8.7
architecture 8.6
damaged 8.6
line 8.6
grungy 8.5
street 8.3
industrial 8.2
lines 8.1
graphic 8
rails 7.9
noisy 7.9
design 7.9
scratches 7.9
layered 7.9
mess 7.9
freight 7.8
scratch 7.8
scene 7.8
movie 7.8
messy 7.7
layer 7.7
blank 7.7
highway 7.7
collage 7.7
screen 7.7
engine 7.7
tree 7.7
mask 7.7
winter 7.7
stone 7.6
pattern 7.5
mountains 7.4
weather 7.4
speed 7.3
computer 7.3
color 7.2
grass 7.1
theater 7.1
day 7.1
passenger car 7
scenic 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

monitor 94.2
house 94.1
television 92.3
sky 89
tree 83.7
screen 76.1
gallery 71.6
railroad 70.6
black 69.2
old 65.2
picture frame 63.1
building 58.8
room 58.2
flat 43.3

Color Analysis

Feature analysis

Amazon

Train

Clarifai

Picture frame
House
Tree
Window
Plant

AWS Rekognition

Train 91.5%

Clarifai

Picture frame 98.5%

Clarifai

House 87.1%

Clarifai

House 45.9%

Clarifai

House 45.5%

Clarifai

House 33.9%

Clarifai

Tree 79.7%

Clarifai

Tree 67.1%

Clarifai

Window 64.8%

Clarifai

Window 62.1%

Clarifai

Window 54.5%

Clarifai

Window 48.7%

Clarifai

Window 47.1%

Clarifai

Window 46.4%

Clarifai

Window 40.8%

Clarifai

Window 40.7%

Clarifai

Window 39.2%

Clarifai

Window 38.5%

Clarifai

Window 36.8%

Clarifai

Window 35.3%

Clarifai

Window 34%

Clarifai

Plant 39.8%

Categories

Imagga
created on 2019-06-05

cars vehicles 65.6%
nature landscape 20.8%
streetview architecture 5.1%
beaches seaside 2.2%
interior objects 1.3%
paintings art 1.1%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts an old, long, single-story wooden building with a smaller second-story section at its center. The architecture appears simple, with rows of rectangular windows lining the ground floor. A dirt path runs alongside the building, bordered by grassy terrain in the foreground. Trees are visible on the left side, and parts of larger homes or structures can be seen in the background, suggesting a residential or institutional setting. The photograph is framed with a decorative dark matte, giving it a formal, vintage feel.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a historical photograph of the Armory building at Williams College around 1910. The building appears to be a wooden structure with a long rectangular form and a central section that is slightly higher and wider. The roof is sloped, and the exterior shows several evenly spaced windows along the length of the building. There are a few small trees visible on the left side of the image, and a grassy area is in the foreground. In the background, there are other buildings suggesting a campus or institutional setting. The photograph is mounted in a dark frame with the name "Wallace" visible in the lower corner.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a large, multi-story wooden building with a slanted roof. The building appears to be an old structure, likely from an earlier time period. It is surrounded by a grassy field and some other smaller buildings can be seen in the background. The overall scene has a rustic, historic feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white historical photograph showing a long, single-story wooden building with multiple windows along its side. The building appears to be a barracks or dormitory-style structure, with what looks like a stone or concrete foundation wall running along its base. The building has a simple gabled roof and appears to be painted in a dark color. The photograph is mounted on a dark cardboard or paper mat with decorative linear borders. The landscape around the building is fairly sparse, with some grass or open ground visible, and there appear to be some trees or shrubs in the background. The architectural style and photographic quality suggest this image was taken in the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image presents a sepia-toned photograph of a large, two-story building with a long, single-story extension to its left. The building's exterior is clad in dark wood siding, featuring multiple windows on both floors and a central chimney. A dirt path leads to the entrance of the building, which is situated on the left side of the image.

In the foreground, a grassy field stretches out, with a tree visible on the left side of the building. The background of the image reveals additional buildings, set against a clear sky.

The photograph is presented in a dark brown frame, with a thick border surrounding the image. The overall atmosphere of the image suggests a serene and peaceful setting, likely taken in the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

This image is a sepia-toned photograph of a building, likely taken in the late 19th or early 20th century. The building appears to be a single-story structure with a gable roof and a central chimney. It has a long, rectangular shape with multiple windows along its length.

In front of the building, there is a grassy area with a few trees and bushes. A path leads up to the entrance of the building, which is located on the left side of the image. The path is made of dirt or gravel and has a few steps leading up to the entrance.

The background of the image shows a clear sky with no clouds. There are also some other buildings visible in the distance, but they are not clearly defined.

Overall, the image suggests that the building may have been used for residential or commercial purposes, possibly as a school, hospital, or office building. The sepia tone and old-fashioned style of the photograph suggest that it was taken many years ago, possibly in the late 19th or early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image features a vintage photograph of a building set against a backdrop of a grassy field. The building appears to be a large, rectangular structure with a gabled roof, and it has numerous windows, suggesting it might be a dormitory or a similar type of building. The photograph is framed in a dark border, which adds an old-fashioned aesthetic to the image. The building is situated on a slope, with a pathway leading up to it, and there are trees and other buildings visible in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white photograph of a large building. The building is rectangular, with a long, flat roof. It has several windows and doors, and a chimney on the roof. The building is surrounded by a grassy field, with a small tree on the left side. In the background, there are other buildings, possibly houses, and some trees. The photograph has a vintage look, with a brownish tint and a slightly blurred effect.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

Here's a description of the image:

This is a sepia-toned photograph of a long, low building, likely taken in the early 20th century or before. The building is constructed from what appears to be dark wood, and it has many windows running along its length. The windows are rectangular with dark shutters.

The building is partially two-storied, with a higher central section topped with a small square room or tower. The roof is low-sloping and possibly flat, with chimneys visible. A path or walkway runs along the front of the building, and the ground slopes down to a grassy area in the foreground. A tree is to the far left side of the image. In the far background on the right is another house.

The photograph is mounted on a dark grey or black paperboard, which frames the image. The overall impression is one of historical documentation, with a focus on architectural detail.

Created by gemini-2.0-flash-lite on 2025-06-04

Here's a description of the image:

Overall Impression:

The image is a black and white photograph, likely from an earlier era (perhaps early 20th century or older) due to the sepia tone and framing. It depicts a long, low building or complex. The photograph is mounted on a dark gray or black matting.

Building Features:

  • Structure: The main building is long and appears to be constructed of wood, with a horizontal clapboard siding. There are multiple windows with shutters evenly spaced along the building's façade.
  • Design: The building has a central, slightly taller section that likely serves as an entrance or focal point. It appears to have a small porch with a roof. A section of a similar building is visible on the right side.
  • Roof: The roof is a simple, gabled design.
  • Chimneys: There are chimneys visible on the building, indicating fireplaces.

Surroundings:

  • Landscape: The building sits on a slightly sloped grassy area. A pathway runs in front of the building.
  • Vegetation: There are a few trees to the left of the building, and a grass field in the foreground.
  • Background: The background is somewhat plain with other buildings visible behind the main one.

Tone and Atmosphere:

The image has a quiet, somewhat somber feel. It is likely a photograph of an institution, based on the design and the way it is framed in a photo album.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts an old photograph of a long, single-story building with a central section that is slightly taller and has a gabled roof. The building appears to be made of wood, with a dark exterior and several windows along its length. The central section has a small porch with a set of stairs leading up to it.

The building is situated in a grassy area with a dirt path running alongside it. There are a few trees and shrubs around the building, providing some greenery to the scene. The sky is overcast, giving the photograph a muted, vintage feel.

The photograph itself is framed with a dark, wide border, and there is a signature or photographer's mark in the bottom right corner, though it is not entirely legible. The overall impression is of a historical or institutional building, possibly a school, hospital, or barracks from an earlier time period.

Qwen