Human Generated Data

Title

Defectives, Insane: United States. Massachusetts. Waverly. McLean Hospital: McLean Hospital: Stable

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3036.5

Human Generated Data

Title

Defectives, Insane: United States. Massachusetts. Waverly. McLean Hospital: McLean Hospital: Stable

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3036.5

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Building 91.4
Nature 86.3
Outdoors 84.8
Plant 71.9
Grass 71.9
Urban 69.9
Architecture 66.5
Tower 66.5
Housing 65.2
Vehicle 60.3
Transportation 60.3
Office Building 59.5
Postal Office 56.8
Bunker 56.2

Clarifai
created on 2019-06-05

no person 98.7
monochrome 97.4
home 96.6
people 96
house 95
farmhouse 93.9
barn 92.1
war 92.1
building 92
vintage 90.5
architecture 88.1
street 87.8
farm 87.1
military 86.5
old 85.5
vehicle 85.4
landscape 85
sepia 84.6
family 83.6
winter 82.5

Imagga
created on 2019-06-05

passenger car 72.5
car 62.4
wheeled vehicle 53
house 38.7
building 34.8
vehicle 34.7
architecture 31.1
structure 29
sky 26.6
rural 22
home 21.5
old 20.9
barn 19.1
trees 17.8
conveyance 17.8
roof 17.5
farm 17
station 15.8
exterior 14.8
construction 14.6
railway station 14.1
garage 14.1
travel 14.1
window 13.8
tree 13.2
country 13.2
new 13
countryside 12.8
clouds 12.7
grass 12.7
field 12.6
windows 12.5
door 12.4
snow 12.1
landscape 11.9
wood 11.7
terminal 11.6
housing 11.4
estate 11.4
church 11.1
residence 10.6
wooden 10.6
residential 10.5
facility 10.5
abandoned 9.8
brick 9.6
sunny 9.5
hut 9.4
wall 9.3
mountain 9
religion 9
houses 8.7
school 8.7
real 8.5
winter 8.5
summer 8.4
outdoors 8.2
transportation 8.1
history 8.1
neighborhood 7.9
land 7.8
rustic 7.7
buildings 7.6
lawn 7.5
town 7.4
historic 7.3
mobile home 7

Google
created on 2019-06-05

House 81.2
Architecture 78.7
Building 74.1
Home 68.2
Rural area 65.4
History 64.5
Landscape 59.3
Black-and-white 56.4
Farm 55.5
Vehicle 51.9

Microsoft
created on 2019-06-05

outdoor 100
sky 99.4
ground 96.4
house 92.3
building 90
old 69.2
cloud 55.5
dirt 32.8

Color Analysis

Feature analysis

Amazon

Train

Clarifai

Tree
House
Window
Plant

AWS Rekognition

Train 60.3%

Clarifai

Tree 80.9%

Clarifai

Tree 64.5%

Clarifai

Tree 41.8%

Clarifai

Tree 38.2%

Clarifai

Tree 35.4%

Clarifai

Tree 35%

Clarifai

House 74.9%

Clarifai

House 55.7%

Clarifai

House 54.7%

Clarifai

House 53.5%

Clarifai

House 50.5%

Clarifai

House 41.1%

Clarifai

House 36.6%

Clarifai

House 36.5%

Clarifai

House 33.6%

Clarifai

Window 51.9%

Clarifai

Window 50.2%

Clarifai

Window 49.3%

Clarifai

Window 47.8%

Clarifai

Window 46.6%

Clarifai

Window 45.7%

Clarifai

Window 44.9%

Clarifai

Window 44.5%

Clarifai

Window 42.7%

Clarifai

Window 42.7%

Clarifai

Window 40.9%

Clarifai

Window 39.5%

Clarifai

Window 38.2%

Clarifai

Window 37.7%

Clarifai

Window 37%

Clarifai

Window 36.4%

Clarifai

Window 35.5%

Clarifai

Window 35%

Clarifai

Window 34.7%

Clarifai

Window 33.4%

Clarifai

Window 33.1%

Clarifai

Plant 45.5%

Categories

Imagga
created on 2019-06-05

cars vehicles 99.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-29

a photograph of a large building with a large building in the background

Created by general-english-image-caption-blip-2 on 2025-07-05

a large building with a large clock on top

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a historic brick building situated in a rural setting with open fields and hills in the background. The architecture features a combination of pitched roofs, dormer windows, and a cupola at the center of the structure. The building appears to be sturdy and well-designed, possibly serving an institutional or agricultural purpose. In the distance, there are additional smaller structures, including houses and stone fences, suggesting a village or farm community. The overall scene has an early 20th-century feel.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts an old architectural structure, likely a barn or a farm building, captured in black and white. The building appears to be constructed of brick, with a distinctive, multi-angled roof adorned with small dormer windows. The central part of the roof includes a cupola with venting, which might have been used for ventilation or lighting. The building is set in a rural landscape, surrounded by open fields and with a background of distant, gentle hills and bare trees, suggesting the photo was taken in a season when leaves are either sparse or have fallen. There are a few other buildings visible in the far right background, likely indicating a small rural community or farm complex. The photograph gives an impression of early 20th-century architecture and rural life.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a large, multi-story building with a distinctive roof structure. The building appears to be made of wood and has several dormers and chimneys. It is situated in a rural or small-town setting, with grassy fields and hills visible in the background. The image has a sepia-toned, historical appearance, suggesting it is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white historical photograph of what appears to be an institutional building, likely from the late 19th or early 20th century. The building has a distinctive architectural style with brick walls on the lower level and white clapboard or similar material on the upper level. It features multiple dormers on the roof, a central cupola with ventilation, and appears to have an extended wing or corridor stretching to the right. The building sits on a grassy landscape with rolling hills visible in the background. The architecture suggests this could be part of a school, hospital, or similar institutional facility. The photograph has the quality and style typical of documentary photography from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image depicts a large, two-story brick building with a distinctive roofline featuring multiple peaks and dormers. The building has a central tower or cupola and a long, rectangular shape with a flat roof. It is situated in a rural or suburban area, surrounded by grassy fields and trees in the background. The sky above is overcast, suggesting a cloudy day.

The building appears to be an old farmhouse or barn, possibly from the early 20th century. The presence of a central tower or cupola suggests that it may have been used for storage or as a lookout point. The multiple peaks and dormers on the roof indicate that the building may have been designed to provide additional space for living quarters or storage.

Overall, the image presents a serene and peaceful scene, with the old building standing proudly in the midst of the natural surroundings.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of a large, two-story building with a gable roof and a central cupola. The building appears to be made of brick or stone and has several windows on both floors. In the foreground, there is a grassy area with a dirt path leading up to the building. In the background, there are trees and hills, suggesting that the building is located in a rural or suburban area. The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image shows an old photograph of a building, possibly a barn or a farm building, with a large, sloping roof and multiple windows. The building is constructed with brick walls and has a chimney on top. The building is surrounded by a vast grassy field, with a road leading up to it. In the distance, there are trees and a hill, and the sky is cloudy.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photo of a building. The building is a large structure with a sloped roof. It has many windows and a chimney on the roof. The building is situated in a grassy field. There are some trees in the distance, and the sky is cloudy. The image has a vintage filter, giving it an old-fashioned look.

Google Gemini

Created by gemini-2.0-flash on 2025-06-02

The image is a sepia-toned photograph of a large, brick building. The building has a complex roofline, with a central pyramidal structure topped by a weather vane. Several dormer windows jut out from the roof.

The building is surrounded by a large, grassy field. In the background, trees and hills can be seen. There are also houses in the distance. The sky is overcast. The photograph has a vintage feel, possibly taken in the early 20th century.

Created by gemini-2.0-flash-lite on 2025-06-02

Here's a description of the image:

Overall Impression:

The image is a sepia-toned, vintage photograph of a brick building in a rural or suburban setting. It appears to be from the early to mid-20th century. The building is the primary focus, and the surrounding environment gives a sense of place and time.

Building Details:

  • Architecture: The building has a distinctive architectural style. It features a complex roofline with gabled sections, dormer windows, and a central section that rises higher, possibly with a cupola or a lookout structure. The building appears to be primarily brick.
  • Windows and Openings: The building has rows of rectangular windows, suggesting a regular grid or structural layout within.
  • Structure: The building looks like it has a symmetrical layout.
  • Condition: the building is well-maintained

Environment:

  • Setting: The building is set on a spacious grassy area. Beyond the building, there are trees, suggesting a wooded area or park. In the distance, gently rolling hills can be seen, and there appear to be a few houses.
  • Sky: The sky is overcast and seems to have soft, diffused sunlight.
  • Paths/Roads: There's a dirt or gravel road leading towards the building.

Overall: The image evokes a sense of history and a feeling of quietude. It could be a photograph of a school, a community center, or perhaps a facility for waterworks.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a large, single-story brick building with a distinct architectural design, likely from the early 20th century. The structure features a steeply pitched roof with multiple dormer windows, which allow for natural light to enter the upper sections of the building. The roof is topped with a small, decorative cupola.

The building has a symmetrical layout with a central section that projects slightly forward, flanked by two wings on either side. The central section has a gabled roof and a prominent entrance, suggesting it might be the main entry point. The wings have flat roofs and numerous windows, indicating that they could be used for classrooms or offices.

The building is situated in a rural or semi-rural area, with open fields surrounding it. In the background, there are some trees and other smaller buildings, possibly residential houses. The overall setting suggests a peaceful and spacious environment.

The photograph appears to be old, as indicated by the sepia tone and the slight wear and tear visible on the image. This gives it a historical feel, capturing a moment from a bygone era.

Qwen

No captions written

Text analysis

Google

3
3