Human Generated Data

Title

Defectives, Insane: United States. Massachusetts. Waverly. McLean Hospital: McLean Hospital. Men's Gymnasium: Entrance hall and smoking room

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3035.2

Human Generated Data

Title

Defectives, Insane: United States. Massachusetts. Waverly. McLean Hospital: McLean Hospital. Men's Gymnasium: Entrance hall and smoking room

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3035.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Flooring 100
Floor 100
Furniture 99.9
Indoors 94.8
Interior Design 94.8
Room 94.3
Living Room 94.3
Hardwood 89.3
Wood 89.3
Table 84.8
Housing 70.5
Building 70.5
Couch 64.6
Fireplace 55.8

Clarifai
created on 2019-06-05

furniture 99.7
room 99.6
indoors 99.4
seat 98.9
chair 98.3
table 97.6
home 97.5
no person 96.7
house 95.4
interior design 95
inside 94.2
sofa 93.9
window 93.5
family 93.1
ceiling 92.6
apartment 92.5
lamp 89.2
dining room 88.2
architecture 88.1
desk 86.4

Imagga
created on 2019-06-05

room 94.9
interior 73.5
table 65.2
kitchen 62.8
furniture 61.4
chair 56.9
house 51.1
home 42.4
floor 39.1
area 37.7
design 33.8
wood 33.4
restaurant 33.1
modern 33
dining 32.4
decor 31.9
chairs 29.4
anteroom 26.5
window 25.7
inside 24.9
indoor 24.7
seat 24.3
luxury 23.2
architecture 22.8
contemporary 22.6
lamp 22.1
living 20.9
decoration 20.3
comfortable 20.1
style 20.1
empty 19.8
cafeteria 19.8
glass 19.5
light 19.4
indoors 19.4
counter 18
dinner 17.7
residential 17.3
tables 16.8
structure 16.7
food 15.7
stool 15.5
apartment 15.4
sofa 15.3
decorate 15.3
stove 14.8
hall 14.4
plant 14.2
wall 14
building 13.8
dining table 13.2
patio 12.7
drink 12.6
hotel 12.4
space 12.4
upscale 11.9
elegance 11.8
cabinet 11.6
lunch 11.2
classroom 11.1
cook 11
eat 10.9
cabinets 10.9
rug 10.9
tile 10.8
hardwood 10.8
oven 10.8
residence 10.7
carpet 10.7
couch 10.6
estate 10.5
place 10.3
bar 10.2
3d 10.1
relaxation 10.1
stylish 10
drawer 9.9
refrigerator 9.9
studio apartment 9.8
furnishing 9.8
vase 9.7
wooden 9.7
lighting 9.7
elegant 9.4
relax 9.3
domestic 9.1
sink 8.8
desk 8.8
render 8.7
expensive 8.6
office 8.6
nobody 8.6
real 8.6
chandelier 8.4
island 8.3
meal 8.1
steel 8
diner 7.8
armchair 7.6
fireplace 7.4
coffee 7.4
service 7.4
marble 7.1
urban 7

Google
created on 2019-06-05

Room 92.7
Black-and-white 89
Interior design 88.7
Building 86.9
Architecture 80.4
Floor 79.4
Furniture 78.3
Table 74.6
House 73.1
Ceiling 72.9
Monochrome 70.2
Monochrome photography 69.6
Loft 68.1
Flooring 65.4
Style 52.5
Chair 51.3

Microsoft
created on 2019-06-05

floor 100
indoor 100
ceiling 99.3
room 99
wall 98.9
table 98.8
chair 98.2
house 92.3
kitchen & dining room table 90.1
living 88.2
coffee table 87.5
desk 80.6
furniture 78.7
interior 75
fireplace 68.2
cabinetry 52.7
building 50.4
area 31.8
several 21.3

Color Analysis

Feature analysis

Amazon

Chair
Dining Table

Clarifai

Chair
Window
Building
Door
Table
Fireplace
Picture frame

AWS Rekognition

Chair 99.9%

AWS Rekognition

Chair 99.7%

AWS Rekognition

Chair 99.7%

AWS Rekognition

Chair 97.7%

AWS Rekognition

Chair 71.5%

AWS Rekognition

Dining Table 84.8%

Clarifai

Chair 97.4%

Clarifai

Chair 83.8%

Clarifai

Chair 80.1%

Clarifai

Chair 79.8%

Clarifai

Chair 75.1%

Clarifai

Chair 72.5%

Clarifai

Chair 71.1%

Clarifai

Chair 67.8%

Clarifai

Chair 61.4%

Clarifai

Chair 57.5%

Clarifai

Chair 57.2%

Clarifai

Chair 53.5%

Clarifai

Chair 47.6%

Clarifai

Chair 47.1%

Clarifai

Chair 45%

Clarifai

Chair 38.1%

Clarifai

Window 61.8%

Clarifai

Building 54.9%

Clarifai

Door 46.7%

Clarifai

Door 34.3%

Clarifai

Table 46.5%

Clarifai

Fireplace 46.1%

Clarifai

Picture frame 40%

Categories

Imagga
created on 2019-06-05

interior objects 98.6%
streetview architecture 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-29

a photograph of a living room with a fireplace and a fireplace

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a living room with a fireplace

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image depicts an elegant, vintage interior space, likely a communal parlor or lounge from the early 20th century. The room features polished wooden floors, arched architectural details, and an assortment of ornate furniture. In the foreground, there is a table surrounded by chairs, while a chandelier with intricate detailing hangs from the ceiling.

On the left side, a fireplace with a prominent mantle serves as a focal point, accompanied by classic armchairs. Above the fireplace is a framed artwork, creating a cozy yet formal ambiance. In the background on the right, large windows allow natural light to illuminate the room, and potted plants enhance the space with greenery. There is also a piano and additional seating near the windows, reflecting the room's function as a place for leisure and socialization. The open doorways on the far side give a glimpse into adjacent hallways or rooms.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts an elegant, historical room, perhaps a parlor or common area in a large house or institution, with a vintage aesthetic. A prominent feature is the large wooden fireplace on the left side of the room, which is centrally placed along the wall. Above it hangs a framed picture or painting, and there are two wall-mounted lights on either side.

In the middle of the room is a table with chairs surrounding it, reflecting early 20th-century style. A chandelier hangs from the ceiling, providing light and adding to the classic ambiance.

On the right side of the room, there is a grand piano accompanied by additional chairs, suggesting a space used for both leisure and musical entertainment. Large windows in that area allow natural light to fill the room, and several potted plants are placed on a table by the windows, offering a touch of greenery.

The flooring is wooden, and the room extends into a hallway on the left, indicating that this is a part of a larger building. The overall aesthetic of the room demonstrates a formal and luxurious setting with a harmonious blend of functional and decorative elements.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows the interior of what appears to be a grand, historic building. The room is spacious and ornate, with high ceilings, arched doorways, and a large fireplace. The room is furnished with antique-style furniture, including a table and chairs, as well as a chandelier hanging from the ceiling. The walls are decorated with framed artwork and other decorative items. The overall atmosphere suggests a formal, elegant setting, possibly a living room or parlor of a historic mansion or estate.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white historical photograph of what appears to be a formal parlor or sitting room, likely from the late 19th or early 20th century. The room features elegant Victorian-era furnishings including:

  • A prominent fireplace with a decorative mantel
  • An ornate chandelier hanging from the ceiling
  • Several upholstered chairs and seating areas
  • A decorative table in the center of the room
  • A piano against one wall
  • Potted plants near the windows
  • Wall sconces for lighting
  • Framed artwork on the walls

The room has hardwood flooring and high ceilings typical of the period. Through an archway, there appears to be a windowed sitting area, and to the left, a long hallway extends out of view. The overall style suggests this might be from a wealthy home, hotel, or institution of the era. The image has the number "74" in the bottom right corner, suggesting it may be part of a series of documentary photographs.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

The image depicts a large, open room with a high ceiling and hardwood floors. The room is furnished with several pieces of furniture, including a fireplace, a piano, and several chairs and tables.

Key Features:

  • Fireplace: A large fireplace is located on the left side of the room, with a mantle above it. The fireplace appears to be made of stone or brick.
  • Piano: A grand piano is situated in the center of the room, facing the fireplace. The piano has a dark finish and appears to be an older model.
  • Chairs and Tables: Several chairs and tables are scattered throughout the room, including a large table in the foreground with a vase of flowers on it. The chairs are upholstered in a light-colored fabric, and the tables have a dark finish.
  • Windows: Large windows are located on the right side of the room, allowing natural light to enter. The windows have a decorative trim around them.
  • Lighting: A chandelier hangs from the ceiling above the piano, providing additional lighting for the room.
  • Decorations: Several decorative items are visible in the room, including a clock on the mantle above the fireplace and a few pieces of artwork on the walls.

Overall Impression:

The room appears to be a formal living space, possibly in a large house or mansion. The furniture and decorations suggest a sense of elegance and sophistication, while the high ceiling and large windows create a sense of openness and airiness.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image is a black and white photograph of a room with a fireplace, a piano, and several chairs. The room has a high ceiling and a large window on the right side. There is a fireplace on the left wall, with a mantle above it that has a clock and other decorations. In front of the fireplace is a table with two chairs. On the right side of the room is a piano, with a chair in front of it. There are several other chairs scattered throughout the room, as well as a plant in the corner. The floor is made of wood and has a shiny finish. The walls are painted white, and there are several pieces of artwork hanging on them. The overall atmosphere of the room is one of elegance and sophistication, with its high ceilings, large windows, and ornate furniture.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black-and-white image features an old-fashioned living room. The room has a wooden floor, white walls, and a ceiling with a chandelier. The room has several pieces of furniture, including chairs, a table, a piano, and a fireplace. There are also two picture frames on the wall, one of which is near the fireplace. On the right side, there is a window with plants on the sill.

Created by amazon.nova-lite-v1:0 on 2025-05-31

A black-and-white image of a room with wooden floors and white walls. There are several pieces of furniture, including a table with a chair, a fireplace, a piano, and a chandelier. There are also picture frames hanging on the wall. There are also several windows on the right side of the room, and there are potted plants outside the windows. The image has a watermark on the bottom right corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-05

Here's a description of the image:

Overall Impression:

The image is a sepia-toned photograph of a large, well-lit interior space. It appears to be a living room or lounge area of an older building, possibly a grand home or a public building. The scene conveys a sense of spaciousness and formality.

Key Features:

  • Architecture: The room features a high ceiling, hardwood floors, and architectural details like archways and a large fireplace. There are several doorways and hallways visible, suggesting a multi-room layout.
  • Furniture: The space is furnished with a mix of furniture, including armchairs, tables, chairs, a grand piano, and possibly a rocking chair or two. The style suggests an older era.
  • Lighting: The room is lit by both natural light from a large window (right side) and overhead lighting, in the form of a chandelier. There are sconces above the fireplace.
  • Decor: The space has artwork, plants, and possibly a clock above the fireplace.

Composition:

The photograph is well-composed, with a sense of balance and depth. The diagonal lines of the floorboards lead the eye through the space. The fireplace provides a focal point.

Atmosphere:

The overall atmosphere is one of quiet elegance and a glimpse into a bygone era. The sepia tone enhances this feeling of nostalgia.

Created by gemini-2.0-flash on 2025-06-05

Here's a description of the image:

This black and white photograph depicts a well-lit, spacious interior room, reminiscent of a lounge or common area. The room features a polished wooden floor, and the furniture is arranged in a manner suggesting a comfortable and functional space.

To the left, a doorway leads into another room, offering a glimpse down a hallway. Adjacent to this doorway, a fireplace with an ornate mantel is the focal point of the wall. Above the mantel, there's a framed picture and decorative items.

In the center of the room, a table with an ornately curved base and a single chair occupy the space. A chandelier hangs above the table, providing lighting.

To the right of the room, separated by an archway, is a bright seating area. Large windows let in ample light, and plants are positioned along the window sills. A piano and several tables with chairs are arranged in this area, creating a relaxing atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a spacious, well-lit room that appears to be a living or sitting area, likely from an earlier time period given the style of furniture and decor. The room features several notable elements:

  1. Furniture:

    • There are multiple chairs and a small sofa, with some chairs having ornate designs and upholstered seats.
    • A table with a decorative top is centrally placed in the room.
    • A fireplace is situated against one wall, with a mantel that holds various decorative items, including a framed picture, candles, and possibly a clock.
  2. Lighting:

    • A chandelier hangs from the ceiling, providing a central light source.
    • Natural light is streaming in through large windows on the right side of the room, which are covered with blinds.
  3. Decor:

    • The walls are adorned with framed pictures.
    • There are plants placed around the room, adding a touch of greenery.
    • The floor is polished wood, with a large area rug placed in the center.
  4. Architecture:

    • The room has high ceilings and a spacious feel.
    • There is an arched doorway or passage leading to another part of the house or building.
    • The walls are plain with a light color, enhancing the brightness of the room.

Overall, the room exudes a sense of elegance and comfort, characteristic of a formal sitting area from a past era.

Qwen

No captions written

Text analysis

Amazon

74

Google

74
74