Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the treatment

Date

c. 1905

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.334.3

Human Generated Data

Title

Charity, Tuberculosis: United States. Massachusetts. Rutland. Massachusetts State Sanatorium: Massachusetts State Sanatorium: Taking the treatment

People

Artist: Unidentified Artist,

Date

c. 1905

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.334.3

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 93.6
Human 93.6
Clinic 92.7
Hospital 87.7
Person 83.1
Person 75.3
Wood 66.1
Operating Theatre 59.1
Plywood 55.7

Clarifai
created on 2025-01-10

people 100
adult 99.4
group together 99.2
two 98.2
war 98.1
man 97.9
administration 97.5
reclining 97.4
woman 97.3
group 96.9
one 96.7
military 95.8
furniture 94.6
vehicle 94.1
soldier 94.1
street 93.5
wear 92.1
child 90.5
three 90.4
skirmish 90.3

Imagga
created on 2022-06-25

room 90.8
bedroom 75.6
interior 46
house 40.1
furniture 38.8
home 37.5
luxury 30
sofa 28.9
modern 28.7
decor 27.4
floor 25.1
chair 25
table 24
lamp 23.8
comfortable 22.9
living 22.7
wood 22.5
residential 22
architecture 22
window 21.1
relaxation 20.9
design 20.8
hospital 20.5
indoors 20.2
hotel 20.1
bed 20
pillow 19.4
travel 19
wall 18.7
light 18.7
apartment 18.2
relax 16.8
studio couch 16.8
rest 16.8
seat 15.1
inside 14.7
water 14.7
comfort 14.5
sea 14.1
motel 13.8
suite 13.8
decoration 13.8
convertible 13.4
style 13.4
estate 13.3
sleep 12.6
deck 12.3
mattress 11.9
cozy 11.8
domestic 11.8
clean 11.7
ocean 11.6
couch 11.6
lodging 10.9
space 10.9
living room 10.8
vacation 10.6
wooden 10.6
resting 10.5
indoor 10
relaxing 10
luxurious 9.7
residence 9.7
structure 9.5
empty 9.5
lifestyle 9.4
nobody 9.3
holiday 9.3
elegance 9.2
boat 9.2
sky 8.9
chairs 8.8
carpet 8.8
real 8.5
resort 8.4
tourism 8.3
landscape 8.2
night 8
guest 7.9
bedding 7.9
pillows 7.9
furnishings 7.9
hardwood 7.9
lounge 7.8
sleeping 7.8
color 7.8
glass 7.8
3d 7.7
vase 7.7
summer 7.7
elegant 7.7
decorate 7.6
fashion 7.5
leisure 7.5
cover 7.4
warm 7.4
new 7.3
panel 7.3
people 7.3

Google
created on 2022-06-25

Sky 93.8
Window 86.2
Wood 84.3
Building 75.8
Monochrome 72.8
Monochrome photography 72.2
Art 72
Room 65.8
Hardwood 64
House 61.7
Visual arts 61.2
Landscape 59.8
Vintage clothing 58.5
Roof 55.9
Ocean 53
Sitting 52.2
Sea 51.7
Horizon 51.4
Still life photography 50.1

Microsoft
created on 2022-06-25

indoor 86.3

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 27-37
Gender Female, 97.3%
Sad 48.3%
Calm 21.5%
Fear 17%
Disgusted 14.1%
Angry 11.3%
Surprised 9.8%
Happy 2.5%
Confused 1.1%

AWS Rekognition

Age 29-39
Gender Female, 99.6%
Surprised 98.9%
Fear 8.8%
Happy 3%
Sad 2.4%
Calm 2.3%
Angry 1.5%
Disgusted 1.2%
Confused 1%

AWS Rekognition

Age 22-30
Gender Male, 87.4%
Disgusted 89.3%
Calm 7.9%
Surprised 6.4%
Fear 6%
Sad 2.5%
Confused 0.6%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Female, 55.5%
Calm 39.6%
Surprised 25.9%
Fear 20.8%
Angry 6.4%
Sad 4.4%
Happy 4.1%
Disgusted 2.5%
Confused 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Person 93.6%
Person 83.1%
Person 75.3%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people sitting on a porch -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a group of people sitting outdoors on a wooden balcony or veranda in a snowy landscape. They are bundled up in warm clothing, blankets, and furs to protect against the cold. Some are lounging in chairs, while others appear to be reading. The architectural details of the building behind them include columns and large windows. The view stretches out to a flat, snow-covered terrain with sparse vegetation in the background, giving a sense of a wintry, serene setting. The individuals seem relaxed despite the chilly conditions, indicating that they may be enjoying fresh air or participating in a health-related activity such as cold air therapy, which was popular in certain historical contexts.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a group of people sitting in lounge chairs on a porch. The porch features large columns and extends outward, providing a view of a snowy landscape. The individuals are bundled up with blankets and coats, indicating cold weather. Some are reading books, while others appear to be engaging in conversation or resting. The atmosphere seems serene and leisurely, with the people enjoying fresh air despite the chilly conditions. The porch is elevated, offering a panoramic view of the barren and snow-covered land beyond.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of people sitting or lying on beds or mattresses on a balcony or porch overlooking a snowy landscape. The people appear to be bundled up in blankets and coats, suggesting it is a cold outdoor environment. The balcony or porch has large windows that provide a view of the winter scenery in the distance. The overall scene conveys a sense of people seeking shelter and comfort in an outdoor setting during what seems to be a cold winter day.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical black and white photograph showing what appears to be a tuberculosis sanatorium's outdoor recovery porch or balcony. Several patients are resting on reclining chairs, bundled up in heavy blankets or fur robes to stay warm while getting fresh air treatment, which was a common therapeutic practice in the early 20th century. The porch has white columns and wooden flooring, and there appears to be a winter landscape visible in the background. This type of "fresh air" treatment was typical of TB sanatoriums of the era, where patients would spend hours outdoors in all weather conditions as part of their recovery regimen.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image depicts a group of people gathered on a wooden deck, with a snow-covered landscape visible in the background. The scene appears to be set in a rural or mountainous area, possibly during the winter season.

  • People:
    • There are approximately 15 individuals in the image, all dressed in warm clothing, including coats, hats, and scarves.
    • Some people are seated on chairs or benches, while others are standing or leaning against the railing.
    • The majority of the individuals appear to be women, although it is difficult to determine their exact number.
  • Deck:
    • The deck is made of wood and has a railing along the edge.
    • There are several chairs and benches scattered throughout the deck, providing seating for the group.
    • The deck appears to be covered in a thin layer of snow, suggesting that it may have been recently snowed on.
  • Background:
    • In the distance, there is a snow-covered field or meadow.
    • Beyond the field, there are trees and hills visible on the horizon.
    • The sky above is overcast, with a thick layer of clouds obscuring the sun.
  • Overall:
    • The image conveys a sense of community and social gathering, as the group of people appears to be enjoying each other's company.
    • The winter setting and snow-covered landscape add a sense of coziness and warmth to the scene.
    • The image may have been taken during a special event or celebration, such as a holiday party or family gathering.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of a group of people sitting on a balcony, with a snowy landscape in the background. The balcony has a wooden floor and railings, and the people are seated in chairs or on benches, some of them wrapped in blankets or coats. They appear to be enjoying the view and each other's company.

In the foreground, there is a large window with multiple panes, and a column supporting the roof of the balcony. The overall atmosphere of the image suggests a cold winter day, but the people seem to be warm and comfortable despite the chill.

The image may have been taken in the early 20th century, based on the style of clothing and the architecture of the building. It could be a scene from a resort or a vacation home, where people have gathered to enjoy the winter scenery and each other's company.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of a porch or balcony with several people sitting on chairs. The people are dressed in warm clothing, suggesting it is a cold day. They are sitting on the porch, which has a railing, and there are some blankets and pillows on the chairs. The porch has a wooden floor and a white railing. In the background, there is a vast landscape with snow-covered ground and some trees.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black-and-white photograph of a group of people sitting on a balcony. The balcony has a wooden floor and a railing. The people are sitting on chairs and seem to be reading books. Some of them are wearing hats and gloves. A woman is standing near the window. The balcony is surrounded by snow. In the distance, there is a vast area covered with snow.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

The black and white image shows a group of people, possibly patients, resting and reading on a long porch, likely at a sanatorium or similar health facility. The building appears to be institutional, with tall windows and architectural columns. The porch is wooden, and the people are lying in lounge chairs or on blankets, bundled up against the cold. Some are covered with thick fur blankets.

The landscape in the background is stark and wintry, likely a flat, snow-covered plain with bare trees dotting the horizon. The sky is overcast, contributing to the somber and quiet atmosphere. The image has a historical feel due to its monochrome tone and the attire of the people, suggesting it was taken in the early to mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-08

Here's a description of the image:

Overall Impression:

The image is a vintage black and white photograph, likely from the early to mid-20th century. It depicts a group of people resting on a porch or balcony of a building, bundled up against what appears to be cold weather. The atmosphere is quiet and calm.

Details:

  • Setting: The scene takes place on a wooden porch or balcony. The backdrop shows a flat, snowy landscape, indicating a cold climate. The building has a classical design with pillars.
  • People: Several people are present. Most are reclined in chairs, wrapped in blankets, furs, and coats. Some appear to be reading. One woman is sitting and reading alone at the end.
  • Weather: The presence of snow and the heavy clothing worn by the people strongly suggest a cold, possibly winter, day.
  • Composition: The photographer has captured a long shot from a side angle, focusing on the people and the porch. The horizon provides a strong background element.
  • Mood: The image evokes a sense of leisure, relaxation, and a quiet time.

Possible Context:

The image may be from a sanatorium, a hospital or clinic, where patients were encouraged to rest and receive fresh air, and light. It could also be an observation deck of a scenic view.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a group of people resting on a balcony or porch of a building during a cold season, possibly winter. The scene is set in a snowy landscape, with a vast expanse of snow-covered ground visible in the background.

The people are bundled up in heavy blankets and warm clothing, indicating the cold weather. They are seated on what appear to be wooden benches or chairs. The balcony has a wooden floor and railing, and the building's exterior includes large windows with multiple panes. The overall atmosphere suggests a moment of relaxation or recuperation, possibly in a sanatorium or a similar institution where people might go to recover from illnesses, given the setting and the way they are wrapped in blankets. The image has a historical feel, likely from the late 19th or early 20th century, based on the clothing and architectural style.