Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Illinois. Leclaire. Nelson Manufacturing Company: Welfare Institutions. N. O. Nelson Co., Leclaire, Ill.: Working Man's Home: 6 rooms - city water-electric lights - cost without land $1700.00

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2250.2

Human Generated Data

Title

Industrial Problems, Welfare Work: United States. Illinois. Leclaire. Nelson Manufacturing Company: Welfare Institutions. N. O. Nelson Co., Leclaire, Ill.: Working Man's Home: 6 rooms - city water-electric lights - cost without land $1700.00

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2250.2

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Architecture 100
Outdoors 100
Shelter 100
Neighborhood 99.3
Grass 99.2
Plant 99.2
House 99.2
Housing 99.2
Porch 99.2
Clothing 93.9
Dress 93.9
Fashion 88.4
Formal Wear 87.9
Gown 87.9
Wedding 87.9
Wedding Gown 87.9
City 86.2
Tree 86.2
Nature 77.4
Face 63.2
Head 63.2
Road 57.8
Street 57.8
Urban 57.8
Photography 57.6
Adult 57.2
Bridegroom 57.2
Male 57.2
Man 57.2
Suburb 56.6
Cottage 56.3
Villa 55.9
Baseball 55.9
Baseball Glove 55.9
Glove 55.9
Sport 55.9
Door 55.9
Walking 55.5
Brick 55.4
Yard 55.3

Clarifai
created on 2019-02-18

people 99.2
house 98.7
home 98.1
street 97.7
tree 94.6
architecture 94.3
building 94.1
family 93.9
adult 91.8
man 90.7
no person 90.7
road 86.3
cavalry 82.7
woman 81.7
storm 80.2
group 80
winter 79.7
wood 77.9
fence 76.3
landscape 75.9

Imagga
created on 2019-02-18

patio 100
area 98.4
structure 92.9
house 55.3
architecture 51.3
home 44.7
building 41
estate 35.2
real 32.3
construction 29.1
residence 26.4
sky 23.6
residential 23
dwelling 22.6
property 22.3
roof 21.9
exterior 20.3
trees 19.6
town 19.5
suburban 18.8
new 18.6
window 17.8
travel 16.9
street 15.7
modern 15.4
grass 15
landscape 14.9
luxury 14.6
wall 14.5
windows 14.4
suburbs 13.8
houses 13.6
architectural 13.5
expensive 13.4
brick 13.2
housing 12.9
mortgage 12.7
buildings 12.3
lawn 12.3
urban 12.2
investment 11.9
fence 11.9
old 11.9
realty 11.8
wood 11.7
door 11.4
clouds 11
neighborhood 10.8
landscaping 10.8
city 10.8
garage 10.1
garden 9.9
tourism 9.9
vacation 9.8
flowers 9.6
lamp 9.5
living 9.5
contemporary 9.4
tree 9.2
driveway 8.9
yard 8.8
balcony 8.6
stone 8.4
church 8.3
history 8.1
light 8
rural 7.9
bungalow 7.9
masonry 7.9
mansion 7.9
deck 7.8
real estate 7.8
sunny 7.8
outdoors 7.5
historic 7.3
square 7.2
road 7.2
coast 7.2
summer 7.1
sea 7
wooden 7

Google
created on 2019-02-18

Photograph 96.6
House 93.6
Home 93
Snapshot 86
Building 73.9
Room 71.4
Architecture 65.5
Paper product 59.4
History 54.1

Microsoft
created on 2019-02-18

outdoor 98.5
old 45
house 45
courthouse 26.3
church 19.5
tree 12.7
black and white 10.5
building 9.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 25-35
Gender Male, 77%
Happy 42%
Confused 33.7%
Calm 8.9%
Surprised 8.9%
Fear 8.5%
Sad 2.9%
Angry 1.6%
Disgusted 1.4%

AWS Rekognition

Age 23-33
Gender Male, 88.3%
Calm 77.7%
Sad 12.2%
Surprised 6.7%
Fear 6.5%
Confused 2.8%
Disgusted 2%
Happy 1.4%
Angry 0.7%

Feature analysis

Amazon

Person
Building

Clarifai

No features identified

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 96%

AWS Rekognition

Building 92.3%

Categories

Imagga
created on 2019-02-18

paintings art 97.4%
streetview architecture 2.2%

Captions

Microsoft
created by unknown on 2019-02-18

a vintage photo of a house 92%
a vintage photo of an old building 88.7%
a vintage photo of a building 88.6%

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a woman sitting on a bench in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts an early 20th-century rural or suburban scene featuring a modest, two-story wooden house with a gabled roof and clapboard siding. The house has a small front porch with steps leading down to a neatly curved sidewalk surrounded by a manicured lawn. A fenced yard is visible to the left, along with a small outbuilding in the background, possibly a barn or shed. To the right of the house, trees provide shade and add to the picturesque feel. In the foreground, a man and a woman are seated on chairs, positioned on the lawn in front of the house. The man is dressed in a shirt and tie, and the woman is wearing a long white dress, suggesting they're enjoying a quiet moment outdoors. The image is sepia-toned, evoking a vintage aesthetic. The number "47" is handwritten in the bottom right corner.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a sepia-toned photograph of a couple sitting on a lawn in front of a two-story house. The house has a covered front porch with steps leading down to a paved pathway that winds through the well-kept lawn. The architecture suggests an early 20th-century American home, with a gable roof and wooden siding. There are a few small trees and a fenced-off area to the left of the house. In the background, there is a small outbuilding, possibly a shed or workshop. The couple, likely from the same time period, appear relaxed, with the man dressed in a shirt and pants, and the woman in a long white dress. The number "47" is handwritten in the bottom right corner of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a large, two-story wooden house with a porch and gabled roof. The house is surrounded by trees and has a gravel path leading up to it. In the foreground, there are two people sitting on the porch, a man and a woman, both dressed in clothing typical of the late 19th or early 20th century. The image has a sepia tone, indicating it is an old photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a sepia-toned vintage photograph showing a classic American house from what appears to be the early 1900s. The house is a two-story white clapboard structure with a steep pitched roof and a covered front porch supported by columns. There's a concrete or stone walkway leading to the porch steps. Two people are seated on the porch steps, and the photograph captures a domestic, peaceful scene. In the background, there's a tree on the right side of the house and what appears to be an outbuilding or barn visible on the left side of the image. The yard appears well-maintained with a neat lawn. The photograph has the number "47" marked in the lower right corner, suggesting it may be part of a collection or series.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image is a sepia-toned photograph of a house with two people sitting in front of it.

The house is two stories tall and has a porch on the front. It is made of clapboard siding and has a gable roof. There are several windows on both floors, and a chimney rises from the roof. A sidewalk leads from the street to the front door.

In front of the house, a man and woman are sitting on a bench. The man is wearing a white shirt and pants, and the woman is wearing a long white dress. They are both looking at the camera and smiling.

To the left of the house, there is a small outbuilding with a sloping roof. In the background, there are trees and a clear sky.

The overall atmosphere of the image is one of warmth and happiness. The couple appears to be enjoying each other's company, and the house looks like a cozy and welcoming place to live.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image depicts a sepia-toned photograph of a house with a couple sitting on the front lawn. The house is two stories tall, featuring a covered porch and a chimney. A tree stands to the right of the house, while a fence runs along the left side of the yard. In the background, another building is visible, although its purpose is unclear.

The couple, dressed in old-fashioned clothing, sits on a bench or chair in front of the house. The woman wears a long dress, while the man is attired in a suit and tie. The overall atmosphere of the image suggests a serene and peaceful setting, likely taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The image appears to be a vintage photograph of a house with two people sitting on a chair in front of it. The house has a chimney and a porch with a railing. The two people are dressed in old-fashioned clothing, with the man wearing a hat and the woman wearing a dress. The house is surrounded by trees and a fence, and there is a small building in the distance. The image has a sepia tone, giving it an old-fashioned look.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The image is an old black-and-white photograph of a house. Two people sit on chairs in front of the house. The house has a porch with a railing and a staircase. The house has windows and a chimney. A tree is in front of the house. A pathway is in front of the house. A wooden fence is on the left side of the house. A shed is on the left side of the house.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here is a description of the image:

This is an old sepia-toned photograph of a house and yard, possibly from the late 19th or early 20th century. The house is the focal point, a two-story structure with a gabled roof and clapboard siding. It has a front porch supported by columns and a chimney. In front of the house, a man and a woman are seated in a grassy area. The woman is wearing a long white dress, while the man is dressed in a lighter colored shirt. A tree is situated to the right of the house, and a pathway leads towards the front door. In the yard there is a shed or outbuilding. The photograph has a vintage quality, with some slight fading and imperfections, adding to its historical charm.

Created by gemini-2.0-flash on 2025-05-01

This monochrome photograph showcases a two-story house with a distinctive high-pitched roof. The house is constructed with horizontal siding and features a covered porch at the front. A pathway, appearing as a light stripe, curves from the side of the house, adding a touch of elegance to the landscape.

In front of the house, a man and a woman are seated. The man is dressed in a lighter-colored shirt, trousers, and a tie, suggesting a semi-formal attire. The woman is wearing a long, flowing white dress that drapes around her as she sits.

To the left of the main house, partially obscured by trees, stands a smaller building, likely a shed or garage, with a simple gable roof and door. A fence runs along the side of the yard, adding a sense of enclosure.

To the right of the house, another building can be seen, indicating a neighborhood setting. A large tree with dense foliage is positioned to the right of the main house, its branches reaching toward the top of the frame.

The photograph is uniformly tinted in sepia tones, giving it an antique or vintage appearance, as if it were an image from a bygone era. The overall composition of the shot, with the house as the central element and the surrounding buildings and figures adding context, suggests a carefully arranged family portrait or an architectural record.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image depicts a vintage photograph of a two-story house with a gabled roof and a front porch supported by columns. The house appears to be constructed with wooden siding and has a symmetrical design with multiple windows on both the first and second floors.

In front of the house, there are three people: two children and one adult. The children are sitting on the grass, while the adult, who appears to be a woman, is standing beside them. The woman is wearing a long dress, typical of the fashion from the late 19th or early 20th century. The children are dressed in what seems to be period-appropriate clothing as well.

The yard is well-maintained with a pathway leading up to the porch steps. There are trees and shrubbery around the house, adding to the picturesque setting. To the left of the house, there is a smaller structure, possibly a shed or garage, and a fence running along the property line. The overall scene conveys a sense of tranquility and domestic life from a bygone era.

Qwen

Text analysis

Amazon

47