Human Generated Data

Title

Defectives, Epileptics: United States. New York. Sonyea. Craig Colony: Craig Colony, Sonyea, N.Y.: Swine and House

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1376.2

Human Generated Data

Title

Defectives, Epileptics: United States. New York. Sonyea. Craig Colony: Craig Colony, Sonyea, N.Y.: Swine and House

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1376.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Ground 99.9
Nature 99
Outdoors 97.9
Mammal 97.5
Animal 97.5
Soil 94.1
Building 93.1
Countryside 85.6
Rural 81.3
Shelter 80.9
Housing 74.1
Hut 71.4

Clarifai
created on 2019-06-05

people 98.8
farmhouse 94.6
cavalry 93
no person 92.9
war 91.7
home 91.5
military 90.4
mammal 88.9
house 88.5
group 88.4
tree 87.8
calamity 87.4
landscape 86.7
farm 86.5
adult 86.3
man 86.2
soldier 82.8
vehicle 82.8
monochrome 81.8
nature 81.4

Imagga
created on 2019-06-05

snow 43.6
landscape 37.2
structure 31.8
memorial 30.4
tree 27.8
trees 24.9
weather 24.1
forest 23.5
sky 23.2
gravestone 21.9
road 18.1
cemetery 18
winter 17.9
cold 17.2
season 17.2
old 16.7
stone 15.6
brass 15.1
rural 15
park 14.8
fence 14.8
scenery 14.4
field 14.2
vintage 14.1
countryside 13.7
travel 13.4
scenic 13.2
wood 12.5
grunge 11.9
grass 11.9
clouds 11.8
day 11.8
building 11.7
architecture 11.7
track 11.4
outdoor 10.7
autumn 10.6
country 10.6
scene 10.4
light 9.4
barrier 9.3
ice 9.2
fall 9.1
environment 9.1
texture 9
retro 9
summer 9
snowy 8.8
fog 8.7
antique 8.7
sand 8.5
house 8.4
frame 8.3
outdoors 8.2
frosty 7.8
rock 7.8
frost 7.7
land 7.5
city 7.5
vacation 7.4
branch 7.3
rough 7.3
horizon 7.2
history 7.2
mountain 7.1
textured 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

outdoor 99.8
tree 99.3
grass 99.2
field 93.9
house 91.4
sky 76.7
pasture 54.7
cattle 50
farm building 33.9

Color Analysis

Feature analysis

Amazon

Sheep

Clarifai

Tree
House
Cattle
Animal
Sheep

AWS Rekognition

Sheep 97.5%

AWS Rekognition

Sheep 93.4%

AWS Rekognition

Sheep 92.1%

AWS Rekognition

Sheep 88.1%

AWS Rekognition

Sheep 79.3%

AWS Rekognition

Sheep 78.2%

AWS Rekognition

Sheep 76.9%

AWS Rekognition

Sheep 61.5%

Clarifai

Tree 89.7%

Clarifai

Tree 89.1%

Clarifai

Tree 85.7%

Clarifai

Tree 82.6%

Clarifai

Tree 76.7%

Clarifai

Tree 72%

Clarifai

Tree 62.9%

Clarifai

Tree 57.7%

Clarifai

Tree 56%

Clarifai

Tree 51.5%

Clarifai

Tree 46.8%

Clarifai

Tree 39.9%

Clarifai

Tree 37.6%

Clarifai

House 65.1%

Clarifai

House 46.1%

Clarifai

House 34.8%

Clarifai

Cattle 41.6%

Clarifai

Cattle 36.4%

Clarifai

Animal 34.5%

Clarifai

Sheep 33.7%

Categories

Imagga
created on 2019-06-05

nature landscape 59.8%
beaches seaside 31.6%
paintings art 3.3%
text visuals 3.2%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This is a vintage black-and-white photograph depicting a rural scene with a group of swine grazing in a fenced grassy area. The foreground shows a field scattered with some rocks and tree stumps, while several pigs roam around, eating or rooting in the ground. In the background, there's a house with a large barn-like roof and multiple windows, surrounded by trees. A smaller structure, possibly a shed or gazebo, is visible on the right. The idyllic environment suggests a farm setting, and handwritten text at the bottom of the image reads "SWINE AND HOUSE."

Created by gpt-4o-2024-08-06 on 2025-06-10

The image shows a pastoral scene with a number of pigs grazing in a fenced field. In the background, there is a house or barn, which is large and has a structure featuring a chimney and dormer windows along the roof. The field is surrounded by trees, adding to the rural feel of the image. The ground is grassy and dotted with a few rocks and tree stumps. The photo is in black and white, and there is a handwritten caption at the bottom that reads "SWINE and HOUSE," indicating that the focus of the image is the pigs (swine) and the nearby structure. The number "768" is written in the top right corner of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a pastoral scene with a group of sheep or lambs grazing in a field in front of a wooden house or structure. The house has a distinctive roof and appears to be situated in a wooded area with trees surrounding it. The image has a vintage, sepia-toned appearance, suggesting it is an older photograph.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image shows a large group of pigs grazing in a fenced-in field with a house or farm building in the background. The pigs appear to be free-ranging and are scattered across the grassy area, with some stumps or rocks also visible. Trees line the background behind the wooden fence that encloses the pigs' pasture. The building has a pitched roof and chimney. The caption at the bottom identifies the scene as "SWINE AND HOUSE".

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical black and white photograph labeled "SWINE AND HOUSE" showing a farm scene. In the background, there is a large house with a distinctive roof line and what appears to be a cupola or dormer on top. The house has a porch and appears to be a substantial farmhouse structure. In the foreground, there is a large fenced yard or pen where numerous pigs are grazing. The yard appears to be well-worn from the animals' activity, and there are some tree stumps or rocks visible in the grazing area. The property is surrounded by trees, giving it a rural, pastoral setting. The image appears to be from the early 20th century based on its photographic style and the architecture of the house.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a sepia-toned photograph of a farm with a large house and several pigs in the yard.

The photograph is taken from a distance, showing the front of the house and the yard. The house is a two-story building with a gable roof and a chimney on the left side. It has a porch on the front and a fence surrounding the yard. There are several trees in the background, and a small outbuilding to the right of the house.

In the foreground, there is a large grassy area with several pigs roaming around. Some of the pigs are lying down, while others are standing or walking. The grass is patchy, with some areas appearing to be overgrown.

The sky above is hazy, suggesting that the photo was taken on a cloudy day. The overall atmosphere of the image is one of serenity and tranquility, with the pigs seemingly enjoying their surroundings.

The image appears to be an old photograph, possibly from the early 20th century. The sepia tone and the style of the house suggest that it may have been taken during this time period. The image has been captioned "SWINE AND HOUSE" at the bottom, which provides context for the scene depicted.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a sepia-toned photograph of a farm scene, featuring a large field with numerous pigs grazing and roaming about. In the background, there are several buildings, including a house and a barn, surrounded by trees. The overall atmosphere suggests a rural setting, possibly from an earlier era given the sepia tone and the style of the buildings.

Key Features:

  • Field: The central focus of the image is a large field where many pigs are seen grazing and moving around.
  • Buildings: In the background, there are several structures, including what appears to be a house and a barn. These buildings are characteristic of rural or farm settings.
  • Trees: Surrounding the field and buildings are trees, which add to the natural and serene environment depicted in the image.
  • Sepia Tone: The photograph has a sepia tone, which gives it an aged appearance and suggests that it may have been taken in the past.

Overall Impression:

The image presents a peaceful and idyllic scene of farm life, showcasing the interaction between animals and their environment. The presence of pigs in the field and the rural architecture in the background evoke a sense of simplicity and connection to nature.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of a farm with a swine house in the background. The swine house is a rectangular building with a sloping roof and a chimney on top. It is surrounded by a fence, and there are trees and shrubs in the area. In the foreground, there are several pigs grazing on the grass. Some of them are lying down, while others are standing and eating. The pigs are of different sizes and colors, and some of them have tags on their ears.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a field with a flock of sheep grazing. The sheep are scattered across the field, with some standing and others lying down. In the background, there is a house with a chimney and a fence surrounding it. The house is surrounded by trees, and there is a small structure that looks like a shed or a barn. The photograph has a vintage look, and the text "SWINE AND HOUSE" is written at the bottom.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

Here is a description of the image:

The image is a black and white photograph, likely taken in the early to mid 20th century. It depicts a scene of a rural or agricultural setting, with "SWINE AND HOUSE" printed at the bottom center of the frame.

The main subject of the image is a large group of pigs (or possibly sheep) scattered across a grassy field. They appear to be grazing or moving around, their forms creating a dispersed pattern throughout the field.

In the background, there is a two-story house with a distinctive roof structure, possibly a barn or farm building. The house has a modest, rural architectural style. Next to the house, there is a small, round structure that looks like a gazebo or a small outbuilding, enclosed by a fence.

The field is surrounded by trees in the background, indicating a wooded or semi-rural location. There is also a fence separating the field from the house and the gazebo-like structure.

In the foreground, a tree stump can be seen, adding to the rural and naturalistic feel of the image.

The overall tone of the photograph is historical and pastoral, suggesting a scene from an agricultural setting in a bygone era. There is a number "768" written on the right upper corner.

Created by gemini-2.0-flash-lite on 2025-05-27

Here's a description of the image:

The image is a sepia-toned photograph depicting a rural scene. A large, multi-sectioned wooden building, likely a house or barn, takes center stage, its roof accented by a cupola and chimney. A fence, partially obscured by trees, appears in front of the building and around a smaller, square structure with a domed roof.

The foreground is dominated by a grassy field dotted with a flock of pigs. The pigs are spread out, grazing and interacting with each other. A few trees, with full foliage, surround the house and field creating a sense of a sheltered environment. A tree stump sits prominently in the lower center of the field.

The overall composition suggests a farm setting. The title beneath the image "SWINE AND HOUSE" confirms the subject matter. The photograph has an old, historical feel, with its muted tones and the somewhat grainy quality typical of older photography.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a vintage photograph depicting a rural scene with a house and a group of pigs. The house is a two-story building with a pitched roof and a small porch, surrounded by trees and foliage. In front of the house, there is a fenced area where numerous pigs are grazing and roaming freely. The ground appears to be grassy but somewhat bare in places, likely due to the activity of the pigs. The title "Swine and House" is written at the bottom of the image, indicating that the focus is on the pigs and the residential structure in the background. The overall setting suggests a farm or a homestead where pigs are being raised. The photograph has a sepia tone, which is characteristic of older photographs, adding to its historical feel.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image is a sepia-toned photograph dated as "768" and labeled "SWINE AND HOUSE." It depicts a rural scene with a group of pigs scattered across a grassy area, some grazing and others wandering. In the background, there is a farm structure resembling a house or barn, with a slanted roof and visible windows and a chimney. The area is enclosed by a fence, and there are trees surrounding the property, suggesting a farm or countryside setting. The image gives a nostalgic and historical feel, likely from the late 19th or early 20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This is a sepia-toned photograph labeled "SWINE AND HOUSE" at the bottom. The image depicts a rural scene with a herd of pigs grazing in a fenced pasture. In the background, there is a house with a gabled roof and a chimney. The house is surrounded by trees, and there is a small shed or outbuilding to the right of the house. The overall atmosphere suggests a farm setting, likely from an earlier time period given the style of the photograph. The number "768" is written in the upper right corner, possibly indicating a catalog or reference number.

Text analysis

Amazon

HOUSE
768
SWINE_ A AND HOUSE
AND
SWINE_ A

Google

767 SWINE AND HOUSE
767
SWINE
AND
HOUSE