Human Generated Data

Title

Untitled (family in front of shack)

Date

1950

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18186

Human Generated Data

Title

Untitled (family in front of shack)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18186

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Shelter 99.6
Nature 99.6
Outdoors 99.6
Building 99.6
Countryside 99.6
Rural 99.6
Person 99.6
Human 99.6
Person 96.2
Clothing 85.4
Apparel 85.4
Hut 80.5
Shack 76.2
Urban 73.3
Shorts 69.3
Housing 65.2
Yard 63.4
Face 58.2
Apiary 55.4
Person 53.1

Clarifai
created on 2023-10-22

people 99.8
home 98.8
adult 98.8
group together 98.4
group 98.3
campsite 97.3
vehicle 95.5
calamity 94.5
war 94.2
man 93.6
tent 93.5
waste 90.1
several 89.6
child 89.3
family 89
many 88.9
monochrome 88.9
three 88.6
two 87.9
house 87.7

Imagga
created on 2022-03-04

structure 52.6
building 52.1
greenhouse 38.3
rural 22.9
house 22.6
old 22.3
sky 21.7
architecture 21.1
landscape 18.6
trees 17.8
travel 17.6
wheeled vehicle 16.8
tree 15.4
school 15.1
history 14.3
grass 14.2
wood 14.2
shopping cart 13.2
summer 12.2
fence 11.5
outdoor 11.5
scenic 11.4
forest 11.3
container 11.3
scene 11.3
mobile home 11
historic 11
handcart 10.8
farm 10.7
country 10.5
home 10.4
clouds 10.1
season 10.1
water 10
housing 9.8
wooden 9.7
autumn 9.7
roof 9.5
ancient 9.5
winter 9.4
countryside 9.1
vintage 9.1
tourism 9.1
outdoors 9
sun 8.9
trailer 8.8
light 8.7
fog 8.7
canvas tent 8.7
vehicle 8.5
field 8.4
rubbish 8.4
church 8.3
memorial 8.2
fall 8.1
wall 8.1
religion 8.1
holiday 7.9
sea 7.8
abandoned 7.8
cold 7.7
sunny 7.7
houses 7.7
culture 7.7
beach 7.6
snow 7.5
ocean 7.5
town 7.4
park 7.4
exterior 7.4
village 7.3
picket fence 7.2
stone 7.1
agriculture 7

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

outdoor 97.9
black and white 94
house 93.5
text 93.1
black 78.4
white 70.1
old 48.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 43-51
Gender Male, 82.1%
Confused 58.8%
Sad 17%
Surprised 12.9%
Calm 3.7%
Happy 3.3%
Angry 2.6%
Fear 1%
Disgusted 0.7%

AWS Rekognition

Age 4-12
Gender Male, 56.8%
Fear 83.7%
Surprised 14.5%
Calm 0.7%
Happy 0.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Sad 0.1%

Feature analysis

Amazon

Person
Person 99.6%
Person 96.2%
Person 53.1%

Categories

Imagga

paintings art 80.7%
cars vehicles 18%

Captions

Microsoft
created by unknown on 2022-03-04

an old photo of a house 74.3%
an old photo of a person 55%
an old photo of a building 54.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people standing around a building -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of a small, dilapidated house or shack, with a family standing outside.

The house has a sloping roof and is constructed from brick or concrete blocks. The walls are cracked and crumbling, and the door is open. A chimney protrudes from the roof. The ground around the house is littered with debris, including broken furniture, trash, and what appears to be a car tire.

In the foreground, a man stands on the right side of the image, wearing a hat, a plaid shirt, and white pants. He has his hands on his hips and is looking at the camera. To his left, a woman stands in the doorway of the house, holding a child. The child is wearing a dress and has a bow in her hair. Behind them, another man stands, wearing a hat and a light-colored shirt.

The background of the image is dark, suggesting that it was taken at night or in a shaded area. The overall atmosphere of the image is one of poverty and neglect. The house appears to be in a state of disrepair, and the family's living conditions seem to be harsh.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image depicts a black-and-white photograph of a man standing in front of a dilapidated structure, with two children visible inside. The man is dressed in a hat, plaid shirt, and pants, and appears to be engaged in conversation or gesturing towards the camera.

In the foreground, the man stands on a dirt path surrounded by scattered debris and overgrown vegetation. The structure behind him features a corrugated metal roof and walls constructed from various materials, including what appears to be cardboard or plastic sheets. A chimney protrudes from the roof, suggesting that the structure may have been used for cooking or heating purposes.

Inside the structure, two children can be seen standing near the entrance. They are both wearing casual clothing and appear to be looking out at the man or the camera. The overall atmosphere of the image suggests a sense of poverty and hardship, with the dilapidated structure and surrounding debris implying a lack of resources or access to basic amenities.

The image may have been taken during a time of economic hardship or social unrest, and could potentially be used to illustrate the challenges faced by marginalized communities or individuals living in poverty. However, without additional context or information, it is difficult to determine the specific circumstances or events depicted in the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The black-and-white image depicts a scene of a dilapidated shack in a rural or abandoned area. The shack appears to be made of wood and has a damaged roof, with some parts of it missing. The surroundings are littered with debris and broken objects, suggesting neglect and abandonment. In front of the shack, there is a man standing, wearing a hat and a plaid shirt. He seems to be observing the surroundings or perhaps waiting for someone.

In the background, there are trees, and the sky is dark, indicating that it might be either early morning or late evening. The image conveys a sense of desolation and abandonment, with the man standing in the foreground as a solitary figure in a desolate landscape. The overall mood of the image is somber and reflective, evoking a sense of loneliness and isolation.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white image shows a man standing in front of a house in an outdoor area. He is wearing a hat and a checkered long-sleeve shirt. Behind him, a woman and two kids are standing. The house has a slanted roof, and a chimney is on top of it. In front of the house, there are some pieces of wood, a bucket, and other things. Behind the house, there are some trees.

Google Gemini

Created by gemini-2.0-flash on 2025-05-23

The image is a black and white photograph of what appears to be a family standing outside a makeshift house. The house is constructed from various materials and has a chimney. A man wearing a hat stands in the foreground, pointing towards the house with his right hand. Behind him, near the entrance of the house, are three other figures. A stroller sits to the right of the man. The ground is covered with debris and vegetation. The negative inversion of the photo results in a somewhat surreal, high-contrast appearance.

Created by gemini-2.0-flash-lite on 2025-05-23

Here's a description of the image:

Overall Impression:
The image is a black and white negative, giving it a stark and somewhat surreal quality. It appears to be a photograph of a family or group of people in a rural setting. The scene is cluttered, and the subjects are positioned around a modest, makeshift structure.

Key Elements:

  • The Structure: A small, simple building or shack dominates the left side. It looks to be constructed with salvaged materials, possibly wood. It has a crude chimney and a makeshift appearance.
  • The People: A man in the foreground is wearing a hat, shirt and pants. There are other people visible near the structure.
  • The Setting: The setting is outdoors and has a somewhat desolate feel. There are scattered items, including old shoes, on the ground, suggesting an impoverished or transient lifestyle. Bare trees in the background add to the raw and unpolished atmosphere.
  • Composition: The photograph is well-composed, with the structure and people positioned to create a sense of balance. The use of black and white enhances the visual impact.

Possible Interpretations:
The image could be depicting a scene of poverty, hardship, or a simple, self-reliant way of life. The makeshift structure, cluttered surroundings, and casual attire of the people indicate modest circumstances. The photograph may be part of a documentary or social commentary series, capturing a snapshot of a particular place or time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image is a black-and-white photograph depicting a man standing in front of a makeshift structure. The man is dressed in light-colored clothing, including a hat, a jacket, and trousers. He is holding an object in his hands, which appears to be a piece of cloth or a garment.

The structure behind him is constructed from a variety of materials, including what looks like cardboard, fabric, and possibly metal sheets. The roof is made from a patchwork of materials, and there is a large bottle-like object protruding from the top. The walls of the structure are similarly made from a mix of materials, and there are various items hanging or placed around it, including clothes, containers, and other miscellaneous objects.

The ground around the structure is uneven and covered with debris, including branches, leaves, and other natural materials. The setting appears to be outdoors, possibly in a rural or wooded area, as there are trees and shrubs visible in the background. The overall scene suggests a rustic, perhaps impoverished, living situation.

Text analysis

Amazon

SID
KODAK-EEELA

Google

SIA VT37A2- XAGON
SIA
VT37A2-
XAGON