Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2948.2

Human Generated Data

Title

Social Settlements: United States. Maryland. Baltimore. "Lawrence House": The Lawrence House, Baltimore, Md.: Irish, German and Italian Families.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2948.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.8
People 92
Art 91.7
Urban 73.6
Apparel 73.1
Clothing 73.1
Building 71.5
Walkway 66.5
Path 66.5
Family 58.3
Workshop 57.5
Porch 56.9

Clarifai
created on 2019-06-05

people 100
group 100
child 99.5
adult 99.2
many 99.2
group together 99
several 98.3
war 97.5
administration 97.1
man 96.2
military 95.8
wear 94.5
five 93.4
four 93.3
three 92.9
vehicle 92.5
woman 91.7
offspring 90.2
soldier 87.8
transportation system 86.8

Imagga
created on 2019-06-05

old 30.7
architecture 29.7
ancient 27.7
cemetery 26.7
building 24.7
stone 24.2
travel 19
tourism 19
grunge 18.7
city 18.3
history 17.9
structure 16.6
historic 16.5
historical 16
culture 15.4
art 15.1
statue 15
vintage 14.1
monument 14
antique 13.8
religion 13.4
landmark 12.6
wall 12
street 12
sculpture 11.7
decoration 11.6
aged 10.9
temple 10.7
town 10.2
person 10.1
tourist 10
altar 9.8
medieval 9.6
scene 9.5
famous 9.3
church 9.2
dirty 9
child 9
sepia 8.7
man 8.7
house 8.4
texture 8.3
cell 8
urban 7.9
artistic 7.8
people 7.8
memorial 7.7
old fashioned 7.6
retro 7.4
paper 7.2
male 7.2
romantic 7.1

Google
created on 2019-06-05

People 96.6
Photograph 96.1
Snapshot 85.2
Standing 79.6
Family 68.4
Vintage clothing 67.8
Child 64.5

Microsoft
created on 2019-06-05

clothing 99.4
person 99.2
posing 98.9
human face 98.2
baby 98.2
toddler 97.4
old 97.2
child 94.4
smile 91.6
standing 87.8
boy 80.5
woman 73.1
group 69
vintage 57.7
photograph 54.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-13
Gender Female, 99.3%
Disgusted 6.1%
Surprised 3.5%
Happy 43.8%
Calm 16.7%
Angry 22.7%
Sad 5.7%
Confused 1.6%

AWS Rekognition

Age 4-9
Gender Female, 54.8%
Calm 45.1%
Angry 45.1%
Disgusted 45%
Sad 45.5%
Surprised 45%
Happy 54.2%
Confused 45.1%

AWS Rekognition

Age 1-5
Gender Female, 85.6%
Sad 82.8%
Disgusted 2.3%
Surprised 0.8%
Happy 1.4%
Confused 2.5%
Angry 8%
Calm 2.3%

AWS Rekognition

Age 19-36
Gender Female, 64.6%
Sad 20.9%
Surprised 0.4%
Disgusted 0.9%
Calm 0.6%
Happy 1%
Confused 0.7%
Angry 75.5%

AWS Rekognition

Age 6-13
Gender Female, 53%
Angry 0.2%
Happy 96.8%
Surprised 0.3%
Calm 1.7%
Confused 0.2%
Sad 0.7%
Disgusted 0.2%

AWS Rekognition

Age 35-52
Gender Female, 99.9%
Angry 0%
Happy 99.6%
Surprised 0%
Calm 0%
Confused 0%
Sad 0.2%
Disgusted 0%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Clothing
Human face
Footwear
Tree
Woman
Human hair

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 96%

AWS Rekognition

Painting 91.7%

Clarifai

Clothing 87.9%

Clarifai

Clothing 85%

Clarifai

Clothing 76.4%

Clarifai

Clothing 75.5%

Clarifai

Clothing 74.2%

Clarifai

Clothing 62.4%

Clarifai

Clothing 58.2%

Clarifai

Clothing 46.4%

Clarifai

Clothing 45.8%

Clarifai

Human face 77.8%

Clarifai

Human face 74.8%

Clarifai

Human face 73.6%

Clarifai

Human face 73.3%

Clarifai

Human face 70.5%

Clarifai

Human face 70.4%

Clarifai

Human face 48.9%

Clarifai

Footwear 71.9%

Clarifai

Footwear 67.8%

Clarifai

Footwear 61.8%

Clarifai

Footwear 61.4%

Clarifai

Footwear 61.4%

Clarifai

Footwear 60.7%

Clarifai

Footwear 59%

Clarifai

Footwear 43.6%

Clarifai

Footwear 36.6%

Clarifai

Footwear 33.7%

Clarifai

Tree 59.3%

Clarifai

Woman 47.1%

Clarifai

Human hair 35.1%

Clarifai

Human hair 34.8%

Categories

Imagga
created on 2019-06-05

paintings art 99.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

an old photo of a family with a dog

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing in front of a fence

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a group of people, primarily children, gathered in a yard with a rustic atmosphere. The group is positioned against a wooden fence, which shows signs of wear. A tree trunk is visible next to the fence, and behind it, parts of a brick building and a window can be seen. The children are dressed in vintage clothing, indicative of an older time period, with long dresses and patterned shirts. Some are holding a small dog, adding a lively element to the scene. The yard is paved with cobblestones, and clothing is hanging on the fence to dry. Overall, the setting suggests a modest, urban or residential area from the past.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a group of children standing outdoors, possibly in a backyard or alleyway, as evidenced by the rough wood fence behind them and cobblestone ground underfoot. The fence has visibly weathered panels and is adjacent to a tree. The children are dressed in the typical attire of the early 20th century, including dresses and button-up shirts. One of the children is holding a small dog, which is positioned in the center of the image and adds a playful element to the scene. Behind the fence, part of a brick building can be seen with laundry hanging to dry. In the background, there is another child visible above the fence in a window of the building. There is a faded numeral "S I 11" written in the top left corner which may be an archival reference. The overall atmosphere conveyed by the photograph is casual and candid, capturing a moment in everyday life during that era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph of a group of people, likely a family, standing outside of what looks like an old, dilapidated building or structure. The group includes several adults and children, some of whom are holding a small dog. The people are dressed in clothing typical of an earlier era, with the women wearing long dresses and the men wearing coats and hats. The background suggests a rural or urban setting with some wooden structures and debris visible. The overall scene conveys a sense of modest living conditions.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a vintage black and white photograph, likely from the early 1900s, showing a group of children and an adult standing outside what appears to be a modest urban dwelling. The setting suggests this might be in a working-class neighborhood, with weathered walls visible in the background. The children are dressed in the style of the era, with some wearing plaid or checkered shirts and one young girl in a white dress. The image has the characteristic grainy quality of early photography and provides a glimpse into what appears to be urban life from that historical period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image depicts a vintage black-and-white photograph of a woman and six children standing in front of a wooden fence, with a brick wall visible in the background. The woman is positioned on the right side of the image, wearing a long-sleeved dress and holding a baby in her arms. To her left are five children, ranging in age from young to older, all dressed in old-fashioned clothing.

In the center of the group, one of the older girls is holding a small dog. The children are arranged in a staggered formation, with some standing closer to the front than others. The overall atmosphere of the image suggests a family gathering or portrait, possibly taken in the early 20th century given the style of clothing and the sepia tone of the photograph.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image depicts a black-and-white photograph of a group of children and a woman standing in front of a wooden fence, with a brick building in the background.

The woman, positioned on the right side of the image, has dark hair and is dressed in a long-sleeved blouse and a long skirt. She is holding a baby in her arms, who is wearing a white dress. To her left, a girl is holding a dog, while another girl stands to her right. A boy is positioned to the left of the girl holding the dog, and a smaller girl stands in front of them.

The group is standing on a cobblestone street, with a wooden fence behind them. The fence appears to be old and weathered, with some sections missing or broken. In the background, a brick building can be seen, with a doorway and windows visible.

The overall atmosphere of the image suggests that it was taken in a rural or urban setting, possibly during the early 20th century. The clothing and hairstyles of the individuals in the photo are consistent with this time period, and the condition of the fence and building suggests that the photo may have been taken in a less affluent area.

The image provides a glimpse into the lives of a group of people who may have been living in poverty or hardship. The fact that they are standing together in a group, despite their apparent difficulties, suggests a sense of community and resilience.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

In an old black-and-white photo, a group of children is standing together on a cobblestone road. The children are smiling, and some of them are holding a dog. Behind them, there is a wooden fence, and a tree trunk is standing next to it. Behind the fence, there is a brick building with a window. On the right side, there are clothes hanging on the fence.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The image is a black-and-white photograph depicting a family portrait. The family consists of a woman, two children, and a baby. They are standing in front of a wooden fence, with a tree trunk visible behind them. The woman is holding the baby, and the children are standing close to her. The baby is wearing a white dress, and the children are dressed in simple, vintage clothing. The photograph has a sepia tone, giving it an old-fashioned look. The image captures a moment of family togetherness, with the woman smiling and the children looking up at the camera.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

This is a black and white photograph taken outdoors. It appears to be a vintage snapshot, likely from the early 20th century. A woman and five children are posing in front of a wooden fence.

Here's a breakdown of what I see:

  • The People: A woman stands in the center of the group, holding a baby in her arms. There are two girls and two boys. One girl is wearing a dress, a girl is holding a small dog, another girl is wearing a white dress with a bow on her head, and the boy is wearing a striped shirt and pants, and the other boy is standing with a dress.
  • Setting: The backdrop is a weathered wooden fence and the side of a building. A large tree trunk is visible to the left of the group. The ground appears to be made of brick or cobblestone.
  • Overall Impression: The photograph has a nostalgic feel, typical of older photos. The subjects are dressed in period clothing. The setting suggests a modest or possibly urban environment. It seems like a family portrait.

Created by gemini-2.0-flash on 2025-06-16

Here is a description of the image:

General Description:
The image is an old, sepia-toned photograph of a family group posed outdoors, likely in a backyard or alley. The image shows signs of age, with some discoloration and wear.

Foreground:

  • People: There is a group of five children and a woman, presumably the mother.
    • The woman is standing, holding a toddler in her arms. She is smiling slightly.
    • There are four other children. One girl in a dark dress stands to the left, while another is holding a small dog. A little girl with a bow in her hair stands near the center. To the right, a boy in a striped shirt and dark pants is positioned.
  • Ground: The ground is paved with brick or stones. There's some debris and what appears to be a piece of metal or machinery in the bottom left corner.

Background:

  • Fence: Behind the family, there is a tall, wooden fence with gaps and visible wear.
  • Building: Part of a brick building is visible above the fence on the left. There are also some other structures and what appears to be laundry hanging on a line behind the family on the right side of the fence.
  • Tree: A tree trunk is visible in the center behind the children, suggesting the photo was taken near a tree or against the fence of a yard.

Overall Impression:

The photograph gives the impression of a family portrait from the late 19th or early 20th century. The style of clothing, the setting, and the photographic tone all point to this period. The image is informal and candid, capturing a moment in the lives of the subjects.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a vintage black-and-white photograph depicting a group of six individuals, likely a family, standing in front of a dilapidated building. The setting appears to be an urban alleyway or courtyard with cobblestone ground and worn-out wooden structures.

From left to right, the individuals are:

  1. A young girl wearing a long dress with a shawl draped over her shoulders. She is leaning against the wall with her arms crossed.
  2. A young boy holding a small dog. He is wearing a shirt and pants.
  3. A young child, possibly a toddler, dressed in a light-colored outfit, standing in front of the boy holding the dog.
  4. A woman, likely the mother, standing behind the children. She is wearing a long dress and has her hair styled in a bun.
  5. A young boy wearing a cap, jacket, and pants, standing in front of the woman.
  6. A young girl in a white dress with a large bow in her hair, standing in the center of the group.

The building behind them has peeling paint and appears to be in poor condition, suggesting a low-income or impoverished setting. The overall atmosphere of the photograph conveys a sense of hardship and resilience. The image likely dates back to the late 19th or early 20th century, based on the clothing styles and the quality of the photograph.

Qwen

No captions written

Text analysis

Amazon

Il