Human Generated Data

Title

Rose and Her Mother, Fall River, MA

Date

1982

People

Artist: Polly Brown, American 1941 -

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.233

Human Generated Data

Title

Rose and Her Mother, Fall River, MA

People

Artist: Polly Brown, American 1941 -

Date

1982

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.233

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.9
Human 99.9
Person 97.3
Shoe 97.2
Clothing 97.2
Footwear 97.2
Apparel 97.2
Interior Design 96.1
Indoors 96.1
Room 94.8
Chair 81.1
Furniture 81.1
Person 74.9
Appliance 73.4
Bedroom 71.4
Refrigerator 68.5
Living Room 66
Person 65.4
Monitor 64.8
Display 64.8
Screen 64.8
Electronics 64.8
Dorm Room 58.5
Clinic 55.7

Clarifai
created on 2023-10-25

people 99.9
room 99.1
chair 99
two 98.2
adult 97.6
man 97.5
monochrome 97.2
woman 96.9
sit 96.3
furniture 96
group 95.9
child 95.6
three 95.2
desk 95.2
group together 93.8
hospital 93.4
seat 92.4
indoors 92.4
family 92.1
medical practitioner 89.6

Imagga
created on 2022-01-08

computer 37.3
office 35.3
laptop 34.4
man 32.9
work 29.8
business 27.9
person 27.5
people 27.3
male 27
room 26.8
businessman 24.7
professional 24.3
chair 23.4
working 23
men 21.5
adult 21.5
indoors 21.1
home 18.4
teacher 18.3
corporate 18
interior 17.7
classroom 17.3
modern 16.8
furniture 16.3
technology 16.3
desk 15.9
device 15.7
handsome 15.2
worker 15.1
notebook 14.9
smiling 14.5
executive 14.2
job 14.2
communication 13.4
house 13.4
education 13
occupation 12.8
equipment 12.8
confident 12.7
businesswoman 12.7
suit 12.6
attractive 12.6
happy 12.5
table 12.5
musical instrument 12.5
meeting 12.3
sitting 12
smile 11.4
indoor 11
network 11
lifestyle 10.8
call 10.4
senior 10.3
monitor 10.2
student 10.1
seat 9.9
group 9.7
success 9.7
employee 9.6
women 9.5
floor 9.3
projector 9.3
briefcase 9
life 8.5
keyboard 8.4
portrait 8.4
pretty 8.4
school 8.4
manager 8.4
mature 8.4
machine 8.1
team 8.1
looking 8
black 7.8
portable computer 7.7
electronic instrument 7.7
hand 7.6
career 7.6
phone 7.4
inside 7.4
light 7.4
successful 7.3
design 7.3
teenager 7.3
barber chair 7.2
support 7.1
to 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

indoor 98.7
person 94.4
text 94.1
clothing 94
black and white 82.9
furniture 74.9
man 63.4
footwear 52.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 94.6%
Confused 2%
Surprised 1.4%
Sad 0.7%
Angry 0.6%
Fear 0.4%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 0-3
Gender Female, 98.2%
Sad 63.7%
Calm 27.6%
Confused 3.4%
Disgusted 2.4%
Angry 1.8%
Happy 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 0-4
Gender Male, 99.7%
Calm 89.7%
Sad 5.6%
Disgusted 1.2%
Angry 1%
Surprised 0.9%
Happy 0.7%
Confused 0.6%
Fear 0.3%

AWS Rekognition

Age 0-3
Gender Female, 99.7%
Calm 97.9%
Happy 0.6%
Confused 0.4%
Sad 0.4%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 63.3%
Calm 99.7%
Sad 0.1%
Angry 0.1%
Confused 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Female, 57%
Surprised 43.6%
Fear 26.7%
Happy 7.7%
Angry 5.9%
Sad 5.7%
Calm 4.3%
Confused 4%
Disgusted 2.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Chair
Refrigerator
Person 99.9%
Person 97.3%
Person 74.9%
Person 65.4%
Shoe 97.2%
Chair 81.1%
Refrigerator 68.5%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a woman standing in a living room with a baby in a rocking chair -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts an interior domestic scene in black and white. A woman is standing near a refrigerator, dressed casually in a blouse and pants. The living space features patterned wallpaper, and various objects are present, such as a baby stroller and furniture. A seated adult is holding a baby on a chair, while a young child lies on the floor with a pillow nearby. A television is turned on, showing a smiling figure, and shelves are filled with decorations. The room has a cozy yet lived-in appearance.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a black and white photograph capturing a domestic scene inside a living room. There is a woman standing by a refrigerator, possibly pregnant, looking towards the living area. In the center of the room, a baby is lying in a baby walker. A person is sitting on a padded chair, holding a small child in their lap. In the background, the walls are covered in patterned wallpaper, and there is a stove visible. On the left, a television is on, displaying an image of a smiling person. The room appears to have various household items and decor, including shelves with decorative items on the right. A young child is lying on the floor in the foreground, resting on a pillow. The setting and objects suggest it is a home environment from the mid-to-late 20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to depict a domestic scene in a home. It shows a woman standing in a kitchen, with a refrigerator and other appliances visible. In the foreground, a woman is seated in a chair holding two infants, while a young child is sleeping on the floor nearby. The room is cluttered with various personal items and furnishings, creating a sense of a lived-in, family environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing what appears to be a domestic scene in a living room. The room has wallpaper with a tree pattern and contains various furniture pieces including a leather armchair and what looks like a television or media cabinet. There's a refrigerator visible, and a high chair or baby seat in the middle of the room. The image captures what seems to be a family moment, with a pregnant woman standing by the refrigerator, someone seated in the armchair holding two infants, and another child resting on the floor. The photograph has a documentary-style quality typical of candid family photography from what appears to be the 1970s or 1980s, based on the interior decor and furnishings.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a woman standing in a kitchen, with two babies and another woman sitting in a chair in the background.

The woman standing in the kitchen has dark hair and is wearing a white shirt with a floral pattern and dark pants. She is holding a bottle in her right hand and appears to be preparing a meal or snack. The kitchen is equipped with a refrigerator, stove, and television. There is also a baby bouncer and a rocking chair in the room.

In the background, there is a woman sitting in a chair holding a baby on her lap. Another baby is lying on a pillow on the floor. The room is decorated with wallpaper and furniture, and there are various objects on the shelves and tables.

Overall, the image suggests that the woman in the kitchen is taking care of her children and preparing a meal or snack while the other woman is also caring for a baby in the background. The image provides a glimpse into the daily life of a family with young children.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This image is a black-and-white photograph of a woman standing in front of a refrigerator, with another woman sitting in a chair holding two babies. The woman by the refrigerator has dark hair and is wearing a white shirt with a floral pattern and dark pants. She appears to be pregnant. The woman in the chair has short dark hair and is wearing a white shirt and dark pants. She is holding two babies, one in each arm.

In the foreground, there is a baby lying on the floor. To the left of the image, there is a television set with a picture of a baby on the screen. The room is decorated with wallpaper featuring a forest scene, and there are various pieces of furniture and objects scattered throughout the space. The overall atmosphere of the image suggests a cozy and intimate family setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The black-and-white photo shows a living room with a family. The woman in the middle is pregnant and standing near the refrigerator. The woman sitting on the couch is holding two babies. Another baby is lying on the pillow on the floor. There is a cabinet with a bowl on top near the refrigerator. A television is on the left side. A shelf with a few owls is on the right side.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a living room with a woman and four children. The woman is sitting on a couch, holding two babies. The babies are wearing identical outfits. On the floor, there is a baby stroller and a child sleeping on a pillow. A woman is standing next to the refrigerator, and she is pregnant. There is a television on the left side of the room, and a cabinet is behind the couch.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

The black and white photograph captures a candid domestic scene. The composition is centered, showcasing a living room or kitchen area.

In the foreground, a young child is lying on a pillow, seemingly asleep. To the left, a woman, visibly pregnant, stands near a refrigerator with her back to the camera. The refrigerator is adorned with magnets. In the background, another woman is seated in a large armchair, holding two babies. A baby swing is positioned in front of her. The room is decorated with floral wallpaper and furnished with a vintage television set displaying an image, and a cabinet filled with decorative objects. The room looks lived-in and is bathed in natural light.

Created by gemini-2.0-flash on 2025-05-16

The black and white photograph depicts a domestic scene, likely from the 1970s or early 1980s, featuring several family members in a cluttered yet intimate setting.

On the left side of the frame, a young woman stands near a refrigerator, visibly pregnant. She is wearing a patterned blouse and jeans, and her gaze is directed slightly downward. To her left, an older-style television set displays a face on the screen.

To the right, a woman sits in a large armchair, holding two babies. Her expression is somewhat pensive. A baby stroller sits nearby, and behind her is a cabinet filled with figurines, adding to the feeling of a lived-in space.

On the floor in the foreground, a child lies asleep on a pillow, creating a sense of both chaos and peace within the scene. The overall composition of the photograph is candid and unfiltered, offering a glimpse into the everyday life of a family.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The black-and-white photograph depicts a domestic scene that appears to be from the mid-20th century. Here’s a detailed description:

  1. Setting: The room is a living space with a vintage aesthetic. The wallpaper features a pattern with trees and houses.

  2. People:

    • A young girl, standing by an open refrigerator, is looking inside it. She is wearing a short-sleeved dress with a pattern and dark pants.
    • A woman is seated in a leather armchair, holding two babies, one in each arm. She is wearing a dark dress and has short, dark hair.
    • A young boy is lying on the floor, appearing to be asleep or resting. He is dressed in a striped shirt and light-colored pants.
  3. Furniture and Objects:

    • To the left, there is a television set displaying an image of a person.
    • Next to the refrigerator, there is a small table with a cloth covering it.
    • A baby walker is placed in the center of the room.
    • There is a dresser or cabinet with drawers behind the baby walker.
    • The room contains other miscellaneous items, such as a bowl on top of the television and various decorations on the furniture.
  4. Atmosphere: The scene portrays a casual, everyday moment in a family's life, capturing the simplicity and warmth of domestic activities.

This image evokes a sense of nostalgia and provides a glimpse into the lifestyle and interior design of a past era.