Human Generated Data

Title

William and Ginna Chicco, Shannon Soplio, Belmont

Date

1994

People

Artist: Nicholas Nixon, American born 1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2001.216

Copyright

© Nicholas Nixon

Human Generated Data

Title

William and Ginna Chicco, Shannon Soplio, Belmont

People

Artist: Nicholas Nixon, American born 1947

Date

1994

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2001.216

Copyright

© Nicholas Nixon

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.3
Clothing 94.1
Apparel 94.1
Sitting 91
Furniture 84.2
Indoors 72.7
Pants 71.6
Couch 69
Room 68.3
Wood 62.2
Shelf 61.3

Clarifai
created on 2023-10-25

people 99.7
elderly 98.9
man 98.6
portrait 98.2
monochrome 97.5
elder 97.5
adult 97.1
chair 91.8
street 90.5
walking stick 89.8
two 88.9
couple 88.3
actor 86
group 85
three 83.9
family 83.3
leader 82.5
room 81.9
old 81.8
woman 81.3

Imagga
created on 2022-01-09

statue 40.2
sculpture 31.8
religion 31.4
kin 24.5
art 24.2
old 23
religious 22.5
ancient 19.9
history 19.7
culture 17.1
temple 16.7
monument 15.9
historic 15.6
god 15.3
historical 15
antique 14.7
stone 14.3
traditional 14.1
architecture 14.1
person 13.8
face 13.5
spirituality 13.4
spiritual 13.4
faith 13.4
travel 13.4
church 12.9
people 12.8
tourism 12.4
pray 11.6
worship 11.6
prayer 11.6
gold 11.5
man 11.4
decoration 10.9
male 10.8
clothing 10.7
holy 10.6
world 10.5
catholic 9.8
famous 9.3
peace 9.1
sacred 8.8
building 8.7
heritage 8.7
figure 8.7
saint 8.7
china 8.5
costume 8.5
east 8.4
black 8.3
vintage 8.3
dress 8.1
oriental 7.9
statues 7.9
soldier 7.8
army 7.8
belief 7.8
color 7.8
portrait 7.8
golden 7.7
mother 7.6
mask 7.4
detail 7.2
interior 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 96.9
clothing 96.1
man 88.6
text 85.8
black and white 78

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 59-67
Gender Male, 100%
Sad 43.3%
Confused 31.2%
Calm 20.2%
Angry 3.6%
Disgusted 0.5%
Surprised 0.4%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 26-36
Gender Female, 90.8%
Happy 60.1%
Sad 36.9%
Calm 0.9%
Angry 0.5%
Fear 0.5%
Disgusted 0.4%
Surprised 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 85.3%

Categories

Imagga
created on 2022-01-09

pets animals 70.3%
people portraits 17.7%
paintings art 11.6%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and woman standing in front of a doorway

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts an indoor scene with three individuals engaged in different activities. An elderly man stands on a scale in a doorway, wearing a plaid shirt and trousers, while someone standing next to him provides support by holding his arm. A seated individual with curly hair and casual clothing sits on a cushioned chair to the left, observing the scene. A dog is positioned near the man's legs. The room features wood-paneled walls and simple furnishings, including a curtain hanging in the doorway. This is a black-and-white photograph.

Created by gpt-4o-2024-08-06 on 2025-06-16

The black and white image shows a domestic scene with three central figures. The person on the left is seated on a couch with curly white hair, wearing a t-shirt that has some writing on it. In the center, a figure is standing on a weighing scale, wearing a checkered short-sleeved shirt and light-colored trousers. The person to the right, partially obscured behind the central figure, is wearing a patterned dress, a wristwatch, and white shoes. This person appears to be holding or supporting the central figure. The background includes a wooden paneled wall with a doorbell or knob, and a curtain is drawn to the side, revealing part of the interior setting. A small portion of a pet dog or cat is visible near the central figure's legs. A desk or table with some stacked papers or objects is in the lower right corner.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image depicts an elderly man standing in a doorway, observing a younger woman who is sitting on the floor in the foreground. The man appears to be wearing a plaid shirt and khaki pants, while the woman is wearing a patterned dress. The scene has a somber, contemplative mood, with the contrast between the man's upright stance and the woman's seated posture suggesting a complex relationship or interaction between them.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing an elderly couple at what appears to be their doorway. One person is wearing a plaid short-sleeved shirt and standing, while the other is wearing a white t-shirt with some kind of graphic design and is bending down, seemingly petting or interacting with what looks like a dark-colored dog. The image has a casual, domestic feel to it, captured in what seems to be a candid moment. The setting appears to be the entrance to a home, with a door and some curtains visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts an elderly man standing on a scale, with a woman and an older woman in the background. The man is wearing a plaid shirt, khaki pants, and black shoes. He has short white hair and is looking down at the scale. The woman behind him is wearing a long dress with a patterned design and has her hand on the man's shoulder. She is also looking down at the scale. The older woman is sitting in a chair to the left of the man, wearing a t-shirt with a graphic design and looking at the man.

The background of the image appears to be a living room or bedroom, with a door to the left of the man and a curtain to the right. The overall atmosphere of the image suggests that the man is being weighed by the woman, possibly for health reasons or as part of a routine check-up.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of an elderly man standing on a scale, with two women and a dog in the room. The man is wearing a plaid shirt, khaki pants, and black shoes, and has short white hair. He is standing on a scale, which is placed on the floor in front of him. To his left is a woman with short white hair, wearing a white t-shirt with a graphic design on it. She is sitting on a couch or chair, looking at the man. On the right side of the image, there is another woman standing behind the man, partially obscured by a curtain. She is wearing a patterned dress and has her hand on the man's arm. A dog is also present in the room, but its breed and size are not clearly visible.

The background of the image appears to be a living room or bedroom, with a door and a wall featuring vertical paneling. The overall atmosphere of the image suggests that the man is being weighed or monitored by the two women, possibly in a healthcare setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The black-and-white photograph depicts a scene inside a room with a wooden door. On the left side, an elderly woman is seated on a couch, wearing a white t-shirt with a graphic design. She is looking towards the right side of the image, where an elderly man is standing on a scale. The man is dressed in a checkered shirt and pants, with a belt around his waist. He is holding a dog in his hands. To the right of the man, another woman is standing, dressed in a dress with a pattern and a necklace. She is looking at the man on the scale.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white photo shows an elderly man standing on a weighing scale in front of a door. He is wearing a plaid polo shirt, pants, and shoes. Behind him, a woman is standing, wearing a dress and shoes. She is holding the door and looking at the man. On the left, a woman is sitting on a couch, wearing a shirt and a bracelet. There is a curtain on the right side of the door.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

This is a black and white photograph capturing an intimate domestic scene. On the left, an elderly woman with short, curly hair is seated on a large, dark armchair, looking towards the right side of the frame. She is wearing a casual t-shirt with a graphic design. Her hands are resting on the arm of the chair.

To the right, in the doorway, stands an elderly man. He is wearing a plaid short-sleeved shirt and high-waisted trousers. He appears to be standing on a scale, with one hand extended towards a medium-sized dog standing on its hind legs between the woman's chair and the man. A young woman with short hair is positioned slightly behind the man, in the doorway. She is wearing a patterned dress and a stethoscope hangs around her neck. She has her hand on the man's arm.

The doorway is partially draped with a heavy curtain on the right side. Vertical wooden paneling is visible on the walls. In the background, the interior behind the doorway is dark. There is a thermostat visible on the wall to the left of the door.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression: The image is a black and white photograph capturing an intimate moment, possibly within a home. It seems to be a scene of domestic life, possibly related to healthcare.

Key Elements:

  • The Elderly Man: The focal point of the image is an elderly man, likely in his later years, standing on a scale. He is wearing a plaid short-sleeved shirt and light-colored pants. He appears to be getting his weight checked.
  • The Woman Assisting: A younger woman, possibly a nurse or caregiver, is standing behind the elderly man, with her hand on his arm for support. She is wearing a dress and has a stethoscope around her neck.
  • The Elderly Woman on the Couch: In the foreground to the left, an elderly woman is seated on a large, dark-colored sofa. She appears to be watching the scene unfolding with interest.
  • The Environment: The setting appears to be a home interior. There are doorways with drapes. The room appears simply furnished and lit. The presence of the scales suggests a medical aspect, possibly in-home healthcare.
  • The Pet: A dog can be seen peering into the doorway.

Atmosphere: The image evokes a sense of quiet dignity, care, and routine. The use of black and white gives it a timeless and somewhat somber feeling. There is a sense of intimacy and closeness between the people.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting an indoor scene with three people. Here’s a detailed description:

  1. Setting: The scene appears to be inside a room with wooden panel walls. There is a door visible in the background with a doorknob, and a curtain is partially drawn to the side.

  2. People:

    • Person on the Left: An elderly woman with short, curly hair is kneeling on the floor. She is wearing a t-shirt with a graphic design on it and appears to be interacting with a small animal, possibly a cat, which is standing on its hind legs.
    • Person in the Center: An elderly man is standing upright, holding onto a cane with his right hand. He is wearing a short-sleeved, plaid shirt and light-colored trousers. He is looking downwards, possibly at the animal or the woman.
    • Person on the Right: A woman is standing in the doorway, partially obscured by the curtain. She is wearing a patterned dress and has her arms crossed. She appears to be observing the scene.
  3. Animal: A small animal, likely a cat, is standing on its hind legs in front of the kneeling woman. The cat seems to be interacting with her, possibly being petted or fed.

  4. Objects:

    • There is a piece of furniture, possibly a dresser or a table, visible to the right side of the image.
    • The floor appears to be carpeted.

The overall atmosphere of the image suggests a casual, domestic setting with a moment of interaction between the individuals and the animal.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

This black-and-white photograph depicts an indoor scene with three individuals. On the left, an older woman is sitting on a couch, wearing a patterned shirt and appearing to observe the other two individuals. In the center, a man is standing on a scale, holding a small object in his hand. On the right, a woman dressed in a patterned dress is leaning back slightly, with her hands resting on the man's shoulders as if she is gently supporting or assisting him.

The setting appears to be a simple room with a wooden door and a curtain in the background. The lighting creates a dramatic effect, with shadows emphasizing the expressions and postures of the individuals. The overall mood of the photograph conveys a sense of quiet interaction and care.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This black-and-white photograph captures a moment in a domestic setting. On the left, an older woman with short, curly hair is seated on a dark, cushioned chair. She is wearing a light-colored t-shirt with a graphic design on it and is looking towards the center of the image. In the center, an older man stands on a scale, wearing a plaid short-sleeve shirt and light-colored trousers. He is looking down at the scale, and his hand is gently touching a small, light-colored dog that is sitting on the floor between the woman and the man. To the right, a younger woman is partially obscured by a dark curtain. She is wearing a patterned dress and appears to be smiling, with her hand resting on the older man's arm. The scene is framed by a wooden door on the left and a dark curtain on the right, suggesting an intimate, candid moment within a home.