Human Generated Data

Title

Untitled (man and two boys on armchair)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16830

Human Generated Data

Title

Untitled (man and two boys on armchair)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16830

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Chair 100
Furniture 100
Face 98.9
Human 98.9
Interior Design 96.7
Indoors 96.7
Clothing 93
Apparel 93
Cushion 93
Smile 91.8
Home Decor 90.8
Pillow 85.7
Room 84.4
Head 79.8
Kid 79.8
Child 79.8
Female 79.5
Living Room 78
Portrait 76
Photography 76
Photo 76
Baby 74.2
Table 68
Girl 67.6
People 64.7
Pants 58.8
Play 57.3
Skin 56.8
Woman 56.7
Boy 55.6
Teeth 55.6
Mouth 55.6
Lip 55.6
Armchair 55.4
Potted Plant 55.3
Pottery 55.3
Jar 55.3
Vase 55.3
Plant 55.3
Housing 55.1
Building 55.1

Clarifai
created on 2023-10-29

people 99.8
child 98.5
man 98.5
monochrome 98
two 97
adult 95.9
three 95.8
indoors 94.3
group 93.5
sit 92.6
woman 91.7
chair 91.4
furniture 91.1
family 89.5
facial expression 87.7
boy 87.2
room 86.4
group together 83.7
wear 83.7
actor 82.5

Imagga
created on 2022-02-26

nurse 47.8
person 33.4
people 31.8
adult 28.6
patient 26.3
medical 25.6
man 24.9
negative 24.7
groom 24.5
professional 24
health 22.9
medicine 22.9
doctor 22.5
film 22
hospital 21.8
male 19.9
work 18
wedding 17.5
bride 17.4
love 16.6
home 15.9
happiness 15.7
care 15.6
photographic paper 15.5
dress 15.4
couple 14.8
happy 13.8
men 13.7
human 13.5
indoors 13.2
room 12.9
lab 12.6
worker 12.6
laboratory 12.5
mask 12.5
instrument 12.4
working 12.4
lifestyle 12.3
cheerful 12.2
face 12.1
device 12
specialist 11.9
women 11.9
veil 11.8
clinic 11.6
science 11.6
holding 11.5
married 11.5
uniform 11.5
equipment 11.2
technology 11.1
occupation 11
breathing device 10.8
test 10.6
profession 10.5
looking 10.4
portrait 10.3
photographic equipment 10.3
sitting 10.3
smiling 10.1
treatment 10.1
indoor 10
team 9.9
fashion 9.8
illness 9.5
oxygen mask 9.4
smile 9.3
modern 9.1
black 9
sexy 8.8
scientist 8.8
surgeon 8.8
celebration 8.8
chemistry 8.7
chemical 8.7
research 8.6
bed 8.5
case 8.3
life 8.2
sick person 8.2
student 8.1
suit 8.1
stethoscope 8.1
family 8
coat 8
interior 8
job 8
sterile 7.9
surgery 7.8
gown 7.8
scientific 7.7
attractive 7.7
bouquet 7.7
two 7.6
marriage 7.6
hand 7.6
biology 7.6
one 7.5
child 7.3
hair 7.1
romantic 7.1
day 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

human face 95.5
man 95.3
clothing 93.7
person 90.7
text 80.1
smile 71.2
posing 70.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 24-34
Gender Female, 71.1%
Calm 52.4%
Happy 40.5%
Sad 4.6%
Surprised 1.4%
Disgusted 0.4%
Angry 0.4%
Fear 0.2%
Confused 0.2%

Feature analysis

Amazon

Person
Bed
Couch

Clarifai

Human face
Clothing
Couch
Picture frame
Human arm
Furniture
Boy
Curtain
Human nose
Human mouth
Human hand

AWS Rekognition

Person 97.8%

Categories

Imagga
created on 2022-02-26

paintings art 71%
interior objects 17%
text visuals 8.3%
food drinks 1.6%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

photograph of a family in a hospital room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a man and two children sitting on a couch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image appears to be a black-and-white negative photograph showing a scene in an interior space. Visible is a person seated in a textured armchair, while another figure, likely a child, is interacting with them by standing or leaning onto the chair. The room is warmly lit, featuring framed pictures or artwork on the walls, along with architectural details such as a lamp or column-like structure. Fabric textures and lighting play a significant part in the image’s composition.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image is a black-and-white photograph taken indoors. It shows three individuals, with one adult seated in a large armchair. The adult is wearing a button-up shirt or jacket. Two children are interacting with the seated adult: one is standing on the armchair beside the adult, and the other is standing behind the armchair. The setting includes a wall in the background with framed pictures hanging on it, and a tall lamp can be seen in one corner of the room. The photograph has a timestamp indicating it was taken using Kodak Safety Film.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows an elderly man sitting in a chair, with a young child sitting next to him. There appears to be another child standing behind the seated man. The scene is captured in black and white, suggesting this is an older photograph. The setting looks like a home or private residence, with framed artwork visible on the walls. The expressions on the faces of the individuals suggest a warm, familial interaction.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white photograph that appears to be from an older era. It shows two young children interacting with what appears to be an older adult sitting in a textured armchair or couch. The children seem quite young - one appears to be a toddler in dark clothing, while the other child is standing behind. The interior setting includes some framed items on the wall in the background. The lighting in the photo creates strong contrasts, giving it a distinctive vintage quality. The image has a casual, family-moment feel to it, captured in what seems to be a home setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image depicts a black-and-white photograph of a man and two children in a living room setting. The man, seated in a chair, appears to be elderly, with a somber expression on his face. He is dressed in a suit jacket and tie, and has a blanket draped over his lap.

To the left of the man, a young child stands on a chair, looking up at him with a curious expression. The child is wearing a long-sleeved shirt and pants, and has a small, round head. Behind the child, another child sits on the floor, partially obscured from view.

In the background, there are several framed pictures on the wall, as well as a lamp and a window with curtains. The overall atmosphere of the image suggests a quiet, intimate moment between the man and the children, possibly in a domestic setting such as a home or office.

The image is likely a family portrait or a snapshot of a special occasion, and the contrast between the man's serious expression and the children's playful energy creates a sense of tension and warmth.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of two young boys sitting on a chair with an elderly man. The boy on the left is wearing a dark-colored shirt and pants, while the boy on the right is dressed in a light-colored shirt and pants. The elderly man is seated in a large armchair, covered by a blanket.

In the background, there are several framed pictures hanging on the wall, adding to the nostalgic atmosphere of the scene. The overall mood of the image is one of warmth and intimacy, capturing a tender moment between the three individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The image depicts a monochromatic photograph of three individuals seated in a room. The photograph is likely from the mid-20th century, given the style of the clothing and the framing of the photo. The central figure is an elderly man who is sitting in a comfortable, upholstered armchair. He is wearing a suit and tie, suggesting a formal or semi-formal setting. His expression is one of calm and contentment, with his eyes closed, indicating a moment of rest or reflection.

To the left of the elderly man, there is a young child, possibly a toddler, sitting on the arm of the chair. The child is dressed in a simple, striped shirt and shorts, with socks on his feet. The child is reaching out towards the elderly man, indicating a possible interaction or affection between them.

Behind the elderly man and the child, there is a young boy standing. He is dressed in a button-up shirt and appears to be slightly older than the toddler. The boy is looking directly at the camera, with a curious expression on his face. He is positioned between the elderly man and the child, creating a sense of connection and family among the three individuals.

The background of the image is a plain, dark wall adorned with several framed pictures. The frames are of various sizes and styles, suggesting a personal touch to the room's decor. The overall atmosphere of the photograph is one of warmth and intimacy, with the three individuals sharing a moment of connection and affection. The monochromatic filter adds a sense of nostalgia and timelessness to the image, emphasizing the enduring nature of family bonds and the passage of time.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The image is a black-and-white photograph that features three people in a room. An elderly man is seated on a chair, and two young children are standing behind him. The elderly man has a serious expression and is looking towards the camera. The two children, a boy and a girl, are standing behind the man, and they are looking in different directions. The boy is looking towards the camera, while the girl is looking away. The room has a few framed pictures on the wall, and a curtain is hanging on the left side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage black and white negative, portraying a scene of familial affection. The composition focuses on three figures within a well-lit room.

Key Elements:

  • The People: An elderly man sits in a large armchair. Two young boys are close to him, one stands in front, and the other one is just behind him.
  • Setting: The scene takes place in what appears to be a living room or a similar domestic space. The background includes framed artwork hanging on the wall. A lamp is visible.
  • Mood: The image evokes a sense of warmth, familial closeness, and nostalgia.

Let me know if you would like a more detailed breakdown of any specific aspect!

Created by gemini-2.0-flash on 2025-05-24

Here is a description of the image:

This is a black and white negative photograph featuring three figures: an older man and two young boys. The man is seated in a patterned armchair. He appears to be wearing a light-colored button-up sweater or cardigan.

A younger boy is standing near the arm of the chair and is reaching out towards the man. He has a buttoned shirt on and appears to be wearing diaper-like bottoms. The second, slightly older boy is standing behind the younger child and to the left of the seated man. He is wearing a light-colored collared shirt and sweater.

In the background, there are framed pictures hanging on the wall behind them. A tall lamp stand can also be seen on the left side of the frame. The negative film strip information is visible on the right edge of the frame.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image is a black-and-white photograph featuring three individuals seated on a couch. The setting appears to be a living room or a similar indoor space, with some framed pictures on the wall in the background.

  1. Foreground:

    • A young child is seated on the left side of the couch. The child is wearing a dark jacket and light-colored pants and is looking directly at the camera with a neutral expression.
    • An older adult, likely a man, is seated on the right side of the couch. He is wearing a light-colored suit and appears to be looking slightly to the side, away from the camera.
  2. Background:

    • Behind the two individuals on the couch, there is another person, possibly a young girl, standing. She is wearing a light-colored dress and is also looking towards the camera.
  3. Room Details:

    • The room has a few framed pictures on the wall behind the couch.
    • There is a lamp visible to the left side of the image.
    • The couch has a textured fabric, and there are some cushions or pillows on it.

The photograph has a vintage feel, possibly from the mid-20th century, and captures a moment of family or close acquaintances gathered together.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-17

The image is a black-and-white photograph depicting an indoor scene. It appears to be a family portrait. In the foreground, there is a child sitting on a chair, facing away from the camera but looking over their shoulder with an expression that seems curious or surprised. The child is wearing a dark outfit. Behind the child, another figure, possibly an adult, is sitting in a chair. This figure appears to be wearing a light-colored outfit. The background features framed pictures on the wall, suggesting a home setting. The lighting in the photograph is soft, and the overall tone is nostalgic, indicating that the photo may have been taken some time ago.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-17

This black-and-white photograph captures a poignant and somewhat eerie scene. An older man is seated in a chair, looking off to the side with a serious expression. In front of him, a young child and a toddler are positioned on the armrests of the chair. The older man appears to be lifeless, suggesting that he might be deceased. The children, dressed in formal attire, are posed in a manner that seems staged, adding to the unsettling atmosphere of the image. The background includes framed pictures on the wall and a lamp, indicating that the setting is likely a formal or domestic interior. The overall tone of the photograph is somber and reflective.

Text analysis

Amazon

2
KODAKA-EITW

Google

MJI7--YT3RA°2--AGO
MJI7--YT3RA°2--AGO