Human Generated Data

Title

Untitled (man and two boys on armchair)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16829

Human Generated Data

Title

Untitled (man and two boys on armchair)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16829

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Chair 100
Furniture 100
Face 99.5
Human 99.5
Clothing 98.4
Apparel 98.4
Head 91.2
Female 82.6
Smile 81.6
Portrait 77.9
Photography 77.9
Photo 77.9
Kid 73.4
Child 73.4
Girl 71.2
Baby 69.5
Sitting 69.2
Indoors 64
Performer 63.4
Hat 62.9
Woman 62.4
Teen 62.2
People 62.2
Table 60.1
Shorts 57.6
Potted Plant 56.3
Pottery 56.3
Jar 56.3
Vase 56.3
Plant 56.3

Clarifai
created on 2023-10-29

people 99.7
man 98.3
monochrome 97.8
woman 96.5
adult 96.4
indoors 95.9
chair 95.8
child 94.7
group 94.2
sit 93.8
three 92.7
couple 92.4
group together 91.7
wedding 91.6
family 91.4
two 90.5
four 86.1
portrait 85.8
seat 83.9
furniture 83.2

Imagga
created on 2022-02-26

groom 42.6
nurse 38.1
people 34.6
person 32.3
couple 31.3
adult 29.8
home 29.5
man 28.9
love 26.8
happiness 25.8
happy 25
negative 23.8
male 22.9
bride 22.4
smiling 21.7
patient 21.2
wedding 21.1
film 18.9
men 18.9
hospital 18
cheerful 17.1
room 16.8
portrait 16.8
indoors 16.7
women 16.6
sitting 16.3
dress 16.3
family 16
lifestyle 15.9
child 15.5
husband 15.3
wife 15.2
medical 15
smile 15
together 14.9
veil 14.7
photographic paper 14.6
health 14.6
two 14.4
married 14.4
bed 14.2
care 14
indoor 13.7
human 13.5
face 13.5
house 13.4
bouquet 13.3
holding 13.2
professional 12.8
marriage 12.3
looking 12
celebration 12
life 11.9
couch 11.6
interior 11.5
flowers 11.3
doctor 11.3
attractive 11.2
romantic 10.7
loving 10.5
day 10.2
treatment 10.1
fashion 9.8
pretty 9.8
photographic equipment 9.8
fun 9.7
medicine 9.7
case 9.6
sick person 9.5
work 9.4
relationship 9.4
playing 9.1
romance 8.9
lady 8.9
cute 8.6
comfortable 8.6
enjoying 8.5
mother 8.4
relaxation 8.4
event 8.3
leisure 8.3
joyful 8.3
suit 8.1
worker 8.1
childhood 8.1
kid 8
wed 7.9
living room 7.8
baby 7.8
instrument 7.8
ceremony 7.8
sofa 7.6
hand 7.6
enjoyment 7.5
one 7.5
laptop 7.3
relaxing 7.3
sexy 7.2
blond 7.2
hair 7.1
bedroom 7.1
breathing device 7.1
working 7.1
modern 7

Google
created on 2022-02-26

Black 89.5
Smile 87.8
Comfort 85.5
Black-and-white 85
Style 84
Monochrome 75.7
Monochrome photography 75.4
Eyewear 75.4
Couch 73.7
Sitting 66.6
Rectangle 65.5
Room 65.4
Fun 64.7
Shorts 64.2
Stock photography 63
Happy 61.7
Toddler 61.7
T-shirt 60.9
Child 55.3

Microsoft
created on 2022-02-26

human face 98.3
person 93.4
man 92.3
text 85.8
posing 84.4
clothing 80.9
window 80.4
black 70.5
statue 69.5
smile 59.3
old 43.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 42-50
Gender Male, 88.8%
Surprised 79.6%
Happy 15.5%
Calm 2.9%
Fear 0.9%
Sad 0.3%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%

Feature analysis

Amazon

Person
Couch

Clarifai

Human face
Clothing
Man
Couch
Curtain
Picture frame
Furniture
Human arm
Human nose
Human eye
Human mouth

AWS Rekognition

Person 98.4%

Categories

Imagga
created on 2022-02-26

interior objects 70.4%
text visuals 18%
paintings art 6.2%
streetview architecture 2.2%
food drinks 1.1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

person and his wife in a hospital room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a man sitting on a couch with a baby in a chair

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image is a photographic negative capturing an indoor scene. A seated figure is resting in a textured armchair, with a small child standing nearby, leaning on the armrest. The background features framed artwork, primarily images of sailboats, displayed on the walls. A tall lamp is visible near the edge of the room, and curtains partially obscure a window or a glass door on the left side.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a negative of a photograph showing three individuals in a room. One person is seated in a large armchair with a textured fabric. A child is standing on the arm of the chair, leaning towards the seated person, and another child is standing beside the armchair. The room includes several framed pictures or paintings on the walls. There is also a tall lamp with a lampshade in the corner near the armchair. The scene suggests a familial, domestic setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows an elderly man sitting in a chair, with a young child sitting next to him. They appear to be in a room with framed artwork on the walls. The man has a serious expression on his face, while the child seems to be interacting with him. The image has a black and white tone, giving it a vintage feel.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image shows an elderly man sitting in an armchair with two young children, a boy and a girl, standing next to him. The man has a serious expression and is wearing a suit. The children are smiling and appear to be interacting playfully with the man, perhaps his grandchildren based on the age difference. The room has framed pictures or paintings on the wall behind them. The scene conveys a sense of a family gathering or portrait in a home setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage black and white photograph showing three generations together in what looks like a home living room. There are two young children and an elderly person seated in a comfortable armchair. The room has framed pictures of sailboats on the wall in the background. The image has a warm, familial quality typical of mid-20th century family photographs. The lighting creates an interesting contrast, giving the photograph a somewhat dramatic effect while still maintaining its intimate, domestic character.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of an older man sitting in a chair with a young boy standing next to him. The man is wearing a suit jacket and has a serious expression on his face. The boy is wearing a dark-colored shirt and has a big smile on his face. He is leaning on the arm of the chair, with his right hand resting on the man's shoulder.

The background of the image shows a wall with several framed pictures hanging on it. There is also a lamp in the corner of the room, and a window with curtains on the left side of the image. The overall atmosphere of the image suggests that it was taken in a home or office setting, possibly in the 1950s or 1960s based on the clothing and decor.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black and white photograph of three people, two children and an adult, sitting in a chair. The image has been inverted, with the colors reversed.

  • The adult is sitting in a large armchair, wearing a white shirt and a blanket or throw over their lap.
  • The two children are standing behind the adult, one on either side of the chair.
  • The child on the left is wearing a dark-colored shirt and pants, while the child on the right is wearing a light-colored shirt and pants.
  • The background of the image is a room with dark walls and several framed pictures hanging on the wall.
  • There is a lamp in the corner of the room, and a curtain or drapes hanging from the window.
  • The overall atmosphere of the image is one of warmth and comfort, with the adult and children appearing to be enjoying each other's company.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph depicting a man sitting in a chair with two young boys on his lap. The man appears to be elderly, with a serious expression on his face. The boy on the left is smiling and looking directly at the camera, while the boy on the right is looking down and appears to be slightly shy. Behind the man, there is a wall with several framed pictures hanging on it. The image has a vintage look, possibly from the early 20th century.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white photo shows an elderly man sitting on a couch, smiling and holding the hand of a baby sitting on his lap. The baby is smiling and looking at the camera. Behind them, another child is standing and smiling. The room has a few frames hanging on the wall. The photo has a vintage filter, giving it a nostalgic feel.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-06-02

Here's a description of the image:

Overall Impression:

The image appears to be a portrait, likely taken indoors, depicting three generations. It has a somewhat vintage feel, possibly due to the style of the image and the subjects. The image is a photographic negative, so the colors are inverted.

Subjects:

  • An older man is sitting in a large armchair.
  • A young boy is standing behind him and slightly to the left.
  • A baby is sitting on the older man’s lap and reaching towards the right.

Setting and Composition:

  • The background shows a wall with framed pictures hanging on it.
  • A standing lamp is partially visible.
  • The composition focuses on the interaction between the three individuals.
  • The lighting seems to come from a bright source, perhaps a window or a lamp.

Possible Interpretations:

  • This could be a family portrait, capturing a moment of connection between generations.
  • The expressions of the subjects (even in negative) hint at happiness.

Created by gemini-2.0-flash on 2025-06-02

The image is a black and white negative showing an older man sitting in an armchair with two young boys, likely his grandsons. The older man is seated in the armchair, which takes up the majority of the frame. He appears to be wearing a collared shirt with a sweater. He looks directly at the camera with a neutral expression.

In the background, a slightly older boy stands behind the armchair, partially obscured. In front of him, a younger child is standing on the arm of the chair. Both children are looking forward.

In the background, several framed pictures hang on the wall behind them. There is also a floor lamp visible. The image has a slight glow.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a black-and-white photograph featuring three individuals in what appears to be a living room or a similar indoor setting. The setting is decorated with framed pictures on the wall, a lamp, and an upholstered chair.

  1. Foreground: An older man is seated in a chair. He is wearing a suit and tie, and his expression is serious. His hand is gently placed on the shoulder of a young child standing in front of him.

  2. Middle Ground: A young child is standing close to the older man. The child is dressed in a dark outfit with a white collar and is looking directly at the camera with a neutral expression.

  3. Background: Another young child is standing behind the first child. This child is also dressed in a dark outfit and is looking at the camera with a slight smile.

The photograph has a somewhat vintage feel, possibly indicating it was taken several decades ago. The overall atmosphere is formal and composed, suggesting a posed family portrait. The image also has a watermark on the right side that reads "KODAK SAFETY FILM."

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-17

This is a black and white photograph that appears to be a formal or staged portrait. It depicts an older man sitting in a large, upholstered armchair, with a young child in the foreground and another child partially visible behind the older man. The older man is dressed in formal attire, while the child in the foreground is wearing a dark, possibly velvety outfit. The setting includes framed pictures on the wall, a lamp, and a curtain with a pattern on the left side. The photograph has a vintage quality, suggesting it could be from an earlier era.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-17

This black-and-white photograph captures a tender moment between an elderly man and two young children. The older man is seated in a comfortable armchair, wearing a light-colored jacket. His expression is calm and affectionate as he interacts with the children.

One child, dressed in a dark sweater, is sitting on the armrest of the chair, leaning towards the older man with a joyful and animated expression. The other child stands behind the older man, also leaning forward, appearing equally engaged and happy. The background features a wall with framed pictures and a lamp, suggesting a cozy, lived-in interior setting. The overall mood of the image is warm and familial.

Text analysis

Amazon

KODAKA-ITW

Google

MJI7--YT3RA°2--XAGO
MJI7--YT3RA°2--XAGO