Human Generated Data

Title

Untitled (young boy sitting on man's lap)

Date

c. 1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7411

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young boy sitting on man's lap)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7411

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Chair 99.8
Furniture 99.8
Clothing 99.5
Apparel 99.5
Human 98.6
Face 98.3
Blonde 97.5
Female 97.5
Teen 97.5
Woman 97.5
Kid 97.5
Girl 97.5
Child 97.5
Baby 93.2
Home Decor 90.8
Indoors 88.8
Smile 86.5
Room 82.4
Dress 82.4
Portrait 80.7
Photography 80.7
Photo 80.7
Footwear 77.7
Glasses 74.1
Accessories 74.1
Accessory 74.1
Man 73.3
Shorts 72.8
People 68
Housing 65.6
Building 65.6
Plant 65.5
Living Room 64.9
Couch 61.9
Shirt 59.1
Pants 56.8
Newborn 56.2

Clarifai
created on 2023-10-25

people 98.8
child 98
lid 97.8
monochrome 95.8
family 94.8
nostalgia 94
two 92.6
man 92.6
retro 91.5
veil 89
love 87.1
fun 86.8
sit 86.5
woman 85.6
Christmas 85.3
indoors 84.9
illustration 83.8
adult 82.7
celebration 82.4
winter 80.7

Imagga
created on 2022-01-08

negative 32.4
person 29.8
people 27.3
film 25.8
laboratory 22.2
medical 22.1
professional 21.9
medicine 21.1
adult 20.7
doctor 20.7
health 20.1
photographic paper 19.9
clothing 19.7
boutique 18.9
shower cap 18.1
fashion 17.3
human 17.2
cap 17.1
portrait 16.8
lab 16.5
research 16.2
man 16.1
science 16
work 15.7
chemistry 15.5
test 15.4
equipment 14.8
scientist 14.7
attractive 14
chemist 13.8
headdress 13.7
scientific 13.6
chemical 13.5
photographic equipment 13.3
biology 13.3
biotechnology 12.8
dress 12.6
technology 12.6
hospital 12.4
working 12.4
sexy 12
pretty 11.9
student 11.8
nurse 11.5
clinic 11.5
lady 11.4
worker 11
hat 11
model 10.9
tube 10.6
education 10.4
bride 10
face 9.9
male 9.9
development 9.7
black 9.6
hair 9.5
instrument 9.5
cute 9.3
holiday 9.3
blond 9.2
modern 9.1
care 9
team 9
one 9
researcher 8.9
biochemistry 8.9
technician 8.8
coat 8.7
happiness 8.6
men 8.6
smile 8.5
hand 8.4
joy 8.4
glasses 8.3
stylish 8.1
decoration 8
home 8
celebration 8
microscope 7.9
microbiology 7.9
experiment 7.8
assistant 7.8
elegant 7.7
industry 7.7
mask 7.7
wedding 7.4
mother 7.4
cheerful 7.3
pose 7.2
smiling 7.2
consumer goods 7
look 7

Google
created on 2022-01-08

Hat 89.3
Window 85.6
Black-and-white 84.6
Style 83.8
Chair 82.5
Monochrome photography 75.6
Monochrome 75.1
Snapshot 74.3
Art 74.2
Vintage clothing 70.4
Sitting 69
Room 68.9
Stock photography 65.4
Classic 62.3
Plant 61.1
Illustration 59.5
Table 55.8
Cap 55.4
Child 55.1
Glass 53.2

Microsoft
created on 2022-01-08

text 98.1
person 91.3
window 80.8
clothing 77
old 63.6
human face 61.2
black and white 53.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Female, 80.9%
Happy 82%
Sad 8.7%
Surprised 3.4%
Fear 3.1%
Angry 1.2%
Confused 0.7%
Disgusted 0.4%
Calm 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe

Clarifai

No features identified

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.5%

AWS Rekognition

Shoe 77.7%

Categories

Imagga
created on 2022-01-08

paintings art 100%

Captions

Microsoft
created by unknown on 2022-01-08

an old photo of a person 91.4%
old photo of a person 89.9%
a person wearing a hat 83.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man sitting on a chair with a baby in his lap

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image is a black and white negative photograph that shows a seated elderly man wearing a checkered shirt and slacks. His watch is visible on his wrist as he gently interacts with a child who is sitting on his lap. The setting includes a room with furniture, such as a lamp and patterned upholstery, and other objects like books and boxes scattered around on the floor. There are visible details of the window and natural light filtering through, adding a homely atmosphere to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-17

This image appears to be a negative, featuring an older man and a child sitting together indoors. The man is wearing a checkered shirt and has short hair. Beside him, there is a lamp and several pieces of furniture, suggesting a cozy interior setting. The child sits on his lap and is holding an object, possibly a toy or device, with both hands. Various other details, such as curtains or plants, can be seen in the background, contributing to the warm and inviting atmosphere of the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows an older man sitting in a chair, holding a young child on his lap. They appear to be in a home setting, with a lamp and other furnishings visible in the background. The man is wearing a plaid shirt and the child is holding what looks like a small toy or object. The image has a black and white, vintage aesthetic.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage black and white photograph showing an adult and child sitting together indoors. The adult is wearing a checkered shirt and appears to be sitting on what might be a radiator or window ledge. The child is sitting on the adult's lap and appears to be holding something small in their hands. There's a lamp visible in the background and the image has a bright, overexposed quality typical of photographs from an earlier era, possibly the 1950s or 1960s. The setting seems to be a home interior with windows visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black and white photograph of a man and a young child sitting on a chair, with the man holding the child on his lap. The child is wearing a long-sleeved shirt and pants, while the man is dressed in a plaid shirt and pants. The man has short hair and is wearing glasses, and the child has short hair as well. The child is holding a small object in their hands, possibly a toy or a book.

The background of the image shows a room with a window, a lamp, and a table with a chair. There are also some objects on the floor, including a toy car and a stuffed animal. The overall atmosphere of the image suggests a warm and intimate moment between the man and the child, possibly during a special occasion or a quiet moment at home.

The image appears to be a candid shot, captured in the moment without any apparent planning or staging. The photographer's perspective is from the side, looking at the man and child as they sit together on the chair. The image is framed by a white border, with some text visible at the top and bottom edges of the photo. The text is not legible, but it may provide additional context or information about the image.

Overall, the image conveys a sense of warmth, love, and connection between the man and the child, and it is likely to evoke feelings of nostalgia and sentimentality in the viewer.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of an older man sitting in a chair, holding a young child on his lap. The man has short white hair and is wearing a plaid shirt, dark pants, and white shoes. He is looking down at the child, who is wearing a long-sleeved shirt and pants. The child is holding a small object in their hands.

In the background, there is a window with a lampshade hanging from the ceiling. There are also some books and other objects on a table or shelf. The overall atmosphere of the image suggests a warm and intimate moment between the two individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring a man sitting on a chair with a young child on his lap. The man is dressed in a checkered shirt and glasses, while the child is wearing a white shirt and holding a small object, possibly a toy or a book. The child is looking directly at the camera with a smiling face. The man is looking down at the child, and his face is illuminated by the light from the camera. The background of the image is blurry, with a window and a lamp visible.

Created by amazon.nova-pro-v1:0 on 2025-06-03

In a black-and-white image, an old man is sitting on a chair while holding a baby in his arms. The baby is holding a cell phone and smiling. Behind them, a lamp is mounted on the wall. A striped pillow is placed on the chair beside them. A curtain is hanging on the window. The image has a watermark with the text "L104" on the bottom right.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

The image is a black and white photograph depicting an older man holding a young child on his lap. The man appears to be seated and is wearing glasses, a plaid shirt, and light-colored pants with what looks like dress shoes. He has his arm around the child, who is holding a small rectangular object, possibly a toy or small gift. The child is wearing dark clothing and what appears to be a pair of shoes.

The background includes what seems to be a window, a lamp, and a Christmas tree, with gifts wrapped in striped paper visible below the tree. There is a toy truck on the floor to the left.

The image has a negative or inverted appearance, with the darker areas of a typical photograph appearing light, and vice versa. This gives it a high-contrast look. There is some overexposure or light bleed, which may be a result of how the photograph was taken or processed. There are perforations visible along the edge of the picture, suggesting it could be a negative or a contact print. The number "41677" is written on the right side of the picture.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

The image shows a scene in what appears to be a home setting. A man is sitting, possibly in a chair, and he is holding a young child on his lap. The man is wearing glasses, a plaid shirt, and what looks like a watch on his wrist. The child is holding something, possibly a toy.

There's a lamp overhead and various objects in the background, including a window, what could be a Christmas tree, some wrapped gifts, and a toy truck on the floor. The picture is presented as a film negative, so the colors are inverted: bright areas are dark, and dark areas are light. The edges of the negative film are visible. The overall impression is of a candid, intimate moment captured on film.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph featuring an adult and a child. The adult, who appears to be an older man, is seated on a chair and is wearing glasses, a checkered shirt, and trousers. He is holding a small object in his hand, possibly a toy or a small electronic device. The child, who seems to be a young boy, is sitting on the adult's lap, holding what looks like a game controller or a similar device. The child is smiling and appears to be engaged in an activity, likely playing a game.

The setting appears to be indoors, possibly in a living room or a similar domestic environment. In the background, there is a window with curtains, and some toys are visible on the floor, including a small toy car. The overall atmosphere of the image suggests a warm, familial moment, possibly capturing a bonding experience between the adult and the child.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

This is a black-and-white photograph that appears to be a vintage image, likely from the mid-20th century. The photo is slightly overexposed, giving it a bright and somewhat ethereal quality.

In the image, there is an older man sitting on a chair, wearing a plaid shirt and glasses. He is holding a baby on his lap, who is wearing a dark outfit and appears to be looking at the camera. The baby is holding what looks like a small bowl or cup.

The setting seems to be indoors, with a window in the background that allows natural light to enter. There is a table with a lamp and other items on it, and the room has a cozy, lived-in feel. The overall mood of the photograph is warm and familial, capturing a tender moment between the older man and the baby. The image has a timestamp or number “41677” in the bottom right corner, which might indicate it is from a negative collection or a catalog.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This is a black and white photograph depicting a tender moment between an elderly man and a young child. The man, wearing glasses and a checkered shirt, is seated and holding the child on his lap. The child, who appears to be a toddler, is wearing a dark outfit and is holding a small, clear object in their hands. The man is smiling and looking at the child, who is also smiling and appears to be enjoying the interaction. The background includes a lamp, a window with curtains, and some furniture, suggesting that the setting is a cozy indoor environment. The photograph has a warm and affectionate atmosphere.

Text analysis

Amazon

41677
SO
VТ7A°-x