Human Generated Data

Title

Untitled (woman cooking in bedroom with television and picnic basket)

Date

1963

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12236

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman cooking in bedroom with television and picnic basket)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1963

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12236

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Display 99.8
Screen 99.8
Electronics 99.8
Furniture 99.6
Human 99.4
LCD Screen 94.9
TV 91.7
Television 91.7
Apparel 67.1
Clothing 67.1
Entertainment Center 59.7
Shelf 55.3

Clarifai
created on 2019-11-16

people 99.5
adult 97.6
man 97.3
room 95.2
technology 94.6
one 93.7
television 93.1
woman 92.9
desk 90
chair 89.7
computer 89.4
indoors 89.2
monitor 87.7
furniture 87.2
screen 86.9
two 86
monochrome 85.7
display 84.8
group 84.4
office 83.8

Imagga
created on 2019-11-16

office 51.7
desk 47.8
computer 46.4
table 35.5
monitor 33.8
working 31.8
work 31.4
business 29.1
room 27.6
people 26.2
man 24.9
person 23.9
sitting 23.2
male 22.7
furniture 22.3
laptop 21.6
interior 21.2
engineer 20.8
keyboard 20.7
adult 19.6
technology 19.3
equipment 19
job 18.6
indoors 18.4
center 18
businessman 17.7
home 16.7
screen 16.4
indoor 16.4
professional 15.6
smiling 15.2
notebook 14.8
chair 14.6
worker 14.2
corporate 13.7
lifestyle 13.7
education 13
radio 12
personal computer 11.8
communication 11.8
electronic equipment 11.7
desktop 11.5
furnishing 11.5
workplace 11.4
modern 11.2
patient 11.1
occupation 11
businesswoman 10.9
television 10.8
happy 10.7
hand 10.6
desktop computer 10.4
senior 10.3
men 10.3
phone 10.1
broadcasting 10
house 10
mouse 9.9
school 9.9
looking 9.6
manager 9.3
smile 9.3
confident 9.1
portrait 9.1
network 8.9
medical 8.8
display 8.7
women 8.7
couch 8.7
studying 8.6
face 8.5
meeting 8.5
casual 8.5
relax 8.4
hospital 8.4
horizontal 8.4
mature 8.4
health 8.3
data 8.2
board 8.1
shop 8.1
seat 8.1
digital computer 7.9
clinic 7.8
30s 7.7
attractive 7.7
machine 7.7
exam 7.7
college 7.6
career 7.6
doctor 7.5
teacher 7.5
place 7.4
help 7.4
floor 7.4
coffee 7.4
back 7.3
student 7.2
classroom 7.2
paper 7.1

Google
created on 2019-11-16

Photograph 96.1
Snapshot 86.2
Room 71.4
Photography 70.6
Stock photography 69.2
Desk 51
Art 50.2

Microsoft
created on 2019-11-16

wall 95.8
computer 94.7
man 92.2
indoor 87.8
text 79.4
desk 69.6
furniture 61.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 16-28
Gender Male, 53%
Disgusted 45%
Happy 45%
Fear 45.1%
Confused 45%
Surprised 45.1%
Calm 51.1%
Angry 48.5%
Sad 45.2%

Feature analysis

Amazon

Chair
Person
Monitor

Clarifai

Television
Clothing
Human face
Human hair
Human leg
Furniture
Human arm

AWS Rekognition

Chair 99.6%

AWS Rekognition

Person 99.4%

AWS Rekognition

Monitor 98.4%

Clarifai

Television 93%

Clarifai

Television 39.9%

Clarifai

Clothing 85.4%

Clarifai

Clothing 39.8%

Clarifai

Human face 51%

Clarifai

Human hair 39.7%

Clarifai

Human leg 39.3%

Clarifai

Furniture 38.6%

Clarifai

Human arm 37%

Categories

Imagga
created on 2019-11-16

paintings art 89.5%
interior objects 4.3%
people portraits 2.1%
food drinks 1.8%

Captions

Microsoft
created by unknown on 2019-11-16

a man sitting in a box 70.8%
a man standing in front of a computer 70.7%
a man sitting in front of a computer 69.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a man sitting on a couch in a living room

Created by general-english-image-caption-blip-2 on 2025-07-10

a woman sitting in a chair with a television and a basket

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts a modest room with various items scattered around. On the left, there is a bed covered with a patterned blanket, with items such as a box and clothes visible nearby. In the center, a person is seated in an armchair wearing a robe and interacting with objects on a small table. On the floor near the chair, there is an open basket containing tools or utensils. To the right, a retro-style television sits atop a refrigerator. Above the television, shelves contain electronics and other miscellaneous items, including wires. The flooring appears to be terrazzo or a similar material. The overall setting suggests a casual and utilitarian environment.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a person seated in a chair, engaged in an activity with their hands, possibly preparing or assembling something. The setting appears to be a small living space or room with a bed and a television. To the left of the person, there is a bed covered with a patterned blanket. A few items are placed on the bed, including a bag. On the floor, there are a couple of books or magazines and a box, possibly for shoes. Next to the chair and the person, there is a basket with an open lid revealing various objects inside. In front of the chair, there is a small refrigerator or cooler with a hot plate or similar appliance on top, likely used for cooking or heating food. A television sits to the right, resting on a small table. The photograph's border shows the date "SEP 63," indicating it was taken in September 1963.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a person, likely a man, sitting in a chair in what appears to be a home environment. The person is wearing a white shirt and is surrounded by various household items such as a television, a basket, and other objects. The image has a vintage or historical feel, with the black and white photography style and the dated appearance of the furnishings and technology.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph dated September 1963. It shows a person in a white garment sitting in what appears to be a living room or bedroom setting. They are seated in an armchair with a patterned throw or blanket visible on what might be a bed or couch to the left. The person appears to be working with or examining something in their hands.

In the room, there's a vintage television set on a stand to the right, and various items are scattered on the floor, including what looks like a woven basket and some papers or documents. The floor appears to be concrete or terrazzo. The overall composition gives a candid, documentary-style feel to the image, capturing a moment of everyday life in the early 1960s.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-30

The image depicts a black-and-white photograph of a woman sitting in a chair, surrounded by various objects. The woman is wearing a white robe and has short dark hair. She is seated in a light-colored armchair with a high back, facing to the right. In front of her, there is a small table with a television on top, which appears to be an older model with a rounded screen. To the left of the television, there is a small basket containing various items, including what looks like a pair of scissors and other tools.

On the floor next to the basket, there are several other objects, including a book or magazine, a box, and a small container. The background of the image shows a bed with a blanket and pillow on it, as well as a wall with a window or door behind the woman. The overall atmosphere of the image suggests that the woman is engaged in some kind of activity, possibly crafting or repairing something, while watching television.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-30

The image is a black-and-white photograph of a woman sitting in a chair, surrounded by various objects. The woman has short, dark hair and is wearing a white robe. She is sitting in a light-colored armchair with her legs crossed, holding a spoon in her right hand and a bowl in her left hand. In front of her is a small table with a record player on it, and a television set is placed to the right of the table. A basket filled with records is positioned in front of the table.

To the left of the woman is a bed with a blanket and pillow on it. On the floor next to the bed are some books and a bag. The background of the image is a plain white wall. The overall atmosphere of the image suggests that the woman is enjoying some quiet time to herself, possibly listening to music or watching television while eating a snack.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

A black-and-white photograph depicts a man sitting on a chair in a room. He is wearing a white robe and holding a spoon. A basket is on the floor next to him, and a TV is placed on a cabinet. A bed is on the left side of the room, and a blanket is spread over it. A power outlet is mounted on the wall above the TV. The image has a watermark with the date "SEP 63" on the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The black-and-white image shows a man sitting on a chair in a room. He is wearing a white shirt and seems to be eating food. There is a basket with some stuff in front of him. On the right side, there is a TV with a wooden frame. A small table with a bowl and a box is placed beside the TV. On the left side, there is a bed.

Google Gemini

Created by gemini-2.0-flash on 2025-05-01

Captured in a black and white photograph dated "SEP 63", the image presents a scene of domesticity. A person is seated in a high-backed armchair, clad in what appears to be a light-colored, possibly white, robe. They are focused on a pan set atop a small portable stove, positioned on a table, and seem to be either cooking or testing the food with a spoon.

To the left of the person is a bed, neatly covered with a patterned blanket and a pillow. Beside the chair, on the floor, sits a picnic basket with its lid open, revealing cutlery. The foreground shows what looks like a portable radio or tape recorder and a few other small items scattered on the floor.

To the right of the seated figure is an old television set, perched on a simple metal stand. Above the TV, an air conditioning unit is fitted into the wall, complete with visible electrical outlets and cords. The room has a terrazzo-style floor, adding to the vintage feel of the image.

Created by gemini-2.0-flash-lite on 2025-05-01

Here is a description of the image:

The image is a black and white photograph taken in 1963, as indicated by the "SEP 63" stamp at the top. It captures a candid moment of a person inside what appears to be a living space.

The central focus is a person seated in a high-backed armchair, dressed in what seems to be a light-colored robe. They are holding a spoon and appearing to eat something from a pan that is sitting on top of what looks like a small table or appliance, perhaps a small freezer.

To the right of the person, a classic, boxy television set stands on a small metal table. Above the television, there's a rectangular box-like structure with what appears to be a ventilation system or air conditioner.

In the foreground, there's a woven picnic basket, open to reveal cutlery and plates, implying a casual meal or perhaps a setting of a picnic. A small, retro-style radio sits on the floor to the left of the chair, on the edge of a bed covered with a patterned blanket and sheets.

The floor is tiled with a speckled pattern. The lighting suggests a typical interior of the era, with the scene capturing a relaxed moment of someone eating while relaxing with television.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image is a black-and-white photograph taken in September 1963. It depicts an indoor scene, likely a living room or a similar domestic space. Here's a detailed description:

  1. Person: A person is standing and appears to be engaged in an activity near a table. They are wearing a short-sleeved shirt and shorts, and their attention is focused on something in their hands.

  2. Furniture and Objects:

    • Armchair: To the left, there is an armchair with a blanket or throw draped over it. The armchair is upholstered in a light-colored fabric.
    • Table: In front of the person, there is a small table with various items on it, including what looks like a basket, some papers or magazines, and possibly kitchen utensils.
    • Television: To the right, there is a vintage television set placed on a stand. The television is turned off.
    • Shelf or Cabinet: Above the television, there is a shelf or cabinet with various items stored on it, including what appears to be a jar and other household objects.
  3. Floor: The floor is covered with a patterned rug or carpet.

  4. Miscellaneous Items: There are several other items scattered around the room, including a box on the floor and what looks like a pair of shoes near the armchair.

The overall atmosphere of the image suggests a casual, lived-in space, possibly capturing a moment of everyday life from the 1960s.

Qwen

No captions written

Text analysis

Amazon

2
63
SEP

Google

63 SEP
63
SEP