Human Generated Data

Title

Untitled (man smiling at woman off camera while sitting with drink on couch)

Date

1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9895

Human Generated Data

Title

Untitled (man smiling at woman off camera while sitting with drink on couch)

People

Artist: Martin Schweig, American 20th century

Date

1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9895

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Chair 100
Furniture 100
Table 96.4
Couch 95.8
Human 94.8
Home Decor 94.8
Tabletop 92.8
Dining Table 90.8
Cushion 88.5
Pillow 86.5
Indoors 85.2
Face 84.5
Room 80.8
Living Room 77
Portrait 66.9
Photography 66.9
Photo 66.9
Clothing 66.4
Apparel 66.4
Dish 62.7
Food 62.7
Meal 62.7
Female 59.9
Sitting 59.1
Tablecloth 58.9
Art 57.3
Girl 55.9

Clarifai
created on 2023-10-27

people 99.9
child 99.7
sit 97.3
two 97.2
furniture 97.2
chair 96
adult 94.7
man 93.5
seat 93
group 92.4
three 92.1
family 92
son 91.8
room 91.1
monochrome 90.9
offspring 90.6
indoors 90.3
boy 90.1
one 89.2
recreation 87.8

Imagga
created on 2022-01-28

newspaper 53
product 42
creation 31.7
man 29.6
person 28.8
male 23
people 22.3
sitting 21.5
outdoors 21.2
adult 20.3
smiling 20.2
home 19.9
laptop 19.3
happy 18.8
lifestyle 17.3
computer 16.9
senior 16.9
scholar 16.8
attractive 16.8
mother 16.4
together 15.8
casual 15.2
couple 14.8
portrait 14.2
intellectual 13.4
elderly 13.4
working 13.3
mature 13
technology 12.6
child 12.5
handsome 12.5
leisure 12.4
cheerful 12.2
looking 12
love 11.8
day 11.8
retired 11.6
seller 11.6
family 11.6
business 11.5
retirement 11.5
boy 11.3
men 11.2
beach 11.1
room 11
happiness 11
relaxing 10.9
park 10.7
professional 10.7
indoors 10.5
reading 10.5
grandma 10.5
old 10.4
notebook 10.4
relaxation 10
teenager 10
house 10
smile 10
holding 9.9
work 9.8
kid 9.7
women 9.5
clothing 9.1
alone 9.1
fun 9
businessman 8.8
using 8.7
outside 8.6
life 8.5
tree 8.5
relax 8.4
pretty 8.4
summer 8.4
glasses 8.3
teen 8.3
chair 8.2
aged 8.1
holiday 7.9
grandmother 7.8
sea 7.8
father 7.8
typing 7.8
education 7.8
older 7.8
outdoor 7.6
enjoying 7.6
communication 7.6
enjoyment 7.5
human 7.5
one 7.5
office 7.2
sunset 7.2

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 97.7
furniture 94
person 93.9
table 90.2
window 84.9
bed 78.2
couch 71.5
vase 64.4
chair 57.1

Color Analysis

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Bed

Clarifai

Human face
Clothing
Man
Table
Pillow
Human hair
Chair
Human leg
Human arm
Human hand

AWS Rekognition

Person 94.8%

Categories

Imagga
created on 2022-01-28

paintings art 88.9%
streetview architecture 10.1%

Captions

Microsoft
created by unknown on 2022-01-28

a little girl sitting in front of a window 51.8%
a girl sitting in front of a window 51.7%

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

a man sitting on a couch in his living room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man sitting on a couch with a box of cigarettes

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This image is a photographic negative depicting a man leaning on a patterned couch. He has short hair and is wearing a plaid shirt and light-colored pants. The scene appears to be indoors, possibly in a living room or lounge area. The furnishings include a floral-patterned couch, decorative throw pillows, and a small coffee table with items like a glass, a plate, and objects that are not distinctly identifiable due to the image being inverted. In the background, there are various decorative elements such as a table with a lamp, vases, and framed pictures. A second person’s legs are visible in the frame, wearing high heels, which suggests they might be standing near the couch. The image has markings and text at the edges indicating it is a processed film negative, likely Kodak brand.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image appears to be a black and white negative photograph depicting a man lounging on a sofa in a living room or lounge area. He is leaning on his elbow and appears to be relaxed. The man is wearing a plaid shirt and light-colored pants. The sofa is adorned with patterned pillows. In front of the man is a round table with various items on it, including a glass, possibly a drink, and a dish with some food or snacks.

The room is filled with various pieces of decor, including lamps, framed photographs or paintings, and other knick-knacks on tables and shelves. There is a patterned carpet on the floor. In the background, behind the man, there is a corner with possibly more seating and decorations, including more pictures and objects on the shelves.

The photograph seems to capture a moment in a well-decorated, personal space, with a somewhat casual and candid feel due to the man's relaxed position. Since it is a negative, the colors and shades are inverted, which may give the scene an unusual appearance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows an elderly man sitting in a chair, surrounded by various decorative items and furnishings. He appears to be reading or examining something in his hands. The room is cluttered with various objects, including vases, lamps, and framed artwork on the walls. The overall scene suggests a cozy, lived-in environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from an earlier era, likely mid-20th century. It shows a person relaxing on a patterned couch or sofa, wearing a plaid button-up shirt. The room appears to be a living room or sitting room with decorative elements including what looks like an oil lamp or vase on a side table, and there's a patterned carpet visible on the floor. The furniture has an ornate, vintage style with decorative upholstery patterns. The overall scene has a casual, at-home feeling to it.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

This image is a black and white photograph of a man sitting on a couch, with his head resting on his right hand. The man has short hair and is wearing a plaid shirt and white pants. He is sitting on a floral-patterned couch, with his left arm resting on the armrest.

In front of the couch, there is a small round table with a glass top, holding various items such as a camera, a book, and a vase. The floor is covered with a rug, and there are several other objects in the room, including a lamp, a picture frame, and a vase.

The overall atmosphere of the image suggests that the man is relaxing or contemplating something, possibly in a living room or study. The presence of the camera and book on the table may indicate that the man is interested in photography or reading.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a black-and-white photograph of a man sitting on a couch, with a table in front of him. The man is wearing a plaid shirt and white pants, and he has his head resting on his hand as he looks down at something on the table.

  • A man sitting on a couch:
    • The man is sitting on a couch with a floral patterned cushion.
    • He is leaning forward, with his head resting on his hand.
    • His body is relaxed, with his legs stretched out in front of him.
  • A table with objects on it:
    • The table is small and round, with a glass top.
    • There are several objects on the table, including a vase, a book, and a box.
    • The objects are arranged in a way that suggests the man is studying or examining them closely.
  • A lamp in the background:
    • The lamp is standing on a table behind the couch.
    • It has a dark shade and a metal base.
    • The lamp is not turned on, but it adds to the overall ambiance of the room.

Overall, the image suggests that the man is in a quiet, contemplative mood, perhaps lost in thought as he examines the objects on the table. The dim lighting and relaxed posture of the man contribute to a sense of calmness and introspection.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

A black-and-white photo of a man sitting on a couch in a room. He is wearing a checkered shirt and has his head resting on his hand. In front of him is a table with some items on top. There are pillows on the couch. Behind him is a glass table with some items on top. There are also picture frames and vases on the glass table.

Created by amazon.nova-lite-v1:0 on 2025-05-30

The black-and-white image features an elderly man sitting on a couch, with his hand resting on his chin. He is wearing a checkered shirt and white pants. There is a small table in front of him with various items on it, including a lamp and a box. Behind him, there is a window with a view of a room that has a table with a lamp, a picture frame, and a vase. The image has a watermark with the text "Koda-Elm" in the bottom right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-05-19

Here's a description of the image:

This black and white image shows a man reclining on a patterned sofa. He's dressed in a plaid shirt and light-colored pants. The sofa has several pillows with floral patterns. A round table next to the sofa holds various objects. The scene appears to be in a well-decorated room with pictures on display. The carpet has a floral pattern, and various objects are scattered around, including a table lamp and a standing fan. The image seems to be a photographic negative, with the colors inverted. There are notations on the edges of the image, likely markings from the film or development process.

Created by gemini-2.0-flash-lite on 2025-05-19

Here is a description of the image:

The image is a black and white negative of a man relaxing on a sofa in a well-appointed room. The man, whose face is in profile, appears to be middle-aged with short, thinning hair. He is wearing a checkered shirt and light-colored pants. He's leaning forward with his hand near his chin, seemingly deep in thought.

He's reclining on a patterned sofa adorned with several throw pillows. A small, round table sits next to him, holding items like a small glass, possibly a box, and a small ornate dish. A closed book sits on the floor between the man and the camera.

Behind him, there's a side table with a lamp, a framed picture, and other decorative objects. The room seems to be lavishly decorated, with a patterned rug on the floor and additional framed pictures in the background. The image's style suggests it might be a historical photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image appears to be a black-and-white photograph depicting a domestic scene. The main focus is on an older man seated on a couch in a living room. The man is wearing a plaid shirt and appears to be looking down, possibly at something in his hands.

The room is decorated with various items, including:

  • A coffee table in front of the couch, which has a few objects on it, including what looks like a mug and some other small items.
  • Several cushions and pillows on the couch, with different patterns.
  • A lamp on a side table next to the couch.
  • Various decorative items and ornaments on shelves and surfaces in the background.
  • A chandelier hanging from the ceiling.
  • A patterned rug on the floor.

The room has a cozy and somewhat cluttered appearance, with a mix of decorative elements and personal items. The overall atmosphere suggests a lived-in and comfortable space.

Qwen

No captions written

Text analysis

Amazon

h-0