Human Generated Data

Title

Untitled (man with cigarette balancing on see-saw toy in living room)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7407

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with cigarette balancing on see-saw toy in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7407

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 97.3
Clothing 85.7
Apparel 85.7
Sport 83.5
Sports 83.5
Vehicle 72.3
Transportation 72.3
Portrait 61.8
Face 61.8
Photography 61.8
Photo 61.8
Sleeve 56.6

Clarifai
created on 2023-10-25

people 99.2
monochrome 96.5
man 96.2
wear 92.7
adult 92.6
retro 88.9
fashion 88.4
wedding 82.5
one 82
portrait 79.9
street 79.4
art 77
paper 76.3
nostalgia 76.1
chair 73.3
woman 72.3
indoors 71.3
music 71.1
actor 69.5
vintage 66.2

Imagga
created on 2022-01-08

drawing 25.3
mannequin 23.8
design 23.7
art 21.4
sketch 20.3
silhouette 19.1
boutique 18
people 16.7
icon 15.8
symbol 14.8
man 14.8
set 14.4
sign 14.3
business 14
graphic 13.9
cartoon 13.4
black 13.2
fashion 12.8
shape 12.4
frame 12.2
bride 11.9
style 11.9
paper 11.8
male 11.4
human 11.3
person 11.1
dress 9.9
representation 9.7
3d 9.3
vintage 9.1
collection 9
retro 9
pattern 8.9
plan 8.5
city 8.4
element 8.3
shopping 8.2
antique 8.1
women 7.9
floral 7.7
decorative 7.5
wedding 7.4
banner 7.4
lady 7.3
group 7.3
cute 7.2
science 7.1
card 7.1
love 7.1
modern 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 98.3
man 93.3
sketch 86.3
drawing 78.7
clothing 75.1
person 69.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 70.6%
Happy 53%
Calm 24.3%
Sad 8.4%
Angry 4.2%
Surprised 3.5%
Confused 2.9%
Fear 1.9%
Disgusted 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Skateboard

Clarifai

Skateboard
Footwear
Wheel
Human face
Human arm
Human leg

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 91.8%

AWS Rekognition

Skateboard 83.5%

Clarifai

Skateboard 87.8%

Clarifai

Skateboard 74.8%

Clarifai

Skateboard 71.7%

Clarifai

Footwear 73.2%

Clarifai

Footwear 47.2%

Clarifai

Footwear 47.1%

Clarifai

Wheel 52.2%

Clarifai

Human face 49.1%

Clarifai

Human arm 36.5%

Clarifai

Human arm 35.5%

Clarifai

Human leg 33.1%

Categories

Imagga
created on 2022-01-08

paintings art 98.3%
interior objects 1.4%

Captions

Microsoft
created by unknown on 2022-01-08

a man standing in a room 85.8%
a person posing for the camera 85.7%
a man posing for a picture 83.9%

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

person, a senior, is a senior photographer.

Salesforce

Created by general-english-image-caption-blip on 2025-05-06

a photograph of a man standing in a room with a skateboard

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a photographic negative showing a person standing on a skateboard indoors. The individual is wearing a button-up shirt and pants. The room has a carpeted floor and various pieces of furniture, including a lamp with a patterned shade and what appears to be a cabinet or hutch on the left. There are floral curtains hanging in the window behind the person, allowing light to filter through. The surrounding environment suggests it's a living room space with other items, such as a TV or stereo cabinet, visible in the background. Additional figures and objects are partially visible throughout the room.

Created by gpt-4o-2024-11-20 on 2025-06-12

The image appears to be a negative photograph of a person balancing on a skateboard indoors. The individual is dressed in a buttoned shirt and pants, and is positioned on a carpeted floor. The room contains furniture, including a lamp on the right side and other items in the background. Curtains and a window are visible, allowing light to illuminate the space. The environment suggests a casual, possibly domestic setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a person wearing a white suit and glasses, standing in what appears to be a room or studio setting. The person is holding what looks like a microphone or other equipment, and there are various objects and furniture visible in the background. The image has a somewhat hazy, black and white quality, suggesting it may be an older photograph or film still.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be an old black and white photograph showing someone in a white lab coat or medical uniform working in what looks like a clinical or laboratory setting. The person is wearing glasses and appears to be standing near some equipment or machinery. The image has a somewhat overexposed or high-contrast quality typical of vintage photographs. The setting appears to be indoors with some equipment or furniture visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a man riding a skateboard in a room, likely a home or office setting. The man is wearing a white shirt with buttons down the front and dark pants. He has a watch on his left wrist and is holding a cigarette in his right hand. The skateboard is white with a dark stripe down the middle and appears to be in mid-air as the man rides it.

In the background, there are various objects and people visible, including a lamp, a chair, and a person standing behind the man. The room is well-lit, with natural light coming from a window on the left side of the image. The overall atmosphere suggests a casual, everyday scene, possibly from the 1950s or 1960s based on the clothing and decor.

The image is a black-and-white photograph, which adds to its nostalgic feel. The quality of the image is good, with clear details and no major distortions or artifacts. Overall, the image captures a moment in time, showcasing a man enjoying himself on a skateboard in a familiar setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image is a black and white photograph of a man riding a skateboard in a room. The man is wearing a white shirt with a design on the front, dark pants, and white shoes. He has short hair and is looking at the camera. His arms are outstretched for balance as he rides the skateboard.

In the background, there is a large window with curtains, a lamp, and a piece of furniture that appears to be a dresser or bookshelf. The floor is covered with a rug, and the walls are painted a light color. The overall atmosphere of the image suggests that the man is having fun and enjoying himself while riding the skateboard.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of an elderly man standing on a skateboard, which appears to be floating in the air. He is wearing a white shirt, pants, and sneakers. The man's expression suggests that he is posing for a photograph. Behind him, there is a room with a carpeted floor, a cabinet, and a lamp. The image has a watermark in the top left corner that reads "SOL" and "2017-03-27."

Created by amazon.nova-pro-v1:0 on 2025-06-02

A black-and-white photo shows an old man riding a skateboard with one foot on the ground. He is wearing glasses, a shirt, and pants. He is holding a cigarette in his left hand. He is smiling and seems to be posing for a photo. Behind him, there is a glass window with curtains, a shelf with a lamp, and a chair. On the left side, there is a cabinet with a picture frame.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

Here is a description of the image:

The image is an inverted black and white photograph featuring an older man on a skateboard. The man is wearing a short-sleeved, button-down shirt with a pattern and pants. He has glasses and appears to be smiling. The man is positioned on the skateboard with his arms outstretched to the sides for balance.

Behind the man, there are faint outlines suggesting a living room or indoor space, possibly with a window in the background. To the left of the image is a corner of a room with furniture. The carpet is visible on the floor. The negative's border is visible, with writing and markings along the edges, including "KODAK" and "41688".

Created by gemini-2.0-flash-lite on 2025-05-07

Certainly! Here's a description of the image:

Overall Impression

The image appears to be a black and white negative of a man riding a homemade or very simple skateboard indoors.

Key Elements

  • Subject: A man is the primary focus, standing on a skateboard. He's wearing a collared shirt with decorative details, light-colored pants, and sneakers. He's wearing glasses and seems to have short hair.
  • Skateboard: The skateboard itself is quite simple, possibly handmade, with a flat platform and a single central wheel.
  • Setting: The scene is inside a house. There is a large window or door in the background. A rug or carpet covers the floor. Some other people or objects can be seen in the background, although details are difficult to make out.

Other details:

  • The image is very bright as this is a negative image.
  • The photo is likely from the mid-20th century based on the man's clothing, glasses and the style of the home.
  • The image has some visible edge markings, characteristic of film negatives, including the "KODAK 2-VEE14" print and the number "88914".

Let me know if you would like any more information!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph featuring a man riding a skateboard indoors. The man is wearing glasses, a white shirt, and dark pants. He appears to be in motion, balancing himself on the skateboard with his arms extended slightly for stability. The background shows a living room setting with various items of furniture, including a lamp with a decorative lampshade, a chair, and other household items. The room has a cozy and somewhat cluttered appearance, with curtains and other decor elements visible. The photograph has a vintage feel, possibly due to its black and white nature and the style of the furniture and decor. The date "4 16 88" is visible in the bottom right corner, suggesting the photo was taken on April 16, 1988.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image is a black and white photograph that appears to have been taken with a high exposure, resulting in an overexposed and ghostly effect. The primary subject is a person standing in the middle of the room, seemingly in the process of jumping or dancing. The motion blur suggests movement, and the person is wearing a light shirt, dark trousers, and glasses. The background features a room with furniture, a lamp, and some wall decorations, but due to the high exposure, the details are hard to discern. The overall effect is dreamlike and surreal, with a sense of motion and energy captured in the photo.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This is a black-and-white photograph with a strong overexposed effect, causing much of the image to appear very bright and washed out. The main subject appears to be a man on a small, wheeled scooter. He is wearing a light-colored, short-sleeved shirt with a floral pattern and dark pants. He has short hair and glasses, and he seems to be in motion, possibly turning or leaning to one side. The background shows a room with furniture, including a lamp and a table with various items on it. The overexposure makes it difficult to discern many details of the room and the objects within it. There are also some numbers and text on the right side of the image, likely related to the film or photo processing.

Text analysis

Amazon

88914
SOI

Google

SO me im li be ra torine 88 9 14
SO
me
im
li
be
ra
torine
88
9
14