Human Generated Data

Title

Untitled (three seated older men talking)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5213

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three seated older men talking)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5213

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.4
Clothing 95.5
Apparel 95.5
Face 92.6
Female 77.5
Advertisement 72.6
Nature 70.2
Outdoors 69.7
Portrait 69.2
Photography 69.2
Photo 69.2
People 69.1
Meal 68.5
Food 68.5
Girl 66.5
Poster 66.1
Text 62.6
Head 59.7
Woman 58.1
Hat 57.5
Finger 57
Art 55.9

Clarifai
created on 2023-10-26

people 99.7
monochrome 98.8
man 97.5
group 97.4
interaction 95.8
veil 95.8
adult 95.3
woman 94.9
wedding 92.2
actor 88.3
illustration 87.9
scan 86.5
bride 86
retro 85.5
three 85.2
lid 84.3
nostalgia 83.7
couple 81.8
leader 80.2
portrait 78.5

Imagga
created on 2022-01-23

negative 37.9
film 35.4
people 27.9
photographic paper 23.6
man 23.6
male 22.7
person 22.4
adult 18.3
professional 16.4
medicine 15.8
photographic equipment 15.8
work 15.7
doctor 15
businessman 15
medical 15
silhouette 14.9
business 14.6
team 14.3
portrait 14.2
technology 14.1
human 13.5
bride 13.2
groom 12.6
happy 12.5
looking 12
health 11.8
science 11.6
face 11.4
blackboard 11.3
student 10.9
job 10.6
laboratory 10.6
art 10.5
office 10.4
hospital 10.4
wedding 10.1
equipment 9.9
worker 9.9
care 9.9
web site 9.7
specialist 9.6
couple 9.6
clinic 9.6
education 9.5
grunge 9.4
teamwork 9.3
smile 9.3
event 9.2
occupation 9.2
group 8.9
working 8.8
computer 8.8
boy 8.7
lifestyle 8.7
newspaper 8.6
happiness 8.6
drawing 8.4
coat 8.1
hair 7.9
women 7.9
day 7.8
black 7.8
lab 7.8
husband 7.7
men 7.7
1 7.7
attractive 7.7
two 7.6
uniform 7.6
marriage 7.6
life 7.5
design 7.3
lady 7.3
success 7.2
dress 7.2
sexy 7.2
creation 7.2
amulet 7.1
love 7.1
together 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.7
old 92.7
human face 92.5
window 91.7
person 90.4
clothing 89.6
posing 77.3
man 77
player 69.9
poster 63.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99%
Happy 99.4%
Confused 0.2%
Calm 0.1%
Surprised 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Clothing
Man
Human face
Poster
Human arm
Human nose
Human hand
Hat
Human hair

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.6%

Clarifai

Clothing 93%

Clarifai

Clothing 83.7%

Clarifai

Man 90.6%

Clarifai

Human face 87.5%

Clarifai

Human face 79.9%

Clarifai

Human face 77.9%

Clarifai

Poster 48.2%

Clarifai

Human arm 45.6%

Clarifai

Human arm 36.2%

Clarifai

Human arm 35.3%

Clarifai

Human nose 44.5%

Clarifai

Human hand 38.9%

Clarifai

Hat 37.4%

Clarifai

Hat 36.1%

Clarifai

Human hair 34.5%

Categories

Imagga
created on 2022-01-23

paintings art 99.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

photograph of a man talking to a man.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man in a hospital bed with a nurse and a nurse

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image is a black-and-white negative showing three individuals inside a room. The scene includes two men wearing hats, one in a patterned suit and tie on the left and the other in a shirt and pants on the right. The person in the center is wearing a striped shirt. They appear to be in a casual setting, engaged in what seems to be an exchange or moment of interaction, with hand gestures visible. Shelving with items and a cylindrical object are present in the background.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a photographic negative showing a scene with three people indoors. One person is on the left wearing a light-colored suit and a flat cap, gesturing with their right hand. The person in the middle is wearing a striped shirt. The person on the right is wearing a long-sleeved shirt and a broad-brimmed hat, also gesturing with their hand. The setting appears to be a casual or informal gathering with some shelving and what looks like a water heater in the background. The arrangement and gestures suggest a moment of interaction or conversation among the individuals.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows three older men standing together in what appears to be a store or shop setting. They are all wearing hats - one man is wearing a fedora, another is wearing a cowboy hat, and the third man is wearing a cap. The men seem to be engaged in conversation or some kind of interaction. The image has a black and white, vintage aesthetic.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph showing three men in what looks like an indoor setting. The person in the center is wearing a striped shirt or polo and appears to be standing between two other men who are wearing suits and hats. The image has a somewhat overexposed or high-contrast quality typical of older photography. The men seem to be engaged in some kind of interaction or conversation, with the two men on either side appearing to be gesturing or reaching toward the person in the middle. The setting appears to be some kind of indoor space, possibly a business or store, though the details of the background are somewhat difficult to make out due to the image quality.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of three men standing in a room, with a shelf visible in the background.

The man on the left is wearing a light-colored suit jacket, a dark shirt, and a tie. He is holding a small object in his right hand and pointing at it with his left hand. The man in the middle is wearing a striped shirt and has short hair. He is looking at the object being pointed at by the man on the left. The man on the right is wearing a dark shirt and a hat. He is also looking at the object.

The background of the image shows a room with a shelf on the wall. The shelf has several objects on it, but they are not clearly visible due to the low quality of the image.

Overall, the image appears to be a candid shot of three men interacting with each other in a room. The exact context and purpose of the image are unclear, but it may have been taken for personal or professional reasons.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of three men in a room, with the men in the foreground and various objects in the background. The man on the left wears a suit jacket, tie, and hat, while the man in the middle sports a striped shirt. The man on the right dons a dark shirt and a hat. The background features a window, a shelf, and other items that are not clearly visible due to the image's quality.

The image appears to be an old photograph, possibly from the early 20th century, given the style of clothing and the overall aesthetic. The men seem to be engaged in conversation or some form of interaction, but the exact context is unclear. The image has a nostalgic feel to it, evoking a sense of a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph featuring three elderly men in a room. The man on the left is wearing a hat, glasses, and a tie, and he is pointing at something while smiling. The man in the middle is wearing a striped shirt and has tattoos on his arm. He is also smiling and appears to be engaged in a conversation with the man on the left. The man on the right is wearing a hat and a long-sleeve shirt, and he is looking at the man in the middle. The image has a watermark in the bottom right corner that reads "55551".

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white photograph of three elderly men, possibly taken in the early 1900s, is printed on a white sheet of paper with a black border. The men are sitting in a room and seem to be talking to each other. The man on the left is wearing a suit and tie, while the man in the middle is wearing glasses and a striped shirt. The man on the right is wearing a hat.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

Here's a description of the image:

Overall Impression:

The image is a black and white, negative photograph. It depicts three men in an interior setting, likely a shop or possibly a kitchen. They appear to be in conversation or engaged in some sort of interaction.

Key Features:

  • The Men: Three men are the central focus. The man on the left is wearing a light-colored suit and a cap. The man in the middle has a striped shirt, glasses, and seems to be holding something. The man on the right is wearing a hat and dark clothing. The man on the right points towards the man in the middle.
  • Setting: The background provides some context. There's a window, part of a wall with items hanging, and a round object that could be a pipe or large appliance.
  • Composition: The photograph is well-composed, with the three men arranged in a way that suggests interaction.
  • Film Type: The words "AGFA NITRATE FILM" are written on the edge of the image, indicating the type of film used.
  • Age: The image appears to be an older photograph, likely from the mid-20th century. The style of clothing supports this guess.

If you'd like, provide another image, and I'll describe it for you.

Created by gemini-2.0-flash on 2025-05-09

Here is a description of the image:

The image appears to be a black and white photographic negative. It features three men in what seems to be an indoor setting.

One man is seated on the left, wearing a suit and a cap. He is turned towards the center man, holding something small in his hands.

In the center stands a man wearing glasses and a striped shirt. He is also holding something small and appears to be engaged in conversation.

On the right, there's another man wearing a hat, a long-sleeved shirt, and trousers. He is pointing his finger towards the center man.

The background includes what looks like shelves with boxes and a doorway. The image is a film negative, as indicated by the reversed tones and the text "AGFA NITRATE FILM" on the left side.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring three older men sitting together in what appears to be a casual setting, possibly indoors. The man on the left is wearing a hat and a suit jacket, with a tie, and is holding a cigarette. The man in the middle is wearing a striped shirt and glasses, and he is smiling. The man on the right is also wearing a hat and a long-sleeved shirt, with his arm resting on the shoulder of the man in the middle. The background includes some shelves with items on them, suggesting a domestic or informal environment. The image has a vintage feel, possibly from the mid-20th century. The men appear to be engaged in a friendly conversation or gathering.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

The image is a black and white photograph showing three individuals in a room. The central figure appears to be seated and is wearing a striped shirt, while the other two individuals are standing on either side. Both standing individuals are wearing hats, and one of them is gesturing towards the seated person. The room has a sign in the background that reads "A Brands Hardware Store," suggesting the setting might be a hardware store or a similar retail establishment. The image has a vintage feel, likely from an earlier time period, indicated by the style of clothing and the quality of the photographic film. There is a date "1955" printed at the bottom of the photograph, which could provide context for when the image was taken.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This black-and-white photograph appears to be a vintage image featuring three men in a casual and friendly interaction. The man in the center is wearing a striped shirt and glasses, and he seems to be the focus of attention. The man on the left is dressed in a suit and hat, and he is smiling as he holds the central figure's hand. The man on the right is also wearing a hat and a dark shirt, and he is holding the central figure's other hand. The background shows a room with shelves and a bright light source, possibly a window, which creates a strong contrast in the image. The overall tone of the photograph suggests a moment of camaraderie or celebration.

Text analysis

Amazon

AGFA
NITRATE
AGFA NITRATE FILM
FILM
a
a BRAND
BRAND
.sssal
HAOBHAB

Google

కా కా
కా