Human Generated Data

Title

Untitled (man and woman in riding outfits seated on a bench indoors)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5181

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman in riding outfits seated on a bench indoors)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5181

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.3
Human 98.3
Tie 98
Accessories 98
Accessory 98
Person 97.4
Clothing 83.3
Apparel 83.3
Clinic 64
People 62.3
Text 59.3
Photography 55.6
Photo 55.6

Clarifai
created on 2023-10-26

people 98.8
man 97.6
group 96.1
adult 95.3
uniform 89.8
monochrome 88.3
woman 86.1
two 83.8
veil 83.3
business 82.6
actor 80.1
desktop 78.9
indoors 78.6
retro 76.9
wedding 76
suit 75.6
coat 72.7
portrait 69.9
nostalgia 69.6
science 69

Imagga
created on 2022-01-23

bow tie 90
necktie 74.6
garment 47.3
man 43.7
lab coat 36.8
person 36.5
coat 36.2
businessman 34.4
male 33.4
people 32.4
professional 31.8
work 29.8
office 29.7
clothing 29.7
business 29.2
medical 29.1
adult 28.5
doctor 26.3
worker 24
businesspeople 22.8
laboratory 22.2
computer 21.6
working 21.2
medicine 21.1
laptop 21
lab 20.4
job 20.4
occupation 20.2
looking 20
team 19.7
portrait 19.4
indoors 19.3
corporate 18.9
desk 18.9
teamwork 18.5
student 18.3
businesswoman 18.2
health 18.1
science 17.8
scientist 17.6
smiling 17.4
research 17.1
happy 16.9
chemical 16.5
face 16.3
biology 16.1
education 15.6
hospital 15.5
test 15.4
table 14.7
indoor 14.6
sitting 14.6
men 14.6
group 14.5
chemistry 14.5
handsome 14.3
colleagues 13.6
clinic 13.4
chemist 12.8
scientific 12.6
serious 12.4
meeting 12.3
bright 12.2
technology 11.9
casual 11.9
confident 11.8
experiment 11.7
expertise 11.7
care 11.5
shirt 11.2
suit 11.1
room 10.9
color 10.6
executive 10.4
home 10.4
women 10.3
patient 10.1
hand 9.9
microscope 9.9
biotechnology 9.8
equipment 9.8
human 9.8
thoughtful 9.7
practitioner 9.7
corporation 9.7
elderly 9.6
workplace 9.5
talking 9.5
one person 9.4
senior 9.4
study 9.3
glasses 9.3
attractive 9.1
researcher 8.9
success 8.9
analysis 8.8
discovery 8.8
look 8.8
assistant 8.7
uniform 8.7
tube 8.7
lifestyle 8.7
development 8.6
smile 8.6
tie 8.5
horizontal 8.4
mature 8.4
camera 8.3
successful 8.2
alone 8.2
cheerful 8.1
nurse 8.1
microbiology 7.9
associates 7.9
discussing 7.9
happiness 7.8
technician 7.8
conference 7.8
consultant 7.8
1 7.7
modern 7.7
think 7.7
two 7.6
sit 7.6
communication 7.6
instrument 7.5
manager 7.5
holding 7.4
focus 7.4
safety 7.4
20s 7.3
specialist 7.1
day 7.1
together 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.6
wall 95.3
man 90.5
clothing 87.6
person 85.1
human face 83.3
black and white 68.4
posing 46.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 50.9%
Calm 37.7%
Sad 32.7%
Happy 20.7%
Surprised 6.5%
Angry 0.7%
Disgusted 0.6%
Confused 0.6%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 95.1%
Calm 95.8%
Sad 2.6%
Angry 0.4%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 98.3%
Person 97.4%
Tie 98%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created by unknown on 2022-01-23

a group of men posing for a photo 73%
an old photo of a man 72.9%
a group of people posing for a photo 71%

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a man and woman sitting on a bed -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image appears to be a photographic negative, showing two individuals seated on a bench or chair in front of a fireplace. Behind them is a wall-mounted painting featuring abstract or artistic imagery, and a floral arrangement is positioned to the side. Decorative sconces and elements of the room's interior design, such as molding and ornate details, are visible. The lighting suggests a formal or elegant atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a negative of a photograph showing two men sitting on a bench. The men are dressed in formal attire with light-colored jackets and dark trousers. In the background, there is a decorative mantle with a vase of flowers and a framed painting or artwork mounted above it. The room has ornate sconces on either side of the mantle, suggesting it is a well-furnished, possibly elegant setting. The image is marked with numbers along the side, which could be an index or reference for archival purposes.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows two men in formal attire, likely in a professional or official setting. They are seated at a table, with one man gesturing with his hands while the other observes. The room appears to be ornately decorated, with a framed painting on the wall and ornate lighting fixtures. The overall scene suggests a formal or ceremonial event or meeting taking place.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The black and white image shows two elderly African American men sitting together, both wearing white outfits that resemble lab coats or doctor's coats. They appear to be having tea or coffee, with cups and saucers visible in front of them on an ornate white tablecloth. The room has elegant decor, with a framed painting visible on the wall behind them and sconce lighting. The men have serious expressions and seem to be engaged in conversation or discussion.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph of two people wearing white coats or uniforms, likely waiters or service staff. They are sitting together and both wearing dark neckties or cravats with their white uniforms. The setting appears to be an elegant room with decorative wall sconces visible in the background, along with what looks like a framed artwork on the wall. The image has the formal, posed quality typical of professional photography from an earlier era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of two men sitting on a couch, with a painting on the wall behind them. The man on the left is wearing a white suit jacket, a striped shirt, and a white cap. He has a cup of coffee in his hand. The man on the right is wearing a white suit jacket, a plaid shirt, and a dark tie. He is holding a glass in his hand.

The background of the image shows a room with a fireplace and a painting on the wall above it. There are also some decorative items on the mantlepiece, such as vases and sculptures. The overall atmosphere of the image suggests that the two men are enjoying a leisurely afternoon together, perhaps over coffee or tea.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

This image is a black and white photograph of two men sitting on a bench, with a fireplace and painting in the background. The men are dressed in formal attire, with one wearing a hat and the other holding a glass. The fireplace features a painting above it, and there are decorative elements such as sconces on either side of the fireplace. The overall atmosphere suggests a formal or professional setting, possibly from an earlier time period given the style of clothing and decor.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white photo shows two men sitting on a bench, probably in a room. The man on the left is holding a cup, while the man on the right is holding a glass. They are both wearing white jackets, hats, and shoes. Behind them is a wall with a frame, a wall decoration, and a candle holder. The wall decoration has a flower design, while the candle holder has a candle and a flower design.

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image is a black-and-white photograph of two men sitting on a bench. The man on the left is wearing a hat and holding a cup, while the man on the right is holding a glass. Both men are dressed in white coats and appear to be in a formal setting. Behind them is a wall with a picture frame and a lamp, and there is a watermark on the bottom right corner of the image.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image appears to be a negative of a vintage photograph. The colors are inverted, with light areas appearing dark and vice-versa. This suggests a historical scene, possibly from the early to mid-20th century, given the clothing styles and setting.

Main Subjects:

  • Two Men: The primary focus is on two formally dressed men. They both wear light-colored suit jackets with dark collar shirts. One wears a white cap and the other appears to have a patterned tie or scarf. They both seem to be seated on a cushioned bench or similar piece of furniture. One is holding a glass.

Setting & Background:

  • Interior: The scene is set indoors, in what appears to be a well-appointed room.
  • Fireplace & Decor: A fireplace is visible behind the men, adding a touch of elegance to the room. There's a painting above the fireplace. Additional details are visible that add to the background.

Additional Details:

  • A small tea cup is visible to the left of one man.
  • There are decorative wall sconces flanking the fireplace.
  • The image has notations on the side.

Created by gemini-2.0-flash on 2025-05-17

The image shows a negative of a black and white photograph. Two men are seated, likely on a low bench or ottoman.

The man on the left is wearing a cap and a light-colored suit over a striped vest. He is holding a cup and saucer. The man on the right is also wearing a light-colored suit and appears to be holding a glass or small container.

Behind them is a fireplace with a framed picture hanging above it. On either side of the fireplace, there are sconces or light fixtures. The photograph appears to be taken indoors in a somewhat formal setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts two men sitting at a table, likely in a formal setting. Both are dressed in light-colored suits with dark cravats, and one is wearing a hat adorned with what appears to be feathers. They are seated in front of a table that has a white tablecloth, some cups, and other items, possibly food or utensils. The background includes a framed painting on the wall and ornate wall decorations, including wall sconces and possibly a clock. The overall ambiance suggests a historical or vintage setting, possibly from the early 20th century, given the style of clothing and decor. The image has a somewhat ghostly or faded quality, which could be due to age or the type of photographic process used.

Text analysis

Amazon

11526
NAGON
YTABAS

Google

)1526
)1526