Human Generated Data

Title

Untitled (John Ringling North with a cigarette seated on a couch, Pennsylvania)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11669

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (John Ringling North with a cigarette seated on a couch, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11669

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Furniture 99.9
Shelf 98.6
Indoors 98.3
Person 97.8
Human 97.8
Bookcase 97.1
Clothing 96.6
Apparel 96.6
Room 96.4
Library 90.6
Book 90.6
Chair 88.8
Person 87.1
Couch 87.1
Sunglasses 86.2
Accessories 86.2
Accessory 86.2
Living Room 75
Shop 69.2
Female 62.3
Girl 61.6
Portrait 60.3
Photography 60.3
Face 60.3
Photo 60.3
Interior Design 59.2
Bookstore 55.3

Clarifai
created on 2023-10-26

people 99.9
adult 98.5
monochrome 98.5
one 97
man 96.6
wear 96.1
two 95.9
group 95.3
portrait 95.1
furniture 93.2
music 92.3
leader 89.9
retro 88.9
several 87.5
many 87.1
group together 86.2
writer 85.8
administration 84.8
street 84.5
newspaper 82.9

Imagga
created on 2022-01-15

professional 39.1
office 37.5
person 37.1
business 36.5
man 35
people 32.4
work 31.4
corporate 30.9
adult 29.5
male 27.7
job 27.4
businessman 27.4
businesswoman 27.3
laptop 26.6
scholar 25
computer 24.9
executive 24.9
working 24.8
businesspeople 24.7
happy 22.6
newspaper 22.5
success 20.9
intellectual 20
manager 19.6
worker 19.3
successful 17.4
smiling 17.4
men 17.2
smile 17.1
suit 16.9
portrait 16.8
desk 16.3
product 16.2
looking 16
shop 15.9
indoors 15.8
occupation 15.6
sitting 15.5
career 15.1
table 14.9
team 14.3
technology 14.1
lifestyle 13.7
talking 13.3
phone 12.9
creation 12.6
medical 12.4
20s 11.9
clothing 11.9
women 11.9
confident 11.8
employee 11.5
meeting 11.3
pretty 11.2
attractive 11.2
home 11.2
color 11.1
communication 10.9
chair 10.8
cheerful 10.6
serious 10.5
reading 10.5
coat 10.5
room 10.2
horizontal 10.1
indoor 10
alone 10
clinic 9.7
hairdresser 9.7
group 9.7
profession 9.6
education 9.5
happiness 9.4
finance 9.3
building 9.3
face 9.2
barber chair 9.1
holding 9.1
library 9
interior 8.8
colleagues 8.7
book 8.7
boss 8.6
formal 8.6
workplace 8.6
research 8.6
garment 8.5
plan 8.5
clothes 8.4
modern 8.4
document 8.4
teamwork 8.3
mercantile establishment 8.1
patient 8
standing 7.8
consultant 7.8
laboratory 7.7
secretary 7.7
30s 7.7
health 7.6
company 7.4
bookshop 7.3
stylish 7.2
jacket 7.2
handsome 7.1
call 7.1
necktie 7.1
medicine 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 100
book 99.8
person 99.1
shelf 98.9
black and white 94
library 88.3
clothing 81.8
man 81.1
monochrome 67.6
room 44
store 39.6
shop 12.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 87%
Calm 97.9%
Sad 0.8%
Happy 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Female, 66.8%
Calm 93.7%
Sad 2.6%
Angry 2.1%
Happy 0.6%
Confused 0.5%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses
Person 97.8%
Person 87.1%
Sunglasses 86.2%

Captions

Microsoft
created by unknown on 2022-01-15

a person reading a book shelf 72.9%
a person reading a book shelf 72.7%
a person reading a book in a library 72.6%

Clarifai
created by general-english-image-caption-blip on 2025-05-23

a photograph of a man in a white suit and tie is talking on the phone -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image is a negative photograph depicting a person seated on a floral-patterned sofa in a room with bookshelves and large windows in the background. The individual is wearing a light-colored suit with a pocket square, holding a cigarette in one hand. The room appears to be well-furnished, featuring a coffee table with items placed on it and a chair visible to the side. The setting suggests a library or a study with a cozy and sophisticated ambiance.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image features a person sitting on a floral-patterned sofa in a room filled with bookshelves. The person is wearing a light-colored suit, with the jacket, trousers, and dress shirt all matching in tone. The left hand is gesturing, while the right hand rests on the knee. The room has a comfortable setting, with books neatly stacked on shelves, and large windows that open up to an outside view. There is a table next to the sofa with objects on it, partially visible. The overall aesthetic suggests a formal yet relaxed atmosphere.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a man sitting in a chair in what appears to be a library or study. The man is wearing a white suit and has a serious expression on his face. Behind him, there are bookshelves filled with books, and there are various framed items on the walls, including what looks like a portrait. The overall atmosphere of the image suggests a contemplative or intellectual setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph showing someone seated in what appears to be a library or study, with bookshelves visible in the background. The subject is wearing light-colored clothing and is photographed in profile, looking to the side. The image has an artistic quality with interesting lighting and shadows, and there appears to be some decorative floral or leaf patterns visible, possibly from wallpaper or fabric in the setting. The photo has a vintage quality to it, likely from the mid-20th century based on the style and composition.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a man sitting on a couch, with a bookshelf and other furniture visible in the background.

  • The man is seated on a floral-patterned couch, wearing a white suit and tie. He has short hair and appears to be gesturing with his hand as he speaks.
  • In the background, there is a bookshelf filled with books, as well as a desk and chair. A window is visible behind the man, allowing natural light to enter the room.
  • The overall atmosphere of the image suggests a formal or professional setting, possibly a library or office.

The image provides a glimpse into a quiet, studious environment, with the man's attire and demeanor conveying a sense of seriousness and focus.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a man sitting on a floral-patterned couch in a room filled with books. The man is wearing a white suit, black shirt, and white tie, and has short, light-colored hair. He is sitting with his left leg crossed over his right, and his left hand is raised near his face.

The couch has a floral pattern, and there is a glass table in front of it with a glass on top. In the background, there are several bookshelves filled with books, as well as a window with a view of trees outside. The overall atmosphere of the image suggests a sophisticated and intellectual setting, possibly a library or study.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a man sitting on a couch in a room. He is wearing a white suit and tie, and has his hand on his chin, as if deep in thought or contemplation. The room is filled with bookshelves and a fireplace, and there are various items on the shelves, such as picture frames and books. The image has a vintage feel, with a slightly blurry quality and a sepia tone. The man's expression and posture suggest that he is a serious and thoughtful person, and the room's decor adds to this impression.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo shows a man sitting on a couch in a room. He is wearing a white suit, a white shirt, and a tie. He is making a hand gesture with his left hand, while his right hand is on his lap. The room has a glass window with a view of the outside. There are bookshelves filled with books and picture frames on top of them.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

The image is a black and white, negative photograph of a man seated on a floral-patterned sofa. He is wearing a light-colored suit with a tie, and appears to be in a relaxed pose, his left arm resting on the armrest of the sofa and his right hand raised. He appears to be in a room with bookshelves visible on either side of a window in the background. In the background, there's a white mantlepiece, a picture, and some other decorative elements. In the foreground, there's a small table with a glass and an ashtray. The overall aesthetic is one of mid-century elegance. There are some numbers and text visible along the borders.

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a high-contrast black and white photograph showing a man seated in an armchair in a room. The man is wearing a light-colored suit with a dark shirt and tie. His hair is neatly styled, and he appears to be in his middle years. He is looking to his right, with his right hand raised, gesturing slightly with his fingers. His left hand rests on his leg.

The armchair he is sitting in has a floral pattern. A bookshelf filled with books is visible on the left side of the image. In the background, there is a window and a table with framed pictures and a floral arrangement. On a table next to the man, there is a plate and a glass. The image has a vintage feel, likely due to its high contrast and black and white tones. The numbers "12215." are visible at the top and bottom of the frame.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man seated in what appears to be a study or a library. The man is dressed in a light-colored suit and tie, and he is holding a cigarette in his right hand while his left hand rests on the arm of the chair. He is seated in a patterned armchair with a floral design.

The background is filled with bookshelves containing numerous books, indicating a well-stocked library. There are also framed photographs and decorative items on the shelves and a mantelpiece. The room has a classic, sophisticated ambiance, with additional furniture such as a chair and a table visible. The overall setting suggests a scholarly or intellectual environment. The lighting in the image is soft, highlighting the man and the details of the room.

Text analysis

Amazon

12215
12215.
CALBERT
Sincerely

Google

-15 12215 NAUON-YT3HA2 -NAMT A3
-15
12215
NAUON-YT3HA2
-NAMT
A3