Human Generated Data

Title

Untitled (man in suit and tie playing cards, New York City)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12135

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man in suit and tie playing cards, New York City)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12135

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.6
Apparel 99.6
Tie 99.3
Accessories 99.3
Accessory 99.3
Person 99
Human 99
Person 98.7
Hat 98.1
Hat 98
Sunglasses 97.3
Tie 96.7
Shirt 93.8
Person 79
Clinic 69
Coat 68.6
Overcoat 64.7
Person 64.1
Finger 61.4
Suit 60.5
Dress Shirt 56.6

Clarifai
created on 2023-10-26

people 99.7
adult 99.3
man 98.9
monochrome 97.2
portrait 95.8
lid 91.5
group 91.3
woman 86.3
uniform 85
eyewear 84.1
hospital 82.2
vertical 78.8
horizontal 77.9
actor 77.8
indoors 77.3
bowler 77.1
fedora 77.1
humor 77.1
wear 77.1
group together 76.9

Imagga
created on 2022-01-22

bow tie 58.3
man 53.1
necktie 51.1
male 44.7
professional 39.8
person 38.9
businessman 36.2
people 32.4
work 31.4
medical 30
business 29.8
garment 29.7
adult 28.9
office 25.9
doctor 25.4
occupation 24.8
looking 24
portrait 24
worker 21.8
corporate 21.5
job 21.3
coat 20.9
medicine 20.3
laboratory 20.3
clothing 20.2
face 19.9
hospital 19.9
lab 18.5
student 18.4
handsome 17.8
working 17.7
happy 17.6
suit 17.5
businesspeople 17.1
team 17
successful 16.5
care 16.5
confident 16.4
men 16.3
tie 16.1
desk 16.1
health 16
smiling 15.9
manager 15.8
scientist 15.7
serious 15.3
computer 15.2
executive 14.6
research 14.3
mature 14
laptop 13.7
expertise 13.6
lab coat 13.3
senior 13.1
success 12.9
nurse 12.8
chemistry 12.6
science 12.5
illness 12.4
biology 12.3
career 12.3
indoors 12.3
patient 12.2
group 12.1
employee 11.7
workplace 11.4
hand 11.4
guy 11.3
modern 11.2
shirt 11.2
casual 11
clinic 11
indoor 11
experiment 10.7
bright 10.7
employment 10.6
test 10.6
exam 10.6
elderly 10.5
human 10.5
uniform 10.5
education 10.4
sitting 10.3
study 10.3
teamwork 10.2
two 10.2
smile 10
examining 9.8
chemical 9.8
technology 9.7
look 9.6
building 9.5
happiness 9.4
specialist 9.4
communication 9.2
businesswoman 9.1
one 9
thoughtful 8.8
lifestyle 8.7
table 8.7
collar 8.6
profession 8.6
notebook 8.4
color 8.4
holding 8.3
room 8.2
engineer 8.1
stethoscope 7.9
women 7.9
together 7.9
chemist 7.9
x ray 7.9
technician 7.8
partner 7.7
1 7.7
attractive 7.7
old 7.7
only 7.6
meeting 7.5
company 7.4
builder 7.3
black 7.2
to 7.1

Google
created on 2022-01-22

Coat 92.6
Hat 92.4
White 92.2
Vision care 91.1
Fedora 89.8
Eyewear 89.8
Sun hat 89.1
Tie 86.4
Black-and-white 84.6
Sunglasses 84
Style 83.8
Suit 83.2
Blazer 78.3
Cap 77.8
White-collar worker 77.2
Font 75.3
Motor vehicle 75.2
Vintage clothing 74.7
Snapshot 74.3
Formal wear 73.7

Microsoft
created on 2022-01-22

hat 100
fashion accessory 99.8
fedora 99.1
text 98.5
cowboy hat 97.9
sun hat 97.9
man 94.1
human face 93.9
clothing 92.7
person 91.9
black and white 72.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 92.3%
Calm 98.3%
Sad 0.6%
Happy 0.5%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 94.9%
Sad 1.4%
Surprised 1.2%
Angry 1.1%
Happy 0.5%
Disgusted 0.4%
Confused 0.4%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Tie
Person
Hat
Sunglasses
Suit
Tie 99.3%
Tie 96.7%
Person 99%
Person 98.7%
Person 79%
Person 64.1%
Hat 98.1%
Hat 98%
Sunglasses 97.3%
Suit 60.5%

Categories

Imagga

paintings art 99.4%

Captions

Microsoft
created by unknown on 2022-01-22

a man wearing a hat 82.2%
a man in a hat 80.7%
a close up of a man wearing a hat 73.3%

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a suit and tie is looking at a book -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image appears to show three individuals sitting at a table, dressed in formal attire that includes suits, ties, and hats. The clothing features patterns, such as stripes on the tie and a textured appearance on the suits. The setting includes small framed images visible in the background, possibly photographs or artwork. The image itself is inverted, creating a negative effect where light and dark areas are reversed.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image appears to be a photographic negative featuring three well-dressed individuals seated at a table. They are wearing suits, and two of them have on hats. The person in the center is holding a card or a piece of paper in their hand. In the background, there are several small photographs or images pinned to a wall. The image is marked with the text "AGFA SAFETY FILM" along the top edge, indicating that it is an old or traditional film negative.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows three men in suits and hats standing together. They appear to be in some kind of office or professional setting, with framed images on the wall behind them. The men have a serious, focused expression on their faces as they seem to be engaged in conversation or discussion. The black and white photograph gives the image a classic, historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph that appears to be from an earlier era, likely mid-20th century. It shows three men in formal attire, wearing white suits, patterned ties, and fedora hats. They appear to be in deep conversation or examining something together. The image has a film noir quality to it, with strong contrast between light and dark elements. In the background, there appear to be some small photographs or posters on the wall. The men's attire and the photographic style suggest this may be from the 1940s or 1950s.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-30

The image is a black-and-white photograph of three men in suits and hats, with one man holding a small object.

  • The man on the left wears a white suit jacket, a dark shirt, and a white fedora hat. He has a serious expression and looks down at the object in the other man's hand.
  • The man in the middle wears a white suit jacket, a dark shirt, and a tie with diagonal stripes. He also wears glasses and has short, light-colored hair. He holds a small, rectangular object in his right hand and looks down at it.
  • The man on the right wears a white suit jacket and a dark hat. He has short, light-colored hair and looks to the left at the other two men.

The background of the image is out of focus, but it appears to be a room with white walls and several pictures hanging on them. The overall atmosphere of the image is formal and serious, suggesting that the men may be attending a business meeting or other professional event.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-30

The image is a black-and-white photograph of three men in suits and hats, with one man holding a piece of paper. The man on the left wears a fedora hat and a light-colored suit jacket over a dark shirt and tie. The man in the middle has short white hair and wears a light-colored suit jacket over a dark shirt and striped tie. He holds a piece of paper in his hands. The man on the right is partially visible, wearing a fedora hat and a light-colored suit jacket.

In the background, there are several small pictures on the wall, but they are not clearly visible. The overall atmosphere of the image suggests a formal or professional setting, possibly from the mid-20th century given the style of clothing and hats.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The black-and-white image shows three men, all dressed in formal attire, seated in a room. The man in the middle is holding a piece of paper, perhaps reading it. He is wearing glasses and a tie. The man on the left is wearing a hat and is looking at the man in the middle. The man on the right is wearing a hat and is looking at the man on the left. Behind them is a wall with several pictures of people.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The black-and-white photo shows three men sitting in front of a white wall with pictures of people. The man on the left is wearing a hat and a tie. He is looking at something in front of him. The man in the middle is wearing eyeglasses and a tie. He is looking at something on his right hand. The man on the right is wearing a hat and looking at something on his left.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

The image is a black and white negative depicting three men in suits gathered in an interior space. The central figure is the clearest and appears to be looking down at a small card or piece of paper he's holding. He's wearing glasses, a patterned tie, and a light-colored suit with a subtle grid pattern. The two men flanking him are also in suits, one wearing a hat. The background is out of focus, but a row of framed pictures or illustrations can be seen on the wall behind them. The image has a vintage feel, suggesting it was taken some time ago. The "10743." appears at the side of the image on each side.

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

The image appears to be a black and white photographic negative featuring three men. All three are dressed in light-colored suits. The man in the center is wearing glasses and looking down at what appears to be a small card or paper in his hands. The man to his left is wearing a fedora and also appears to be looking down. The man on the right is partially visible, wearing a hat with a wider brim, and his face is in profile.

Behind the men, there is a wall with a series of framed pictures. Numbers are visible on both the left and right edges of the image, suggesting that this is a scan of a photographic negative. The overall quality of the image is somewhat bright and washed out, likely due to it being a negative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting three men, likely from the mid-20th century. The man in the center is wearing glasses and a light-colored suit with a striped tie. He appears to be examining or holding a small object in his hands. To his left is a man wearing a light-colored hat and suit, looking intently at the object the central figure is holding. To his right is another man, also wearing a hat, who is looking in the same direction. The background shows a wall with several framed pictures or photographs. The men's attire and the setting suggest a formal or semi-formal gathering, possibly related to business or a professional event. The photograph has markings on the edges, indicating it might be a negative or a print from a film roll.

Text analysis

Amazon

10743.
M 113
M 113 AFCA
AFCA
EhLOI

Google

10743.
10743.