Human Generated Data

Title

Untitled (man fishing off dock with two young boys)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8834

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man fishing off dock with two young boys)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8834

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.7
Human 98.7
Person 98.4
Person 98.2
Person 95.7
Clinic 84.1
Chair 60.3
Furniture 60.3
Hospital 59.1
Doctor 56.2
Operating Theatre 55.3

Clarifai
created on 2023-10-25

piano 99.8
people 99.7
man 99.2
music 98.7
musician 98.1
monochrome 98.1
adult 97.9
jazz 96.8
instrument 96.3
pianist 96.2
woman 94
group 93.9
indoors 93.6
two 92.3
child 89.4
furniture 88.2
art 85.3
sit 85.2
boy 83.7
rehearsal 83.6

Imagga
created on 2022-01-09

people 30.1
man 29.6
male 26.2
counter 25.2
person 23.7
business 21.3
adult 21.2
happy 18.2
office 18.1
lifestyle 16.6
men 16.3
work 15.8
smiling 15.2
businessman 15
monitor 15
billboard 14.3
women 14.2
sitting 13.7
corporate 12.9
technology 12.6
laptop 12
signboard 11.6
meeting 11.3
equipment 11.3
professional 11.1
casual 11
communication 10.9
businesswoman 10.9
smile 10.7
interior 10.6
dishwasher 10.6
standing 10.4
portrait 10.4
television 9.9
modern 9.8
structure 9.8
cheerful 9.8
job 9.7
computer 9.7
group 9.7
indoors 9.7
musical instrument 9.6
couple 9.6
electronic equipment 9.4
worker 9
chair 9
table 9
looking 8.8
happiness 8.6
two 8.5
percussion instrument 8.4
board 8.3
child 8.3
silhouette 8.3
human 8.2
team 8.1
success 8
working 8
black 7.9
elegant 7.7
pretty 7.7
white goods 7.7
talking 7.6
hand 7.6
career 7.6
room 7.6
togetherness 7.6
holding 7.4
blackboard 7.4
executive 7.3
lady 7.3
indoor 7.3
confident 7.3
home 7.2
classroom 7.2
day 7.1
home appliance 7.1
sky 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 99.6
black and white 95.1
person 91.1
clothing 77.3
piano 59.8
monochrome 58.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 97.9%
Happy 46.3%
Calm 36%
Fear 12.4%
Surprised 1.6%
Sad 1.1%
Confused 1.1%
Disgusted 0.9%
Angry 0.6%

AWS Rekognition

Age 26-36
Gender Male, 62.3%
Sad 50.3%
Fear 27.8%
Happy 10.6%
Angry 4.2%
Calm 3.2%
Surprised 1.5%
Disgusted 1.5%
Confused 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.7%
Person 98.4%
Person 98.2%
Person 95.7%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a man and a woman sitting on a bench in a museum -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image depicts three individuals leaning over a railing, appearing to look downward. The setting includes structural details such as a boat, dock components, and various architectural elements like poles and railings. The individuals seem to be interacting with their surroundings, suggesting a moment of observation or engagement. The image has a reversed tone, resembling a photographic negative.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image is a negative photograph depicting a scene involving several individuals on a boat. Two of the individuals are crouched and leaning over the railing of the boat, engaging in an activity that requires them to look downward, possibly into the water or at something nearby. One individual has fair hair, while the other has light-colored hair and both are wearing dark shirts. Behind them, there is partial visibility of another person standing on the deck of the boat. The background shows elements of the boat's structure, including a ladder and some rigging, along with a mooring post. The scene conveys a nautical setting, possibly during daytime due to the presence of shadows.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a group of people, likely medical professionals, gathered around a hospital bed or examination table. They appear to be leaning over the table, intently focused on something or someone on the table. The scene has a somber, serious tone, suggesting a medical or emergency situation. The black and white photograph creates a stark, dramatic atmosphere. Without being able to identify the individuals, the image conveys a sense of care, concern, and professionalism as the group works together on the task at hand.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a construction or industrial setting. Several workers wearing dark shirts are leaning over and working on what appears to be a beam or railing. They are positioned at an elevated level, likely during the construction or maintenance of a building. The image has an architectural or structural quality to it, with visible support columns and geometric elements in the background. The workers appear to be focused on their task, all bending forward in a similar position. The photograph has a documentary style typical of industrial or architectural photography from an earlier era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of a group of people working on a large piece of equipment.

In the foreground, there are four men standing on a platform or stage, with their hands grasping a long, dark-colored object that appears to be a piece of machinery. The men are all wearing dark-colored shirts and pants, and they have short hair. They are looking down at the object, which is positioned at an angle, suggesting that they may be working on it.

In the background, there is a large, dark-colored structure that appears to be a building or a warehouse. There are also several other people visible in the background, although they are not clearly defined.

The overall atmosphere of the image suggests that the men are engaged in some kind of industrial or manufacturing activity, possibly related to the construction or repair of the machinery they are working on. The image has a vintage feel to it, suggesting that it may have been taken in the mid-20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image is a black and white photograph of four men working on a boat. The men are all wearing dark-colored shirts, with the two men in the foreground leaning over the side of the boat, while the man in the middle is standing behind them, and the man in the background is standing on the dock.

The boat appears to be a large vessel, possibly a yacht or a commercial boat, with a flat deck and a railing around the edge. The men are all focused on their work, with their hands and tools visible as they perform their tasks.

In the background, there is a dock or pier, with other boats and structures visible in the distance. The overall atmosphere of the image suggests a sense of industry and activity, with the men working together to maintain or repair the boat.

The image also includes a vertical strip of text on the right side, which reads "KODAK" and "MITCHELL - YETTAPS - 394918". This suggests that the image was taken by a photographer named Mitchell, and that it is part of a collection or archive of photographs related to boats or maritime activities.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph showing three adult men standing on the deck of a boat. They are leaning over the railing, possibly inspecting or fixing something on the deck. The man in the middle is looking down at the deck, while the man on the left is looking at the man in the middle, and the man on the right is looking at something on the right side. Behind them, there is a blurry image of a man standing on the deck.

Created by amazon.nova-pro-v1:0 on 2025-05-27

A black-and-white image of three men in front of a boat. The three men are leaning on the railings, and one of them is holding a rope. The man on the right is wearing a polo shirt, while the man in the middle is wearing a shirt and pants. Behind them is a man standing near the railings. There is a bollard on the left side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The photograph is a black and white negative, which means the light and dark areas are inverted from a normal photograph. It appears to depict a scene on a boat or pier.

Here's a breakdown:

  • Main Subjects: Three people are prominently featured. Two older men and a younger boy are positioned along the edge of a structure. The boy is looking downward, as if peering into the water or at something on the lower level. The men appear to be supporting or observing whatever the boy is doing.
  • Setting: The backdrop suggests a marine setting. A boat or structure with windows and a railing is visible in the background. Behind the men, another man can be seen. The structure has what appears to be a support system, suggesting it may be a dock or a part of the boat.
  • Lighting/Technique: As a negative, the contrast is inverted. The image has a sense of depth. The camera angle gives the impression of looking up slightly from the dock toward the boat.
  • Additional Details: The image contains the numbers 39491B and the words "KODAK - 2.VEELA - EITW" on the side, possibly marking information about the negative itself.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image appears to be an inverted black and white photograph. The scene features three people standing by a railing. From left to right, an adult and a child are leaning over the railing, with another adult leaning next to the child. All three appear to be looking down at something. Behind them, inside what seems to be the cabin of a boat, is another person who appears to be wearing a suit and tie. The setting seems to be on or near a boat or dock, with various structures and details of a vessel visible. There is some writing on the right edge of the photo that reads "39491B."

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-29

The image appears to be a black-and-white photograph taken in a medical setting, possibly a hospital ward. It shows four individuals, three of whom are standing and one who is seated on a bed. The individuals have been intentionally blurred to obscure their identities.

  1. Setting: The environment suggests a hospital or medical facility. There are multiple beds with metal frames, each equipped with a headboard and footboard. The beds are covered with sheets and blankets, and some have pillows.

  2. Individuals:

    • Three people are standing near the bed. Their faces and bodies are blurred, making it difficult to discern specific details about them.
    • One person is seated on the bed, also blurred.
  3. Details:

    • The bed in the foreground has a metal frame and is partially covered with a blanket.
    • There is a cylindrical object, possibly a medical device or a structural column, on the left side of the image.
    • The background shows additional beds and medical equipment, indicating a shared ward or room.
  4. Lighting: The lighting is relatively bright, suggesting that the room is well-lit, possibly with overhead fluorescent lights common in medical settings.

Overall, the image captures a moment in a medical facility, with the focus on the interaction between the individuals and the environment. The blurring of the people suggests an effort to maintain privacy.

Text analysis

Amazon

39491B

Google

MJ--YT33A°2--AGON
MJ--YT33A°2--AGON