Human Generated Data

Title

Old Cellar Bakery, New York City

Date

1910, printed later?

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosemblum, P1979.81

Human Generated Data

Title

Old Cellar Bakery, New York City

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1910, printed later?

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosemblum, P1979.81

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.2
Clothing 96.1
Apparel 96.1
Animal 75.6
Mammal 75.6
Pet 75.6
Sitting 69.2
Finger 65.5
Face 64.6
Archaeology 63.7
Undershirt 62.3
Pants 62
Sleeve 59
Hat 56.9

Clarifai
created on 2023-10-25

people 99.9
adult 99.2
one 98.2
man 98.1
two 97.2
canine 96.4
portrait 95.2
military 94.3
mammal 93.4
actor 92.9
wear 92.5
sit 91
furniture 90.8
dog 90.4
child 89.4
veil 88.5
sitting 87.7
lid 86.9
street 85.3
war 84.9

Imagga
created on 2022-01-08

cadaver 19.3
person 17
man 15.5
adult 14.9
statue 14.1
old 13.2
people 12.3
male 12.2
rock 12.2
one 11.9
art 11.9
grunge 11.1
sculpture 11
ancient 10.4
water 10
outdoor 9.9
religion 9.9
culture 9.4
architecture 9.4
stone 9.3
travel 9.2
dirty 9
sea lion 9
posing 8.9
city 8.3
fashion 8.3
sport 8.2
sensuality 8.2
fitness 8.1
body 8
cool 8
attractive 7.7
balance 7.6
outdoors 7.5
human 7.5
religious 7.5
grave 7.5
monument 7.5
style 7.4
lion 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 97.8
text 97.1
wall 96.2
sitting 94
statue 89
clothing 79.8
human face 78.5
black and white 60.8
old 54.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 67.1%
Surprised 18.8%
Fear 4.9%
Confused 3.4%
Disgusted 2.4%
Happy 1.9%
Angry 0.8%
Sad 0.8%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Calm 28.5%
Sad 27.7%
Confused 11.3%
Surprised 9.4%
Angry 7.6%
Fear 7.5%
Disgusted 5.7%
Happy 2.4%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Cat

Clarifai

No features identified

AWS Rekognition

Person 99.2%

AWS Rekognition

Cat 75.6%

Categories

Imagga
created on 2022-01-08

people portraits 74%
nature landscape 16.3%
paintings art 3.1%
beaches seaside 2.5%
pets animals 1.6%
events parties 1.2%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts a scene in what appears to be a work environment, possibly a bakery or mill. A person is seated wearing a cap, a dust-covered shirt, and an apron. The individual is petting a cat that is perched on a wooden surface. The setting has a rustic and industrial atmosphere, with large sacks in the background and textured walls. A small lit candle is mounted on the left side of the frame, contributing to the overall dim lighting.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image depicts a worker seated in an industrial setting, likely in a mill or a factory. The worker is dressed in clothing typical for manual labor, with a cap and an apron, both dusted with what appears to be flour or dust from the work environment. The worker's hand is extended to pet a small cat that is standing on the surface next to them. Behind the worker, there are bags of materials stacked against the wall, suggesting storage of grains or similar goods. The setting is dimly lit, with a small lamp providing light on one side. The overall atmosphere suggests a scene from a time when manual labor and animal companionship were common in workplace environments.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a man with a beard and a cap sitting on a wooden structure, with a cat sitting next to him. The man appears to be in a workshop or industrial setting, with a dimly lit background. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph showing a worker, likely in an industrial or manufacturing setting. He's wearing work clothes including overalls and a flat cap, and has a full beard. He appears to be sitting or leaning against what looks like a large wooden workbench or vat. There's also a cat on the workbench next to him. The worker's clothes appear to be dusty or stained from his work. The setting appears to be indoors with plain walls visible in the background. The image has the grainy quality typical of early 20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image depicts a man sitting on a table, with a rabbit in front of him. The man is wearing a cap and an apron, and appears to be in a workshop or factory setting. He is holding the rabbit's front legs, and the rabbit is standing on the table, looking down at something on the floor.

The background of the image shows a wall with a light fixture on it, and several other tables and workstations in the room. The overall atmosphere of the image suggests that the man is working with animals, possibly in a laboratory or veterinary setting.

  • The man is sitting on a table, with a rabbit in front of him.
    • The man is wearing a cap and an apron.
    • The rabbit is standing on the table, looking down at something on the floor.
  • The background of the image shows a wall with a light fixture on it.
    • There are several other tables and workstations in the room.
    • The atmosphere of the image suggests that the man is working with animals, possibly in a laboratory or veterinary setting.
  • The man is holding the rabbit's front legs.
    • The rabbit appears to be calm and relaxed.
    • The man's expression is neutral, suggesting that he is focused on his work.

Overall, the image suggests that the man is engaged in some kind of animal-related work, possibly involving research or care. The presence of the rabbit and the man's attire suggest a professional or scientific setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This black-and-white photograph depicts a man sitting on a long, rectangular table in a dimly lit room. The man is dressed in a cap, a dirty shirt, and an apron, with his right arm resting on the table and his left arm holding a cat. The table appears to be covered in a layer of flour or dust.

In the background, there are other tables and what seems to be a wall with a light fixture. The overall atmosphere of the image suggests that it was taken in a bakery or a similar setting where flour is used. The presence of the cat adds a touch of warmth and personality to the scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photograph shows a man standing in a room, probably a factory, with his hand on a cat. He is wearing a hat and an apron, with a dirty shirt underneath. He is standing in front of a large stone slab with a small cat on it. Behind him, there is a blurry image of a person standing in front of a large stone slab. The room has a brick wall and a window with a metal frame.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black and white image features a man sitting on a bench, wearing a hat, and holding a cat in his left hand. He is looking towards the camera. Behind him, there is a person standing in the corner. There are several benches in front of him, and a basket is placed on the right side. A lamp is mounted on the wall on the left side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

The image is a black and white photograph depicting a man in a bakery or similar industrial setting. The man has a beard and is wearing a cap, a button-down shirt, and what appears to be an apron. He is sitting on the edge of a large concrete trough. In the foreground, there are several of these troughs, each filled with a light-colored substance, possibly flour or grain. The man is reaching out towards a small, cat-like animal, and the scene is dimly lit, adding a rustic and somewhat aged aesthetic. In the background, there's another person and what appear to be sacks stacked against a wall. The overall tone of the image suggests a moment of rest or interaction within a hardworking environment.

Created by gemini-2.0-flash on 2025-05-17

A monochromatic medium shot depicts a man in a cap sitting on a raised trough with a cat on the trough in front of him.

The man is wearing a cap, a button-down shirt, pants, and an apron draped over his legs. His clothes are dirty and spotted with dust, likely from working with flour or grain. He has a thick beard and a thoughtful expression on his face as he looks towards the camera.

The cat is small and stands on the trough, appearing to sniff at the contents. The trough, which appears to be made of stone or a similar material, is filled with a powdery substance.

In the background, there is another person, blurred and out of focus. Also in the background there are several bags. A light bulb on a short wire is visible on the left wall. The scene is dimly lit, with light possibly coming from the light bulb.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a man and a cat in what appears to be a workshop or a craftsman's studio. The man has a beard and is wearing a cap, a long-sleeved shirt, and an apron, all of which are covered in dust or some kind of powdery substance, likely related to his work. He is seated on a wooden bench or table, with his right hand resting on the surface and holding a tool, possibly a hammer or chisel.

The cat, which is black and white, is standing on the same surface, looking down as if it is inspecting something. The background shows a rustic setting with stone walls and other wooden benches or tables, suggesting a manual labor or artisan environment. The overall atmosphere of the image conveys a sense of hard work and craftsmanship, with the presence of the cat adding a touch of warmth and companionship.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

This is a black and white photograph of a man sitting on the edge of a stone or concrete structure, possibly a basin or tank. The man is wearing a worn shirt and an apron, suggesting he might be engaged in manual labor or a craft that requires such attire. He has a beard and is holding a small animal, possibly a kitten, which he appears to be petting or interacting with. The background is a simple, unadorned wall and includes some indistinct shapes and objects that could be part of a workshop or storage area. The lighting is dim and the overall tone of the image is gritty, evoking a sense of rustic or historical work.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

The image is a black-and-white photograph depicting a man sitting in what appears to be a workshop or industrial setting. He is wearing a cap and an apron over a short-sleeved shirt. The man has a beard and is looking directly at the camera with a slight smile. He is sitting on a bench or a similar structure, and there are several large stone troughs in front of him. The man is holding a small animal, possibly a kitten, in his hands. The background is somewhat cluttered, with various objects and materials visible, suggesting a work environment. The lighting in the image is dim, with a single light source visible in the upper left corner. The overall atmosphere of the photograph is rustic and somewhat aged, indicating it may be from an earlier time period.