Human Generated Data

Title

Untitled (doctors eating)

Date

1965-1968

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.483.4

Human Generated Data

Title

Untitled (doctors eating)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1965-1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.483.4

Machine Generated Data

Tags

Amazon
created on 2019-08-09

Person 98.6
Human 98.6
Indoors 98.2
Interior Design 98.2
Accessory 91.4
Sunglasses 91.4
Accessories 91.4
Room 90.3
Person 86.7
Sitting 85.6
Home Decor 76.8
Couch 72.5
Furniture 72.5
Face 70.1
Meal 69.2
Food 69.2
Photography 67.7
Photo 67.7
Chair 66.7
Undershirt 65.5
Apparel 65.5
Clothing 65.5
Portrait 64.6
Screen 62.3
Electronics 62.3
Monitor 57.3
Display 57.3

Clarifai
created on 2019-08-09

people 99.8
adult 99.5
man 98.2
one 98.1
furniture 98
room 97.5
two 96.4
wear 91.2
medical practitioner 90.7
indoors 90.3
seat 90.1
woman 90.1
facial expression 89.8
chair 89.5
sit 88.3
portrait 87.3
group 86.2
leader 85.2
administration 84.3
scientist 84.3

Imagga
created on 2019-08-09

man 42.3
senior 35.6
person 33.6
barbershop 32.8
people 30.1
male 29.8
adult 29.4
shop 27.3
hairdresser 25.6
couple 25.3
elderly 24.9
mature 24.2
home 23.9
smiling 23.1
indoors 21.1
lifestyle 21
mercantile establishment 20.1
happy 20
wife 19
love 18.9
old 18.8
portrait 18.8
together 18.4
sitting 18
retired 17.5
husband 17.2
holding 16.5
happiness 16.5
looking 15.2
family 15.1
smile 15
retirement 14.4
place of business 14.1
cheerful 13.8
men 13.7
patient 13.7
women 13.4
work 13.3
restaurant 13.1
computer 12.9
professional 12.5
bed 12.3
hand 12.2
table 12.1
phone 12
grandfather 11.7
office 11.5
call 11.4
room 11.2
technology 11.1
pensioner 11.1
two 11
hospital 10.7
medical 10.6
married 10.5
look 10.5
human 10.5
grandma 10.5
indoor 10
aged 10
businessman 9.7
groom 9.5
day 9.4
child 9.4
face 9.2
care 9
health 9
handsome 8.9
mother 8.9
older 8.7
hair 8.7
illness 8.6
talking 8.6
business 8.5
doctor 8.5
relationship 8.4
communication 8.4
joy 8.4
camera 8.3
to 8
working 8
grandmother 7.8
color 7.8
chair 7.7
sick 7.7
modern 7.7
pretty 7.7
loving 7.6
desk 7.6
togetherness 7.6
shirt 7.5
alone 7.3
establishment 7.2
job 7.1

Google
created on 2019-08-09

Microsoft
created on 2019-08-09

indoor 98
person 96.8
black and white 96.6
man 92.6
glasses 80.4
text 79.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 32-48
Gender Male, 95%
Fear 3.7%
Angry 2.8%
Disgusted 0.3%
Sad 30.5%
Happy 0.2%
Calm 61.5%
Surprised 0.3%
Confused 0.5%

AWS Rekognition

Age 42-60
Gender Male, 53.7%
Happy 45%
Angry 45.2%
Sad 54.4%
Disgusted 45%
Confused 45%
Calm 45.2%
Fear 45.1%
Surprised 45%

Feature analysis

Amazon

Person
Sunglasses
Person 98.6%
Person 86.7%
Sunglasses 91.4%

Categories

Captions

Microsoft
created by unknown on 2019-08-09

a man in a white room 89.1%
a man that is standing in the kitchen 80.4%
a man taking a selfie in a room 80.3%

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man is taking a picture of a woman eating a donut -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image depicts an inverted (negative) photograph of a dining scene. A man, dressed in formal attire, including a white jacket, sits at a table set with plates of food, cups, and various tableware. The background includes a dark wall with framed artwork and a clock, while a doorway and another wall with an alcove are visible in the setting. The overall composition suggests a casual dining moment in an indoor environment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image features a scene set in a dining area where multiple individuals are seated around a table laden with various dishes. One of the people is wearing a light-colored jacket and is actively eating. The table is filled with plates and cups, and there are several items of food visible, indicating a meal setting. The room has a dark color scheme on the walls, a couple of paintings hanging, and a wall clock is visible. There is a doorway leading to another area of the room or a separate room, which appears more brightly lit. The photo is presented as a photographic negative, reversing the typical colors.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows an elderly man sitting at a table, intently focused on something in front of him. The room appears to be a kitchen or dining area, with a clock on the wall and some framed artwork or photographs visible. The man is wearing a white shirt and appears to be examining or working on something on the table in front of him. The overall scene has a somber, pensive mood captured in the black and white photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph that appears to be from a laboratory or medical setting. Two people in white lab coats are shown examining or studying something closely, likely using microscopes or similar scientific equipment. They are seated at what appears to be a work table or bench. The room has framed artwork or pictures on the walls and a clock visible in the background. The image has the characteristic look of mid-20th century photography, suggesting it's a historical documentation of scientific or medical work.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of two men in white lab coats, seated at a table with various objects on it. The man on the left has short white hair and is wearing a dark collar under his lab coat. He is leaning over the table, holding a small object in his right hand and looking through a microscope with his left eye. The man on the right has dark skin and is wearing a light-colored hat and glasses. He is also leaning over the table, holding a small object in his right hand and looking through a microscope with his left eye.

The table is cluttered with various objects, including plates, bowls, cups, and other items that are not clearly visible. The background of the image shows a wall with several framed pictures hanging on it, as well as a door and a window. The overall atmosphere of the image suggests that the two men are engaged in some kind of scientific or medical activity, possibly conducting an experiment or examining a specimen.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This black and white image depicts two men in lab coats sitting at a table, engaged in an activity that appears to involve food or specimens. The man on the left has short hair and is wearing a lab coat, while the man on the right also wears a lab coat and has a mask covering his face. Both men are intently focused on the items on the table.

The table itself is cluttered with various objects, including what appears to be food, dishes, and other items that are difficult to discern due to the low quality of the image. In the background, there are several pieces of artwork hanging on the wall, as well as a clock and a doorway leading to another room.

The overall atmosphere of the image suggests a scientific or medical setting, possibly a laboratory or research facility. The men's attire and the equipment on the table suggest that they are engaged in some kind of experiment or analysis. However, without more context, it is difficult to determine the specific purpose or nature of their activity.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The black-and-white photo shows two men sitting at a table, possibly in a dining room. The man on the left is wearing glasses and has his head slightly bent down, perhaps eating. The man on the right is wearing a white coat and glasses and is holding a spoon, possibly eating. There is a table with plates, bowls, and cups on it. Behind them, there are picture frames on the wall, a clock, and a door.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows two men sitting on chairs at a table in what seems to be a dining room. The man on the left is wearing glasses and a long-sleeve shirt, while the man on the right is wearing a hat and a long-sleeve shirt. Both of them are eating. On the table are plates with food, cups, and a spoon. Behind them are picture frames hanging on the wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

This is a black and white, negative image of a dining scene. Two men are seated at a table laden with food. The man in the foreground, seen from the back, is wearing glasses and a white lab coat or similar attire. He's holding a fork and appears to be eating. The second man, in the background, is also wearing glasses and a white coat, and is also eating, possibly.

The table is set with plates, bowls, and what looks like pastries or sandwiches. The room has a plain decor. There's a clock on the wall, two framed pictures, and an open door leading to a hallway or another room with a small mirror on a side wall. The lighting appears to be dim. The image is a bit grainy, giving it a vintage feel.

Created by gemini-2.0-flash on 2025-05-04

The image shows two people sitting at a table in a room. Both appear to be wearing white coats and glasses. The person in the foreground is facing away from the camera, while the person in the background is facing forward. There is food on the table in front of them. On the wall behind them, there are several framed pictures and a clock. There is also an open doorway leading into another room. The image has been inverted, so the colors are reversed.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image is a black-and-white photograph depicting a kitchen scene. Two individuals are present in the kitchen, both engaged in cooking activities.

  • The person in the foreground is an older man wearing glasses and a light-colored shirt. He is facing the stove, holding a utensil, and appears to be cooking something in a pan.
  • The person in the background is a woman wearing an apron, standing near the stove and also engaged in cooking. She seems to be stirring something in a pot or pan.
  • The kitchen has a vintage feel, with a clock on the wall, framed pictures, and a refrigerator visible in the background. The stove is equipped with multiple pots and pans, suggesting a busy cooking session.
  • The room has a dark wall, possibly wallpaper, and the overall ambiance suggests a mid-20th-century setting.

This scene captures a moment of domestic life, highlighting the collaborative effort in preparing a meal.

Text analysis

Amazon

B