Human Generated Data

Title

Untitled (Dr. Herman M. Juergens at desk talking with his wife(?), Leona)

Date

1965-1968

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.496.6

Human Generated Data

Title

Untitled (Dr. Herman M. Juergens at desk talking with his wife(?), Leona)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1965-1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.496.6

Machine Generated Data

Tags

Amazon
created on 2019-08-09

Human 99
Face 81.6
Apparel 75.9
Clothing 75.9
Electronics 61.8
Food 58.7
Meal 58.7
Wood 58.2
Screen 58.1
Finger 57.5
Monitor 55.7
Display 55.7

Clarifai
created on 2019-08-09

people 99.8
adult 99.1
one 98.1
man 97.2
portrait 93.4
wear 92.4
administration 92.3
leader 91.7
two 91
group 90.1
scientist 87.4
sit 87.2
military 86.1
actor 86
furniture 83.9
room 83.7
war 83.2
outfit 83
indoors 82.9
woman 80.1

Imagga
created on 2019-08-09

specialist 52.3
man 45.7
person 38.5
professional 35.2
people 34
male 32.6
doctor 32
work 30.6
medical 30
coat 30
patient 27.7
adult 27.7
lab coat 27.6
nurse 26.3
office 25.7
hospital 23.8
occupation 22
clinic 22
senior 20.6
job 20.4
medicine 20.3
business 20.1
businessman 19.4
desk 18.9
men 18.9
happy 18.8
working 18.6
sitting 18
computer 17.7
looking 16.8
indoors 16.7
health 16.7
smiling 16.6
care 16.5
table 16.5
worker 16.2
portrait 16.2
meeting 16
mature 14.9
uniform 14.6
home 14.4
smile 14.3
face 14.2
women 13.4
team 13.4
surgeon 13.4
elderly 13.4
attractive 13.3
student 13.1
happiness 12.5
profession 12.4
clothing 12.3
couple 12.2
laptop 11.8
expertise 11.6
lifestyle 11.6
exam 11.5
together 11.4
group 11.3
glasses 11.1
two 11
businesswoman 10.9
stethoscope 10.8
laboratory 10.6
cheerful 10.6
businesspeople 10.4
study 10.3
garment 10.2
room 10.1
treatment 10.1
case 10
confident 10
grandfather 9.9
doctors 9.8
old 9.8
to 9.7
lab 9.7
illness 9.5
education 9.5
tie 9.5
practitioner 9.5
color 9.5
corporate 9.5
engineer 9.4
manager 9.3
teacher 9.3
teamwork 9.3
sick person 9.3
indoor 9.1
holding 9.1
scientist 8.8
clinical 8.8
cure 8.8
consultant 8.8
assistant 8.7
colleagues 8.7
director 8.7
busy 8.7
retirement 8.6
husband 8.6
wife 8.5
shirt 8.4
technology 8.2
success 8
science 8
look 7.9
bright 7.9
x ray 7.8
examining 7.8
diagnosis 7.8
surgery 7.8
discussion 7.8
examination 7.8
chemistry 7.7
notes 7.7
staff 7.7
executive 7.6
workplace 7.6
reading 7.6
equipment 7.4
service 7.4
call 7.3
interior 7.1

Google
created on 2019-08-09

Microsoft
created on 2019-08-09

person 98.8
indoor 98.7
wall 97.6
man 95.7
clothing 94.6
text 93.6
kitchen 88.8
human face 81.9
black and white 75.3
glasses 72.1
cooking 21

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-35
Gender Female, 73.9%
Disgusted 0.1%
Sad 1.4%
Angry 0.1%
Happy 0.5%
Surprised 7%
Fear 0.3%
Calm 88.3%
Confused 2.3%

AWS Rekognition

Age 43-61
Gender Female, 71.2%
Disgusted 0.1%
Calm 95.5%
Sad 1.1%
Confused 0.7%
Fear 0.1%
Surprised 1.6%
Happy 0.6%
Angry 0.2%

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.8%

Categories

Imagga
created on 2019-08-09

paintings art 71.7%
food drinks 22.2%
people portraits 2.4%
interior objects 1.9%
pets animals 1.6%

Captions

Microsoft
created by unknown on 2019-08-09

a man cooking in a kitchen 70.9%
a man standing in a kitchen 70.8%
a man cooking in the kitchen 70.3%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-21

a photograph of a man in a white shirt is holding a tray with a tray of food

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This is a black-and-white negative image depicting a scene likely between a medical professional and an elderly woman. The doctor, wearing glasses and a white coat, is seated at a desk, facing the woman and appears to be examining or conversing with her. The elderly woman is wearing a patterned dress and stands near the desk, engaging with the doctor. The setting seems to be a clinical or office space with visible elements such as shelving, a sink, and desk items contributing to the environment. Details like light tones and contrasts are inverted due to the negative image process.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image appears to be a photographic negative showing two individuals in a medical setting. On the left, an older woman, dressed in a patterned dress, is standing. She is wearing glasses and has short hair. On the right, a man, who seems to be a doctor, is seated and also wearing glasses. He is dressed in a white coat, suggesting his medical profession, and he is examining the woman's arm or wrist. The setting looks like a doctor's office, with a desk, papers, and medical instruments in the background. Additionally, there are certificates or framed pictures on the desk behind the doctor. The overall mood of the photograph appears professional and clinical.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows two men in a medical or scientific setting. One man, wearing a white coat, appears to be examining or interacting with the other man, who is wearing glasses and a patterned shirt. They seem to be engaged in some kind of professional discussion or examination. The setting includes shelves and equipment in the background, suggesting a laboratory or research environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph that appears to be from a medical or clinical setting. It shows two people - one appears to be a medical professional wearing a white coat and glasses, and the other is wearing a patterned dress or top and also wearing glasses. They appear to be in an office or medical space, with some paperwork or documents visible on what looks like a desk or counter. The image has the characteristic style and quality of mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of two men in a kitchen, with one man holding a piece of paper and the other man wearing a white lab coat. The image appears to be a vintage photograph, possibly from the mid-20th century.

  • Two men are standing in a kitchen:
    • The man on the left is wearing a patterned shirt and has short hair.
    • The man on the right is wearing a white lab coat and has short hair.
  • One man is holding a piece of paper:
    • The man on the left is holding a piece of paper in his right hand.
    • The paper appears to be a document or a recipe.
  • The man on the right is wearing a white lab coat:
    • The lab coat is a crisp white color.
    • The coat has a pocket on the left side.

The image suggests that the two men are engaged in some kind of activity or discussion in the kitchen, possibly related to food or cooking. The presence of the lab coat on the man on the right implies that he may be a scientist or a medical professional, and the paper he is holding may be a recipe or a scientific document.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a man and woman in a medical setting. The man, dressed in a white lab coat, sits at a desk with his hands extended, holding papers. He wears glasses and has short dark hair. The woman, positioned to the left, faces him while wearing a patterned dress and glasses. Her short hair is styled in an updo.

In the background, various objects are visible, including a sink, a shelf with boxes, and a small framed picture on the desk. The overall atmosphere suggests a professional or clinical environment, possibly a doctor's office or laboratory.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of an elderly woman and an elderly man standing in a room. The woman is wearing glasses and a dress with a floral pattern. The man is wearing a white coat and glasses. The man is holding the woman's arm and appears to be examining her. There is a sink with a faucet and a cabinet with a picture frame on top behind them.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photo shows two people standing in a room. The man is sitting on a chair, wearing glasses and a white coat. He is holding a book and a pen, and he is probably writing something on the book. The woman is standing and wearing eyeglasses, and she is holding a pen. Behind them are some objects, including a picture frame and a shelf with books.

Google Gemini

Created by gemini-2.0-flash on 2025-05-12

The image shows two people in a possible medical setting. On the left stands a woman with short, curly hair, wearing glasses and a patterned dress. She appears to be looking towards a man seated at a desk.

The man is wearing glasses and a white coat, suggesting he is a doctor or medical professional. He is seated in a chair behind a desk that has various items on it, including what appears to be paperwork, framed pictures, and other objects. The background of the image is a room with a sink and shelves.

Created by gemini-2.0-flash-lite on 2025-05-12

Here's a description of the image:

Overall Impression:

The image is a black and white negative of a doctor's office setting. It appears to be an older photograph, possibly from the mid-20th century. The image has a slightly grainy quality, which is typical of older film photography.

Composition:

  • Subject Matter: The scene depicts a doctor interacting with a patient. The doctor is seated behind a desk and the patient is standing next to him.
  • Framing: The image is a medium shot, capturing both individuals from the chest up.
  • Setting: The environment is a doctor's office, with a desk, sink, and shelves.

People:

  • Doctor: The doctor is an older man wearing glasses and a white coat. He is seated at a desk, looking at documents with the patient.
  • Patient: The patient is an older woman, also wearing glasses. She is standing, leaning towards the doctor.
  • Facial Expressions and Interaction: Both appear to be engaged in a conversation, with the doctor possibly explaining something to the patient, as evidenced by documents on the desk.

Details:

  • Desk: There are some documents on the desk, along with a photograph of the holy cross.
  • Setting: There is a washroom to the left, with the sink clearly shown.
  • Visual Style: The lighting appears to be natural light from the window, with some areas being brighter than others.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image appears to be a black-and-white photograph of two individuals in what looks like a laboratory or office setting. Both individuals are wearing protective eyewear, which suggests they might be handling or observing something that requires eye protection.

The person on the left is wearing a patterned blouse and seems to be holding a piece of paper or a thin object, while the person on the right is dressed in a white lab coat, indicating they might be a scientist or a medical professional. The person on the right is holding a small object, possibly a photograph or a slide, and appears to be examining it closely.

In the background, there are various items that suggest a scientific or medical environment, including what looks like a stack of papers or files, a sink, and some equipment on the counter. The overall setting and attire of the individuals indicate that this could be a scene from a scientific experiment, medical examination, or a similar professional activity.

Qwen

No captions written