Human Generated Data

Title

Untitled (Dr. Herman M. Juergens and patient talking in exam room)

Date

1965-1968

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.508.3

Human Generated Data

Title

Untitled (Dr. Herman M. Juergens and patient talking in exam room)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1965-1968

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.2.508.3

Machine Generated Data

Tags

Amazon
created on 2019-08-09

Human 99.6
Clinic 88.5
Finger 75.8
Indoors 63
Clothing 60.4
Apparel 60.4
Room 59
Sitting 58
Operating Theatre 55.9
Hospital 55.9
Cushion 55.6

Clarifai
created on 2019-08-09

people 99.6
adult 98.3
man 97.5
portrait 97.1
one 96.2
elderly 95.8
administration 93.7
monochrome 93.5
leader 92.7
furniture 88.5
room 87.1
two 85.1
sit 83.8
facial expression 83.7
side view 82.8
indoors 82.8
chair 80.4
wear 80.4
newspaper 79.7
street 79.2

Imagga
created on 2019-08-09

person 50
man 47.8
male 43.4
grandfather 43.1
senior 38.5
people 36.9
patient 36.4
home 34.3
indoors 30.8
couple 30.5
retired 27.2
elderly 24.9
adult 24.7
smiling 23.2
specialist 22.7
happy 22.6
mature 22.3
nurse 21.5
men 20.6
together 20.2
old 19.5
medical 19.4
professional 18.5
talking 18.1
sitting 18.1
case 17.8
retirement 17.3
sick person 17.2
husband 17.2
office 17
portrait 15.5
scholar 15.3
wife 15.2
doctor 15.1
occupation 14.7
health 14.6
computer 14.6
inside 13.8
room 13.8
older 13.6
smile 13.6
family 13.4
hospital 13.3
meeting 13.2
pensioner 13.2
lifestyle 13
grandma 12.9
child 12.9
illness 12.4
working 12.4
businessman 12.4
relaxed 12.2
women 11.9
middle aged 11.7
couch 11.6
business 11.6
care 11.5
intellectual 11.5
laptop 11.4
aged 10.9
70s 10.8
discussing 10.8
two people 10.7
to 10.6
adults 10.4
stethoscope 10.3
indoor 10.1
worker 10
attractive 9.8
discussion 9.7
check 9.7
looking 9.6
profession 9.6
reading 9.5
desk 9.5
relaxing 9.1
writing 9.1
holding 9.1
cheerful 9
group 8.9
affection 8.7
table 8.7
chair 8.7
happiness 8.6
females 8.5
casual 8.5
two 8.5
help 8.4
horizontal 8.4
teamwork 8.4
lab coat 8.3
glasses 8.3
neonate 8.2
team 8.1
job 8
love 7.9
appointment 7.9
60s 7.8
surgery 7.8
clinic 7.8
40s 7.8
colleagues 7.8
busy 7.7
married 7.7
hand 7.6
bed 7.6
living 7.6
camera 7.4
20s 7.3
book 7.3
businesswoman 7.3
coat 7.3
baby 7.1
face 7.1
kid 7.1
interior 7.1
work 7.1

Google
created on 2019-08-09

Microsoft
created on 2019-08-09

person 99.3
human face 97
indoor 96.4
clothing 95.9
man 94.9
black and white 80.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 46-64
Gender Male, 97%
Confused 1.1%
Sad 2%
Surprised 10.4%
Calm 74%
Disgusted 1.6%
Happy 8.6%
Fear 1%
Angry 1.3%

Feature analysis

Amazon

Person

Clarifai

Clothing
Human face
Man
Glasses
Human nose
Human mouth

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.2%

Clarifai

Clothing 95.4%

Clarifai

Clothing 63.5%

Clarifai

Human face 90.1%

Clarifai

Human face 64.9%

Clarifai

Man 87.2%

Clarifai

Glasses 52.5%

Clarifai

Human nose 39%

Clarifai

Human mouth 34.7%

Categories

Imagga
created on 2019-08-09

people portraits 47.6%
pets animals 17.5%
paintings art 10.7%
food drinks 8.9%
interior objects 6.4%
events parties 5.8%
streetview architecture 1.5%

Captions

Microsoft
created by unknown on 2019-08-09

a man sitting on a bed 67%
a man and a woman sitting on a bed 44%
a man and woman sitting on a bed 37.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

photograph of a man sitting in a car.

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a man and woman sitting at a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image appears to be a black-and-white negative of two individuals sitting at a table or desk. The person in the foreground has light, curly hair and is wearing a light-colored garment. The background includes various objects, such as boxes labeled "Relax" and "Immunization Against Polio" beside other items. Curtains are visible on the right side, contributing to the indoor setting. A chair is positioned near the table. This scene suggests interaction or a discussion taking place.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image appears to be a negative photograph depicting two people seated at a table engaged in conversation or discussion. The person on the left has light-colored, curly hair and is wearing a shirt. There are some items on the table, including papers and a cloth. In the background, there are boxes with labels, one of which reads "RELAX," and another that appears to refer to vaccinations. The setting suggests a formal or professional environment, potentially involving healthcare or an appointment. Curtains hang in the background, indicating an indoor setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows an elderly man sitting in a chair, wearing glasses and a suit. He appears to be working on some papers or documents in front of him. The image is in black and white, giving it a vintage or historical feel. The man's expression is serious as he focuses on the task at hand. The background suggests this is likely an office or study setting, with shelves and other furnishings visible.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a vintage black and white photograph showing what looks like a medical or clinical setting. The image is somewhat hazy or smoky in quality, with a person wearing what appears to be medical attire or a white coat. The composition is shot at an angle, and there seems to be some medical equipment or furniture visible in the background. The grainy, atmospheric quality of the photograph gives it a historical documentary feel, likely from several decades ago.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a man sitting at a desk, with a woman facing him. The man is wearing a dark jacket, white pants, and a bow tie, and has a piece of paper in his hand. He is seated in a chair with a dark cushion, and there is a sign on the wall behind him that reads "RELAX." The woman has short hair and is wearing a light-colored top. She is sitting with her back to the camera, facing the man.

The background of the image is dark, but it appears to be a room with a curtain or drapes on the right side. The overall atmosphere of the image suggests a formal or professional setting, possibly a doctor's office or a business meeting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of two individuals, one seated and the other standing. The seated person wears a dark jacket with a bow tie, while the standing individual has short hair and a light-colored shirt. The background features a curtain, a sign that reads "RELAX," and another sign with illegible text. The overall atmosphere suggests a medical or professional setting, possibly a doctor's office or a consultation room.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of two individuals, a man and a woman, engaged in what appears to be a medical examination or consultation. The man, wearing glasses and a bow tie, is seated in a chair and is looking towards the woman, who is standing in front of him. The woman is dressed in a white shirt and appears to be holding a medical instrument, possibly a stethoscope, in her hand. Behind them, there is a sign that reads "IMMUNIZATION AGAINST POLIO," suggesting the context of a medical procedure related to polio vaccination.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white photograph of two people. The person on the left is wearing a white shirt and has curly hair. The person on the right is wearing glasses, a bow tie, and a shirt with long sleeves. They are sitting in front of a desk and are probably engaged in a conversation. Behind them is a chair and a window with curtains.

Google Gemini

Created by gemini-2.0-flash on 2025-05-05

Here's a description of the image:

The image appears to be a black and white photograph, possibly taken in a clinical or office setting. In the foreground, a person with short, light hair is partially visible, facing away from the camera.

Slightly further back, an older gentleman is seated at a desk, looking towards the camera. He's wearing glasses, a collared shirt, and what appears to be a bow tie. He has his arms resting on the desk, and there are some objects on it as well, including what could be a telephone receiver.

Behind the man, on a shelf or ledge, there's a box with the word "RELAX" visible. Next to it, there seems to be a sign that reads "IMMUNIZATION AGAINST PO", implying the photo might be related to vaccination efforts.

In the background on the right, there's a chair and a curtain, adding depth to the scene. Overall, the photo has an old-fashioned feel to it, possibly indicative of its age.

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

Overall Impression: The image appears to be a black and white negative photograph depicting a medical or possibly dental setting. There are two people in the scene, and a few background elements are present.

Foreground:

  • The dominant figure is a person facing right, partially obscured.
  • The person is wearing a light colored garment, with their back to the viewer.
  • In the person's left hand they seem to be holding something.

Midground:

  • A man is seated at a table, facing toward the camera, giving the impression that he's at an appointment with the other person.
  • He is wearing glasses, a collared shirt with a bow tie.
  • He is seated, and his arms are resting on the table.
  • On the table is a sign that reads, "IMMUNIZATION AGAINST POLIO."
  • There is a sign that reads, "Oral polio vaccine"

Background:

  • There is a shelf that says "RELAX"

Lighting and Tone: The lighting is diffused, casting shadows that give depth to the image. The use of negative film creates a contrasting effect, where the light areas appear dark and vice versa.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image is a black-and-white photograph depicting an indoor scene. It shows an older man sitting at a table, engaged in conversation with another person, whose back is to the camera. The man is wearing glasses and a suit with a bow tie, suggesting a formal or semi-formal occasion. He appears to be smiling or laughing, indicating a light-hearted or pleasant interaction.

The table has a few items on it, including what looks like a box or container with some text on it, possibly a gift or a package. There is also a hat placed on the table. The setting seems to be a room with a window, as suggested by the light coming through and the visible curtains. The overall atmosphere of the image is warm and social, capturing a moment of connection between the two individuals.

Qwen

No captions written

Text analysis

Google

RELAX IMMZATION ASINST P RLPOLI AC
RELAX
IMMZATION
ASINST
P
RLPOLI
AC