Human Generated Data

Title

Patsy

Date

1960

People

Artist: George Krause, American born 1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.797

Human Generated Data

Title

Patsy

People

Artist: George Krause, American born 1937

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.797

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Face 99.6
Human 99.6
Female 81
Portrait 80.5
Photography 80.5
Photo 80.5
Outdoors 67.6
Nature 62.2
People 61.9
Skin 60.7
Woman 60.5
Performer 58.7
Head 57.3
Man 56.9
Selfie 55.7

Clarifai
created on 2023-10-26

portrait 99.9
people 99.5
monochrome 98.9
art 98.6
street 98
shadow 97.7
man 97.6
light 97.5
one 97
analogue 96
adult 94.5
self 94.3
black and white 93.7
music 93
model 93
girl 91.5
vintage 90.8
window 89
dark 86.8
city 86.8

Imagga
created on 2022-01-22

person 31.2
black 28.8
portrait 27.2
face 22.7
adult 22.1
people 21.2
man 20.9
attractive 20.3
groom 19.6
business 17.6
pretty 17.5
world 17.4
smiling 16.6
smile 16.4
expression 16.2
hair 15.8
male 15.7
happy 15.7
office 14.3
sexy 13.6
dark 13.4
model 13.2
lifestyle 13
suit 12.9
looking 12.8
women 12.6
professional 12.4
businessman 12.4
lady 12.2
manager 12.1
fashion 12.1
human 12
alone 11.9
look 11.4
brunette 11.3
eyes 11.2
elegant 11.1
cute 10.8
spectator 10.4
old 9.7
thinking 9.5
tie 9.5
work 9.4
lips 9.3
window 9.2
businesswoman 9.1
executive 9.1
shirt 8.5
casual 8.5
mouth 8.5
building 8.4
hand 8.4
holding 8.2
friendly 8.2
one 8.2
computer 8.1
close 8
love 7.9
lighting 7.8
skin 7.6
head 7.6
telephone 7.5
relaxed 7.5
senior 7.5
jacket 7.4
mature 7.4
blond 7.4
confident 7.3
sensual 7.3

Microsoft
created on 2022-01-22

human face 98.1
text 93.5
black and white 88.3
person 85.4
clothing 78.7
portrait 77.1
monochrome 70.8
woman 60.2
dark 34.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 66.3%
Calm 41.9%
Fear 27.1%
Sad 23.6%
Surprised 2.4%
Angry 2%
Disgusted 1.2%
Confused 1.1%
Happy 0.7%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Human face
Clothing
Human nose
Human eye
Picture frame
Human mouth

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 60.1%

AWS Rekognition

Person 55%

Clarifai

Human face 97.3%

Clarifai

Clothing 96.5%

Clarifai

Human nose 43.2%

Clarifai

Human eye 42.4%

Clarifai

Human eye 40.7%

Clarifai

Picture frame 37.1%

Clarifai

Human mouth 35.7%

Categories

Imagga
created on 2022-01-22

paintings art 55.2%
people portraits 22.6%
nature landscape 15.4%
events parties 2.9%
streetview architecture 2.1%

Captions

Microsoft
created by unknown on 2022-01-22

a woman standing in front of a window 71.4%
a woman in a dark room 71.3%
a woman standing in a dark room 71.2%

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

portrait of a young woman.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a woman with a flower in her hair

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image features a person wearing a patterned blouse with the collar open and a scarf or tied fabric around their neck. The lighting creates dramatic shadows, with a distinct silhouette of what appears to be plant leaves and part of a building or structure projected onto the wall. To the right of the image, a window with visible wooden frames is partially illuminated. The overall composition is dark, with a focus on light and shadow interplay.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a black and white photograph with a high contrast between the light and the dark areas. The focus is on a person wearing a patterned V-neck blouse. The person is front-lit, creating a shadow to the right side of the photo. There is a prominent shadow cast on the wall that features a silhouette of an object with jagged edges, possibly foliage or a similar shape. The scene is set indoors, as suggested by the window or door frame visible on the right side. The composition is stark and dramatic, emphasizing the play of light and shadow.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a close-up portrait of a woman in a dimly lit setting. The woman has short, dark hair and appears to be looking directly at the camera with a serious expression. The background is dark, with some shadows and shapes visible, creating a moody, atmospheric feel to the image.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The black and white image depicts a woman with short dark hair looking directly at the camera with an intense, somewhat pensive expression. She appears to be wearing a patterned shirt or dress. The lighting creates dramatic shadows across her face, accentuating her features. The background is dark and shadowy, adding to the moody atmosphere of the portrait.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a dramatic black and white photograph with a gothic or mysterious atmosphere. The composition shows a figure in the foreground wearing what appears to be a patterned dress or top. In the background, there's an interesting shadow element that appears to be a bird, possibly a crow or raven, creating an ominous silhouette against what might be a wall or window. The lighting is very moody and contrasty, with deep shadows and highlights that create a haunting effect. The overall tone of the image feels reminiscent of classic horror cinema or the works of Edgar Allan Poe.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a woman with dark hair, wearing a dark-colored top or dress. The woman's face is partially obscured by shadows, and her hair is styled in a way that creates a sense of mystery. The background of the image is dark and indistinct, but it appears to be a room or interior space. The overall effect of the image is one of drama and intrigue, with the woman's enigmatic expression and the dark, shadowy surroundings creating a sense of tension and suspense.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a woman standing in front of a window. The woman has long dark hair and is wearing a dark-colored blouse with a patterned collar. She is looking directly at the camera with a neutral expression.

In the background, there is a window with a white frame on the right side of the image. A plant or tree branch is visible outside the window, casting a shadow on the wall behind the woman. The overall atmosphere of the image is moody and introspective, with the use of shadows and darkness creating a sense of mystery and intrigue.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image features a black-and-white photograph of a woman. She is standing in a dimly lit room, with her face illuminated by a soft light. Her hair is short and falls around her face. She is wearing a blouse with a small collar and a pattern of dots or small shapes. The woman is looking directly at the camera, with an expression that suggests she is posing for the photo. Behind her, there is a shadow cast by a plant or tree, and the wall behind her is dark.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a woman standing in a dark room. The woman is wearing a patterned shirt with a collar. She has short hair and is looking directly at the camera with a serious expression on her face. There is a shadow of a plant on the wall behind her. The light is coming from the right side of the image, casting shadows on the wall and the woman's face.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression: The image is a stark, black and white photograph, characterized by its dramatic use of shadow and light. It evokes a sense of intimacy and perhaps introspection.

Subject and Composition:

  • Central Figure: A woman is the main focus, her face taking up a significant portion of the left side of the frame. She is looking directly at the viewer with a serious or contemplative expression.
  • Lighting and Shadow: The image is heavily reliant on dramatic lighting. Light falls on the woman's face, creating highlights and shadows that define her features. A dark shadow envelops the background and the right side of the image, which appears to be a window or other architectural feature. The shadow creates interesting patterns, potentially of foliage.
  • Details: The woman is wearing a shirt. The texture of the surface on which the photo was taken is visible.

Mood and Atmosphere: The picture creates a mood of somberness, mystery, or maybe quiet contemplation. The contrast between light and shadow, the woman's expression, and the lack of vibrant color combine to produce this effect.

Created by gemini-2.0-flash on 2025-05-17

The black-and-white medium shot depicts a woman with dark hair and bangs, wearing a patterned blouse, who looks directly at the camera with a somber expression. The lighting is dramatic, with shadows of leaves or branches partially obscuring the right side of her face. To her right, a dark shadow in the shape of a window with vertical bars dominates the background, further enhancing the stark contrast and mood of the photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring a person with shoulder-length hair. The person is looking directly at the camera with a neutral expression. The lighting in the photo is dramatic, with the subject's face illuminated while the background is mostly in shadow. The background appears to include a window with a screen, and there is a shadow of what seems to be a hand or fingers on the screen. The person is wearing a patterned shirt. The overall mood of the image is somewhat somber and mysterious due to the stark contrast and shadowy elements.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-09

The image is a black-and-white photograph featuring a person with dark hair, wearing a patterned blouse and a dark jacket. The person is positioned in a dimly lit environment, with the background appearing dark and shadowy. A shadow, possibly from a plant or a branch, is cast on the wall behind the person, adding to the moody and mysterious atmosphere of the photograph. The overall composition and lighting suggest a contemplative or introspective mood.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-09

The image is a black-and-white portrait of a person standing in front of a door. The individual has shoulder-length hair and is wearing a patterned shirt under a jacket. The lighting is dramatic, with shadows cast on the person's face and the door behind them. The shadows appear to be from a plant, creating a stark contrast against the person's face and the dark background. The overall mood of the photograph is somber and contemplative.