Human Generated Data

Title

Self-portrait with Children, July 14, 1984 (Before vacation with their father)

Date

1984

People

Artist: Judith Black, American born 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P1995.49

Human Generated Data

Title

Self-portrait with Children, July 14, 1984 (Before vacation with their father)

People

Artist: Judith Black, American born 1945

Date

1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P1995.49

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Architecture 99.6
Building 99.6
Hospital 99.6
Back 99.5
Body Part 99.5
Clothing 99.2
Shorts 99.2
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.1
Male 99.1
Boy 99.1
Teen 99.1
Person 99.1
Adult 99.1
Female 99.1
Woman 99.1
Person 98.8
Person 98.2
Baby 98.2
Finger 95.1
Hand 95.1
Face 91.5
Head 91.5
Patient 77.8
Clinic 58
Photography 57.4
Portrait 57.4
Dressing Room 57.2
Indoors 57.2
Room 57.2
Neck 56.4
Hairdresser 56.3
Undershirt 55.8

Clarifai
created on 2023-11-01

people 99.9
group 99.3
monochrome 98.4
child 98
woman 97.7
adult 96
group together 95.3
man 94.3
several 93.3
wear 91.7
street 90.3
three 89.9
four 89.5
recreation 89.4
wedding 88.3
five 88.2
actress 87.1
singer 86.5
boy 86.2
music 86

Imagga
created on 2018-12-27

man 36.3
people 32.9
adult 32.4
male 31.3
business 29.7
person 28.4
businessman 26.5
men 24
professional 22.6
group 22.6
happy 21.3
office 21
corporate 20.6
smiling 19.5
businesspeople 19
indoors 18.4
clothing 18.2
women 17.4
lifestyle 16.6
standing 16.5
happiness 16.4
handsome 16
nurse 15.6
portrait 15.5
businesswoman 15.4
team 15.2
job 15
smile 15
mid adult 14.5
couple 13.9
teamwork 13.9
inside 13.8
20s 13.7
indoor 13.7
black 13.3
executive 13.1
cheerful 13
attractive 12.6
meeting 12.2
worker 12.2
occupation 11.9
30s 11.5
together 11.4
career 11.4
modern 11.2
looking 11.2
home 11.2
25 30 years 10.8
fashion 10.6
employee 10.2
two 10.2
holding 9.9
family 9.8
kin 9.8
interior 9.7
life 9.7
formal 9.5
casual 9.3
suit 9.3
room 9.2
staff 9.2
building 9.1
pretty 9.1
care 9
hospital 9
color 8.9
success 8.8
medical 8.8
corporation 8.7
work 8.6
confidence 8.6
doctor 8.5
successful 8.2
friendly 8.2
face 7.8
discussion 7.8
middle aged 7.8
colleagues 7.8
partnership 7.7
expression 7.7
world 7.6
tie 7.6
communication 7.6
one 7.5
window 7.3
new 7.3
mother 7.3
computer 7.2
kitchen 7.2
working 7.1
garment 7.1

Google
created on 2018-12-27

Microsoft
created on 2018-12-27

person 99.9
standing 92.6
posing 89.2
people 81.2
group 77.4
crowd 0.9
black and white 0.2
volleyball 0.1
tournament 0.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 13-21
Gender Male, 96.7%
Calm 97.7%
Surprised 6.3%
Fear 5.9%
Sad 2.9%
Angry 0.1%
Disgusted 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Female, 99.8%
Calm 87.7%
Fear 8.9%
Surprised 6.9%
Sad 3%
Confused 1%
Happy 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Male, 98.1%
Sad 100%
Angry 7.1%
Surprised 6.5%
Fear 6.2%
Calm 2.8%
Disgusted 0.8%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 86.9%
Surprised 7%
Fear 6.3%
Sad 5.4%
Confused 2.7%
Disgusted 0.4%
Angry 0.4%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Calm 63.7%
Sad 14.3%
Surprised 12%
Confused 7.6%
Fear 6.7%
Angry 2.7%
Disgusted 0.7%
Happy 0.6%

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Boy
Teen
Female
Woman
Baby
Person 99.2%
Person 99.1%
Person 99.1%
Person 98.8%
Person 98.2%
Adult 99.2%
Adult 99.1%
Male 99.2%
Male 99.1%
Man 99.2%
Boy 99.1%
Teen 99.1%
Female 99.1%
Woman 99.1%
Baby 98.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-30

a photograph of a group of people standing around a man in a wheelchair -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image features a group of individuals in a casual indoor setting. One person is seated on a chair, while others stand around them. The scene includes natural elements, such as visible greenery in the foreground, emphasizing plants and adding a touch of nature to the room. Light filters in from large windows, creating a bright ambiance. Draped fabric is seen on the right side, suggesting a slightly improvised or intimate space. The clothing varies from casual shirts to a robe, contributing to a relaxed atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a group of five individuals gathered in a sunlit indoor setting. The person on the left is shirtless and stands near some leafy plants. The second person from the left is wearing casual pants and a dark shirt over a light top, casually resting their hand on the back of the third person, who stands with their hands in their pockets wearing a collared, short-sleeved shirt. Seated in the center is a young individual on a chair, wearing shorts, with their hands resting on their knees. On the right stands a person in a robe, with one hand gently resting on the seated individual’s shoulder. The backdrop includes windows allowing light to pour in and a curtain or drape partially covering the background on the right side.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of four individuals, possibly a family, standing in a room with a window and a plant. The person on the left is shirtless and wearing pants, while the person next to them is wearing a dark shirt and light pants. The person on the right is wearing a long robe, and the person in front of them is sitting in a chair, wearing only underwear.

The background of the image shows a room with a window and a plant, suggesting a domestic setting. The overall atmosphere of the image is one of informality and casualness, with the individuals posing in a relaxed manner. The use of black and white photography adds a sense of timelessness and simplicity to the image, emphasizing the natural beauty of the subjects.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of five individuals, including three children and two adults. The scene appears to be set in a room with a window, where the group is gathered together.

Key Elements:

  • Individuals: There are five people in the image, consisting of three children and two adults.
  • Window: A window is visible behind the group, suggesting that the scene is set in a room.
  • Gathering: The individuals are gathered together, possibly for a family portrait or a casual gathering.

Overall Impression:

The image conveys a sense of intimacy and closeness among the individuals, as they are gathered together in a small space. The presence of a window in the background adds a sense of natural light and openness to the scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph featuring a group of five individuals standing in a room, possibly a studio. The individuals are arranged in a semi-circle, with a young boy sitting on a chair in the center. The boy is looking directly at the camera, while the others are looking in different directions. The boy's posture suggests that he is the subject of the photo, while the others are posing for the picture.

The individuals are all wearing casual clothing, with the boy in the center wearing a robe. The boy's robe is loose and flowing, and it covers his body completely. The others are wearing T-shirts and shorts, with one individual wearing a necklace. The room has a simple background, with a white curtain hanging in the background. The image has a slightly blurry effect, which adds to the overall mood of the photograph.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photo shows a group of people standing and sitting together. There are four boys and one girl in the photo. Three of the boys are standing, and one is sitting on a chair. The boy on the left is standing with his left hand on his hip. The boy in the middle is standing with his hand on the shoulder of the boy sitting on the chair. The girl is standing next to the boy sitting on the chair.

Google Gemini

Created by gemini-2.0-flash on 2025-05-23

This is a black and white medium shot of five people, presumably a family, in what appears to be a sunroom or enclosed porch. The setting suggests a warm climate or season.

On the left side, a young boy stands shirtless amidst a large potted plant with broad leaves, looking towards the camera. To his right is another young person, possibly a teenager, wearing an unbuttoned dark shirt over a lighter one, along with knee-length shorts and a necklace. They have a confident or slightly defiant expression.

Next to them, another young person in a striped shirt stands behind a younger child who is seated on a simple metal chair. The seated child is also shirtless and looks directly at the camera with a somewhat serious expression.

On the right, a woman stands tall, wearing a loose robe tied at the waist. She places a hand on the seated child's shoulder in a gesture that could be protective or simply familial. Her expression is solemn.

The background consists of a window with visible panes and a partially draped white sheet, adding to the somewhat informal or staged feel of the photograph. The lighting is soft and diffused, contributing to the overall mood of the image.

Created by gemini-2.0-flash-lite on 2025-05-23

The image is a black and white photograph featuring five people: a woman and four children. They are arranged in a semi-formal pose, presumably indoors near a window or a source of natural light.

Here's a breakdown:

  • The Woman: Stands on the right side of the frame. She wears a long, flowing garment that appears to be a robe. The garment is tied at the waist with a belt. Her expression is serious. She rests her hand on the shoulder of the youngest child.
  • Children: There are four children, who appear to be of varying ages. One boy is seated, the other three are standing. They all have rather sober expressions. One boy is shirtless, another has a shirt open. The children are barefoot, and one boy is holding greenery.
  • Environment: The photo appears to be taken in a sunlit room or area. The background suggests a window or a light source. The shadows and light contrast are quite dramatic, giving the image a classical feel.

Overall, the image has a somewhat mysterious or artistic quality, with a formal composition and a sense of depth. The subjects' expressions and their arrangement create an atmosphere of seriousness.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph featuring five young individuals, likely children or adolescents, posing together in what appears to be a casual, informal setting. Here is a detailed description of each individual from left to right:

  1. The first person on the left is shirtless, with light-colored hair, and is standing with a relaxed posture. They are positioned near a large plant, which adds a natural element to the scene.
  2. The second person is wearing a dark, short-sleeved shirt and light-colored shorts. They have a necklace and are standing with one hand on their hip and the other resting on their chest.
  3. The third person is standing in the center, wearing a light-colored, short-sleeved shirt and shorts. They have short hair and are looking directly at the camera with a neutral expression.
  4. The fourth person is seated on a chair, shirtless, and wearing light-colored shorts. They have a relaxed posture and are looking slightly downward.
  5. The fifth person on the right is wearing a long, light-colored robe tied at the waist. They have short, dark hair and are standing with a serious expression, looking directly at the camera.

The background includes a window with curtains, suggesting an indoor setting, possibly a home. The overall mood of the photograph is casual and candid, capturing a moment of everyday life.