Human Generated Data

Title

Self-Portrait with Erik & Dylan, July 1985

Date

1985

People

Artist: Judith Black, American born 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.328

Human Generated Data

Title

Self-Portrait with Erik & Dylan, July 1985

People

Artist: Judith Black, American born 1945

Date

1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.328

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.9
Human 99.9
Person 99.6
Clothing 99.3
Apparel 99.3
Sleeve 97.5
Person 97.4
People 88.8
Long Sleeve 81.4
Family 66.3
Face 63.4
Girl 63.3
Female 63.3
T-Shirt 62.8
Hair 61.6
Teen 57.6

Clarifai
created on 2023-10-25

child 99.9
people 99.9
family 99.2
group 99.1
son 99.1
portrait 99
three 98.3
sibling 98.1
offspring 95.8
four 95.8
baby 95.3
monochrome 94.9
room 94.1
two 92.6
boy 90.7
man 89.5
woman 89
girl 88.4
documentary 87.7
adult 86

Imagga
created on 2022-01-09

mother 41.6
family 36.5
happy 35.7
male 34.8
child 33.9
man 32.9
father 30.5
parent 30.4
kin 29.5
couple 28.8
people 28.5
smiling 28.2
brother 28
together 26.3
love 26
daughter 25.2
portrait 24.6
dad 23.9
home 23.1
smile 22.8
happiness 21.9
boy 20.9
sibling 19.7
adult 15.6
son 15.6
world 15.4
group 15.3
two 15.3
women 15
men 14.6
children 14.6
person 14.3
indoors 13.2
standing 13
sitting 12.9
fun 12.7
husband 12.6
attractive 12.6
kid 12.4
teenager 11.9
wife 11.4
cheerful 11.4
room 11.2
camera 11.1
lifestyle 10.8
childhood 10.7
30s 10.6
pretty 10.5
youth 10.2
teen 10.1
parents 9.8
hug 9.7
affectionate 9.7
senior 9.4
relationship 9.4
cute 9.3
dress 9
interior 8.8
looking 8.8
sofa 8.6
enjoying 8.5
face 8.5
black 8.5
kids 8.5
casual 8.5
friends 8.5
old 8.4
house 8.4
grandma 8.2
blond 8.1
thirties 7.8
two people 7.8
generation 7.7
expression 7.7
married 7.7
togetherness 7.6
doctor 7.5
human 7.5
care 7.4
life 7.3
color 7.2
domestic 7.1
little 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

human face 98.7
wall 98.5
clothing 97.5
person 96.9
text 96.9
toddler 96.1
smile 94.2
boy 93.6
baby 92.5
standing 79.9
child 78.8
black and white 75.7
girl 67.6
posing 47.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Sad 71%
Disgusted 10.5%
Calm 10.3%
Angry 6.4%
Confused 0.9%
Fear 0.5%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 33-41
Gender Female, 100%
Calm 99.2%
Surprised 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%
Happy 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 6-14
Gender Male, 100%
Sad 42.9%
Calm 29%
Angry 21.8%
Confused 3%
Disgusted 1.3%
Fear 0.8%
Happy 0.6%
Surprised 0.6%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 16
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.9%
Person 99.6%
Person 97.4%

Categories

Imagga

people portraits 99.9%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a woman and two children standing in front of a painting -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This black and white image depicts three individuals standing in front of a house, with wooden siding visible in the background. A photograph or image of a bear is prominently displayed behind them on the wall. Additionally, there is a floral-patterned cushion or object partially visible on the left. The clothing styles include a printed t-shirt, a simple crewneck sweater, and a light dress with lace detailing. The photograph has a vintage aesthetic, framed by a white border.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a black and white photograph featuring three people standing in front of a structure with wooden siding. In the background, there is a framed image hanging on the wall, which appears to depict some natural scenery or possibly an animal. The person on the left is wearing a dark t-shirt with a logo that includes an image and text, part of which reads "We’re it in." The person in the middle is wearing a lighter sweatshirt with a small emblem on the chest. The person on the right is wearing a dress with a decorative square at the neckline. They are positioned in a casual pose, with the person on the right resting an arm on the door frame. There is a large cushion with a floral design visible in the foreground on the left side.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph depicting a family. It shows a woman standing in the center, with two young boys standing next to her. The woman has a serious expression on her face, while the boys seem more relaxed. Behind them, there is a framed photograph on the wall, though the contents of that image are not clearly visible. The overall atmosphere of the photograph suggests a sense of intimacy and domesticity within the family setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph that appears to be from an earlier era, showing a family group standing together. There are two young boys and an adult in what looks like casual, everyday clothing. One boy wears a dark t-shirt with a logo, while the other wears a light-colored sweatshirt. The adult is wearing what appears to be a light-colored dress or long top. They are posed in what seems to be a doorway or entrance, with some wooden paneling visible in the background. The composition has a documentary-style quality to it, with natural, unposed expressions and lighting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a black and white photograph of a woman and two boys. The woman, positioned on the right side of the image, wears a long dress with a white bib-like top featuring a floral pattern. She has her left hand resting on her hip and her right arm raised, with her hand placed on a door frame or wall behind her.

To the left of the woman are the two boys. The boy on the left wears a black t-shirt with a logo and text that reads "More than," although the rest of the text is obscured. His arms are crossed, and he appears to be looking directly at the camera. The boy in the middle wears a light-colored shirt and stands with his hands by his sides, also looking directly at the camera.

In the background, there is a wall adorned with a picture or poster, which is partially visible. The overall atmosphere of the image suggests that it may have been taken in a home or domestic setting, possibly during the 1970s or 1980s based on the clothing and hairstyles of the individuals depicted.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a woman and two boys standing in front of a wall with a poster on it.

The woman, positioned on the right, has dark hair and wears a long-sleeved dress with a square neckline and a patch on the chest. Her left arm is bent at the elbow, with her hand resting on the door frame behind her. The boy on the left has short hair and wears a black t-shirt with a logo and text that reads "Make it Happen." He stands with his arms crossed, facing the camera. The boy in the middle has short hair and wears a light-colored t-shirt with a logo on the chest. He stands with his hands by his sides, facing the camera.

The background features a wall with a poster on it, and a chair with a floral pattern is partially visible on the left side of the image. The overall atmosphere suggests a casual, everyday moment captured in a photograph.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The black and white photograph features three people, two boys and a woman, standing in front of a door. The woman is leaning on the door frame, and the two boys are standing next to each other. The woman is wearing a dress, and the two boys are wearing t-shirts. The boy on the left has his arms crossed, and the boy on the right has his hands in his pockets.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph featuring a family of three. The woman is standing on the porch of a house, leaning against the doorframe. She has her arms crossed and is wearing a long-sleeved shirt. The two boys are standing in front of her, both with serious expressions. The boy on the left has his arms crossed and is wearing a black t-shirt with a logo on it. The boy on the right is wearing a gray t-shirt and has his hands in his pockets. The image has a slightly blurry quality, which adds to the mood of the photograph.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The black and white photograph shows a woman and two boys standing together near a doorway. The woman, who is on the right, has shoulder-length hair and is wearing a loose-fitting dress with a square neckline trimmed with lace. She is leaning against the door frame with one hand and has her other hand on her hip. To her left is a boy with short hair wearing a grey sweater. He looks directly at the camera. To the left of the boy is another boy, who is wearing a t-shirt with a graphic print and the words "Make it ok". He has his arms crossed and is also looking directly at the camera. Behind the boys is a wall, on which hangs a framed picture of something that looks like a bush or tree. The photo is set in a white border.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image is a black and white portrait of a family standing in a doorway or entryway. The composition is straightforward and intimate.

People:

  • There is a woman in the frame on the right side of the image wearing a light-colored, long-sleeved dress with a decorative square patch on the front, her arm resting on the doorframe. Her expression is direct and serious.
  • There are two young boys. The older of the two stands with arms crossed, wearing a t-shirt that says "Make It Do" and a picture of a thumbs up.
  • The second boy has a more serious look and has a similar hairstyle as his brother.

Setting:

  • They appear to be standing in a doorway.
  • Behind the older boy is a framed picture hanging on the wall of what appears to be a natural scene of grass and trees.
  • The backdrop shows a dark wood exterior wall, suggesting a house or building.

Style and Technique:

  • The photograph has a clear, sharp focus.
  • The lighting creates shadows and a good sense of depth.
  • The overall style suggests documentary or candid photography.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a black-and-white photograph featuring three individuals standing in front of a house. The setting appears to be outdoors, with the house's exterior visible in the background.

  1. Left Person:

    • This individual is a young boy with short hair.
    • He is wearing a dark-colored T-shirt with a graphic design that includes text and an image of a person.
    • He has his arms crossed and is standing with a neutral expression.
  2. Middle Person:

    • This individual is a younger boy with light-colored hair.
    • He is wearing a light-colored long-sleeved shirt with a small emblem on the chest.
    • He has a neutral expression and is standing with his hands by his sides.
  3. Right Person:

    • This individual is a woman with medium-length hair.
    • She is wearing a light-colored dress with a simple design.
    • She has a neutral expression and is leaning slightly against the house, with one hand resting on the door frame.

The background includes a portion of the house's exterior wall, a door, and a framed picture or poster hanging on the wall. The overall atmosphere of the photograph is casual and candid, capturing a moment in time.

Text analysis

Amazon

10
Mazeitín
->8A

Google

Moreit ins
Moreit
ins