Human Generated Data

Title

Untitled (several vignettes of family and children)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16522

Human Generated Data

Title

Untitled (several vignettes of family and children)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16522

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.1
Human 99.1
Person 98.9
Person 98.8
Person 97.6
Person 97.2
Person 96.1
Person 96
Person 95.4
Person 95.3
X-Ray 95
Medical Imaging X-Ray Film 95
Ct Scan 95
Person 91.6
Person 89.3
Painting 77.2
Art 77.2

Clarifai
created on 2023-10-28

people 99.4
group 95.5
medicine 95.2
hospital 94
medical 91.5
adult 91.4
man 90.4
woman 90
radiography 89.2
scanning 89
healthcare 88.9
injury 88.7
child 85.8
radiology 85.7
illustration 84.9
scrutiny 84.7
art 84.7
frame 83
patient 83
baby 82

Imagga
created on 2022-02-11

tray 43.3
receptacle 35
container 28.2
graffito 19
decoration 18.7
face 17.7
money 17
art 16.4
currency 16.1
finance 15.2
mask 15.1
dollar 14.8
cash 14.6
covering 13.4
clock 12.9
dollars 12.5
amulet 12.5
portrait 11.6
hundred 11.6
business 11.5
bill 11.4
vintage 11.3
design 11.1
paper 11
black 10.8
one 10.4
disguise 10.4
old 10.4
close 10.3
charm 9.9
retro 9.8
financial 9.8
happy 9.4
grunge 9.4
banking 9.2
person 9
human 9
fun 9
wealth 9
bank 8.9
symbol 8.7
exchange 8.6
people 8.4
color 8.3
man 8.1
holiday 7.9
bills 7.8
expression 7.7
painted 7.6
head 7.5
child 7.5
earth 7.3
time 7.3
global 7.3
make 7.2
painting 7.2
body 7.2
hair 7.1
male 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 91.7
black and white 84.9
person 83.3
cartoon 81.5
old 76.6
clothing 74
drawing 72.3
posing 65
gallery 53.7
painting 53
set 29.1
several 10.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 69.9%
Sad 88%
Calm 9.9%
Confused 1%
Fear 0.3%
Happy 0.3%
Angry 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 38-46
Gender Female, 70.6%
Calm 77.6%
Sad 12.8%
Confused 5.9%
Surprised 1%
Happy 0.9%
Disgusted 0.8%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 45-53
Gender Male, 98.2%
Happy 90.3%
Surprised 6.2%
Calm 1.7%
Fear 0.7%
Confused 0.3%
Angry 0.3%
Sad 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-36
Gender Male, 94.6%
Calm 60.6%
Confused 17.3%
Sad 11.4%
Disgusted 4.5%
Happy 2.1%
Angry 1.8%
Surprised 1.4%
Fear 0.9%

AWS Rekognition

Age 36-44
Gender Male, 99.8%
Calm 65%
Surprised 21.9%
Sad 3.8%
Fear 3.2%
Happy 2%
Angry 1.9%
Confused 1.3%
Disgusted 0.8%

AWS Rekognition

Age 22-30
Gender Female, 79.7%
Sad 43.3%
Surprised 16.3%
Fear 14.1%
Confused 10.5%
Calm 8.6%
Angry 3.4%
Happy 2.2%
Disgusted 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Painting
Person 99.1%
Person 98.9%
Person 98.8%
Person 97.6%
Person 97.2%
Person 96.1%
Person 96%
Person 95.4%
Person 95.3%
Person 91.6%
Person 89.3%
Painting 77.2%

Categories

Imagga

paintings art 100%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people in old time photos of a family -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This is a composite image presented as a black-and-white negative. It is divided into six vignette-style frames featuring scenes of interaction between an adult male and a young child, as well as moments of familial or group interaction. The central frame depicts a family gathering in an interior space, while the surrounding frames highlight tender moments of the adult engaging with the child in various contexts, such as sitting, standing, and playing. The intricate details of furniture, clothing, and setting suggest a formal or posed depiction of family life.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a negative of a photographic collage consisting of five oval-shaped photographs. Each photograph features a man interacting with a child, who is dressed in a dark outfit. The scenes vary from the man holding the child seated on a chair, to the child standing with assistance, and playful interactions. The photographs appear to capture intimate and joyful moments between the man and the child in an indoor setting. The composition suggests a familial or caretaker relationship, and the use of a negative image gives an artistic and vintage feel to the collection.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a collage of several black and white photographic portraits. The portraits depict various individuals, some of whom appear to be elderly or infirm, in different settings and poses. The overall impression is one of a family or group of people, possibly from a different era. The images have a vintage, almost ghostly quality to them, suggesting they may be from an earlier time period. Without being able to identify any specific individuals, the collage seems to capture a sense of history and the passage of time.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a collection of vintage black and white photographs arranged together, possibly from a family album or collection. The images have a distinctive vignette effect where the edges fade to black, which was common in early photography. The photos appear to show family scenes, with what looks like adults and children interacting in indoor settings. The images have that characteristic early-to-mid 20th century quality with the soft focus and lighting typical of that era's photography. The overall composition shows four separate photographs arranged in a grid-like pattern on what seems to be a dark background or photo album page.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image presents a collection of six black-and-white photographs, each featuring an elderly couple with a baby. The photographs are arranged in two rows of three, with rounded corners and a dark background.

Photograph 1:
The top-left photograph shows the elderly man holding the baby, while the elderly woman sits beside them. The baby is dressed in a dark dress with white trim.

Photograph 2:
The top-right photograph depicts the baby standing on a table or bench, wearing the same dark dress with white trim as in the previous photograph.

Photograph 3:
The middle photograph features the elderly couple standing together, with the baby sitting on the floor between them. The baby is dressed in a dark dress with white trim.

Photograph 4:
The bottom-left photograph shows the elderly man holding the baby, while the elderly woman sits beside them. The baby is dressed in a dark dress with white trim.

Photograph 5:
The bottom-right photograph depicts the elderly couple standing together, with the baby standing between them. The baby is dressed in a dark dress with white trim.

Photograph 6:
The middle photograph features the elderly couple standing together, with the baby sitting on the floor between them. The baby is dressed in a dark dress with white trim.

The photographs appear to be from the early 20th century, given the clothing and hairstyles of the individuals depicted. The overall atmosphere of the photographs suggests a sense of warmth and intimacy, capturing a special moment in time for the elderly couple and their baby.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of a family, featuring five oval-shaped cutouts within a larger rectangular frame. The cutouts are arranged in two rows, with three on top and two on the bottom.

In the top-left corner, an older man is shown holding a baby, while in the top-right corner, a baby is depicted wearing a dark dress. The middle cutout features a group of people, including an older man, woman, and child, standing in front of a fireplace. The bottom-left cutout shows an older man sitting with a baby, and the bottom-right cutout depicts an older man and woman with a baby.

The background of the image is dark, with a white border around the edges. The overall atmosphere of the image suggests a formal family portrait, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph with a collage of five different pictures. The first picture in the top left corner shows an old man with white hair, wearing a white shirt, and holding a young girl in his arms. The second picture in the top right corner shows a young girl wearing a dress and standing in front of a blurry background. The third picture in the bottom left corner shows a man and a woman sitting on a chair with a baby on their lap. The fourth picture in the bottom right corner shows a man holding a baby in his arms. The fifth picture in the middle shows a man and a woman standing in front of a fireplace with a picture frame on the wall behind them.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A photo collage of five images of people, possibly a family, in black and white. The first image shows a man holding a baby. The second image shows a little girl. The third image shows a family of four. The fourth image shows a boy sitting on a couch. The last image shows a man holding a little girl. The images have a blurry effect and are displayed on a black background.

Google Gemini

Created by gemini-2.0-flash on 2025-05-26

Here's a description of the image:

This is an image of a photographic negative, displaying multiple portraits arranged in a collage-like fashion. The negative is black and white, which gives the images within it a ghostly, inverted appearance.

There are six distinct vignettes within the negative:

  1. Top Left: A man in a light-colored suit is seated, possibly holding or interacting with a young child or baby.

  2. Top Right: A toddler is seen in a dress, either walking or standing.

  3. Center: A group portrait seems to show a family in a living room. An older couple is present, along with two young boys. A painting on the wall and decorative items such as a candle and chair are visible.

  4. Bottom Left: A child is visible in a seated position. It appears there is a boy looking at the infant.

  5. Bottom Right: Two adult men are with a child. One of the men is holding the child who appears to be walking.

The portraits seem to capture different moments in the lives of the individuals depicted. The composition of the collage suggests that this negative was used for printing several different images together. The overall impression is of a historical or vintage photo collage.

Created by gemini-2.0-flash-lite on 2025-05-26

This appears to be a contact sheet or proof sheet of several family photographs. It's a negative, so the image appears reversed, with light areas showing as dark and vice-versa.

The sheet is arranged with several oval-shaped windows containing individual photographs. The subjects of the photos appear to be a family, with portraits of adults and children. Some of the scenes depict the children interacting with adults, and some show the children on their own. The overall style suggests an early 20th-century photographic aesthetic. The composition and layout are characteristic of how photographers would present a range of poses or shots to clients to choose from.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a collage of five black-and-white photographs, each capturing different moments involving a child and an older person, likely a grandfather. The photographs are arranged in a unique, irregular shape, giving the collage a distinctive look. Here is a detailed summary of each photograph:

  1. Top Left: An older man, possibly the grandfather, is sitting on a chair with the child standing beside him. The man is holding the child's hand, and they appear to be engaged in a conversation or activity.

  2. Top Right: The child is standing alone, holding a small object, possibly a toy or a book. The child is dressed in a dress and appears to be looking at something off-camera.

  3. Middle: This photograph captures a family moment with multiple individuals. The child is sitting on a couch or chair, while the older man stands nearby. Two other adults, possibly the child's parents, are also present, creating a warm family scene.

  4. Bottom Left: The older man is kneeling down to interact with the child, who is standing. They appear to be engaged in a playful or affectionate moment.

  5. Bottom Right: The older man is sitting on a chair with the child standing beside him. They are both smiling and appear to be enjoying each other's company.

The overall theme of the collage is familial love and interaction, highlighting the bond between the child and the older man, as well as the broader family dynamics.

Text analysis

Amazon

3
НАСОА
Y137AB2