Human Generated Data

Title

Untitled (two young children with their father and an Easter basket)

Date

1958

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7924

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two young children with their father and an Easter basket)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7924

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 98.9
Clinic 95.8
Clothing 86
Apparel 86
Accessories 67.5
Accessory 67.5
Hospital 67.2
Indoors 62
Room 61.4
People 60.2
Operating Theatre 58.7
Doctor 55.5

Clarifai
created on 2023-10-25

people 100
group 99
adult 98.6
man 98.3
woman 96.4
child 95.7
nostalgic 94.9
nostalgia 94.2
administration 93.9
group together 92.3
music 91.8
musician 91
outfit 90.8
three 90.4
wear 89.7
actor 89.5
retro 89.2
two 89
interaction 85.8
facial expression 85.3

Imagga
created on 2022-01-09

brass 33.8
person 30.1
wind instrument 27.2
adult 23.1
fashion 22.6
people 20.6
musical instrument 19.8
sexy 18.5
model 17.9
black 17.4
style 17.1
attractive 16.8
man 16.1
body 16
lifestyle 15.9
portrait 15.5
human 15
pretty 14.7
posing 14.2
male 13.5
hair 12.7
performer 12.1
active 11.9
sport 11.9
studio 11.4
expression 11.1
dark 10.9
face 10.6
planner 10.5
modern 10.5
sensual 10
exercise 10
fitness 9.9
one 9.7
cornet 9.5
world 9.3
gorgeous 9.1
stylish 9
singer 9
lady 8.9
cool 8.9
nurse 8.9
uniform 8.8
musician 8.7
cute 8.6
professional 8.5
elegance 8.4
action 8.3
clothing 8.3
makeup 8.2
happy 8.1
dancer 8.1
women 7.9
negative 7.9
smile 7.8
high 7.8
play 7.8
motion 7.7
device 7.7
outdoor 7.6
health 7.6
athlete 7.6
fun 7.5
film 7.5
technology 7.4
make 7.3
pose 7.2
looking 7.2
blond 7.1
medical 7.1
look 7

Microsoft
created on 2022-01-09

text 99.4
person 97.8
clothing 84.4
man 58.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.7%
Sad 77.8%
Calm 21.3%
Confused 0.4%
Surprised 0.2%
Happy 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses

Clarifai

Clothing
Human face
Footwear
Human hair
Human leg
Human arm
Chair
Furniture
Drawer

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.6%

AWS Rekognition

Sunglasses 67.5%

Clarifai

Clothing 91%

Clarifai

Clothing 81.4%

Clarifai

Clothing 80.8%

Clarifai

Clothing 48.8%

Clarifai

Human face 88.4%

Clarifai

Human face 85.3%

Clarifai

Human face 78.5%

Clarifai

Footwear 56%

Clarifai

Human hair 50.9%

Clarifai

Human hair 36.9%

Clarifai

Human hair 36.6%

Clarifai

Human hair 35.4%

Clarifai

Human leg 48.6%

Clarifai

Human arm 41.4%

Clarifai

Chair 39.6%

Clarifai

Furniture 37.5%

Clarifai

Drawer 34.8%

Categories

Imagga
created on 2022-01-09

interior objects 95.1%
paintings art 2.4%
food drinks 1.2%
streetview architecture 1.1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

photograph of a family sitting on a bench.

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a woman sitting on a chair with two children

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This image shows an inverted black-and-white photograph featuring a person seated on the floor alongside two young children. The individuals are gathered around a basket filled with objects that resemble eggs or round items. The surrounding space includes furniture such as a chair, a desk with drawers, and a carpeted floor. The scene suggests an intimate or playful interaction.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a black-and-white negative showing three people in an indoor setting. One of them is sitting on the floor next to a large chair, wearing a short-sleeve shirt and shorts. They are holding a clear bowl filled with small, rounded objects on their lap. Two young children are kneeling on the floor in front of them, wearing dresses and holding small objects. In the background, there is a piece of furniture with drawers and papers on top, as well as another chair. The scene suggests a candid moment of interaction.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows three children, two girls and one boy, gathered around an adult man who appears to be showing them something. The children seem engaged and interested in what the man is presenting to them, which appears to be some kind of object or item. The scene takes place in what looks like a living room or home setting, with furniture and other objects visible in the background. The image is in black and white, giving it a vintage or historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from an earlier era. In the image, three people are gathered together looking at something interesting - there's an adult figure seated on the floor and two children nearby. They seem to be examining or playing with some kind of glass or transparent object that's catching the light. The setting appears to be indoors, with what looks like furniture visible in the background. The lighting in the photo creates interesting contrasts and shadows, typical of vintage photography. Everyone in the scene appears to be completely engaged in whatever they're observing together, creating an intimate, educational moment.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man and two young girls sitting on the floor, surrounded by a few pieces of furniture. The man is seated on the left side of the image, wearing a dark-colored shirt and shorts. He has short white hair and is holding a basket of fruit in his lap. The two girls are standing on either side of him, both wearing dark-colored dresses. They have blonde hair and appear to be looking at something in the basket.

In the background, there is a couch or chair on the left side of the image, and a table with books and a dog standing next to it. The floor is covered with a dark-colored carpet, and the walls are white. The overall atmosphere of the image suggests a warm and cozy domestic setting, possibly a living room or family room.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image depicts a black and white photograph of a man and two young girls sitting on the floor, engaged in an activity. The man, positioned on the left side of the image, is dressed in shorts and a dark shirt, with his legs extended in front of him. He appears to be holding a basket containing small objects, which he is showing to the girls.

The two girls are seated on the right side of the image, both wearing dark dresses. One girl has her hair styled in pigtails, while the other has her hair tied up in a bun. They are both intently focused on the objects in the basket.

In the background, there is a chair and a table with books on it. The overall atmosphere of the image suggests that the man is sharing something with the girls, possibly teaching them about the objects in the basket.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The black-and-white photo depicts a family scene. An adult man is sitting on the floor, holding a basket of peaches, and looking at two young girls. The two girls are sitting on the floor, and one of them is looking at the peaches in the basket, while the other one is looking at something else. Behind them, there is a chair with a cushion, a desk, and a cabinet with drawers.

Created by amazon.nova-pro-v1:0 on 2025-06-07

In a black-and-white photo, a man and two kids are sitting on the floor. The man is sitting on his left leg and holding a basket with his hands. The two kids are sitting next to him. The kid on the right is holding something in her mouth, and the other kid is looking at something. Behind them is a chair, a cabinet, and a carpeted floor.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

This is a black and white photo that features a man and two young children indoors. The man is sitting on the floor, appearing to be holding a basket filled with something. Two little girls are next to him.

The man seems to be looking down at the basket. He has short hair. The two girls are dressed in dresses. One of the girls seems to be eating something. The expressions on the children's faces are somewhat obscured, but they seem curious or focused on what's in the basket.

In the background, there's a piece of furniture with items on top of it, possibly a dresser or a side table. There's also a chair partially visible in the background. The image looks like a casual snapshot, capturing a moment of interaction between the man and the children, possibly during a family activity.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

This black-and-white photograph is a negative image, meaning the tones are reversed. The scene appears to be indoors, possibly a living room.

  • Subject: A man is sitting on the floor, facing two young girls. He is holding a basket, possibly containing eggs. The girls appear to be looking at the basket with interest.
  • Setting: The setting includes a couch to the left, a side table with some objects on it, and what appears to be a chair in the background. The floor is covered in a patterned rug.
  • Atmosphere: The image suggests a moment of family interaction and a shared activity, possibly an Easter-related scene given the presence of the basket and what may be eggs.
  • Style: The photograph has a classic, somewhat grainy texture, typical of older photographic prints.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring three individuals, likely taken in a domestic setting. The photograph appears to be quite old, given its style and the quality of the print.

In the image, there is an older woman sitting on a couch or chair, wearing a dress and possibly a housecoat or robe. She is holding an object in her hands, which looks like a necklace or a string of beads. Two young girls, presumably children, are standing close to her, looking intently at the object she is holding. One of the girls is wearing a dark dress, and the other is in a lighter-colored dress. Both girls appear to be engaged and curious about what the older woman is showing them.

The background includes a piece of furniture, possibly a table or a desk, and a chair, suggesting the scene is set in a living room or a similar space. The overall atmosphere of the image is one of familial intimacy and shared interest in the object being examined.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

The image is a black and white photograph that captures a tender moment between an adult figure and two young girls. The adult, dressed in a dark outfit, is seated on the floor, leaning slightly forward. The two girls, both wearing dresses, are standing close to the adult, who appears to be showing them something in a small, basket-like container they are all focusing on. The setting seems to be a living room, with a vanity table and chair in the background, and a dark-colored rug covering the floor. The lighting is soft and creates a gentle, intimate atmosphere. The photograph has a classic, vintage feel, with a slight vignette effect that draws attention to the subjects in the center.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white photograph appears to have been taken indoors. It shows a man sitting on the floor with two young children. The man, who has short, light-colored hair, is wearing a light-colored shirt and dark pants. He is holding a transparent basket filled with items that resemble chocolate eggs. The two children, both with light-colored hair, are dressed in dark dresses. One child is reaching into the basket, while the other is looking at the man. The background includes a piece of furniture, possibly a dresser, with some items on top, and a chair with a cushion. The overall scene suggests a casual, family-oriented moment.

Text analysis

Google

MJ17--YT3RA 290S
MJ17--YT3RA
290S