Human Generated Data

Title

Untitled (woman at piano with two boys)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4454

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman at piano with two boys)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4454

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Dress 99.7
Clothing 99.7
Apparel 99.7
Face 98.4
Human 98.4
Chair 98.3
Furniture 98.3
Female 97.9
Person 97
Smile 96.1
Person 93.8
Blonde 93.5
Kid 93.5
Girl 93.5
Woman 93.5
Teen 93.5
Child 93.5
Baby 82.1
Person 81.3
Portrait 79.6
Photography 79.6
Photo 79.6
Indoors 70
Shoe 69.2
Footwear 69.2
Poster 68.7
Advertisement 68.7
Sleeve 66.9
Head 66
Suit 64.1
Coat 64.1
Overcoat 64.1
Boy 62.3
Icing 60.1
Food 60.1
Dessert 60.1
Cake 60.1
Cream 60.1
Creme 60.1

Clarifai
created on 2023-10-26

people 99.7
monochrome 99.5
medicine 98.1
science 98
healthcare 96.5
hospital 96.5
child 96.2
doctor 95.8
adult 95.6
uniform 95
woman 93.4
man 93.3
vertical 92.2
medical 91.7
health 91.1
care 91
illness 89.2
indoors 89.1
scientist 86.7
patient 84.8

Imagga
created on 2022-01-23

negative 58.2
film 47
photographic paper 35.5
blond 34.4
person 31.9
portrait 31.1
adult 30
happy 24.4
fashion 24.1
hair 23.8
photographic equipment 23.7
lady 23.5
face 23.4
people 23.4
attractive 23.1
smile 21.4
cute 20.8
pretty 20.3
sexy 19.3
smiling 18.1
skin 16.1
senior 15.9
happiness 15.7
model 14
mature 13.9
eyes 13.8
looking 13.6
bride 13.5
cheerful 13
fun 12.7
love 12.6
joy 12.5
holding 12.4
man 12.1
clothing 12
human 12
mother 12
wedding 12
old 11.8
health 11.8
child 11.8
elegance 11.8
dress 11.7
elderly 11.5
medical 11.5
holiday 11.5
indoors 11.4
male 11.3
style 11.1
grandma 10.9
women 10.3
day 10.2
lifestyle 10.1
makeup 10.1
care 9.9
retired 9.7
look 9.6
retirement 9.6
body 9.6
couple 9.6
home 9.6
hairstyle 9.5
sitting 9.4
doctor 9.4
camera 9.2
stylish 9
lovely 8.9
tenderness 8.8
older 8.7
elegant 8.6
casual 8.5
black 8.4
hospital 8.2
make 8.2
pensioner 8.1
medicine 7.9
veil 7.8
life 7.8
cap 7.8
seductive 7.6
hand 7.6
baby 7.5
cosmetics 7.5
alone 7.3
sensuality 7.3
gorgeous 7.3
pose 7.2
professional 7.2
snow 7.2
modern 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.4
text 96.2
human face 89.2
clothing 79.4
black and white 71.8
baby 62.2
toddler 60.7
posing 41.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 97.2%
Happy 95.5%
Surprised 2.1%
Calm 1.2%
Fear 0.5%
Disgusted 0.2%
Sad 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 13-21
Gender Female, 50.3%
Calm 59.5%
Happy 29.5%
Sad 4.1%
Fear 2.4%
Disgusted 1.4%
Confused 1.3%
Angry 1%
Surprised 0.7%

AWS Rekognition

Age 13-21
Gender Male, 89.6%
Calm 80.2%
Sad 9.3%
Confused 4.3%
Angry 1.8%
Fear 1.3%
Happy 1.3%
Disgusted 1%
Surprised 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 97%
Person 93.8%
Person 81.3%
Shoe 69.2%

Categories

Imagga

paintings art 99.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a boy and his mother are looking at a statue of a man -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image appears to be a black-and-white negative photograph featuring three individuals. The scene has a vintage feel, with elements such as an ornate outfit, a microphone stand, and a lamp post visible in the background. One individual is seated while holding an object, possibly a box or gift. Another person stands nearby, positioned closer to the camera. The environment suggests a formal or celebratory setting, potentially involving a public event or gathering.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image appears to be a photographic negative, as indicated by the inverted colors and tones. The scene includes two children standing in front of an ornate railing or similar decoration, suggesting they might be on a stage or part of an organized event. The child on the left is seated and holding a box, possibly a gift, while the other child stands nearby, apparently talking or interacting. The setting is further enhanced by the presence of what appears to be a vintage microphone nearby, hinting at a possible performance or speech situation. The background includes what seems to be a lamppost, and there is a visible edge of the negative and some text, such as "SAFETY" visible on the top and different numbers along the side, indicating it is a safety film used for capturing the photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a black and white photograph of a woman and two children. The woman is standing behind a microphone, holding a child on her left hip. The child on her hip is holding a piece of paper or card. The other child is standing to the right of the woman, facing her.

The woman is wearing a dress with a floral pattern and has short, curly hair. The child on her hip is wearing a dark shirt and shorts, and the other child is wearing a dark shirt and light pants.

The background of the image is out of focus, but it appears to be a room with a table and chairs. There are also some objects in the background that are not clearly visible.

Overall, the image suggests that the woman and the children are participating in some kind of activity or performance, possibly a talent show or a school event.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

This image is a black-and-white photograph of a woman and two children. The woman is positioned in the center, wearing a dress and a necklace, and has short hair. She is holding a microphone with her right hand and appears to be reading from a piece of paper held by the child on her left. The child on her left is wearing a dress and has short hair, while the child on her right is wearing a t-shirt and shorts and has short hair. The background of the image is dark, suggesting that it was taken indoors or at night. The overall atmosphere of the image suggests that the woman and children are participating in some kind of performance or event.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph of three people. The image is blurry, but it appears to be a scene from a stage or a performance. The woman in the center is holding a microphone and seems to be speaking or singing. The boy on the left is holding a wrapped gift, and the boy on the right is looking at the woman. There is a blurry background with a street light and some other objects.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image is in black and white. It depicts a woman and two children. The woman is standing and holding a microphone. The boy on the right is looking at something, and the boy on the left is holding a gift. The boy on the left is sitting on a chair. The woman is wearing a necklace and a dress. The boy on the right is wearing a shirt and shorts.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white negative featuring three figures, an older woman and two young boys, standing in front of a vintage-style microphone. The woman is positioned in the center, with one of the boys sitting on a raised surface in front of her, holding a wrapped box. The second boy stands to the right, facing towards the woman.

The woman has a patterned dress and a necklace. The first boy is dressed in a collared shirt and shorts, with socks and shoes. The second boy is wearing a t-shirt and what appears to be shorts or pants.

A tall, ornate lamp can be seen in the background to the left, and there is a window behind them. Handwritten numbers "17251" are visible on both sides and at the bottom of the image.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

This is an interesting, inverted black and white photograph, likely a negative. It appears to depict a woman and two young boys.

  • The woman: She is positioned behind the microphone and appears to be smiling. She is wearing a floral patterned dress and a necklace. Her hair is styled in a curly updo. She seems to be holding a microphone stand.
  • First boy: One boy is being held by the woman. The boy is holding a large, rectangular package, perhaps a gift. He's wearing a short-sleeved shirt, shorts and socks and shoes.
  • Second boy: The second boy is standing to the right, facing the woman and microphone. He appears to be wearing a shirt or undershirt and an overall-type garment.

The scene seems to be an indoor setting. There is a microphone. The setup suggests a radio broadcast or some other public event. The image has a vintage quality.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image appears to be a vintage black-and-white photograph, likely from the mid-20th century. It shows three people: an older woman and two children, a girl and a boy. The older woman is wearing a dress and a pearl necklace, and she is smiling. The girl is standing next to the woman, also smiling, and is wearing a dress and a headband. The boy is standing to the right, facing the woman and girl, and appears to be wearing a casual outfit. They are standing in front of a structure that looks like a small building or booth, with a window and some decorations. The setting seems to be outdoors, possibly at a fair or a community event. The overall mood of the image is cheerful and nostalgic.

Text analysis

Amazon

17251.
MAGOX
1925).
MAGOX NAMTRA3
NAMTRA3

Google

1251. 17251.
1251.
17251.