Human Generated Data

Title

Untitled (group of children playing on living room floor)

Date

1959

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10511

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of children playing on living room floor)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10511

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.6
Clinic 97.1
Room 80.9
Indoors 80.9
People 69
Furniture 62.6
Clothing 59.9
Apparel 59.9
Hospital 58.1
Operating Theatre 57.9
Doctor 57.2

Clarifai
created on 2023-10-25

people 99.6
group 98.2
education 97.9
child 97.3
woman 96.6
adult 96.4
monochrome 96.1
group together 95.9
man 95.7
school 94.6
furniture 94.1
room 93.8
sit 93
chair 92.4
recreation 91.9
teacher 91.5
classroom 91.2
seat 91
indoors 91
sitting 89.1

Imagga
created on 2022-01-09

sax 44.7
wind instrument 24.4
man 21.7
glass 20.8
people 20.1
brass 19.9
table 19.1
person 17.4
male 16.3
cornet 14.9
home 14.3
room 14.3
wedding 13.8
laboratory 13.5
musical instrument 13.3
interior 13.3
medical 13.2
men 12.9
chemistry 12.5
business 12.1
party 12
work 11.8
lab 11.7
research 11.4
cheerful 11.4
event 11.1
team 10.7
chair 10.7
chemical 10.6
working 10.6
setting 10.6
businessman 10.6
office 10.5
biology 10.4
wine 10.4
instrument 10.3
biotechnology 9.8
experiment 9.7
medicine 9.7
group 9.7
sitting 9.4
dinner 9.4
smiling 9.4
happy 9.4
worker 9.2
indoors 8.8
device 8.7
happiness 8.6
music 8.6
dining 8.6
development 8.5
food 8.5
black 8.4
modern 8.4
drink 8.3
groom 8.1
decoration 8
water 8
family 8
adult 8
celebration 8
restaurant 7.9
banquet 7.8
scene 7.8
elegant 7.7
test 7.7
flower 7.7
bride 7.7
equipment 7.6
sign 7.5
house 7.5
fun 7.5
silhouette 7.4
teamwork 7.4
desk 7.4
light 7.3
life 7.3
lifestyle 7.2
professional 7.2
romance 7.1
love 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 99
person 69
cartoon 61.6
clothing 56.3
drawing 54.2
room 40.6

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 19-27
Gender Male, 63.2%
Calm 47.4%
Sad 22%
Angry 17%
Confused 7.8%
Disgusted 3.3%
Surprised 1.4%
Happy 0.5%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 98.7%
Calm 78.8%
Sad 13.2%
Angry 2.5%
Happy 1.4%
Confused 1.3%
Surprised 1.2%
Fear 0.9%
Disgusted 0.7%

AWS Rekognition

Age 39-47
Gender Male, 56.1%
Calm 99.8%
Sad 0.1%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 66.7%
Calm 78.5%
Happy 5.6%
Angry 4.2%
Surprised 3.8%
Disgusted 3.6%
Sad 3%
Fear 0.7%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person

Clarifai

Clothing
Footwear
Picture frame
Human face
Window
House
Curtain
Person
Wheel
Table

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 92.3%

AWS Rekognition

Person 86.1%

AWS Rekognition

Person 82%

Clarifai

Clothing 81.6%

Clarifai

Clothing 79.1%

Clarifai

Clothing 71%

Clarifai

Clothing 70.7%

Clarifai

Clothing 68.8%

Clarifai

Clothing 61.1%

Clarifai

Footwear 67.6%

Clarifai

Footwear 57%

Clarifai

Footwear 51.9%

Clarifai

Footwear 51.8%

Clarifai

Footwear 48.8%

Clarifai

Footwear 47.7%

Clarifai

Footwear 45.1%

Clarifai

Footwear 44.3%

Clarifai

Footwear 41.7%

Clarifai

Footwear 40.3%

Clarifai

Footwear 36%

Clarifai

Footwear 33.8%

Clarifai

Footwear 33.2%

Clarifai

Footwear 33.2%

Clarifai

Picture frame 60.3%

Clarifai

Picture frame 47.6%

Clarifai

Human face 56.5%

Clarifai

Human face 53.8%

Clarifai

Human face 47.8%

Clarifai

Human face 45.2%

Clarifai

Human face 44.7%

Clarifai

Window 48.7%

Clarifai

House 48.2%

Clarifai

Curtain 47.7%

Clarifai

Person 44.5%

Clarifai

Wheel 43.6%

Clarifai

Wheel 40.6%

Clarifai

Wheel 36%

Clarifai

Table 43.2%

Categories

Imagga
created on 2022-01-09

interior objects 72.1%
paintings art 18.8%
food drinks 2.8%
people portraits 1.8%
text visuals 1.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

a painting of a child's room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people sitting around a couch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a family setting in a living room. There are several children dressed in various outfits, with some gathered near a toy stroller filled with items. Two adults are seated; one on a chair and the other on a couch in the background, with a baby on her lap. The room is furnished with curtains, a side table, a lamp, and framed artwork on the wall. The mood suggests a casual and domestic indoor scene.

Created by gpt-4o-2024-08-06 on 2025-06-08

This image appears to be a photographic negative of a family gathering in a living room. There are several children playing on the carpeted floor. Some children are playing with toys, including a small stroller. Two women, possibly the children's mothers or caretakers, are sitting and engaging with the children. One is seated on the left in an armchair, while the other is seated on the sofa. The room contains furniture such as a sofa, armchair, and side tables. A window is visible with drawn curtains and there are lamps on the side tables. The walls have framed artwork hanging. The layout suggests a typical living room setting where family or group interactions take place.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a living room scene with several dolls and toys scattered around the floor. There appear to be multiple dolls of different sizes and styles, including some baby dolls in strollers. The room has a couch, a lamp, and some artwork on the walls. The overall scene suggests a playful, domestic setting with children's toys and activities taking place.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a black and white photograph from what looks like the 1950s or 1960s, showing a living room scene. The room has floral curtains by a window, a couch, table lamps, and some framed artwork on the walls. Several people are gathered in the room, with some seated on the couch and others on the floor. There appears to be a toy stroller or carriage in the scene, and what looks like some toys or items scattered on the floor. The room has a typical mid-century modern domestic feel to it, with the furniture and décor characteristic of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts a black and white photograph of a living room with a family of six, including two adults and four children. The mother is sitting on a couch, while the father is standing next to her. The children are playing in the room, with one of them pushing a toy shopping cart filled with toys. The room is decorated with furniture and artwork, and there are curtains on the windows. The overall atmosphere of the image is one of warmth and family bonding.

  • A family of six is in the living room:
    • The family consists of two adults and four children.
    • The mother is sitting on the couch, while the father is standing next to her.
    • The children are playing in the room, with one of them pushing a toy shopping cart filled with toys.
  • The mother is sitting on the couch:
    • She is wearing a dress and has her hair styled in a neat manner.
    • She appears to be engaged in conversation with the father.
  • The father is standing next to the mother:
    • He is wearing a suit and tie, suggesting that he may be dressed for a special occasion.
    • He appears to be watching the children play.
  • There are four children playing in the room:
    • They are all dressed in casual clothing and appear to be having fun.
    • One of them is pushing a toy shopping cart filled with toys.
  • The children are playing with a toy shopping cart:
    • The cart is filled with various toys, including dolls, blocks, and other objects.
    • The children are using their imaginations to create a pretend store or market.
  • The room is decorated with furniture and artwork:
    • There is a couch, chairs, and tables in the room.
    • There are also several pieces of artwork on the walls, including paintings and prints.
  • The curtains are open on the windows:
    • The curtains are made of a light-colored material and have a floral pattern.
    • They are open, allowing natural light to enter the room.

Overall, the image suggests a happy and harmonious family scene, with the parents and children enjoying each other's company in a warm and welcoming environment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

This image is a black and white photograph of a living room with a family of eight, including six children and two adults. The room is decorated with a couch, coffee table, end tables, lamps, and a window with curtains. The floor is littered with toys and clothing.

The two adults are sitting on the couch, while the six children are scattered around the room, playing with toys or sitting on the floor. One child is pushing a toy shopping cart filled with toys. The overall atmosphere of the image suggests a chaotic but happy family scene, with the children engaged in playful activities and the adults supervising from the couch.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The black-and-white photo shows a living room with a couch, a table, and a lamp. There are also some children and dolls in the room. The woman is sitting on the couch with a child in front of her. The child is holding a doll. The child in the middle is sitting on the floor and holding a doll. The child on the right is holding a toy. The room has a window with curtains.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The black and white photo features a living room with a couch, a lamp, and picture frames on the wall. There are four children and two adults in the room. The children are playing with toys, and some are wearing dresses. The adults are sitting on the couch and on a chair. The room has a carpeted floor, and there are curtains on the window. There are also tables with items on top.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

This is a black and white, negative image of a domestic interior scene. It appears to be a candid shot of a family.

Key elements and details:

  • People: There are several people in the room, including two women who appear to be seated on upholstered furniture. There are also a number of young children present. The children seem to be playing on the floor.
  • Furniture and decor: The room features a sofa, end tables with lamps, curtains, and framed artwork on the wall.
  • Activities/atmosphere: The scene suggests a casual, everyday family moment. The presence of the children and scattered items on the floor suggest play.
  • Composition: The image is well-composed, with the various elements arranged to create a balanced and visually interesting scene.

Overall, the photograph captures a glimpse of family life in a living room setting, and gives us a nostalgic peek into a bygone era.

Created by gemini-2.0-flash on 2025-04-30

The image shows a black and white negative print of an interior scene featuring two women and four children. The composition is centered around the figures and the furniture in the room.

On the left side, a woman is seated in a chair, facing towards the center of the scene. She appears to be engaged in a conversation or observation of the other people in the room. Next to her is a window with patterned curtains, and a lamp on a small table.

In the center of the room, another woman sits on a couch, surrounded by several children. One child stands next to the couch, while the others are on the floor. One child is sitting in a toy stroller. The floor is cluttered with various items.

In the background, there are two framed pictures on the wall, and a lamp on a table. The overall mood of the image is domestic and familial, capturing a moment of everyday life within a home setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image depicts a scene inside a living room, seemingly from the mid-20th century. The room is furnished with a sofa, a couple of armchairs, a coffee table, and a side table with a lamp. The decor includes patterned curtains and framed pictures on the wall.

In the room, there are several people, including adults and children. The adults are seated: one on the sofa and another in an armchair. The children are engaged in play activities. One child is standing on the sofa, while others are seated on the floor. There are toys scattered around, including dolls and a doll stroller, suggesting that the children are playing with dolls.

The overall atmosphere of the image appears to be casual and domestic, capturing a moment of family interaction and children at play. The black-and-white nature of the photograph adds a vintage feel to the scene.

Qwen

No captions written

Text analysis

Amazon

44971