Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

Date

1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7868

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7868

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Clothing 99.1
Apparel 99.1
Person 98.5
Sitting 98.3
Furniture 97.9
Person 95.7
Chair 92.5
Blonde 90.2
Teen 90.2
Kid 90.2
Child 90.2
Female 90.2
Woman 90.2
Girl 90.2
Couch 85.1
Dress 82
Table 78.8
Flooring 74.2
Room 74.1
Indoors 74.1
Shoe 69.8
Footwear 69.8
Wood 67.5
Evening Dress 66.8
Fashion 66.8
Gown 66.8
Robe 66.8
People 65.7
Floor 63.1
Suit 62.1
Coat 62.1
Overcoat 62.1
Plywood 61.8
Living Room 61.1
Photography 60.7
Photo 60.7
Face 58.5
Dining Table 56.4

Clarifai
created on 2023-10-25

people 99.8
monochrome 95.2
woman 95.1
man 94.8
furniture 94.8
group 94.2
adult 94.2
room 93.3
wedding 93.1
sit 93
group together 92.4
indoors 91.4
chair 90.7
child 90.1
two 89
music 88.5
family 87.5
table 82.8
dining room 82.6
three 82.2

Imagga
created on 2022-01-09

people 36.2
classroom 31.6
man 31.6
person 31.4
room 30.8
male 29.2
adult 28.8
happy 28.8
laptop 28.5
home 27.1
computer 25.7
smiling 24.6
together 23.7
business 23.1
women 22.1
table 21.8
group 21.8
meeting 21.7
businessman 21.2
office 20.6
indoors 20.2
businesswoman 20
men 19.7
smile 19.2
portrait 18.1
lifestyle 18.1
sitting 18
casual 17.8
couple 17.4
senior 16.9
teamwork 16.7
indoor 16.4
desk 16.2
team 16.1
attractive 16.1
work 15.7
executive 15.6
mature 14.9
professional 14.7
teacher 14.5
talking 14.3
corporate 13.7
colleagues 13.6
mother 13.5
elderly 13.4
happiness 13.3
clothing 12.4
businesspeople 12.3
cheerful 12.2
face 12.1
worker 12.1
interior 11.5
grandma 11.4
success 11.3
pretty 11.2
negative 11
day 11
suit 10.8
two people 10.7
job 10.6
working 10.6
modern 10.5
boy 10.4
enjoying 10.4
hall 10.4
manager 10.2
communication 10.1
successful 10.1
house 10
blond 10
confident 10
old 9.7
older 9.7
retired 9.7
technology 9.6
sexy 9.6
30s 9.6
looking 9.6
education 9.5
student 9.5
horizontal 9.2
chair 9.1
color 8.9
casual clothing 8.8
60s 8.8
discussion 8.8
40s 8.8
conversation 8.7
film 8.7
class 8.7
retirement 8.6
pensioner 8.1
new 8.1
family 8
bright 7.9
discussing 7.9
coworkers 7.9
conference 7.8
busy 7.7
drinking 7.7
sofa 7.7
boss 7.6
two 7.6
age 7.6
ethnic 7.6
notebook 7.6
togetherness 7.6
world 7.5
friends 7.5
friendship 7.5
fun 7.5
inside 7.4
20s 7.3
relaxing 7.3
child 7.2
educator 7.2
hair 7.1
handsome 7.1
daughter 7
kin 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

furniture 97.9
text 96.2
clothing 95
table 94.5
chair 91
person 89
woman 76.1
footwear 61.3
black and white 56.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 54.9%
Happy 98.9%
Calm 0.9%
Fear 0%
Surprised 0%
Angry 0%
Sad 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Female, 90.2%
Calm 85.1%
Sad 7.4%
Fear 3.7%
Surprised 1.5%
Happy 0.7%
Confused 0.7%
Disgusted 0.6%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Couch
Shoe
Person 99.5%
Person 98.5%
Person 95.7%
Couch 85.1%
Shoe 69.8%

Categories

Imagga

paintings art 99.3%

Captions

Microsoft
created by unknown on 2022-01-09

a person sitting on a table 84.1%
a person sitting at a table 84%
a man and a woman sitting on a table 57.8%

Clarifai
created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people sitting on a couch -100%

Google Gemini

Created by gemini-2.0-flash on 2025-05-05

The image appears to be a black and white negative of a family portrait taken indoors. An older man wearing a short-sleeved floral patterned shirt and trousers is seated on a white sofa. To his right, a woman in a patterned dress is also seated, seemingly engaged in conversation or gesture. In front of them is a young boy who is kneeling and appears to be playing or interacting with something on a low rectangular table. The table also has books and an ashtray on it. Behind the woman and slightly to the right is a young girl, possibly preteen, standing and smiling. Behind her, a birdcage on a stand is visible. The background features a large window or sliding glass door, offering a view of what seems to be an outdoor area with lush plants and foliage.

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

Overall Impression:

The image is a black and white negative of what appears to be a family scene, likely taken indoors or in a sunroom. The style suggests it could be a photograph from the mid-20th century. The overall aesthetic is somewhat surreal due to the negative effect.

Setting and Composition:

  • Setting: The family seems to be in a well-lit, possibly indoor space with a large window looking out onto lush greenery. There's a sofa visible in the background and what appears to be a coffee table.
  • Composition: The family members are grouped together, with the focus on the interaction between them.

People:

  • There are four people visible:
    • An older man sitting on a sofa. He's wearing a patterned short-sleeved shirt and pants.
    • A woman sitting beside him. She is wearing a patterned dress.
    • A younger boy kneeling near the coffee table, seemingly engrossed in something.
    • A young girl standing behind the table. She is wearing a skirt and leotard.
  • All of the people are fair-skinned.

Objects and Details:

  • A low coffee table is in the foreground. On the table are a few items: a book, a small object, and an ashtray that reads "Hotel".
  • A birdcage is visible in the background.
  • The background is filled with foliage, suggesting either a view of a garden or interior plants.

Overall Mood:

The scene creates an impression of a casual family gathering. There's a sense of leisure. The image has a classic, timeless quality.

Text analysis

Amazon

Hotel

Google

8 SIH -YT37A°2 -- XAGON
8
SIH
-YT37A°2
--
XAGON