Human Generated Data

Title

Untitled (men and women in Hawaiian print garb seated in a living room)

Date

1948

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5400

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women in Hawaiian print garb seated in a living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5400

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.2
Crowd 91.1
Nature 85
Audience 80.5
Outdoors 79.9
Chair 78.9
Furniture 78.9
Room 77.2
Indoors 77.2
People 71.8
Shorts 65
Clothing 65
Apparel 65
Suit 63.4
Coat 63.4
Overcoat 63.4
Transportation 63.1
Vehicle 63.1
Text 60.4
Female 60.3
Face 59.9
Photography 58
Photo 58

Clarifai
created on 2023-10-26

people 98.3
woman 97.2
man 96.3
group 96.2
indoors 96.1
business 93.8
education 92.8
communication 90.5
adult 89.7
sit 88.6
horizontal 88.3
child 88.2
empty 86.4
paper 85.2
young 82.9
technology 82.2
family 80
spherical 79.7
teamwork 79
adolescent 78.8

Imagga
created on 2022-01-23

business 23.1
design 23.1
graphic 22.6
art 21.8
gymnasium 18.9
silhouette 17.4
pattern 15.7
modern 15.4
decoration 14.5
athletic facility 14.3
letterhead 14.3
element 14.1
grunge 13.6
technology 13.4
creative 13.2
symbol 12.8
facility 12.7
shape 12.6
color 12.2
floral 11.9
graphics 11.7
stationery 11.3
people 11.2
drawing 11
retro 10.6
monitor 10.6
digital 10.5
urban 10.5
map 10.3
frame 10.3
line 10.3
3d 10.1
sign 9.8
curve 9.6
equipment 9.6
light 9.4
network 9.3
space 9.3
paper 9.3
flower 9.2
wallpaper 9.2
city 9.1
plant 9.1
old 9.1
texture 9
backgrounds 8.9
style 8.9
idea 8.9
office 8.8
work 8.6
writing paper 8.6
life 8.6
corporate 8.6
arrow 8.5
creation 8.4
ornate 8.2
global 8.2
world 8
counter 7.9
scene 7.8
blank 7.7
construction 7.7
web 7.6
communication 7.6
house 7.5
decorative 7.5
vintage 7.4
reflection 7.4
globe 7.4
person 7.4
swirl 7.4
card 7.3
data 7.3
computer 7.3
dirty 7.2
black 7.2
businessman 7.1
architecture 7

Google
created on 2022-01-23

Chair 85.3
Font 82.1
Art 81
Monochrome 70.8
Event 69.3
Sitting 66.5
Room 66.3
Monochrome photography 65.8
Visual arts 65.6
Photo caption 64.3
Illustration 62.4
Advertising 61.4
Display device 61
Painting 58.5
Team 57.2
Drawing 55
Brand 50.5

Microsoft
created on 2022-01-23

text 97.4
group 63.2
posing 61.4
person 53.8
old 52.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Female, 91.6%
Happy 86.9%
Sad 6.9%
Calm 2.2%
Confused 1.2%
Disgusted 0.9%
Fear 0.7%
Surprised 0.6%
Angry 0.6%

AWS Rekognition

Age 29-39
Gender Male, 96%
Calm 82%
Sad 10.1%
Confused 6.1%
Disgusted 0.5%
Happy 0.5%
Angry 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 47-53
Gender Male, 61.4%
Calm 85.1%
Happy 10.1%
Sad 2.4%
Confused 0.8%
Surprised 0.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Motorcycle

Clarifai

No features identified

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 94.4%

AWS Rekognition

Person 93.1%

AWS Rekognition

Person 90.5%

AWS Rekognition

Person 79%

AWS Rekognition

Person 72%

AWS Rekognition

Person 53.6%

AWS Rekognition

Person 45.5%

AWS Rekognition

Person 42.4%

AWS Rekognition

Motorcycle 63.1%

Categories

Imagga
created on 2022-01-23

paintings art 44.2%
interior objects 30.7%
text visuals 24.3%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people sitting in chairs in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This is a negative image showing a group of people gathered indoors in a relaxed setting. The room contains furniture, including chairs and sofas, as well as décor elements like a framed picture on the wall. Some individuals are seated, while others are leaning or sitting on the floor. The scene appears casual, depicting a social gathering or recreational moment. Natural light is visible streaming through the windows, and the atmosphere is informal.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image appears to be a photographic negative depicting a group of people gathered in a living room. The group is casually sitting and interacting in a relaxed environment. Several individuals are seated on couches and chairs or on the floor. The room is decorated with a modern style, featuring furniture and a potted plant. On the wall behind them, there's a framed picture visible, and a television set is positioned nearby. The atmosphere suggests a social or family gathering, possibly during a warm season, given the light clothing and presence of open windows letting in natural light.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph depicting a group of people, mostly women, sitting and relaxing in what seems to be a living room or lounge area. The individuals are dressed in casual, floral-patterned clothing and appear to be engaged in various activities, such as reading or conversing. The room is well-lit, with windows and artwork visible in the background. The overall atmosphere suggests a relaxed and intimate setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph taken in what looks like a classroom or institutional setting. Several people are seated in a row along what appears to be a wall or partition. The image has a somewhat overexposed or high-contrast quality typical of older photography. There's a number visible at the bottom of the photo (24395), suggesting this might be from an archive or collection. The interior space has visible support columns or beams in the ceiling area. The lighting appears to be coming from windows, creating a bright, washed-out effect in parts of the image.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a group of people gathered in a room, with the central focus being a man and woman in mid-air, as if they are jumping or falling. The room is furnished with a couch, chairs, and a table, and features a window on the left side and a doorway on the right. A large piece of artwork hangs on the back wall, adding to the room's aesthetic.

In the foreground, the man and woman are prominently featured, their bodies in motion as they jump or fall. The surrounding individuals appear to be watching them, creating a sense of drama and tension in the scene. The overall atmosphere of the image is one of energy and movement, capturing a moment in time that is both dynamic and intriguing.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This image is a black and white photograph of a group of people in a living room. The room is well-lit, with large windows on the left side and a doorway on the right. The walls are dark-colored, and the furniture is light-colored. There is a painting on the wall behind the couch.

The group consists of 11 people, all wearing casual clothing. They are seated on the couch, chairs, and floor, with some leaning against each other or the furniture. The atmosphere appears relaxed and social, with the group engaged in conversation or enjoying each other's company.

In the foreground, there is a small table with a plant on it, and a piece of furniture that resembles a dresser or bookshelf. The background of the image shows the room's architecture, including the windows, doorway, and ceiling.

Overall, the image captures a moment of social interaction and relaxation in a domestic setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image features a group of people sitting in a room, possibly a living room. The people are sitting on couches and chairs, and they are all looking in the same direction. The room has a carpeted floor and a wall with a picture frame. There is a vase with flowers on a table, and a lamp is mounted on the ceiling. The image has a black-and-white filter, giving it a vintage look.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white image depicts a group of people in a room, probably at a party. Some are sitting on a couch, while others are sitting on the floor. Some are wearing bikinis, while others are wearing shorts. A desk with a vase of flowers is placed behind them. A picture frame is mounted on the wall, and a monitor is placed on the desk on the right. The image has a watermark "EVEELLA" at the bottom right.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The image shows a group of people in a living room setting. They are casually dressed, some in swimwear or summer clothing. The room has a relaxed, informal atmosphere, with a piano, a painting on the wall, and comfortable seating arrangements. The overall impression is that of a gathering, possibly a party or casual get-together, with people lounging and interacting in a convivial setting. The negative effect gives the image a stark, almost ghostly appearance.

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

This appears to be a negative image of a group of people gathered in a living room or similar indoor space. The scene is lit with bright light, with most features washed out in shades of white and gray.

Here's a breakdown of what can be seen:

  • People: There are several figures scattered around the room, some sitting on a couch, and others sitting or reclining on the floor. They are dressed in what appears to be casual attire, with some wearing what could be swimwear. The genders of the people are difficult to determine as everything is in negative.
  • Furniture and Objects: There's a couch, a small storage or display unit, and what might be a piano in the background. A framed picture hangs on the wall. There's a window visible on the left, and another door or window on the right.
  • Setting: The architecture suggests a room with a modern or mid-century design, and a large open window.

The overall impression is of a social gathering taking place indoors, with the bright exposure making it difficult to discern the specific details of the setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a group of people posed in a living room setting. The photograph is in black and white, and the people appear to be wearing similar patterned clothing, which suggests a coordinated or themed gathering. The individuals are seated or lying on a couch and the floor, engaging in a casual and relaxed manner. The room features modern furniture, including a sofa, a coffee table, and various decorative items such as a framed picture on the wall and a vase with flowers. The overall atmosphere seems informal and friendly, indicative of a social gathering or family event. The image has a slightly faded or ghostly quality, which may be due to the photographic technique or the age of the print.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This black-and-white photograph depicts a group of individuals, both men and women, gathered in a living room. The people are dressed in casual and somewhat unconventional attire, with some wearing patterned clothing and others in swimwear. The room has a modern design with a brick wall, a framed picture, and a television set. There are also various pieces of furniture, including a couch and chairs, and a small table with a plant. The overall atmosphere appears relaxed and informal. The image has a vintage feel, possibly from the mid-20th century. The number "24395" is visible at the bottom of the photograph.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

This is a black-and-white photograph of a group of people seated in what appears to be a lounge or waiting area, possibly in a hotel or similar establishment. The room is furnished with couches and has a modern design, with a brick wall in the background and a framed picture or artwork mounted on it. Several individuals are dressed in swimwear, suggesting that this might be a poolside or beachside lounge. The people are engaged in various activities, such as sitting, chatting, or relaxing. The photo has a nostalgic quality, likely taken in the mid-20th century, and has a slightly faded appearance, with the edges of the image showing slight wear or damage. The number "24395" is visible at the bottom right corner of the image, which could indicate a catalog or catalogued number for the photograph. The overall atmosphere is casual and relaxed.

Text analysis

Amazon

24395
EVEELA

Google

24395
24395