Human Generated Data

Title

Untitled (home of Virgil Thaxton, near Mechanicsburg, Ohio)

Date

July 1938-August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1795

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (home of Virgil Thaxton, near Mechanicsburg, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1795

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Keyboard 99.2
Musical Instrument 99.2
Piano 99.2
Person 95.6
Person 95.6
Person 95.3
Person 95.2
Person 94
Upright Piano 93.5
Person 88.6
Person 84.3
Grand Piano 74.2
Face 69.9
Head 69.9
Person 68.1

Clarifai
created on 2018-05-11

piano 100
music 99.5
instrument 99.5
synthesizer 99.5
jazz 98.9
pianist 98.7
ivory 98.4
ebony 98.1
keyboard 97.9
sound 97.5
musician 96.9
no person 96.8
classic 96.2
play 95.1
retro 94.9
art 94.7
metal key 94.7
song 94.6
old 94.1
studio 92.7

Imagga
created on 2023-10-06

piano 100
musical instrument 99.8
upright 92.9
electric organ 71.2
keyboard instrument 68.1
electronic instrument 65.7
stringed instrument 56.2
percussion instrument 55.7
keyboard 43.3
music 40.9
instrument 34.4
device 33.1
keys 27.3
musical 26.8
play 25.8
sound 25.3
black 23.4
key 22.4
playing 20.1
classical 18.2
synthesizer 16.8
business 15.8
musician 15.6
office 15.3
equipment 13.1
entertainment 12.9
song 12.7
finance 12.7
folder 12.6
concert 12.6
word 12.2
showing 12.2
pianist 11.9
ivory 11.8
closeup 11.4
hand 11.4
technology 11.1
card 11
paper 11
register 10.9
close 10.8
success 10.5
education 10.4
learn 10.4
electronic 10.3
classic 10.2
note 10.1
child 10
ebony 9.9
chord 9.9
art 9.8
lesson 9.7
grand 9.7
practice 9.7
sell 9.7
computer 9.6
performance 9.6
home 9.6
fingers 9.5
work 9.4
money 9.4
digital 8.9
detail 8.8
melody 8.8
paperwork 8.8
hands 8.7
finger 8.3
banking 8.3
data 8.2
bank 8.1
light 8
financial 8
people 7.8
invest 7.7
payment 7.7
old 7.7
audio 7.6
learning 7.5
harmony 7.5
sale 7.4
investment 7.3
information 7.1

Microsoft
created on 2018-05-11

music 99.2
piano 98.1
white 67.5
old 51.3
electric organ 11.5

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 4-12
Gender Male, 94.6%
Disgusted 82.5%
Surprised 6.5%
Calm 6.2%
Fear 6.2%
Angry 3.9%
Happy 3.5%
Sad 2.7%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Male, 99.6%
Calm 72.9%
Angry 9.2%
Surprised 9.1%
Disgusted 8.3%
Fear 6.1%
Sad 3.4%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Disgusted 59.5%
Surprised 17%
Calm 9.4%
Fear 7.4%
Angry 5%
Sad 4.8%
Confused 2.6%
Happy 1.1%

AWS Rekognition

Age 22-30
Gender Male, 91.3%
Sad 83.2%
Confused 30.7%
Fear 9.8%
Disgusted 9.3%
Calm 7.5%
Surprised 6.8%
Angry 4.1%
Happy 1.2%

AWS Rekognition

Age 6-14
Gender Male, 89.5%
Calm 72.3%
Fear 13.8%
Surprised 7.7%
Confused 6.6%
Sad 2.8%
Angry 1.2%
Disgusted 1%
Happy 0.6%

AWS Rekognition

Age 16-24
Gender Female, 67.7%
Calm 74.7%
Angry 9.2%
Sad 8.7%
Surprised 6.6%
Fear 6.5%
Happy 1.7%
Disgusted 1.3%
Confused 0.7%

Imagga

Traits no traits identified

Feature analysis

Amazon

Piano
Person
Piano 99.2%
Person 95.6%
Person 95.6%
Person 95.3%
Person 95.2%
Person 94%
Person 88.6%
Person 84.3%
Person 68.1%

Categories

Captions

Microsoft
created by unknown on 2018-05-11

a black and white photo of a piano 93.8%
a vintage photo of a piano 93.7%
an old photo of a piano 93.6%

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a piano player's piano in a piano -100%

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts an upright piano in a room with patterned wallpaper. The piano's name, "R. S. Howard Co.," is visible above the keyboard. On the top shelf of the piano, a lace or crochet doily is draped across, and several framed photographs are displayed. These photos appear to be portraits and seem to be of various people, possibly family members. On the music rack, there are several pieces of sheet music, including titles like "The Little Old Church in the Valley," "Hawaiian Memories," "My Smiling Sweetheart," and "The Letter Edged in Black." The piano adds an antique and nostalgic feel to the decor.

Created by gpt-4o-2024-11-20 on 2025-06-12

This image depicts a classic upright piano with ornate details, displaying sheet music propped on the music stand. The titles of the sheet music include "The Little Old Church in the Valley," "Hawaiian Memories," "My Swanee Sweetheart," "Who'll Take My Place When I'm Gone," and "The Letter Edged in Black." Above the piano, there is a decorative lace covering, and numerous framed photographs rest on top. The piano is situated against a patterned wallpaper backdrop, adding to the vintage aesthetic of the room.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows an old upright piano with various framed portraits and photographs displayed on the shelf above it. The piano appears to be an antique model, with a decorative trim along the top. On the shelf, there are several black-and-white portraits, likely of people from an earlier era. Below the piano, there are several sheet music books and publications, including titles like "Hawaiian Memories" and "The Little Church in the Valley." The overall scene suggests a nostalgic, historical setting, with the piano and its displayed items creating a sense of a bygone era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph of an upright piano with several pieces of sheet music displayed on the music stand. The visible sheet music titles include "The Little Old Church in the Valley," "Hawaiian Memories," and what appears to be "My Schoolday Sweetheart," among others. On top of the piano, there's a row of framed photographs displayed on a decorative doily or runner. The piano appears to be a Schutz & Co. model, and the image has a vintage quality to it, likely from the early-to-mid 20th century based on the style and presentation. The piano is photographed against what appears to be wallpapered wall with a pattern visible in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a vintage upright piano, showcasing its rich history and musical heritage. The piano is adorned with a variety of sheet music, including "Hawaiian Memories," "The Little Old Church in the Valley," and "The Lettered on Black." Above the piano, a collection of framed photographs adds a personal touch, while the piano's dark wood finish and ornate details evoke a sense of nostalgia and tradition.

Key Features:

  • Piano: Upright piano with a dark wood finish and ornate details
  • Sheet Music: Various titles, including "Hawaiian Memories," "The Little Old Church in the Valley," and "The Lettered on Black"
  • Photographs: Collection of framed photographs above the piano
  • Background: Wall with a floral patterned wallpaper
  • Overall: The image presents a nostalgic and traditional setting, evoking a sense of history and musical heritage.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black and white photograph of an upright piano, with a collection of framed photographs and sheet music displayed on top. The piano is positioned against a wall, and its front panel features a decorative scalloped edge. A small, round object resembling a music box or figurine sits to the left of the sheet music.

Above the piano, eight framed photographs are arranged in a row, each containing a portrait of an individual. The background of the image appears to be a wallpapered wall, which adds a touch of elegance to the overall scene. The photograph itself has a white border around it, suggesting that it may have been taken from an album or frame.

Overall, the image presents a charming and nostalgic view of a bygone era, capturing a moment in time when music and family were deeply intertwined.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image shows a black-and-white photograph of a piano with various items on top of it. The piano is a vintage upright piano with a wooden body and a black finish. On top of the piano, there are several books and sheet music. The books are arranged in a row, with the titles "The Little Old Church in the Valley," "Hawaiian Memories," "My School Days Sweetheart," and "When I Take My Travel" visible. The sheet music has the title "The Letter Edged in Black."

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is a black-and-white photograph of a piano. The piano is a vertical upright model, with a dark wooden finish. On top of the piano, there is a shelf adorned with a lacy white cloth. The shelf holds several framed photographs, each showing individuals or groups of people, suggesting that they might be family members or loved ones. The photographs vary in size and style, indicating different eras or occasions. In front of the piano, on the keyboard, are several books and sheet music, suggesting that the piano is used for playing music. The books and sheet music have titles that are partially visible, indicating a mix of genres or styles of music. The piano is positioned against a patterned wall, which adds a bit of texture and depth to the image. The overall atmosphere of the image is nostalgic and sentimental, evoking a sense of history and personal connection to the piano and the people depicted in the photographs.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

The black and white photo shows an upright piano against a wall with patterned wallpaper. On top of the piano, there's a shelf adorned with a lace-edged cloth. Arranged on the shelf are several framed photographs, including what appear to be portraits of individuals and possibly couples.

Resting on the piano, in front of the shelf, are several sheets of music. The titles of these pieces are visible, including "The Little Old Church in the Valley", "Hawaiian Memories", "My School Day Sweetheart", "When I Take My Sweet in Her", and "The Letter Edged in Black". There's also a smaller book or sheet music titled "The Kings".

The piano itself has a full keyboard, and the name "M. Schulz CO." is visible on the front. The piano has decorative carved legs, giving it a classic look. The overall setting suggests an older home, with the piano and the items displayed on it creating a personal and musical atmosphere.

Created by gemini-2.0-flash-lite on 2025-05-08

Here's a description of the image:

The image is a black and white photograph of an upright piano. The piano is dark, likely stained wood, and has a full keyboard with a visible music rack. On top of the piano are several framed photographs of people in formal attire. A delicate lace doily runs across the top of the piano, under the framed photos.

In the space where the music rack would sit, there are several pieces of sheet music. The titles of the sheet music are: "THE LITTLE OLD CHURCH IN THE VALLEY", "HAWAIIAN MEMORIES", "MY SCHOOL DAY SWEETHEART", "When Take My Throat In Her", and "THE LETTER EDGED IN BLACK".

The piano is set against a backdrop of wallpaper with a subtle pattern. The image is likely from the early to mid 20th century due to the style of the photographs, music, and the piano itself. The overall impression is one of a lovingly maintained instrument in a domestic setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts an old upright piano situated against a wall with patterned wallpaper. The piano is adorned with several items:

  1. Sheet Music: On the piano's music stand, there are several pieces of sheet music. The titles of the songs are visible, including "The Little Old Church in the Valley," "Hawaiian Memories," "My Schooldays Sweetheart," "When I Take My Vacation in Dixie," and "The Letter Found in the Sand."

  2. Book: There is a book titled "The Modern Pianist" placed among the sheet music.

  3. Photographs: Above the piano, on a decorative shelf with a scalloped edge, there are several framed photographs. These photographs appear to be portraits of individuals, likely family members or notable figures.

The piano itself has a classic design with ornate legs and a polished finish, indicative of a style popular in the early 20th century. The overall setting suggests a nostalgic and personal atmosphere, likely within a home or a music room.

Text analysis

Amazon

LITTLE
THE
VALLEY
IN THE VALLEY
IN
LETTER
SWEETHEART
THE LITTLE OLD CHURCH
KINGS
NEVADA
OLD
BLACK
MATTIE NEVADA
MATTIE
CHURCH
SCHOOLDAY
THE LETTER EDGED IN BLACK
My SCHOOLDAY SWEETHEART
SCHULZ
M
SONG
Nei
M SCHULZ co
My
In Nei
H.C
In
EDGED IN
HAWAIIAN MEMORIES
سنة H.C
co
سنة
PRINC
MyToral

Google

HAMAIAN HEMORIES IN THE VALLEY
HAMAIAN
HEMORIES
IN
THE
VALLEY