Human Generated Data

Title

Untitled (woman playing piano and crowd in front of H.J. Heinz. Co. building)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4447

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman playing piano and crowd in front of H.J. Heinz. Co. building)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4447

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 98.4
Person 98.1
Audience 97.8
Crowd 97.8
Person 97.6
Interior Design 94.8
Indoors 94.8
Person 86.5
Person 79.1
Person 77.1
Person 72.1
Face 68.3
Room 68.2
Person 67.1
Person 62.6
Architecture 62
Building 62
Pillar 62
Column 62
People 61.9
Photography 56.5
Photo 56.5
Lecture 55.2
Speech 55.2
Person 49.4

Clarifai
created on 2023-10-27

people 99.4
many 98.5
administration 97.8
man 97.8
group 96.8
adult 95.9
crowd 94.6
monochrome 91.9
leader 89.1
group together 88.5
woman 87.5
war 84.1
chair 82.1
architecture 81.1
child 80.9
building 77.4
horizontal 75.5
outdoors 73.3
theater 71.5
street 71.5

Imagga
created on 2022-01-23

hall 70.2
building 50.5
city 43.2
architecture 39.2
urban 30.6
night 28.4
structure 26
classroom 25
cityscape 22.7
bridge 22.7
sky 22.3
buildings 21.7
room 20.8
landmark 20.8
travel 20.4
skyline 19.9
center 19.7
tourism 19
library 16.2
water 16
famous 15.8
tower 15.2
downtown 14.4
river 14.2
town 13.9
light 13.4
panorama 13.3
street 12.9
tourist 12.8
clouds 12.7
modern 12.6
office 12.5
sea 12.5
skyscraper 12.5
ocean 12.4
lights 11.1
construction 11.1
coast 10.8
windows 10.6
old 10.4
scene 10.4
business 10.3
evening 10.3
landscape 9.7
historic 9.2
school 9
new 8.9
bay 8.8
university 8.7
panoramic 8.6
dusk 8.6
supermarket 8.5
house 8.4
destination 8.4
monument 8.4
boat 8.4
vacation 8.2
history 8
houses 7.7
us 7.7
port 7.7
roof 7.6
illuminated 7.6
tall 7.5
dark 7.5
road 7.2

Google
created on 2022-01-23

Photograph 94.2
Building 92.6
Window 91.3
Black 89.8
World 89.5
Black-and-white 86.1
Style 84
Line 82
Font 79.9
Adaptation 79.3
Art 76.1
Monochrome photography 75.7
Monochrome 75.4
Snapshot 74.3
Crowd 72
Event 72
House 69.3
Facade 68.3
Stock photography 65.6
History 65.2

Microsoft
created on 2022-01-23

text 95
black 79.4
old 70.1
people 65.1
crowd 1.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Female, 92.5%
Happy 76.6%
Fear 6.8%
Angry 4.6%
Calm 4.6%
Sad 4.1%
Surprised 2%
Disgusted 1%
Confused 0.3%

AWS Rekognition

Age 22-30
Gender Female, 99.4%
Calm 88.1%
Fear 5.3%
Angry 2.6%
Happy 1.3%
Sad 0.9%
Disgusted 0.7%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Female, 53.5%
Calm 72.1%
Sad 14.8%
Happy 11.1%
Angry 0.9%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Female, 94.8%
Calm 63.5%
Happy 24.9%
Sad 4%
Angry 2.4%
Disgusted 1.7%
Fear 1.3%
Surprised 1.1%
Confused 1.1%

AWS Rekognition

Age 23-31
Gender Female, 89.1%
Calm 97.9%
Surprised 0.7%
Angry 0.3%
Happy 0.3%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 36-44
Gender Female, 53.1%
Calm 67.6%
Happy 14.3%
Fear 5.4%
Sad 5.2%
Angry 3.2%
Disgusted 1.7%
Confused 1.3%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Female, 98.9%
Calm 90.4%
Happy 2.3%
Sad 2.2%
Fear 1.8%
Confused 1.6%
Surprised 0.8%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-31
Gender Female, 74.4%
Calm 38%
Sad 22.3%
Surprised 14%
Angry 7.4%
Confused 6.8%
Happy 4.7%
Fear 3.8%
Disgusted 3.1%

AWS Rekognition

Age 21-29
Gender Male, 97.1%
Calm 87.6%
Sad 3.7%
Happy 2.8%
Fear 2.3%
Angry 1.3%
Disgusted 1.2%
Surprised 0.7%
Confused 0.5%

AWS Rekognition

Age 20-28
Gender Female, 97.9%
Calm 92.2%
Sad 4.1%
Happy 2.6%
Angry 0.4%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 33-41
Gender Male, 98.7%
Calm 85.8%
Angry 5.8%
Sad 3.7%
Happy 2.1%
Disgusted 0.8%
Fear 0.6%
Surprised 0.5%
Confused 0.5%

AWS Rekognition

Age 29-39
Gender Male, 72.9%
Happy 80.6%
Calm 13%
Sad 2.6%
Confused 1.1%
Angry 0.8%
Fear 0.8%
Surprised 0.7%
Disgusted 0.4%

AWS Rekognition

Age 41-49
Gender Male, 94.4%
Calm 97.3%
Disgusted 1%
Surprised 0.8%
Angry 0.3%
Sad 0.2%
Happy 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 90.2%
Calm 51%
Sad 23.4%
Happy 11.4%
Surprised 5%
Confused 3.1%
Angry 2.6%
Disgusted 2.2%
Fear 1.4%

AWS Rekognition

Age 24-34
Gender Female, 83.1%
Sad 69.8%
Calm 27.7%
Happy 1.2%
Angry 0.5%
Fear 0.3%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%

Feature analysis

Amazon

Person
Person 99.7%
Person 98.4%
Person 98.1%
Person 97.6%
Person 86.5%
Person 79.1%
Person 77.1%
Person 72.1%
Person 67.1%
Person 62.6%
Person 49.4%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a crowd of people standing around a large building -100%

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

The image shows a crowd of people gathered in front of a building with the inscription "H. J. HEINZ CO." on the top. There are four pillars standing tall at the entrance of the building. A person is standing at a piano in front of the crowd. The people in the crowd are wearing various types of clothing, including hats and suits. There is a tiled roof visible on the left side of the building. Above the building, what appears to be a roller coaster can be seen. The image has a bright, almost overexposed quality, with details in white tones dominating the scene.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

The image is a negative photograph of a crowd gathered in front of a building. The building has a grand, classical facade, with columns supporting a curved section that reads "H. J. HEINZ CO." in large letters. A rectangular section of the building, presumably an entrance or part of the building itself, can be seen to the left of this curved section, this structure having the appearance of a roof or portico.

A large crowd of people is visible, facing a small stage or area where a woman is speaking or possibly performing, at the far left. The crowd is dressed in clothing typical of the mid-20th century. The scene has a bright, airy feel.

The overall impression is of a special event or gathering, potentially related to the Heinz company. The negative format of the image results in a reversal of light and dark, making it a stark, yet interesting view of the scene.

Text analysis

Amazon

HEINZ
CO.
J.
17236
H. J. HEINZ CO.
17236.
H.
19236. 17236.
19236.
JC

Google

172 36. CO H. J. HEINZ 1723
172
36.
CO
H.
J.
HEINZ
1723