Human Generated Data

Title

Untitled (Kôbe, Japan)

Date

March 14, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4500.4

Human Generated Data

Title

Untitled (Kôbe, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 14, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4500.4

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clarifai
created on 2018-05-10

people 99.8
many 98.1
group 97.5
group together 97
adult 95.3
administration 92.3
music 92.1
man 91.6
woman 91.3
child 86.8
education 86.8
school 84.7
wear 83.4
several 80.9
crowd 80.6
musician 78.8
instrument 78.5
military 77.1
war 75.6
uniform 75.6

Imagga
created on 2023-10-06

graffito 33.5
brass 27.7
ballplayer 23.9
decoration 22.5
wind instrument 21.3
player 21.1
backboard 20
athlete 19.5
musical instrument 17.7
equipment 17.3
man 16.8
person 15.6
contestant 15.5
male 14.9
travel 14.1
black 13.8
people 13.4
barrier 13
sport 12.9
outdoors 11.9
old 11.8
building 11.4
scene 11.2
sky 10.8
transportation 10.7
silhouette 9.9
structure 9.9
urban 9.6
color 9.4
day 9.4
bugle 9.1
portrait 9.1
obstruction 9
pattern 8.9
boy 8.7
water 8.7
grunge 8.5
outdoor 8.4
city 8.3
window 8.2
vacation 8.2
lifestyle 7.9
art 7.9
business 7.9
motion 7.7
hockey stick 7.6
landscape 7.4
tourism 7.4
light 7.3
transport 7.3
life 7.3
interior 7.1
summer 7.1
snow 7.1
modern 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 93.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 28-38
Gender Male, 64.9%
Calm 94.4%
Surprised 6.6%
Fear 6.4%
Sad 2.3%
Disgusted 1.2%
Happy 0.8%
Angry 0.7%
Confused 0.5%

AWS Rekognition

Age 27-37
Gender Male, 96%
Calm 96.3%
Surprised 6.6%
Fear 5.9%
Sad 2.5%
Happy 0.8%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Angry 43.5%
Fear 18.7%
Calm 17.3%
Surprised 8.3%
Happy 6.1%
Sad 4.9%
Disgusted 3.3%
Confused 0.8%

AWS Rekognition

Age 33-41
Gender Male, 96.8%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 45-51
Gender Male, 99.3%
Calm 96.7%
Surprised 6.3%
Fear 5.9%
Sad 3.3%
Angry 0.1%
Happy 0%
Confused 0%
Disgusted 0%

Feature analysis

Amazon

Person
Adult
Male
Man
Bride
Female
Woman
Gun
Shoe

Clarifai

Person
Clothing
Footwear
Human face

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 95%

AWS Rekognition

Person 93.9%

AWS Rekognition

Person 92.5%

AWS Rekognition

Person 92%

AWS Rekognition

Person 91.6%

AWS Rekognition

Person 91.2%

AWS Rekognition

Person 90.7%

AWS Rekognition

Person 89.9%

AWS Rekognition

Person 89.9%

AWS Rekognition

Person 88.2%

AWS Rekognition

Person 87.7%

AWS Rekognition

Person 83.8%

AWS Rekognition

Person 81.2%

AWS Rekognition

Person 79%

AWS Rekognition

Person 78.7%

AWS Rekognition

Adult 98%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Adult 97.4%

AWS Rekognition

Adult 91.6%

AWS Rekognition

Male 98%

AWS Rekognition

Male 97.4%

AWS Rekognition

Male 91.6%

AWS Rekognition

Man 98%

AWS Rekognition

Man 97.4%

AWS Rekognition

Man 91.6%

AWS Rekognition

Bride 97.9%

AWS Rekognition

Female 97.9%

AWS Rekognition

Woman 97.9%

AWS Rekognition

Gun 60.6%

AWS Rekognition

Shoe 55.5%

Clarifai

Person 76.2%

Clarifai

Person 69.3%

Clarifai

Person 63.1%

Clarifai

Person 54%

Clarifai

Person 53.2%

Clarifai

Person 51.5%

Clarifai

Person 50.1%

Clarifai

Person 50%

Clarifai

Person 49.3%

Clarifai

Person 48.5%

Clarifai

Person 47.8%

Clarifai

Person 38.7%

Clarifai

Person 37.8%

Clarifai

Clothing 72.8%

Clarifai

Clothing 72.7%

Clarifai

Clothing 67%

Clarifai

Clothing 62.9%

Clarifai

Clothing 57.5%

Clarifai

Clothing 54.6%

Clarifai

Clothing 54.2%

Clarifai

Clothing 53.9%

Clarifai

Clothing 53.1%

Clarifai

Clothing 52.1%

Clarifai

Clothing 45.4%

Clarifai

Clothing 42.9%

Clarifai

Footwear 43.1%

Clarifai

Footwear 37.6%

Clarifai

Footwear 36.9%

Clarifai

Human face 36.9%

Clarifai

Human face 35.2%

Clarifai

Human face 33.5%

Categories

Imagga
created on 2023-10-06

paintings art 96.9%
people portraits 1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a bandleader in uniform playing the trumpet

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of men in uniform playing instruments

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image is a black-and-white negative of a musical band, likely a military or naval ensemble due to their uniforms. The band members are dressed in formal white attire with dark hats and shoulder embellishments. They are seated in rows, each playing various instruments such as trombones, clarinets, and brass horns, with a conductor standing in front of them guiding the performance. A large tuba can be seen prominently in the background. The setting appears to be outdoors, possibly on a tiled platform or patio, with structures like glass windows and corrugated walls in the background. A railing runs horizontally across the foreground.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a negative of a photograph showing a military or naval band. The band members are dressed in white uniforms with dark hats, seated in a formation while playing various musical instruments. The instruments include clarinets, trumpets, trombones, a sousaphone, and possibly a saxophone. The band appears to be performing on a tiled surface, possibly a platform or a deck, as there is a railing visible in the foreground. The background has a building with large windows and a corrugated surface, indicating the setting could be an outdoor area adjacent to a building. The image is presented in a negative format, so the colors are inverted, with dark elements appearing light and vice versa.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image appears to show a large group of people dressed in military-style uniforms, likely a marching band or military ensemble. They are standing in rows and holding various musical instruments such as drums, trumpets, and other brass instruments. The setting appears to be outdoors, with a corrugated metal building or structure visible in the background. The image has a black and white, historical aesthetic, suggesting this is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This black and white photograph shows a military or marching band performing outdoors. The musicians are all wearing white uniforms with caps and appear to be arranged in formation behind a railing. They are holding various instruments, and there appears to be a large brass instrument (possibly a sousaphone) visible in the group. The band members are seated with music stands in front of them, suggesting this is a formal performance or rehearsal. The setting appears to be on some kind of platform or raised area, with a building visible in the background that has windows and corrugated walls. The image has a historical quality to it and appears to be from an earlier era, as indicated by the style of uniforms and the overall composition of the photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a band performing on a street, likely in the early 20th century.

In the foreground, a group of approximately 20 musicians are seated on folding chairs, arranged in rows. They are dressed in white uniforms with black belts and hats, and some wear black neckties. The instruments include trumpets, trombones, saxophones, and tubas, with a few musicians holding sheet music.

A metal railing separates the band from the street, and a brick sidewalk runs along the front of the building behind them. The building features a large window with a white frame and a door to the left, while a corrugated metal awning covers the top of the building.

In the background, a man stands at the front of the band, directing them with a baton. The overall atmosphere suggests a lively performance, possibly during a parade or festival.

The image is attributed to the President and Fellows of Harvard College (Harvard University Art Museums), with the catalog number P1970.4500.0004.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a military band performing outdoors. The band consists of approximately 20 musicians, all dressed in white uniforms adorned with black epaulets and hats. They are seated on folding chairs arranged in a semicircle, with some members standing behind them.

The musicians are playing a variety of instruments, including brass instruments such as trumpets, trombones, and French horns, as well as percussion instruments like drums and cymbals. A conductor stands at the front of the group, directing the performance.

In the background, a building with a corrugated metal roof and a wall featuring windows and doors is visible. The overall atmosphere suggests a daytime performance, possibly during a parade or other outdoor event.

A copyright notice at the bottom of the image reads "President and Fellows of Harvard College (Harvard University Art Museums)" and includes a unique identifier "P1974F000004".

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image shows a black-and-white photograph of a group of people who appear to be a band. They are standing on a tiled floor and are dressed in white uniforms, hats, and belts. They are holding musical instruments, including trumpets, trombones, and tubas. Some of them are sitting on chairs, while others are standing. Behind them is a building with glass windows and a metal roof.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white photo shows a group of musicians, possibly a band, wearing uniforms, hats, and shoes. They are playing musical instruments, including trumpets, trombones, and a tuba. Some of them are sitting on chairs, while others are standing. The band is performing on the side of the street. Behind them is a building with glass windows and a metal fence.

Google Gemini

Created by gemini-2.0-flash on 2025-05-26

Certainly! Here's a description of the image:

The image is a black and white photograph of a military band. They are dressed in white uniforms with black hats and black accents on the uniforms. Most of the band members are seated, each with sheet music in front of them. The band members are playing various instruments, including clarinets, trombones, trumpets, and a tuba. A conductor stands in front of the band, leading them.

The band is set up outdoors. Behind them is a building with a series of windows on the left and what looks like corrugated roofing on the right. In the foreground, a metal railing runs horizontally across the bottom of the image, partially obscuring the band's view.

Created by gemini-2.0-flash-lite on 2025-05-26

Here is a description of the image:

The image shows a band in black and white, likely from an older era. The band members are all wearing similar uniforms with white jackets, dark hats, and white pants. They are seated on folding chairs on a patio or similar paved area. There's a conductor in the center, facing the band, holding a baton. The band includes various brass instruments such as trumpets, trombones, and tubas, and also percussion instruments, like drums. The background includes windows and a corrugated metal wall, suggesting an exterior setting. A railing is in the foreground. The photo is labeled as from the President and Fellows of Harvard College.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a group of individuals, likely a band or musical ensemble, posing for a photograph. They are dressed in uniforms, which include white shirts, dark pants, and caps with a visor. The individuals are holding various musical instruments, such as brass instruments (trumpets, trombones), woodwind instruments (clarinets), and percussion instruments (drums). The group is arranged in a semi-circular formation, with some members seated and others standing.

The setting appears to be outdoors, with a building in the background featuring windows and a corrugated metal roof. The ground is paved with bricks or tiles, and there is a railing in the foreground, suggesting that the photograph might have been taken from an elevated position. The overall scene conveys a sense of formality and organization, typical of a band or orchestra. The photograph is in black and white, indicating it might be an older image. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black-and-white photograph showing a group of musicians in uniform, likely part of a band or orchestra, performing outdoors. The musicians are seated and standing in formation, playing various brass and percussion instruments, including tubas, trumpets, trombones, and drums. They are dressed in matching white uniforms with caps and are positioned on a paved area with a railing in the foreground, suggesting the performance might be part of a formal or ceremonial event. The background includes a building with large windows and a corrugated metal wall, indicating an urban or institutional setting. The image has a vintage quality, as suggested by the style of the clothing and the grainy texture of the photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph depicts a military or ceremonial band performing outdoors. The band members are dressed in white uniforms with dark hats and belts, giving a formal and organized appearance. They are seated on chairs arranged in rows, with music stands in front of them holding their sheet music.

The instruments include brass instruments such as trumpets, trombones, and a tuba, as well as woodwinds like clarinets or saxophones. The setting appears to be a public area, possibly a square or plaza, with a building in the background that has a corrugated metal roof and large windows. The band is positioned on a raised platform, and there is a railing in the foreground, suggesting that the photograph was taken from an elevated vantage point. The overall atmosphere is one of a formal performance, likely for a special occasion or event.

Text analysis

Amazon

College
Art
Fellows
and
(Harvard
Museums)
of
Harvard
President
University
© President and Fellows of Harvard College (Harvard University Art Museums)
P1970.4500.0004
©

Google

© President and Fellows of Harvard College (Harvard University Art Museums) P1970.4500.0004
©
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4500.0004