Human Generated Data

Title

Untitled (Kôbe, Japan)

Date

March 14, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3270

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Kôbe, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 14, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3270

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clarifai
created on 2018-05-10

people 99.8
group together 99
adult 98.3
many 98.2
group 97.6
woman 96.5
music 94.1
man 93.5
wear 92.1
outfit 90.2
school 87.7
recreation 87.2
child 86.6
musician 85.2
education 84.9
uniform 82.2
vehicle 81.6
crowd 81.4
spectator 80.4
several 80.2

Imagga
created on 2023-10-06

brass 100
wind instrument 100
trombone 78.6
musical instrument 72.5
people 26.2
man 22.8
bugle 19.9
men 19.7
person 16.7
male 16.3
cornet 16.1
adult 14.9
music 14.5
military 14.5
black 13.2
silhouette 11.6
soldier 10.7
army 10.7
war 10.6
business 10.3
baritone 10.2
posing 9.8
group 9.7
together 9.6
city 9.1
uniform 9.1
musician 9.1
outdoors 8.9
bass 8.9
to 8.8
concert 8.7
outdoor 8.4
dark 8.3
holding 8.2
protection 8.2
team 8.1
lifestyle 7.9
businessman 7.9
day 7.8
couple 7.8
weapon 7.8
band 7.8
travel 7.7
musical 7.7
sport 7.6
human 7.5
device 7.2
portrait 7.1
women 7.1
night 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 96.7
outdoor 93
group 92.8
posing 59.2
people 56.6
net 27.1
team 27

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Male, 86.9%
Calm 62.2%
Sad 17.9%
Disgusted 9.9%
Surprised 6.9%
Fear 6.4%
Angry 5.9%
Confused 2.2%
Happy 1.3%

AWS Rekognition

Age 23-31
Gender Male, 82.7%
Calm 98.6%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.2%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Female, 85.5%
Sad 100%
Surprised 6.5%
Fear 6.1%
Disgusted 2.5%
Calm 1.8%
Angry 0.7%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 19-27
Gender Female, 86.5%
Calm 88.7%
Surprised 8.1%
Fear 6.3%
Sad 3%
Angry 2.6%
Happy 0.8%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 27-37
Gender Female, 53.6%
Sad 99.5%
Calm 22.6%
Surprised 8.4%
Fear 6.7%
Angry 3.7%
Confused 1.7%
Disgusted 1.1%
Happy 0.9%

AWS Rekognition

Age 18-26
Gender Male, 77.5%
Sad 99.7%
Fear 12.6%
Surprised 7.1%
Calm 6.5%
Happy 5.2%
Angry 2.9%
Disgusted 2.8%
Confused 0.5%

AWS Rekognition

Age 33-41
Gender Male, 96.7%
Calm 91.1%
Surprised 6.6%
Fear 6.2%
Sad 3.2%
Confused 2.2%
Disgusted 1.3%
Angry 1.2%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Female, 77.4%
Calm 66%
Surprised 11.2%
Angry 7.8%
Fear 6.4%
Sad 6.3%
Disgusted 5.1%
Happy 2.8%
Confused 1.6%

AWS Rekognition

Age 29-39
Gender Female, 59.7%
Sad 99.9%
Calm 12.4%
Surprised 7.4%
Fear 6.4%
Angry 1.5%
Disgusted 1.1%
Confused 1.1%
Happy 0.6%

AWS Rekognition

Age 30-40
Gender Male, 92.2%
Calm 85.3%
Surprised 7.7%
Fear 6.4%
Sad 3.3%
Disgusted 3.2%
Angry 3%
Happy 0.8%
Confused 0.8%

AWS Rekognition

Age 12-20
Gender Female, 97.5%
Calm 89.6%
Surprised 6.5%
Fear 6%
Angry 5.7%
Sad 2.5%
Disgusted 1.5%
Confused 1%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Male, 86.9%
Sad 41.2%
Calm 25.4%
Surprised 19.2%
Angry 13.6%
Fear 8.8%
Disgusted 6.5%
Confused 5.1%
Happy 4%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Calm 54.3%
Angry 31%
Fear 7%
Surprised 6.8%
Sad 3.8%
Disgusted 3%
Happy 1.8%
Confused 1.7%

AWS Rekognition

Age 30-40
Gender Female, 96.7%
Calm 82.2%
Surprised 11.4%
Fear 6.3%
Disgusted 4.2%
Sad 3%
Angry 1.5%
Happy 0.6%
Confused 0.3%

AWS Rekognition

Age 26-36
Gender Female, 95.3%
Sad 99.8%
Calm 12.8%
Surprised 11.1%
Fear 6.8%
Angry 5.6%
Happy 1.1%
Disgusted 0.4%
Confused 0.4%

Feature analysis

Amazon

Person
Adult
Male
Man

Clarifai

Clothing
Person
Musical instrument
Human face

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.9%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 94.1%

AWS Rekognition

Person 93.9%

AWS Rekognition

Person 93.5%

AWS Rekognition

Person 93.3%

AWS Rekognition

Person 93%

AWS Rekognition

Person 92.7%

AWS Rekognition

Person 92.2%

AWS Rekognition

Person 90.8%

AWS Rekognition

Person 90.6%

AWS Rekognition

Person 87.7%

AWS Rekognition

Person 85.3%

AWS Rekognition

Person 81.9%

AWS Rekognition

Person 78.4%

AWS Rekognition

Person 72.3%

AWS Rekognition

Person 69.1%

AWS Rekognition

Adult 98.1%

AWS Rekognition

Adult 97.9%

AWS Rekognition

Adult 97.8%

AWS Rekognition

Male 98.1%

AWS Rekognition

Male 97.9%

AWS Rekognition

Male 97.8%

AWS Rekognition

Man 98.1%

AWS Rekognition

Man 97.9%

AWS Rekognition

Man 97.8%

Clarifai

Clothing 72.9%

Clarifai

Clothing 72.2%

Clarifai

Clothing 69.7%

Clarifai

Clothing 67.9%

Clarifai

Clothing 66.9%

Clarifai

Clothing 53.6%

Clarifai

Clothing 46.6%

Clarifai

Person 71.5%

Clarifai

Person 69.4%

Clarifai

Person 65%

Clarifai

Person 60.2%

Clarifai

Person 58.3%

Clarifai

Person 56.7%

Clarifai

Person 56.5%

Clarifai

Person 54.6%

Clarifai

Person 52.3%

Clarifai

Person 47.3%

Clarifai

Person 47%

Clarifai

Person 44.7%

Clarifai

Person 38.8%

Clarifai

Person 36.2%

Clarifai

Person 34.3%

Clarifai

Person 33%

Clarifai

Musical instrument 64.5%

Clarifai

Musical instrument 60%

Clarifai

Musical instrument 58.6%

Clarifai

Musical instrument 56.3%

Clarifai

Musical instrument 55.8%

Clarifai

Musical instrument 54.5%

Clarifai

Musical instrument 53.7%

Clarifai

Musical instrument 50.1%

Clarifai

Musical instrument 49.2%

Clarifai

Musical instrument 44.7%

Clarifai

Musical instrument 43.9%

Clarifai

Musical instrument 42.6%

Clarifai

Musical instrument 41.5%

Clarifai

Musical instrument 40.4%

Clarifai

Musical instrument 39.8%

Clarifai

Musical instrument 39.3%

Clarifai

Musical instrument 38.9%

Clarifai

Musical instrument 38.8%

Clarifai

Musical instrument 37.2%

Clarifai

Musical instrument 37%

Clarifai

Musical instrument 35.8%

Clarifai

Musical instrument 35.3%

Clarifai

Human face 37.9%

Clarifai

Human face 34.5%

Clarifai

Human face 34.4%

Clarifai

Human face 33.9%

Categories

Imagga
created on 2023-10-06

paintings art 53.4%
interior objects 11.6%
pets animals 10.7%
people portraits 10.7%
food drinks 4.2%
cars vehicles 3.7%
streetview architecture 2.1%
text visuals 1.8%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a band playing on a boat

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a bandleaders in uniform playing instruments

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This black-and-white photograph features a uniformed brass band performing outdoors. The band members are seated in rows with their instruments, including trumpets, trombones, clarinets, drums, and a sousaphone. The conductor, wearing a matching uniform with a belt, stands in front, directing the ensemble. The band members are dressed in formal uniforms with peaked caps, epaulettes, and decorative cords on their shoulders. The setting appears to be a public space with a fenced-off area in front and a corrugated tin building in the background. The scene has a vintage feel, likely from the mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a band of musicians in military or naval uniforms performing outdoors. The musicians are playing various instruments including trombones, clarinets, saxophones, a sousaphone, drum sets, and other band instruments. The uniforms feature light-colored hats with dark bands, dark jackets with light details such as shoulder cords, and light belts. The band members are seated and standing in rows, with a conductor standing in front of the group, leading the performance. The setting appears to be a paved area with metal railings and a corrugated metal wall or building in the background. The image is in black and white, suggesting it may be from several decades ago.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a large group of musicians wearing uniforms and playing various instruments, including trumpets, trombones, and drums. They appear to be part of a marching band or military band, standing in formation outdoors in front of a building with a corrugated metal roof. The scene has a historical, black-and-white aesthetic, suggesting this is an older photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white historical photograph of what appears to be a military or marching band. The musicians are wearing formal uniforms with white caps and are seated with their instruments, which include brass instruments like trombones and what appears to be a sousaphone. The band members are arranged in rows and are positioned in what looks like an outdoor setting with a fence or wall visible in the background. The image has the formal, structured composition typical of military band photographs from the early-to-mid 20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a military band performing on a brick platform.

The band consists of approximately twenty musicians, all dressed in dark uniforms with white belts and caps. They are arranged in rows, with the front row holding instruments such as trumpets, trombones, and clarinets. The second row features a sousaphone, drums, and cymbals. A conductor stands at the front, directing the band with a baton.

In the background, a wooden fence and a corrugated metal roof are visible, suggesting an outdoor setting. The overall atmosphere of the image is one of discipline and camaraderie, as the band members work together to create music. The image appears to be a vintage photograph, possibly taken during a military ceremony or event.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a band performing outdoors. The band consists of approximately 25 musicians, all dressed in dark uniforms adorned with white accents and hats. They are seated on folding chairs arranged in rows, with some members standing behind them. The musicians are playing a variety of instruments, including brass instruments such as trumpets, trombones, and tubas, as well as woodwind instruments like clarinets and saxophones.

In the foreground, a metal railing separates the band from the viewer, while in the background, a corrugated metal wall or fence is visible, accompanied by a building featuring large windows on the left side of the image. The overall atmosphere suggests that the band is performing at an outdoor event or concert.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white photograph of a band, possibly a military band, performing on a stage. The band members are dressed in uniforms and hats, and they are playing various musical instruments, including trumpets, trombones, and tubas. The band members are seated on chairs and standing in front of a white railing. Behind the band, there is a wooden fence, and on the left side, there is a building with glass windows.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white photo of a band, probably from the past. The band members are wearing uniforms and hats. They are holding musical instruments, including trumpets, trombones, clarinets, and drums. Some of them are sitting on chairs, while others are standing. The band is performing in front of a metal sheet wall with a window. The image has a white border, indicating that it is probably a vintage photo.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression:

The image is a black and white photograph of a marching band in formation. The band is likely performing outdoors, possibly on a platform or deck. The photograph has a slightly vintage feel.

Specific Details:

  • Subjects: The photograph depicts a marching band, comprised of a conductor, a percussion section, and several brass and woodwind instruments.
  • Clothing: The musicians are dressed in matching uniforms, likely navy blue or black, with white hats. The conductor has a distinct uniform, set apart from the rest of the band.
  • Setting: They are performing on a deck or a platform. The background is a metal building with horizontal panels. A large dark-colored window is seen at the left.
  • Activity: The musicians are clearly playing their instruments. The conductor is directing the band.
  • Composition: The photograph is a medium shot, with the band occupying most of the frame. The musicians are positioned in rows.

Overall, this is a well-composed photograph capturing a marching band in action.

Created by gemini-2.0-flash on 2025-05-04

Here is a description of the image:

The black-and-white image features a marching band, seemingly a military band or similar group, in a performance setting. All band members are wearing uniforms consisting of dark jackets, light-colored pants, and matching hats.

The band is spread out across the frame, with some members standing and others seated on folding chairs. There's a conductor in the front, facing the band, leading with a baton. The band is equipped with a variety of instruments, including trombones, clarinets, trumpets, a tuba, and drums.

The background consists of a corrugated metal wall, and to the left, there is a building with large windows that reflect the outside environment. The band seems to be performing on a platform, separated from the viewer by a railing.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a military band performing outdoors. The band members are dressed in uniforms, which include dark jackets and hats with white bands. They are seated and standing in a semi-circular arrangement, with various musical instruments visible.

The instruments include:

  • Brass instruments such as trumpets, trombones, and a sousaphone.
  • Woodwind instruments like clarinets and saxophones.
  • Percussion instruments, including snare drums, bass drums, and cymbals.

The setting appears to be an outdoor area with a corrugated metal roof and a wooden fence in the background. The band members are positioned on a paved surface, and there are some folding chairs in front of them, suggesting an audience area. The overall scene suggests a formal or ceremonial performance, likely associated with a military event or parade.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph of a military band performing. The band members are dressed in formal military-style uniforms, including hats and jackets, indicating a disciplined and ceremonial setting. They are seated or standing in formation, playing various brass and woodwind instruments such as trumpets, trombones, saxophones, and tubas. The conductor, positioned in the center, is leading the ensemble with a baton. The setting appears to be outdoors, possibly on a deck or open platform, with a corrugated metal wall in the background and a railing in the foreground. The overall atmosphere suggests a formal or ceremonial event.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph of a brass band seated and arranged in rows, with a conductor standing in front. The band members are dressed in uniform, which includes hats and dark outfits with light-colored belts. They are holding various brass instruments, including trombones, trumpets, and a tuba. The setting appears to be outdoors, with a railing in the foreground and a building with a corrugated metal wall in the background. The conductor is gesturing with their right hand, likely directing the band. The overall scene suggests a formal performance or rehearsal.