Human Generated Data

Title

Untitled (Westmoreland County, Pennsylvania)

Date

Summer 1937, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3391

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Westmoreland County, Pennsylvania)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Summer 1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3391

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.8
Person 99.8
Person 99.8
Footwear 99.6
Shoe 99.6
Clothing 99.6
Apparel 99.6
Leisure Activities 99.5
Musical Instrument 99.2
Guitar 99.2
Banjo 98.8
Person 98.3
Guitar 98
Person 94.6
Shoe 91.3
Musician 90.9
Music Band 59.1
Racket 59
Tennis Racket 59

Clarifai
created on 2018-03-23

instrument 100
music 99.9
people 99.9
musician 99.8
guitar 99.7
stringed instrument 99.6
group 99.1
adult 99
acoustic guitar 98.6
guitarist 98.6
man 98.1
group together 97.2
violin 96.9
singer 95
band 94.8
three 94.4
drum 94
percussion instrument 93.6
jazz 93.1
performance 91.7

Imagga
created on 2018-03-23

banjo 100
stringed instrument 100
musical instrument 100
guitar 82.8
music 78.5
musician 64.2
instrument 60.4
musical 58.4
guitarist 48.2
play 46.5
playing 44.7
rock 44.3
performer 38.9
player 37.7
electric 32.8
singer 31.7
acoustic 31.4
male 30.5
performance 29.6
man 29.6
band 29.1
person 28
song 27.3
concert 23.3
adult 23.3
string 23.1
entertainment 23
sound 22.5
style 22.2
jeans 22
roll 21.8
people 21.7
melody 19.6
guy 19.3
portrait 18.8
rocker 18.8
studio 18.2
cool 17.8
blues 17.7
perform 17.7
artist 17.3
jazz 16.7
pop 16.5
strings 15.8
attractive 15.4
stage 14.9
solo 14.8
hat 14.6
youth 14.5
black 14.4
country 14
smile 13.5
fun 13.5
happy 13.2
bass 11.9
expression 11.9
pretty 11.9
hair 11.9
casual 11.9
sing 11.8
model 10.9
pick 10.7
equipment 10.6
metal 10.5
sexy 10.4
art 10.4
singing 9.8
cowboy 9.8
crazy 9.8
dance 9.5
men 9.4
lifestyle 9.4
senior 9.4
star 9.1
teenager 9.1
holding 9.1
old 9.1
fashion 9
posing 8.9
performing 8.8
tune 8.8
microphone 8.7
standing 8.7
jump 8.6
happiness 8.6
cute 8.6
blur 8.4
dark 8.3
one 8.2
clothing 8
jamming 7.9
denim 7.9
antique 7.8
electrical 7.7
human 7.5
traditional 7.5
cheerful 7.3
group 7.2
women 7.1

Microsoft
created on 2018-03-23

outdoor 99.6
person 89.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Surprised 45.2%
Disgusted 45.2%
Calm 45.5%
Confused 46.3%
Angry 45.9%
Happy 45%
Sad 51.9%

AWS Rekognition

Age 57-77
Gender Male, 99.8%
Angry 12.4%
Disgusted 0.9%
Happy 0.4%
Sad 59.6%
Calm 8.4%
Confused 17.2%
Surprised 1.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Calm 47.7%
Angry 45.8%
Happy 45.1%
Disgusted 45.4%
Sad 49.1%
Surprised 45.1%
Confused 46.7%

AWS Rekognition

Age 35-53
Gender Male, 83.8%
Happy 0.6%
Confused 1.6%
Sad 63.9%
Angry 22.3%
Calm 7.6%
Disgusted 2.6%
Surprised 1.4%

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Shoe
Guitar
Tennis Racket
Person 99.8%
Person 99.8%
Person 98.3%
Person 94.6%
Shoe 99.6%
Shoe 91.3%
Guitar 99.2%
Guitar 98%

Categories

Captions

Microsoft
created by unknown on 2018-03-23

a group of people on a stage 75.2%
a person playing a guitar 46.8%
a close up of a person playing a guitar 43.6%

Clarifai
created by general-english-image-caption-blip on 2025-05-11

a photograph of a group of men playing instruments and banjos -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This black-and-white image depicts a group of four musicians sitting and standing outdoors in a rustic setting, possibly on the steps of a wooden porch or barn. The scene showcases their musical instruments, including a banjo, a resonator guitar, a fiddle (violin), and a cello, suggesting they are playing or preparing to play as a band. Their attire varies, ranging from overalls and shirts to a suit and tie, hinting at different styles or social contexts. The setting features grass, a wooden walkway, and a simple white building with a door and window nearby.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a group of four musicians playing different musical instruments. The first musician on the left is playing a banjo, standing near a building wall. The second musician, seated in the center, is playing a violin and is dressed in overalls, possibly indicating a casual or rural setting. The third musician, standing on a step, is playing a guitar and is dressed in a button-down shirt and pants. The fourth musician, seated to the right, is dressed formally in a suit and tie and is playing a cello. They appear to be performing on steps outside a building with a door that has wooden siding and tall grass growing around the base. The overall scene suggests a casual or informal music gathering.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-30

This black and white photograph depicts a group of men playing musical instruments together outdoors. The men appear to be playing banjo, guitar, violin, and cello. They are seated on the steps of a wooden building, surrounded by plants and greenery in the outdoor setting. The men seem to be engaged in a musical performance or jam session. The image captures a scene of informal, impromptu music-making in a rural or small-town setting.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This is a black and white photograph of a traditional string band, likely from the early to mid-20th century. The group consists of four musicians performing outside what appears to be a white wooden building. From left to right, there's a banjo player in work clothes, a violin (fiddle) player seated on steps wearing overalls, a guitarist in light-colored clothing, and a formally dressed cellist in a dark suit. The contrast between the casual work clothes of some musicians and the formal attire of the cellist is particularly striking. This image captures a moment of American folk or bluegrass music-making, showing how these musical traditions often brought together people from different walks of life.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image depicts a group of four men playing various stringed instruments in front of a building.

The man on the left is wearing a dark shirt and pants, and is playing a banjo. The man in the middle is wearing overalls and is playing a violin. The man on the right is wearing a suit and tie, and is playing a cello. The man behind them is wearing a light-colored shirt and pants, and is playing a guitar.

The background of the image is a white building with a door and window. The ground is covered in grass and dirt. The overall atmosphere of the image suggests that the men are musicians who are playing together in a casual setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

The image is a black-and-white photograph of four men playing musical instruments.

The man on the left is playing a banjo, while the man in the middle is playing a violin. The man on the right is playing a cello, and the man behind him is playing a guitar.

The men are standing outside a building with a wooden door and a window. The ground is covered with grass and dirt.

The overall atmosphere suggests that the men are enjoying themselves while playing music together.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-25

The black-and-white image features four men playing musical instruments in front of a building. Three of them are standing, while one is sitting on a wooden bench. The man on the left is holding a banjo, while the man next to him is playing a guitar. The man sitting is playing a violin, and the man on the right is playing a cello. They are all looking at something in front of them.

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image shows a black-and-white photograph of four men, possibly musicians, standing or sitting on a wooden bench. They are playing musical instruments, including a banjo, a guitar, a cello, and a violin. The man on the left is playing the banjo, while the man in the middle is playing the violin. The man on the right is playing the cello, and the man next to him is playing the guitar. They are standing in front of a white building with a door.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-22

Here's a description of the image:

The image is a black and white photograph of a group of men playing music. There are four men in total, and they are arranged as if they are performing a bluegrass or country music set.

  • Man with Banjo: On the far left stands a man holding a banjo. He is wearing overalls.
  • Man with Guitar: In the back is a man standing and playing a resonator guitar.
  • Man with Fiddle: Seated near the center is a man playing a fiddle (violin). He is wearing overalls.
  • Man with Cello: On the right side of the photo is a man seated and playing a cello. He is wearing a suit.

The lighting is natural, likely taken outdoors near a building or shed. The photograph has a vintage feel.

Created by gemini-2.0-flash on 2025-05-22

The black and white photo features four men playing musical instruments outside of a white building. A man on the left stands with one leg on the ground and one foot propped on a wooden box. He is playing a banjo. To his right, a man in overalls is sitting on the box playing a violin. Behind them, a man stands in a doorway playing a guitar. On the right, another man sits in a suit and tie while playing a cello. In front of the building is grass.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image depicts a group of four men playing musical instruments outdoors, likely in a rural setting. They are positioned near the entrance of a building, which appears to be a simple wooden structure. The men are dressed in casual, work-style clothing typical of the early to mid-20th century.

From left to right, the men are playing the following instruments:

  1. The first man is playing a banjo.
  2. The second man, seated, is playing a fiddle (violin).
  3. The third man is playing a mandolin.
  4. The fourth man is playing a cello.

The setting and instruments suggest that they might be performing traditional folk or country music, common in rural areas during that time period. The relaxed posture and informal attire of the musicians indicate a casual, possibly spontaneous, musical gathering. The photograph captures a moment of community and cultural expression through music.