Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3195

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3195

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 99.4
Human 99.4
Helmet 99.2
Clothing 99.2
Apparel 99.2
Person 98.1
Person 96.6
Face 96.4
Person 95.4
Person 95.1
Person 94.4
Head 92.3
Person 85.8
Chair 81.1
Furniture 81.1
People 71.4
Coat 65.8
Suit 62.1
Overcoat 62.1
Photography 61.2
Photo 61.2
Text 61.1
Officer 58.9
Military 58.9
Military Uniform 58.9
Sculpture 56.8
Art 56.8
Finger 56.7
Man 55.2

Clarifai
created on 2023-10-30

people 100
two 98.9
monochrome 98.7
group 98.7
child 98.7
adult 98.4
portrait 98.3
group together 97.7
three 96.6
wear 96.5
four 93.8
woman 93.3
war 93.3
facial expression 93.2
man 93.1
several 91.9
music 91.5
street 89.9
offspring 89.3
veil 89.1

Imagga
created on 2022-05-28

wheelchair 51.4
machinist 38.2
chair 36
seat 26.9
man 24.2
people 24
helmet 22.4
person 20.8
furniture 16.7
adult 16.2
male 15.6
men 15.4
vehicle 15.3
safety 13.8
street 13.8
city 13.3
child 13.2
sport 13.1
conveyance 11.6
transportation 11.6
tricycle 11.2
outdoors 11.2
protection 10.9
wheeled vehicle 10.8
road 10.8
human 10.5
urban 10.5
stretcher 9.8
portrait 9.7
black 9.6
clothing 9.3
competition 9.1
activity 9
athlete 8.8
lifestyle 8.7
ancient 8.6
industry 8.5
outdoor 8.4
help 8.4
furnishing 8.1
family 8
equipment 8
smiling 8
women 7.9
disabled 7.9
soldier 7.8
warrior 7.8
litter 7.8
army 7.8
travel 7.7
old 7.7
uniform 7.3
speed 7.3
children 7.3
game 7.1
to 7.1

Google
created on 2022-05-28

Microsoft
created on 2022-05-28

human face 98.1
person 97.4
clothing 96.1
text 95.9
smile 81.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-12
Gender Male, 99.5%
Sad 83.6%
Calm 55.3%
Surprised 6.3%
Fear 5.9%
Confused 5.7%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Female, 94.2%
Fear 93.7%
Surprised 12.3%
Sad 3.9%
Confused 2.3%
Calm 1.3%
Disgusted 1.2%
Happy 0.4%
Angry 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Helmet
Person 99.4%
Person 98.1%
Person 96.6%
Person 95.4%
Person 95.1%
Person 94.4%
Person 85.8%
Helmet 99.2%

Categories

Imagga

people portraits 68.5%
paintings art 30.6%

Captions

Microsoft
created by unknown on 2022-05-28

a group of people in uniform 85.9%
a man and a woman in a uniform 74.6%
a person in a uniform 74.5%

Clarifai
created by general-english-image-caption-blip on 2025-05-12

a photograph of a man in a suit and tie is looking at a statue -100%

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here's a description of the image:

Overall Scene: The black and white photograph depicts a scene that is likely from the mid-20th century, given the style and the subjects in the image. It's an outdoor shot with a slight grainy quality.

Main Subjects:

  • Puppet: The central element is a puppet with a black face, white lips, and a tattered hat. The puppet is dressed in a striped shirt. It appears to be a figure used for entertainment or possibly minstrel shows.
  • Man: Beside the puppet sits a Black man who seems to be either the puppeteer or connected to the puppet show. His expression suggests a slight surprise.
  • Boy: A young white boy stands in the foreground, gazing toward the puppet. His expression is thoughtful.

Background:

  • The background includes a brick wall, other individuals (men) standing around, and what looks like a simple wooden table.

Atmosphere/Context:

  • The overall tone of the image is somber.
  • The presence of the puppet, with its racialized appearance, evokes historical context around minstrel shows and racial stereotypes.
  • The scene likely captures a moment of observation or interaction, with the boy perhaps witnessing a performance or show.

Created by gemini-2.0-flash on 2025-04-30

The black and white photograph shows a ventriloquist with his doll entertaining a crowd. A small, blond-haired boy is looking attentively at the doll. An African-American man is behind the doll. He is dressed in a jacket. The doll is painted black and is wearing a hat and a striped shirt. It is sitting on a wooden table next to a stack of papers and a cardboard box. The background is blurry, but it appears to be a brick wall and several people standing around watching the performance.