Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3383

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3383

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 100
Formal Wear 99.8
Sun Hat 99.7
Jacket 98.5
Face 96.9
Head 96.9
People 95.5
Photography 94.7
Portrait 94.7
Cap 84.2
Accessories 72.4
Shirt 67
Pants 63
Overcoat 57.5
Brick 56.5
Blazer 56.5
City 55.9
Crowd 55.3

Clarifai
created on 2018-05-10

people 99.8
group together 99
group 98.5
man 98.3
lid 98.2
veil 97.3
adult 96.9
many 94.6
administration 94.4
fedora 94
leader 91.9
several 89.7
four 88.5
wear 87.7
woman 86.5
outfit 86.3
military 84.2
vehicle 83.4
three 81.1
portrait 78.4

Imagga
created on 2023-10-06

man 52.4
male 51.8
hat 45
bow tie 35.2
person 34.5
people 31.8
portrait 29.1
adult 28.5
necktie 28.4
senior 25.3
happy 25.1
men 21.5
clothing 19.7
handsome 19.6
worker 19.2
construction 18.8
smile 18.5
engineer 18.4
couple 18.3
attractive 18.2
smiling 18.1
professional 17.8
face 17.7
job 17.7
business 17.6
old 17.4
occupation 17.4
architect 17.4
looking 16.8
elderly 16.3
industry 16.2
manager 15.8
work 15.7
two 15.2
grandfather 15.2
hand 15.2
suit 14.9
outdoors 14.9
builder 14.7
garment 14.2
together 14
success 13.7
helmet 13.6
happiness 13.3
businessman 13.2
mature 13
guy 13
love 12.6
team 12.5
engineering 12.4
site 12.2
shirt 12.1
black 12
building 11.9
one 11.9
designer 11.6
foreman 11.5
look 11.4
hair 11.1
lifestyle 10.8
serious 10.5
standing 10.4
style 10.4
teamwork 10.2
casual 10.2
architecture 10.1
safety 10.1
model 10.1
hardhat 9.8
contractor 9.7
expression 9.4
cowboy hat 9.3
cowboy 9
uniform 8.9
age 8.6
outside 8.6
plan 8.5
meeting 8.5
smart 8.5
headdress 8.3
20s 8.2
spectator 8.1
family 8
posing 8
boy 7.8
executive 7.8
older 7.8
western 7.7
corporate 7.7
diversity 7.7
wearing 7.6
secretary 7.6
tie 7.6
office 7.5
holding 7.4
cheerful 7.3
pose 7.2
employee 7.2
women 7.1
working 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.1
tennis 99.1
outdoor 98.6
posing 79.5
old 78.6
crowd 1.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Confused 82.4%
Angry 16.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.9%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Calm 68.4%
Angry 15.5%
Surprised 7.3%
Fear 6.3%
Confused 4.3%
Happy 3.7%
Sad 3.1%
Disgusted 2.6%

AWS Rekognition

Age 6-14
Gender Male, 100%
Sad 100%
Angry 6.6%
Surprised 6.4%
Fear 6.3%
Calm 4.8%
Confused 1.6%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Surprised 97.1%
Calm 26.6%
Fear 5.9%
Sad 2.2%
Confused 0.4%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Angry 57.8%
Confused 22.7%
Calm 10%
Surprised 7.8%
Fear 6.3%
Sad 3.9%
Disgusted 0.7%
Happy 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 96.4%
Surprised 6.5%
Fear 5.9%
Sad 2.9%
Angry 0.3%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 62.3%
Calm 92.6%
Surprised 6.5%
Fear 5.9%
Sad 3.1%
Happy 2.7%
Confused 0.8%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Male, 70.9%
Calm 82.8%
Surprised 7.4%
Fear 7.2%
Sad 3.5%
Confused 2.8%
Disgusted 2.1%
Happy 1.7%
Angry 1.7%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Hat
Suit
Tie
Jeans

Clarifai

Human face
Man
Clothing
Fedora
Human arm
Human eye
Human nose

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 98.7%

AWS Rekognition

Adult 98.6%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 97.6%

AWS Rekognition

Adult 97.4%

AWS Rekognition

Adult 96.5%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 98.7%

AWS Rekognition

Male 98.6%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 97.6%

AWS Rekognition

Male 97.4%

AWS Rekognition

Male 96.5%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 99.1%

AWS Rekognition

Man 98.7%

AWS Rekognition

Man 98.6%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 97.6%

AWS Rekognition

Man 97.4%

AWS Rekognition

Man 96.5%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 62.7%

AWS Rekognition

Hat 96.1%

AWS Rekognition

Hat 82.7%

AWS Rekognition

Hat 80.9%

AWS Rekognition

Hat 63%

AWS Rekognition

Hat 57.1%

AWS Rekognition

Suit 85.5%

AWS Rekognition

Suit 62.3%

AWS Rekognition

Tie 72.4%

AWS Rekognition

Jeans 63%

Clarifai

Human face 95%

Clarifai

Human face 85.3%

Clarifai

Human face 83.8%

Clarifai

Human face 83.6%

Clarifai

Human face 81.7%

Clarifai

Human face 78.3%

Clarifai

Human face 77.2%

Clarifai

Human face 76.3%

Clarifai

Human face 73.1%

Clarifai

Human face 59.8%

Clarifai

Man 94.2%

Clarifai

Man 93%

Clarifai

Man 91.9%

Clarifai

Man 90%

Clarifai

Man 89.6%

Clarifai

Man 84.4%

Clarifai

Man 81%

Clarifai

Man 70.5%

Clarifai

Man 67.2%

Clarifai

Man 66%

Clarifai

Man 62.1%

Clarifai

Man 53.2%

Clarifai

Man 41%

Clarifai

Clothing 59.9%

Clarifai

Clothing 42%

Clarifai

Clothing 41.5%

Clarifai

Clothing 38%

Clarifai

Clothing 33.7%

Clarifai

Fedora 47.8%

Clarifai

Fedora 42.4%

Clarifai

Human arm 36.8%

Clarifai

Human eye 36.3%

Clarifai

Human eye 34.4%

Clarifai

Human nose 35.3%

Clarifai

Human nose 33.2%

Categories

Imagga
created on 2023-10-06

people portraits 72.9%
paintings art 26%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a group of men in suits and hats standing in a crowd

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of men in hats and suits standing in front of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts a group of men gathered outdoors, with a brick building in the background. Most of the men are wearing suits, ties, or collared shirts, and several are donned in hats, ranging from fedoras to flat caps. One man on the right is wearing a striped sweater and holding a cigarette. The setting appears to be urban, with walls featuring advertisements, including a noticeable "U-TOTE-M" sign. The mood suggests a casual or social gathering, possibly during the mid-20th century given the attire.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts a group of men gathered in an outdoor setting, likely dating from the mid-20th century. The men are wearing clothing typical of the era, including suits, ties, and hats. One man is in a suit with a light-colored jacket and a patterned tie, while another wears a striped shirt with a jacket. In the background, there is a brick wall with various signs, and a building with signage that reads "U-TOTE-EM." The atmosphere seems informal, and the gathering appears to be taking place in an urban or industrial area.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph depicting a group of men standing outside a building. The men are wearing hats, suits, and ties, suggesting this is likely a historical scene from the early to mid-20th century. The expressions on the men's faces appear serious, and they seem to be gathered for some purpose, though the specific context is not clear from the image alone. There is a young boy visible in the foreground, also wearing a hat. The overall scene conveys a sense of seriousness and formality.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from the early-to-mid 20th century. It shows a group of people standing together near a brick building. The subjects are wearing clothing typical of the era - several men are wearing fedora-style hats, suits, and ties. There's also a young boy wearing a flat cap in the foreground. The photograph has a documentary or journalistic quality to it, capturing what seems to be an everyday street scene. The composition is fairly tight on the group, and the brick wall behind them provides a stark backdrop. The image quality and style is characteristic of photography from this historical period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

The image is a black-and-white photograph of a group of men and boys standing in front of a brick building. The men are dressed in suits, jackets, and hats, while the boys wear caps. The background features a brick wall with a window and a sign that reads "U-TOIT-SHOP." The overall atmosphere suggests a gathering or event, possibly during the 1930s or 1940s, given the clothing styles and the presence of a vintage sign.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image is a black-and-white photograph of a group of men and a boy standing in front of a brick building.

The group consists of approximately 10 individuals, with the majority wearing hats. The man in the center is dressed in a light-colored suit, white shirt, and dark tie with diagonal stripes. He is wearing a light-colored fedora-style hat with a dark band around it.

To his left is a man in a dark suit and white shirt, wearing a light-colored hat with a dark band. To his right is a man in a light-colored jacket, white shirt, and dark pants, wearing a light-colored hat with a dark band.

In the foreground, a young boy is visible, wearing a light-colored cap and a dark jacket. The background of the image features a brick building with a sign that reads "U-TOTE-EM" in white letters.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

The image is in black and white. It features a group of men, including a boy, standing close to each other, probably in a queue. They are all wearing hats, and some are wearing ties. They are standing in front of a brick wall with a poster on it. The man in the middle is wearing a suit and tie. The boy in front is wearing a cap.

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image is a black-and-white photograph depicting a group of men and boys standing in front of a brick building. The men are dressed in suits and ties, with hats, and appear to be engaged in a conversation. The boys are wearing hats and appear to be listening to the men. The building has a sign that reads "U-Vote-By" on the left side, and there is a window on the right side of the building.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-28

Here's a description of the image:

Overall Impression: The image is a black and white photograph, likely from the early to mid-20th century, given the clothing and style. It shows a group of men, possibly a crowd of people, standing in front of a brick building. The focus of the photograph appears to be on their faces, and their expressions range from serious to stoic.

Key Features and Details:

  • Men: The image features a diverse group of men, wearing a mix of suits, hats (including fedoras and a newsboy cap), and casual clothing. Their posture and expressions suggest a sense of caution or formality.
  • Brick Building: The backdrop is a weathered brick building. This suggests an urban or industrial setting. There is a building with what appears to be "U-Tote-Em" text on the left side, and on the left there is a sign.
  • Atmosphere: The photograph has a somber or serious tone. The lighting is even, casting the faces in a clear light.

Possible Context:

The image could depict a variety of situations, such as:

  • A gathering of workers or members of a community during the Great Depression era.
  • A protest, rally, or other type of public event.
  • A group of individuals in a moment of public activity.

If you have more context, I could offer a more specific description.

Created by gemini-2.0-flash on 2025-04-28

Here is a description of the image:

This is a black and white medium shot of a crowd of men and boys. Most appear to be white, but a couple are Black. Most of the people are dressed in simple, working class clothes. Many are wearing hats. Some have more formal dress, such as a suit jacket or a tie. Some of the faces are serious, and some are looking directly at the camera. The crowd is gathered in front of a brick building. There are signs for businesses on the sides of the buildings.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-23

The image is a black-and-white photograph that appears to be from the early to mid-20th century. It depicts a group of men and boys gathered outdoors in front of a brick building. The men are dressed in a variety of clothing styles typical of the era, including suits, jackets, and hats. Some are wearing fedoras, while others have on caps or no headwear at all.

The central figure is an older man wearing a light-colored fedora and a suit with a tie, standing prominently in the foreground. He has a serious expression on his face. Surrounding him are other men and a young boy, who is wearing a cap and looking directly at the camera. The group appears to be listening intently to something or someone, possibly the photographer or an unseen speaker.

The background includes a brick building with a sign that is partially visible but not entirely legible. The overall mood of the photograph suggests a formal or significant gathering, possibly related to work, a community event, or a public announcement. The expressions on the faces of the individuals range from serious to attentive, reflecting the gravity of the occasion.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This image is a black-and-white photograph depicting a group of people, primarily men, gathered in front of a brick building. The individuals appear to be dressed in attire typical of the mid-20th century, including suits, hats, and ties. Some are in formal wear, while others are in more casual attire like striped shirts and pants. The setting appears to be an urban area, and the crowd seems to be standing closely together, possibly in a public or semi-public space. The expression of the people is serious, and the overall mood of the photograph conveys a sense of solemnity or contemplation. The brick building in the background has a sign that is partially visible, although the text is not clear. The photograph has a grainy texture, suggesting it is an older image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph shows a group of men, including a young boy, standing outdoors in front of a brick building. The men are dressed in a mix of suits, ties, and casual clothing, with many wearing hats. The setting appears to be from an earlier era, possibly the mid-20th century, given the style of clothing and the black-and-white format of the image. The expressions on the men's faces range from serious to neutral, suggesting a moment of significance or concern. The background includes a sign on the building that is partially visible, indicating a business or establishment. The image captures a candid moment in a public space, possibly during a gathering or event.

Text analysis

Amazon

U-TOTE-qM