Human Generated Data

Title

Demonstration

Date

1933

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Richard Norton Memorial Fund, 2011.12

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Human Generated Data

Title

Demonstration

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Richard Norton Memorial Fund, 2011.12

Copyright

© Estate of Ben Shahn / Artists Rights Society (ARS), New York

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 93.6
Art 89.4
Crowd 73.1
Mural 70.6
Face 68.3
Head 66.8
Advertisement 63.3
Collage 63.3
Poster 63.3

Clarifai
created on 2018-03-23

people 99.7
group 99.2
adult 99.2
portrait 98.7
man 98.6
woman 95.4
art 94.8
illustration 93.4
facial expression 93.1
veil 92.8
painting 92.2
leader 91.7
print 91.7
religion 91.5
wear 89.6
gang 86
business 85.1
many 84.9
offense 83.1
group together 82.4

Imagga
created on 2018-03-23

mosaic 33.1
graffito 32.2
art 27
decoration 26.2
jigsaw puzzle 24.6
comic book 24.4
religion 23.3
church 23.1
puzzle 19.4
money 18.7
vintage 17.3
currency 17
book jacket 16.4
covering 16.1
old 16
postmark 15.8
stamp 15.5
mail 15.3
transducer 15.1
portrait 14.9
masterpiece 14.8
letter 14.7
game 14.2
man 14.1
black 14
golden 13.7
jacket 13.7
museum 13.7
envelope 13.6
dollar 13
culture 12.8
face 12.8
postage 12.8
postal 12.7
bible 12.7
icon 12.7
painter 12.5
god 12.4
cash 11.9
finance 11.8
dollars 11.6
spirituality 11.5
colorful 11.5
painted 11.4
electrical device 11.4
male 11.3
close 10.8
financial 10.7
travel 10.5
bill 10.4
one 10.4
prayer rug 10.4
banking 10.1
people 10
global 10
shows 9.8
printed 9.8
orthodox 9.8
print media 9.8
wrapping 9.7
artist 9.6
saint 9.6
faith 9.6
post 9.5
antique 9.5
closeup 9.4
symbol 9.4
religious 9.4
mask 9.1
painting 9
bank 8.9
prophet 8.9
floor cover 8.7
holy 8.7
person 8.6
unique 8.5
business 8.5
adult 8.4
rug 8.3
retro 8.2
wealth 8.1
office 8
byzantine 7.9
philately 7.9
circa 7.9
known 7.9
stamps 7.9
device 7.8
paintings 7.8
ancient 7.8
banknote 7.8
wall 7.7
notes 7.7
card 7.6
exchange 7.6
fine 7.6
paint 7.2
detail 7.2
sexy 7.2

Google
created on 2018-03-23

art 90.2
mural 82.2
painting 73.2
artwork 61.9
visual arts 55.7

Microsoft
created on 2018-03-23

text 94.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 26-43
Gender Female, 77%
Confused 5.1%
Happy 7.3%
Disgusted 1.6%
Angry 3.5%
Surprised 9.1%
Sad 4.8%
Calm 68.5%

AWS Rekognition

Age 26-43
Gender Female, 50.6%
Sad 4.3%
Disgusted 0.3%
Confused 7.4%
Angry 2%
Happy 1.6%
Surprised 1.3%
Calm 83.2%

AWS Rekognition

Age 35-53
Gender Male, 71.6%
Angry 2.7%
Happy 68.9%
Surprised 5.3%
Sad 3.6%
Disgusted 1.8%
Calm 4.4%
Confused 13.2%

AWS Rekognition

Age 26-43
Gender Male, 84.8%
Disgusted 7.4%
Angry 10.9%
Happy 36.6%
Calm 14%
Surprised 13.5%
Sad 3.3%
Confused 14.4%

AWS Rekognition

Age 48-68
Gender Male, 99.3%
Angry 7.2%
Calm 63.5%
Confused 16.2%
Surprised 2.1%
Disgusted 3.1%
Happy 1.3%
Sad 6.6%

AWS Rekognition

Age 45-65
Gender Female, 85%
Sad 6%
Angry 3.7%
Happy 16.2%
Calm 58.1%
Disgusted 4.2%
Confused 6.4%
Surprised 5.5%

AWS Rekognition

Age 26-43
Gender Male, 89.4%
Confused 30.1%
Sad 11.8%
Calm 13.1%
Disgusted 15.3%
Angry 17.3%
Happy 2.9%
Surprised 9.5%

AWS Rekognition

Age 35-52
Gender Female, 83%
Happy 19.7%
Sad 40%
Angry 13.2%
Surprised 5.3%
Disgusted 4.9%
Calm 9.5%
Confused 7.3%

AWS Rekognition

Age 57-77
Gender Male, 99%
Angry 2.9%
Calm 59.2%
Confused 7.9%
Happy 19.2%
Disgusted 1%
Surprised 4.9%
Sad 4.8%

AWS Rekognition

Age 26-43
Gender Male, 97.9%
Disgusted 0.1%
Happy 0.8%
Surprised 0.4%
Sad 2.2%
Calm 94.2%
Angry 0.7%
Confused 1.5%

AWS Rekognition

Age 26-43
Gender Female, 61.6%
Disgusted 3%
Happy 1.4%
Calm 81.6%
Sad 3%
Surprised 5%
Angry 2%
Confused 4%

AWS Rekognition

Age 35-52
Gender Female, 81.2%
Angry 8.5%
Sad 7.2%
Confused 2.8%
Surprised 4.5%
Happy 2%
Disgusted 66.8%
Calm 8.2%

AWS Rekognition

Age 26-43
Gender Male, 76%
Angry 6.2%
Happy 9.7%
Calm 20.4%
Surprised 48.4%
Sad 2.3%
Disgusted 4.5%
Confused 8.5%

AWS Rekognition

Age 26-43
Gender Female, 74.5%
Sad 17.5%
Disgusted 23.1%
Happy 3.2%
Angry 23.1%
Confused 5.9%
Calm 23.6%
Surprised 3.6%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 70
Gender Male

Microsoft Cognitive Services

Age 79
Gender Male

Microsoft Cognitive Services

Age 60
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Human face
Clothing
Man
Human arm
Human nose
Human eye
Human hand

AWS Rekognition

Person 93.6%

AWS Rekognition

Person 92.7%

AWS Rekognition

Person 88.3%

AWS Rekognition

Person 88.2%

AWS Rekognition

Person 83%

AWS Rekognition

Person 78.3%

AWS Rekognition

Person 78.2%

AWS Rekognition

Person 78%

AWS Rekognition

Person 70.6%

AWS Rekognition

Person 67.7%

AWS Rekognition

Person 63.9%

AWS Rekognition

Person 43.3%

AWS Rekognition

Painting 67.3%

Clarifai

Human face 94.8%

Clarifai

Human face 93%

Clarifai

Human face 91.5%

Clarifai

Human face 90.9%

Clarifai

Human face 90.8%

Clarifai

Human face 90.7%

Clarifai

Human face 88.8%

Clarifai

Human face 87.1%

Clarifai

Human face 86.9%

Clarifai

Human face 84.5%

Clarifai

Human face 81.7%

Clarifai

Human face 81.1%

Clarifai

Human face 81%

Clarifai

Human face 68.7%

Clarifai

Human face 68.5%

Clarifai

Human face 44.4%

Clarifai

Human face 42.7%

Clarifai

Human face 34.6%

Clarifai

Clothing 81.7%

Clarifai

Clothing 75.5%

Clarifai

Clothing 75%

Clarifai

Clothing 67.2%

Clarifai

Clothing 59.7%

Clarifai

Clothing 58.5%

Clarifai

Clothing 56.2%

Clarifai

Clothing 47.3%

Clarifai

Clothing 46.3%

Clarifai

Clothing 44.7%

Clarifai

Clothing 44.2%

Clarifai

Clothing 40.2%

Clarifai

Clothing 40.2%

Clarifai

Clothing 39%

Clarifai

Clothing 37.7%

Clarifai

Clothing 35%

Clarifai

Man 71.4%

Clarifai

Man 70.8%

Clarifai

Man 60.2%

Clarifai

Man 56.3%

Clarifai

Man 45.4%

Clarifai

Man 39.8%

Clarifai

Man 38.7%

Clarifai

Man 38.6%

Clarifai

Man 38.5%

Clarifai

Man 34.8%

Clarifai

Man 33.1%

Clarifai

Human arm 43.8%

Clarifai

Human arm 42.5%

Clarifai

Human nose 43.7%

Clarifai

Human nose 38.4%

Clarifai

Human nose 37.8%

Clarifai

Human nose 33.8%

Clarifai

Human eye 37.6%

Clarifai

Human eye 36.5%

Clarifai

Human eye 34.8%

Clarifai

Human eye 34.5%

Clarifai

Human eye 33.9%

Clarifai

Human hand 36.5%

Clarifai

Human hand 35.5%

Clarifai

Human hand 35%

Clarifai

Human hand 33.8%

Categories

Imagga
created on 2018-03-23

people portraits 90.9%
events parties 7.5%
streetview architecture 0.7%
paintings art 0.3%
text visuals 0.2%
pets animals 0.1%
food drinks 0.1%
nature landscape 0.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a group of people with their hands up

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of people holding up their fists in front of a brick wall

OpenAI GPT

Created by gpt-4 on 2024-01-26

The image depicts a group of people, mostly in dark suits and hats, raising their fists in what appears to be a gesture of solidarity or protest. They stand in front of a red brick wall, next to an ornate, dark metal fence that separates them from a night-time landscape with tall pine trees and a dark blue sky. The atmosphere suggests they are gathered for a cause, possibly at dusk or during the evening.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a painting depicting a protest or demonstration scene. The artwork shows a group of people with raised fists in a gesture of solidarity or resistance. They are dressed in dark clothing, many wearing hats typical of a past era - fedoras and caps. The background features a red brick wall on the left side and what appears to be an ornate iron fence with trees visible behind it on the right, set against a dark blue sky. The style of the painting suggests it might be from the early-to-mid 20th century, possibly depicting a labor movement or social protest. The composition creates a powerful sense of unity and collective action among the figures shown.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a crowd of people, with their fists raised in protest or defiance. The figures are stylized and appear to be caricatures, with distinctive facial features and expressions. They are positioned in front of a brick wall, with a wrought-iron gate visible in the background, suggesting an urban setting. The overall scene conveys a sense of collective action and resistance.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a painting of a group of people standing in front of a brick wall and an iron gate, with their fists raised in the air. The painting is done in a style reminiscent of Expressionism, with bold brushstrokes and vivid colors.

Key Features:

  • Group of People: The central focus of the painting is a group of people, likely men, dressed in dark clothing and hats. They are standing in front of a brick wall and an iron gate, which appears to be closed.
  • Raised Fists: Each person in the group has their fist raised in the air, suggesting a sense of unity and defiance.
  • Brick Wall: The brick wall behind the group is depicted in shades of red and brown, with a subtle gradient effect that gives it a sense of depth.
  • Iron Gate: The iron gate is shown in the background, with intricate details and a sense of texture. It appears to be closed, but the people in the foreground seem to be pushing against it or trying to open it.
  • Color Palette: The painting features a muted color palette, with shades of gray, brown, and red dominating the scene. The only splash of color comes from the red hats worn by some of the individuals in the group.
  • Style: The painting is done in an Expressionist style, characterized by bold brushstrokes, vivid colors, and a sense of emotional intensity. The artist has used loose, gestural strokes to capture the movement and energy of the scene.

Overall Impression:

The painting conveys a sense of determination and defiance, as if the people in the group are fighting for something or pushing against an obstacle. The closed iron gate and the brick wall behind them suggest that they are facing resistance or opposition, but their raised fists and determined expressions suggest that they will not be deterred. The painting is a powerful commentary on the human spirit and the struggle for freedom and justice.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a painting of a group of people standing in front of a brick wall and iron gate, with their hands raised in a gesture of protest or solidarity. The group is diverse, comprising men and women of different ages and ethnicities, all dressed in dark clothing and hats. They are positioned in front of a red brick wall on the left side of the image and an iron gate on the right side, which appears to be set against a blue sky with trees in the background.

The overall atmosphere of the painting suggests a sense of unity and defiance, as if the group is standing together in opposition to something or someone. The use of muted colors and the somber expressions on the faces of the individuals add to the sense of gravity and seriousness of the scene.

The painting is signed by the artist in the bottom-left corner, but the signature is not legible. The style of the painting is reminiscent of the work of Pablo Picasso, with its use of bold lines, geometric shapes, and a focus on capturing the essence of the subject rather than creating a realistic representation.

Overall, the image conveys a powerful message about the importance of standing together in the face of adversity and the need for collective action to bring about change.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a group of people, possibly a crowd, gathered in front of a brick wall with a black gate. They are all wearing hats and raising their fists in the air, which may signify a protest or demonstration. The painting is in black and white, giving it a vintage look. The people are painted in a realistic style, with attention to detail in their facial expressions and clothing.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a painting of a crowd of people standing in front of a brick wall. The people are wearing hats and coats, and some of them have their hands raised in the air. The painting is painted in a realistic style, with attention to detail in the faces and expressions of the people. The brick wall is painted in a reddish-brown color, and there is a black metal gate in the background.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The painting depicts a crowd of people, predominantly men, raising their fists in a unified gesture. They appear to be in a protest or rally. The figures are rendered in a somewhat stylized, simplified manner, with strong outlines and minimal detail. They are dressed in dark suits or jackets and wear various hats, creating a sense of uniformity and solidarity.

On the left side of the image, there is a red brick wall. To the right, a dark, wrought-iron gate stands in front of a blue background. The blue background suggests a night sky or a similarly dark, uncertain environment, potentially emphasizing the seriousness or urgency of the group's cause. The lighting seems to be coming from the front, illuminating the faces of the crowd and highlighting their expressions, which range from determination to defiance.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

The image is a painting that depicts a crowd of people raising their fists in a gesture of solidarity or protest. The style is somewhat stylized, with simplified facial features and a focus on the overall composition and emotion.

Key elements:

  • People: There are many individuals in the crowd, mostly men, but also a woman in the lower right corner. Most are wearing hats and dark clothing, giving a sense of a unified group. They are all raising their fists in the air, which strongly suggests a political or social context.
  • Background: The background includes a red brick wall on the left and a dark blue area with a black iron gate to the right. The gate appears to be guarding a park or other open space with trees in the background.
  • Color and Light: The color palette is somewhat muted, with a focus on earthy tones. The lighting appears to be coming from the top, casting shadows that help define the figures and the scene.

Overall Impression:

The painting conveys a sense of defiance, unity, and possibly struggle or hope. The raised fists, the dark clothing, and the brick wall suggest a gathering of workers or individuals seeking change or expressing dissent. It could be a depiction of a strike, a protest, or a moment of solidarity.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a group of people, seemingly engaged in a protest or demonstration. The individuals are shown raising their clenched fists, a universal symbol of solidarity and resistance. They are dressed in dark clothing, and some are wearing hats, giving a sense of unity and shared purpose among the group.

The setting appears to be outdoors, with a brick wall on the left side and an ornate iron fence in the background. The sky is dark, suggesting it might be evening or night. The expressions on the faces vary, with some appearing determined and others looking more somber or concerned. The overall mood of the image conveys a sense of collective action and determination.

The style of the painting is somewhat expressionistic, with exaggerated features and bold lines, emphasizing the emotional intensity of the scene. The use of color is muted, with a focus on earthy tones, which further highlights the serious and solemn nature of the gathering. The artist's signature is visible in the bottom left corner.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-27

The image is a painting depicting a group of people gathered in front of a brick wall and a wrought-iron fence. The people are raising their fists, which suggests a demonstration or protest. The brick wall, painted in red, dominates the left side of the image, while the dark, sky-blue background with the fence in the center creates a contrast. The individuals in the painting are wearing hats and dark clothing, giving the scene a somber and serious tone. The overall composition and style suggest this is a representation of a social or political movement, possibly from a historical context.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-27

This painting depicts a crowd of people, likely in a protest or demonstration, with their fists raised in a show of unity and defiance. The scene is set against a backdrop of a red brick wall on the left and a dark blue sky with a black wrought iron fence on the right. The individuals in the crowd are dressed in a variety of clothing, including hats, suits, and casual attire, suggesting a diverse group. The expressions on their faces range from determined to joyful, indicating a strong sense of purpose and camaraderie. The overall style of the painting is somewhat stylized and expressive, with bold lines and a limited color palette that emphasizes the reds, blues, and dark tones of the scene. The artist's signature is visible in the bottom left corner.

Text analysis

Amazon

soosocbob