Human Generated Data

Title

Carrying a Coffin

Date

2004

People

Artist: José Santos, American born 1964

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, George R. Nutter Fund, M26271

Copyright

© 2004 Jose L. Santos

Human Generated Data

Title

Carrying a Coffin

People

Artist: José Santos, American born 1964

Date

2004

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, George R. Nutter Fund, M26271

Copyright

© 2004 Jose L. Santos

Machine Generated Data

Tags

Amazon
created on 2019-11-01

Human 99.2
Apparel 97.6
Clothing 97.6
Astronaut 96.7

Clarifai
created on 2019-11-01

art 99.4
painting 99.1
people 98.9
print 98
man 95.7
old 95.1
religion 94.2
illustration 94.2
graffiti 92.7
adult 92.1
wear 91.8
retro 91
vintage 89
military 88.8
ancient 88
antique 88
culture 87.9
war 86.7
wall 85.7
group 85.4

Imagga
created on 2019-11-01

graffito 100
decoration 100
art 28.2
old 27.8
grunge 23
retro 17.2
dirty 17.2
vintage 16.5
wall 16.3
design 16.1
church 15.7
money 15.3
religion 15.2
texture 14.6
grungy 13.3
antique 13
ancient 13
currency 12.6
world 11.9
paint 11.8
paper 11.8
pattern 11.6
textured 11.4
travel 11.3
culture 11.1
painting 10.8
history 10.7
stained 10.6
finance 10.1
letter 10.1
cash 10.1
global 10
color 10
aged 9.9
graffiti 9.8
business 9.7
artistic 9.6
economy 9.3
window 9.2
city 9.1
financial 8.9
detail 8.8
bible 8.8
text 8.7
spirituality 8.6
colorful 8.6
drawing 8.6
architecture 8.6
weathered 8.5
religious 8.4
black 8.4
dark 8.3
artwork 8.2
mosaic 8
stamp 7.7
messy 7.7
mail 7.7
decorative 7.5
map 7.5
man 7.4
bank 7.2
creative 7.1

Google
created on 2019-11-01

Art 70.9
Visual arts 66.9
Painting 61.3
Team 52.3

Microsoft
created on 2019-11-01

drawing 96.8
text 78.7
cartoon 74.5
art 72.2
clothing 67
old 61.2
person 55.5
painting 28.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-67
Gender Male, 54.4%
Confused 45%
Sad 45%
Angry 45%
Happy 45%
Calm 54.7%
Disgusted 45%
Fear 45%
Surprised 45.2%

AWS Rekognition

Age 40-58
Gender Male, 51.6%
Happy 45%
Calm 54.7%
Fear 45%
Confused 45%
Surprised 45%
Angry 45.1%
Disgusted 45%
Sad 45.1%

AWS Rekognition

Age 4-12
Gender Male, 54.6%
Sad 53.7%
Happy 45%
Calm 45%
Disgusted 45%
Angry 46%
Surprised 45%
Fear 45.3%
Confused 45%

AWS Rekognition

Age 39-57
Gender Male, 53.9%
Angry 46.3%
Disgusted 45%
Happy 45.1%
Sad 45%
Calm 49.6%
Fear 45.1%
Confused 45%
Surprised 48.9%

AWS Rekognition

Age 22-34
Gender Male, 54%
Happy 45%
Confused 45.4%
Disgusted 45.1%
Calm 45.1%
Fear 47.4%
Sad 51.4%
Angry 45.6%
Surprised 45.1%

AWS Rekognition

Age 37-55
Gender Male, 52.9%
Calm 45.2%
Fear 50.7%
Angry 47%
Disgusted 45%
Sad 46.4%
Confused 45.1%
Surprised 45.5%
Happy 45.2%

Feature analysis

Amazon

Helmet
Person

Clarifai

Clothing
Human face
Man
Person
Human head

AWS Rekognition

Helmet 97.6%

AWS Rekognition

Helmet 90.2%

AWS Rekognition

Person 93.5%

AWS Rekognition

Person 86.7%

AWS Rekognition

Person 84.9%

AWS Rekognition

Person 77%

AWS Rekognition

Person 75.4%

AWS Rekognition

Person 72%

Clarifai

Clothing 70.8%

Clarifai

Clothing 55.4%

Clarifai

Clothing 54.6%

Clarifai

Clothing 53.7%

Clarifai

Clothing 50.2%

Clarifai

Clothing 49%

Clarifai

Clothing 48.5%

Clarifai

Clothing 45.7%

Clarifai

Clothing 41.4%

Clarifai

Clothing 39.1%

Clarifai

Clothing 34.2%

Clarifai

Human face 69.9%

Clarifai

Human face 67.9%

Clarifai

Human face 67.6%

Clarifai

Human face 66.9%

Clarifai

Human face 62.9%

Clarifai

Human face 60.8%

Clarifai

Man 46.6%

Clarifai

Man 38.1%

Clarifai

Man 36.1%

Clarifai

Person 42.8%

Clarifai

Human head 41.6%

Categories

Imagga
created on 2019-11-01

paintings art 99%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-10

a painting of soldiers in front of a mural.

Salesforce

Created by general-english-image-caption-blip on 2025-05-06

a photograph of a painting of a group of soldiers with a sign that says,

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-31

The image depicts a group of soldiers wearing camouflage uniforms, standing together in front of an ornate, decorative background that features an intricate floral pattern. The soldiers are holding a plaque with Arabic script written on it. The overall composition suggests a formal or ceremonial setting.

Created by gpt-4 on 2025-01-31

The image shows a group of individuals in light-colored, possibly white, attire gathered around a dark, rectangular object that features intricate Arabic calligraphy. The attire suggests that they could be wearing traditional or ceremonial clothing, and they appear to be engaging with the object in a collective manner that may indicate some significance or ritual associated with it. The setting is not clearly distinguishable due to the focus on the individuals and the object in the center. The photograph has a textured and painterly quality, which could be a result of a filter or effect applied to the original image to give it an artistic touch. The image is bordered with what might be a patterned frame or a carpeted surface that creates a decorative edge around the scene.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This image appears to be an artistic rendering or illustration showing several figures in white protective suits and helmets standing in a line. They are holding what appears to be a dark panel or board with Arabic calligraphy on it. The figures are wearing what looks like hazmat or protective gear, suggesting they might be medical workers or emergency responders. The background has an ornate, decorative pattern in golden or orange tones. The overall style has a painterly or artistic quality rather than being a straightforward photograph.

Created by claude-3-5-sonnet-20241022 on 2025-01-31

This artistic image shows a group of soldiers or military personnel in white protective gear or hazmat suits. They are standing in a line while holding what appears to be a sign or plaque with Arabic calligraphy on it. The artwork has a stylized quality with muted colors and a decorative border pattern around the edges in golden or orange tones. The figures are rendered in white and light blue tones with subtle green and purple accents. The Arabic text appears to be on a dark background within the frame they're holding.

Created by claude-3-opus-20240229 on 2025-01-31

The image depicts a group of seven soldiers or military personnel posing in front of a wooden sign that reads "Al-tawbah" in Arabic calligraphy. The men are wearing light-colored camouflage uniforms and helmets, and several are holding weapons. The sign is placed on an ornate rug or tapestry with intricate floral patterns in gold, orange and green tones. Based on their attire and the Arabic sign, the image seems to show soldiers in a Middle Eastern setting, likely during a military operation or deployment.

Created by claude-3-haiku-20240307 on 2025-01-31

The image depicts a group of people dressed in camouflage military-style uniforms, holding a framed sign with Arabic text. The people appear to be in a natural outdoor setting, surrounded by foliage. Without being able to identify any specific individuals, the image seems to convey a military or combat-related scene, with the individuals holding the sign potentially signifying a military or political statement.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-03-17

The image depicts a group of soldiers in white uniforms holding a sign with Arabic writing on it. The soldiers are wearing helmets and appear to be in a military setting, possibly during a ceremony or event.

  • The soldiers are standing in a line, with one soldier holding the sign in the center.
  • The sign is black with gold Arabic writing on it.
  • The soldiers are wearing white uniforms with green accents and helmets.
  • The background of the image is a brownish-yellow color, with a floral pattern visible behind the soldiers.
  • The overall atmosphere of the image suggests a sense of unity and cooperation among the soldiers, as they stand together holding the sign.

The image appears to be a painting or drawing, with bold brushstrokes and vivid colors used to depict the scene. The use of Arabic writing on the sign adds an element of cultural significance to the image, suggesting that the soldiers may be from a Middle Eastern or North African country. Overall, the image conveys a sense of pride and solidarity among the soldiers, as they come together to hold the sign and represent their unit or organization.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-03-17

The image depicts a group of eight soldiers in white uniforms, standing in a line and holding a large black sign with Arabic writing. The soldiers are wearing helmets and appear to be standing on a grassy surface, with a black background behind them. The overall atmosphere of the image suggests that the soldiers are participating in some kind of ceremony or event, possibly related to their military service.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-31

The image is a painting of a group of soldiers in a military uniform. They are wearing helmets and carrying guns. The soldiers are standing in a row, and they are holding a wooden box with Arabic writing on it. The box is black, and the writing is gold. The soldiers are standing in front of a wall with a golden pattern. The painting has a blurry effect, giving it a dreamlike quality.

Created by amazon.nova-lite-v1:0 on 2025-01-31

The image is a drawing of a group of soldiers in uniform, standing in a row, with a focus on the soldiers in the front. The soldiers are wearing white uniforms, helmets, and boots, with some of them carrying a black box with Arabic writing on it. The soldiers are lined up in front of a brown background, which could be a wall or a fence. The drawing is done in a sketch-like style, with a combination of black, white, and brown colors.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

The image appears to be a drawing or illustration depicting a group of soldiers in what appears to be military uniforms, carrying a dark, rectangular object with Arabic calligraphy on it. The soldiers are wearing helmets and seem to be in a procession or carrying the object with solemnity.

The background has a decorative border with a floral pattern, giving the image a somewhat ceremonial or commemorative feel. The style of the drawing is somewhat rough and expressive, with visible strokes that give it a hand-drawn quality.

The overall impression is of a symbolic representation, possibly related to military service, cultural heritage, or religious significance, given the Arabic script on the object being carried.

Created by gemini-2.0-flash-lite on 2025-05-07

Here is a description of the image:

The image is a drawing or painting depicting a group of soldiers in camouflage uniforms holding a large, ornate plaque. The soldiers are arranged in a row, and they are all facing forward. They are holding the plaque with both hands. The plaque is black with gold lettering in a style reminiscent of Arabic calligraphy. The background of the image features an ornamental design with golden floral patterns. The overall style of the artwork seems to be a blend of drawing and painting, with visible pencil or crayon strokes. The image is framed with a darker border that enhances its presentation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-09

The image appears to be a painting depicting a group of individuals in white protective suits, possibly hazmat suits, carrying a large rectangular object. The suits suggest they are handling something hazardous or require protection. The object they are carrying has Arabic script on it, which reads "لا إله إلا الله محمد رسول الله" (La ilaha illallah, Muhammadun rasulullah), translating to "There is no god but Allah, Muhammad is the messenger of Allah." This phrase is a central tenet of Islamic faith.

The background of the painting has a decorative border with intricate patterns, possibly resembling traditional Islamic art or textile design. The overall style of the painting is somewhat impressionistic, with visible brush strokes and a focus on the figures and their actions rather than fine details. The color palette includes muted tones of white, green, blue, and brown.

Qwen

No captions written

Text analysis

Amazon

F