Human Generated Data

Title

Indian with White Man

Date

2007

People

Artist: Annu Palakunnathu Matthew, American born 1964

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2008.3.10

Copyright

© Annu Palakunnathu Matthew courtesy sepiaEYE, NYC

Human Generated Data

Title

Indian with White Man

People

Artist: Annu Palakunnathu Matthew, American born 1964

Date

2007

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2008.3.10

Copyright

© Annu Palakunnathu Matthew courtesy sepiaEYE, NYC

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99.8
Sitting 89.2
Military 67.2
Military Uniform 67.2
Art 63
Apparel 63
Clothing 63
Photo 62.4
Photography 62.4
Face 62.1
Portrait 60.4
Poster 59.9
Advertisement 59.9
Soldier 59.5
Head 56.2

Clarifai
created on 2019-11-07

people 99.9
group 99.3
woman 98.9
adult 98.9
man 98.8
portrait 98.6
art 98.5
illustration 98.2
child 97.9
print 97.4
picture frame 96.6
collage 96.6
retro 95.5
nostalgia 95
music 93.3
four 91.3
vintage 91.2
many 91.1
collection 90.5
two 90.3

Imagga
created on 2019-11-07

kin 88.7
people 24.5
black 21.6
man 20.8
portrait 20.1
face 19.2
adult 18.8
person 18.5
body 16
love 15.8
happy 15.7
model 14.8
male 14.3
fashion 13.6
sibling 13.5
child 13.4
attractive 13.3
silhouette 13.2
brunette 13.1
boy 13
couple 12.2
cute 12.2
lady 12.2
sexy 12
youth 11.9
pretty 11.9
vintage 11.6
sport 10.7
family 10.7
happiness 10.2
lifestyle 10.1
dark 10
world 9.8
old 9.7
human 9.7
fun 9.7
hair 9.5
relaxation 9.2
art 9.1
dress 9
sunset 9
one 9
symbol 8.7
sepia 8.7
women 8.7
play 8.6
smile 8.5
culture 8.5
expression 8.5
grunge 8.5
outdoor 8.4
health 8.3
mother 8.2
fitness 8.1
romance 8
posing 8
postmark 7.9
eyes 7.7
stamp 7.7
mail 7.7
passion 7.5
joy 7.5
creation 7.5
emotion 7.4
girls 7.3
smiling 7.2
activity 7.2
summer 7.1

Google
created on 2019-11-07

Microsoft
created on 2019-11-07

room 100
scene 100
gallery 100
wall 99.7
clothing 98.8
person 98.8
man 95.4
posing 93.7
different 88.5
picture frame 82.5
woman 65.4
text 64.9
smile 59.5
various 48.9
painting 43.1
same 23.2
several 13.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 21-33
Gender Female, 54.8%
Happy 45.2%
Angry 45.8%
Surprised 45.1%
Calm 49.7%
Disgusted 45.1%
Fear 45.2%
Sad 48.7%
Confused 45.3%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Angry 54.4%
Disgusted 45%
Calm 45.4%
Sad 45.1%
Fear 45%
Confused 45%
Surprised 45%
Happy 45%

AWS Rekognition

Age 27-43
Gender Male, 54.8%
Happy 45%
Surprised 45.2%
Fear 45%
Sad 45%
Calm 54.4%
Disgusted 45%
Angry 45.3%
Confused 45%

AWS Rekognition

Age 23-35
Gender Male, 51.3%
Sad 46.1%
Confused 45.1%
Fear 45.1%
Angry 45.2%
Surprised 45.3%
Disgusted 45.1%
Calm 53%
Happy 45.1%

Feature analysis

Amazon

Person
Painting

Clarifai

Clothing
Man
Human face
Footwear
Picture frame

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.3%

AWS Rekognition

Painting 63%

AWS Rekognition

Painting 60.2%

Clarifai

Clothing 94%

Clarifai

Clothing 60.7%

Clarifai

Man 91.3%

Clarifai

Man 86.9%

Clarifai

Human face 60.6%

Clarifai

Human face 46.9%

Clarifai

Human face 44.1%

Clarifai

Human face 40.8%

Clarifai

Footwear 60.4%

Clarifai

Footwear 56.2%

Clarifai

Footwear 55.9%

Clarifai

Footwear 48.2%

Clarifai

Footwear 47.3%

Clarifai

Footwear 43.1%

Clarifai

Footwear 42.3%

Clarifai

Footwear 35.3%

Clarifai

Picture frame 43.2%

Clarifai

Picture frame 39.5%

Clarifai

Picture frame 33%

Categories

Imagga
created on 2019-11-07

paintings art 95.5%
people portraits 1.8%

Captions

Microsoft
created by unknown on 2019-11-07

a group of men posing for a photo 53%
a group of people posing for a photo 52.9%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a photograph of the family.

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people sitting on a chair

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This is a photograph featuring two distinct compositions side by side. On the left, there is a depiction labeled "WHITE MAN AND INDIAN," showcasing two individuals seated in contrasting attire: one wearing formal Western clothing, including a suit, and the other dressed in traditional Indigenous clothing with decorative elements, including a feathered headdress. On the right, a similar pairing labeled "INDIAN AND WHITE MAN" switches the attire dynamics. The first individual wears Westernized Indigenous clothing, while the second is casually dressed in non-formal wear, including a shirt and trousers. The setting is minimalistic, with a plain backdrop and visible artistic textures. Below each image, attribution is given to photographers ("Photographed by J. Shindler" and "Photographed by Wells & Mathew").

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a sepia-toned photograph with two distinct portraits side by side. On the left side, there is a photograph of two figures sitting down. The figure on the left is wearing a formal suit with a bow tie, sitting on a chair. The figure on the right is in traditional Native American attire, complete with a feather headdress and decorative clothing. Underneath the image, the text reads "WHITEMAN AND INDIAN" and it credits the photograph to "J. Schröter."

On the right side, another similar setup is visible where the positions of the individuals are reversed. The figure on the left is again wearing a long coat and trousers, likely a suit. The figure on the right is dressed in more casual western clothing, including a collared shirt with rolled-up sleeves. This image is labeled "INDIAN AND WHITEMAN," credited to "Vollle & Mathew."

Both photographs are set against a plain backdrop with the individuals seated on chairs, and the entire compilation is presented with a white border.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows two pairs of people in sepia-toned photographs. The first pair consists of a man with a beard and a Native American man wearing traditional clothing. The second pair shows a man and a woman, both dressed in formal attire. The photographs appear to be from the late 19th or early 20th century, based on the style and quality of the images.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This image shows two historical sepia-toned photographs placed side by side. Both appear to be from the same era, likely mid-1800s, and demonstrate an interesting juxtaposition.

The left photograph, labeled "WHITEMAN AND INDIAN," shows two people - one in Western-style clothing with a dark coat, and the other in traditional Native American dress including what appears to be ceremonial clothing and a feathered headdress.

The right photograph, labeled "INDIAN AND WHITEMAN," shows a similar composition but with the subjects wearing different clothing - one in more formal Western attire and the other in simpler, casual Western clothing.

The photographs appear to be making a statement about cultural identity and appearance, showing how clothing and presentation can affect perception. Both images are credited to photographers - A. Shindler for the left image and Wells & Hamilton for the right image.

The composition and style of both photographs are very similar, with the subjects seated and photographed against a plain backdrop, which was typical of portrait photography of that historical period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image presents a striking contrast between two photographs, each featuring a white man and an indigenous person, likely from the 19th century. The photographs are titled "Whiteman and Indian" and "Indian and Whiteman," respectively.

Photograph 1: Whiteman and Indian

  • The white man is dressed in formal attire, including a suit, vest, and bow tie, with his hands resting on his lap.
  • The indigenous person is seated beside him, wearing traditional clothing, including a headdress adorned with feathers.
  • The background of the photograph is a plain wall, with a subtle shadow cast by the subjects.

Photograph 2: Indian and Whiteman

  • The indigenous person is dressed in formal attire, including a suit and tie, with his hands resting on his lap.
  • The white man is seated beside him, wearing casual clothing, including a shirt and pants, with his hands crossed over his lap.
  • The background of the photograph is also a plain wall, with a similar shadow cast by the subjects.

Comparison and Analysis

  • The photographs highlight the cultural and social differences between the two groups, with the white man in the first photograph representing European-American culture and the indigenous person representing Native American culture.
  • The second photograph appears to be a reversal of roles, with the indigenous person dressed in formal attire and the white man dressed in casual clothing.
  • The photographs may be intended to illustrate the complexities of cultural exchange and interaction between European-Americans and Native Americans during the 19th century.

Conclusion

The image presents a thought-provoking comparison between two photographs, highlighting the cultural and social differences between European-Americans and Native Americans during the 19th century. The photographs may be intended to illustrate the complexities of cultural exchange and interaction between the two groups, and serve as a reminder of the historical context in which they were taken.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image presents a striking visual representation of two photographs, each featuring a pair of individuals from different racial backgrounds. The photographs are displayed side by side, with the left image titled "WHITEMAN AND INDIAN" and the right image titled "INDIAN AND WHITEMAN." Both titles are written in small, capitalized letters at the bottom of their respective images.

In the left photograph, a white man sits alongside an Indigenous man, both dressed in formal attire. The white man wears a dark suit, while the Indigenous man is adorned in traditional clothing, complete with a headdress. In contrast, the right photograph depicts an Indigenous man seated next to a white man, both attired in more casual clothing. The Indigenous man wears a dark jacket and pants, while the white man sports a light-colored shirt and pants.

The photographs are set against a plain background, with a subtle shadow effect surrounding the subjects. The overall atmosphere of the image is one of solemnity and introspection, inviting the viewer to reflect on the complex relationships between different racial groups throughout history.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph that features two different scenes, each showing a man sitting on a chair. The photograph is divided into two sections, with each section depicting a different scene. In the left section, there is a man wearing a suit and a bow tie sitting on a chair, while another man, dressed in traditional Native American attire, sits beside him. The right section of the photograph shows a man in a suit sitting on a chair, with another man in a suit sitting beside him. The photograph is titled "Whiteman and Indian" and "Indian and Whiteman," suggesting a contrast between the two scenes.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image consists of two old photographs of two people sitting on a chair. The person on the left is wearing a black coat, a white shirt, and a bow tie. He is sitting next to a person wearing traditional clothing. The person on the right is wearing a white shirt and a black coat. He is sitting next to a person wearing a white shirt and pants.

Google Gemini

Created by gemini-2.0-flash on 2025-06-16

The image displays two sepia-toned photographs mounted side-by-side on a light gray background. Both photographs feature two individuals seated next to each other.

In the left photograph, a man in a dark suit and tie sits beside a Native American man in traditional attire, complete with a headdress and decorated clothing. Below the image, the text reads "Whiteman and Indian" along with "Photograph by A. Shindler."

The right photograph shows a Native American woman in a coat and trousers seated alongside a white man in a button-down shirt and jeans. The caption under this image reads "Indian and Whiteman" and "Photograph by Wells el. Matthew."

The photographs have a vintage or antique appearance, with visible wear and imperfections adding to their historical character.

Created by gemini-2.0-flash-lite on 2025-05-01

This image presents a diptych, with two separate photographs displayed side-by-side, both in sepia tones. The overall aesthetic suggests a historical context, likely dating back to the 19th or early 20th century due to the style of photography and subject matter. Each photograph depicts two people, seated and posed formally.

Left Panel:

  • The left image is labeled "WHITEMAN AND INDIAN."
  • It features a white man in a formal suit seated next to a Native American man in traditional attire, including a feathered headdress and ceremonial garments.
  • Both appear serious, posing for the portrait.

Right Panel:

  • The right image is labeled "INDIAN AND WHITEMAN."
  • It shows a woman of Native American descent in contemporary attire seated next to a white man in more casual, modern clothing.
  • The woman appears to have a more stern expression, while the white man's gaze is not very strong.
  • The images appear to be shot against a plain backdrop, which could be a simple wall or studio setup.
  • The photographer's name is printed on the bottom of each photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image consists of two side-by-side sepia-toned photographs, each featuring two men sitting next to each other. Both photographs appear to be staged portraits, likely from the 19th century, given the style of clothing and the photographic technique.

  1. Left Photograph (labeled "Whiteman and Indian"):

    • The man on the left is dressed in typical 19th-century Western attire, including a suit with a vest and a bow tie. He has a beard and mustache.
    • The man on the right is dressed in traditional Native American clothing, including a headdress with feathers, a beaded necklace, and patterned leggings. He is holding a pipe.
    • Both men are seated on a bench with a backdrop that includes a painted scene, possibly of a landscape.
  2. Right Photograph (labeled "Indian and Whiteman"):

    • The man on the left is dressed in traditional Native American clothing, similar to the man on the right in the first photograph.
    • The man on the right is dressed in modern casual clothing, including a collared shirt and jeans.
    • Both men are seated on the same bench with the same backdrop as in the first photograph.

The photographs seem to be a juxtaposition or a role reversal, highlighting the contrast between traditional and modern attire, as well as cultural identities. The titles "Whiteman and Indian" and "Indian and Whiteman" emphasize this contrast and the shift in roles between the two images.

Qwen

No captions written

Text analysis

Amazon

WHITEMAN
INDIAN AND
WHITEMAN AND INDIAN INDIAN AND
AND INDIAN
d
Matthew
Piotograp 6 d Matthew
Piotograp 6
Shinfler

Google

Photograph by A. Shindler Photograph by Wells e Matthew WHITEMAN AND INDIAN INDIAN AND WHITEMAN
Photograph
by
A.
Shindler
Wells
e
Matthew
WHITEMAN
AND
INDIAN