Human Generated Data

Title

Untitled (unidentified man, standing, wearing turban, right hand resting on back of chair, unidentified woman in sari, seated, unidentified girl wearing sari standing to right of woman)

Date

1860-1899

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.4

Human Generated Data

Title

Untitled (unidentified man, standing, wearing turban, right hand resting on back of chair, unidentified woman in sari, seated, unidentified girl wearing sari standing to right of woman)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.4

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 99.6
Advertisement 87.2
People 78.3
Tribe 65.7
Art 59.9

Clarifai
created on 2023-10-28

people 99.9
art 99.5
portrait 99.4
adult 98.9
print 98.3
painting 97.6
group 97.4
man 97.4
wear 96.9
woman 96.5
illustration 95
two 94.5
vintage 94.4
leader 93.3
veil 92.6
sepia pigment 92.1
old 91
retro 89
book bindings 87.6
facial hair 85.2

Imagga
created on 2022-02-25

book jacket 64
jacket 49.8
wrapping 37.8
vintage 36.4
covering 29.1
old 27.9
paper 26.7
art 25.1
grunge 21.3
binding 21.2
retro 20.5
stamp 19.7
mail 19.2
postage 18.7
antique 18.2
post 18.1
history 17.9
letter 17.4
ancient 17.3
culture 16.2
postmark 15.8
symbol 15.5
texture 15.3
postal 14.7
museum 13.9
black 13.8
aged 13.6
envelope 13.1
global 12.8
currency 12.6
one 12
money 11.9
design 11.6
lighter 11.5
painted 11.5
banking 11
cash 11
bill 10.5
book 10.3
decoration 10.3
wall 10.3
finance 10.1
device 9.9
masterpiece 9.9
religion 9.9
stamps 9.9
bank 9.9
renaissance 9.8
sculpture 9.8
communications 9.6
church 9.3
painter 9.1
dirty 9
wealth 9
zigzag 8.9
printed 8.9
paintings 8.8
delivery 8.8
cutting 8.7
fine 8.6
unique 8.5
communication 8.4
dollar 8.4
page 8.4
note 8.3
stone 8.1
office 8
financial 8
close 8
icon 7.9
post mail 7.9
fame 7.9
business 7.9
known 7.9
shows 7.9
empty 7.7
us 7.7
artist 7.7
wallpaper 7.7
united 7.6
historical 7.5
pattern 7.5
religious 7.5
graffito 7.5
ornate 7.3
backgrounds 7.3
collection 7.2

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 99.6
person 98.6
clothing 98.4
old 97.6
vintage 96.4
posing 95.6
black 92.3
white 82.3
human face 70.9
woman 68
photograph 64.3
fashioned 53.6
vintage clothing 50.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Female, 99.9%
Calm 95%
Angry 2.5%
Surprised 0.8%
Fear 0.6%
Sad 0.4%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Calm 97.9%
Confused 0.7%
Angry 0.4%
Happy 0.3%
Sad 0.3%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 92.2%
Surprised 3.2%
Fear 2.9%
Angry 0.5%
Confused 0.4%
Sad 0.4%
Disgusted 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster
Painting

Clarifai

No features identified

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.1%

AWS Rekognition

Poster 87.2%

AWS Rekognition

Painting 57.8%

Categories

Imagga
created on 2022-02-25

paintings art 100%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-24

a photograph of a man and two women in traditional clothing

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This image is a vintage photograph featuring three individuals dressed in traditional Indian attire. The seated figure is adorned with elaborate jewelry and a richly patterned sari. The standing figure on the right wears intricately embroidered garments and additional ornaments, such as necklaces and a turban with decorations. The individual on the left also wears a sari with decorative elements. The setting includes a patterned carpet and a backdrop with a rounded arch design. The overall scene reflects cultural and historical significance, possibly dating back to the late 19th or early 20th century.

Created by gpt-4o-2024-08-06 on 2025-06-17

This image depicts three individuals dressed in traditional Indian attire, suggesting a formal or ceremonial occasion. The person on the left is wearing a sari with ornate designs and jewelry. The individual in the center is seated, also wearing a sari with intricate patterns and adorning jewelry such as necklaces and bracelets. The person on the right is standing and dressed in traditional Indian male attire, accessorized with elaborate jewelry including necklaces and armlets. The background features an elegant arch, and there are textiles with detailed patterns positioned nearby. The overall composition of the image suggests a formal portrait intended to display cultural attire and ceremonial customs.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a sepia-toned photograph from the past, depicting three individuals in traditional Indian or South Asian attire. The two individuals seated appear to be a woman wearing an ornate, patterned dress, and a man wearing a long coat and hat. The third individual, standing behind them, is also dressed in traditional clothing. The image has an antique, historical feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical sepia-toned photograph, likely from the late 19th century, showing three individuals in traditional Indian attire. The subjects are wearing ornate clothing with detailed embroidery and jewelry typical of wealthy or noble Indian families of that era. The central figure is seated and wearing what appears to be a sari with a dotted pattern, while the two others are standing and wearing more structured garments with decorative elements. The photograph has an oval-shaped border typical of Victorian-era portrait photography, and the overall composition and formal posing is characteristic of studio photography from that period. The image shows some aging and wear around the edges, which is common for photographs of this age.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a sepia-toned photograph of a family, likely from the 19th century, based on the style of clothing and the quality of the photograph.

  • Family Members:
    • The family consists of three members: a man, a woman, and a child.
    • The man is standing behind the woman and child, wearing a turban and a long coat with intricate designs.
    • The woman is seated on a chair, wearing a sari and jewelry.
    • The child is standing next to the woman, wearing a traditional Indian outfit.
  • Background:
    • The background of the photograph is a plain wall or backdrop, which helps to focus attention on the family members.
  • Overall Impression:
    • The photograph appears to be a formal portrait, possibly taken for a special occasion or as a family keepsake.
    • The family members are dressed in their finest attire, suggesting that they were trying to present themselves in a dignified and respectful manner.

In summary, the image is a vintage photograph of a family, likely from the 19th century, showcasing their traditional clothing and jewelry. The photograph is a formal portrait, possibly taken for a special occasion or as a family keepsake.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

This image is a vintage photograph of three individuals, likely from India, dressed in traditional attire. The photograph appears to be an old sepia-toned print, with visible signs of aging and wear around the edges.

In the foreground, the three individuals are posed in a formal setting. On the left stands a young girl, dressed in a sari and adorned with jewelry, including a necklace and earrings. She has her hands on her hips and looks directly at the camera.

In the center, a woman sits on a chair, also wearing a sari and jewelry. Her hands rest on her lap, and she gazes straight ahead.

On the right, a man stands behind the woman, dressed in a dark-colored outfit with intricate embroidery or patterns. He wears a turban on his head and has his hands resting on the back of the woman's chair. His gaze is directed at the camera.

The background of the photograph features a plain wall or backdrop, which helps to focus attention on the subjects. Overall, the image captures a moment in time, showcasing the cultural heritage and traditional attire of the individuals depicted.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The image is a black-and-white photograph that appears to be a family portrait. The image is sepia-toned, which suggests that it is an old photograph. The photograph features three people, two women and a man, standing together. The man is standing behind the two women, who are seated on a chair. The man is wearing a turban and a necklace. The women are wearing traditional attire.

Created by amazon.nova-lite-v1:0 on 2025-05-31

This is an old photograph of three people dressed in traditional Indian clothing. The woman in the middle is sitting on a chair and looking forward, while the man on the right is standing and looking at her. The woman on the left is standing and looking to the right. They are all wearing traditional Indian clothing, including saris and turbans. The background is a wall with a curtain and a table with a cloth on it.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Here is a description of the image:

This is an old, sepia-toned studio photograph featuring three individuals. The photograph is set against a simple backdrop, with an arched design at the top.

A woman is seated centrally in the image, wearing a traditional saree with a patterned design. Her feet are bare, and she wears several pieces of jewelry, including necklaces, earrings, and bangles.

To the woman's left, a younger girl stands with her hand on her hip. She is dressed in traditional clothing similar to the woman's, and also wears jewelry.

On the right side of the image, a man stands with one hand resting on a table draped with an ornate cloth. He is dressed in a formal outfit, complete with a decorative hat and several medals or medallions. He also appears to be wearing a sword.

The photograph has some signs of age, with discoloration and wear around the edges. The overall composition suggests a formal family portrait from a bygone era.

Created by gemini-2.0-flash-lite on 2025-06-05

Here is a description of the image:

The image is a sepia-toned photograph of a family. The central figure is a woman seated in a chair, wearing a sari and jewelry. To her left stands a young girl, also in traditional attire. To her right stands a man, in a formal outfit with a turban and ornate embellishments. He has his arm on the woman's shoulder. The background is plain, with an arched top. The photograph is on a slightly aged and discolored card.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a vintage sepia-toned photograph featuring three individuals dressed in traditional attire, likely from the Indian subcontinent. The photograph appears to be from the late 19th or early 20th century.

  1. Setting and Background: The photograph is taken indoors with a simple backdrop, possibly in a studio setting. The backdrop has a plain, light-colored arch, which was common in studio portraits of that era.

  2. Subjects:

    • Center Person: A woman is seated in the middle, wearing a traditional saree with intricate patterns. She has long hair and is adorned with jewelry, including earrings and bangles. Her posture is formal, with her hands resting on her lap.
    • Person on the Left: A young boy stands to the left of the seated woman. He is dressed in traditional attire, including a long coat and what appears to be a turban or cap. He has a serious expression and is holding a small object in his right hand.
    • Person on the Right: A man stands to the right of the seated woman. He is dressed in traditional attire, which includes a long coat with elaborate embroidery and a turban. He has a beard and mustache and is leaning slightly on a table covered with a patterned cloth.
  3. Additional Details: The photograph shows signs of aging, with some wear and tear visible on the edges and surface. The sepia tone suggests it is an old photograph, likely taken using early photographic techniques.

Overall, the image captures a formal family portrait from a bygone era, showcasing traditional clothing and the studio photography style of the time.

Qwen