Human Generated Data

Title

Untitled (Jats, Hindus, Delhi)

Date

1862-1863

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.57

Human Generated Data

Title

Untitled (Jats, Hindus, Delhi)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.57

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.9
Human 99.9
Person 99.7
Person 99.6
Person 98.5
Clothing 98
Apparel 98
Sitting 84.5
People 78
Female 76
Turban 67.4
Headband 67.4
Girl 60.3
Flooring 57.5
Hat 54.8

Clarifai
created on 2023-10-26

people 99.9
adult 98.3
bench 97.7
group together 97.4
portrait 96.6
two 96.5
child 95.8
group 95.8
woman 95.4
man 94.8
street 94.6
sit 94.5
wear 92
three 90.2
monochrome 89.9
four 89.2
boy 88.1
furniture 88
seat 86.9
sitting 85.3

Imagga
created on 2022-01-23

child 32.3
man 31.7
kin 30.2
people 30.1
male 29.3
person 26.4
couple 26.1
father 22.3
happy 20.7
family 20.5
happiness 20.4
adult 20
beach 19.4
love 18.9
mother 18.9
outdoors 16.4
lifestyle 15.9
portrait 15.5
parent 15.5
dad 15.4
smiling 15.2
home 15.2
together 14.9
relaxing 14.6
daughter 14.3
joy 14.2
two 13.6
old 13.2
summer 12.9
smile 12.8
dress 11.8
romantic 11.6
vacation 11.5
fun 11.2
sea 10.9
world 10.6
bride 10.6
grandfather 10.5
life 10.4
boy 10.4
sitting 10.3
day 10.2
house 10
water 10
son 10
face 9.9
holding 9.9
sunset 9.9
sand 9.9
groom 9.6
relaxed 9.4
senior 9.4
casual 9.3
ocean 9.1
lady 8.9
looking 8.8
room 8.8
holiday 8.6
husband 8.6
men 8.6
scholar 8.5
laughing 8.5
relationship 8.4
mature 8.4
leisure 8.3
wedding 8.3
alone 8.2
cheerful 8.1
coast 8.1
romance 8
cute 7.9
parents 7.8
attractive 7.7
married 7.7
walking 7.6
fashion 7.5
camera 7.4
20s 7.3
playing 7.3
sun 7.2
handsome 7.1
women 7.1
juvenile 7.1
sky 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

building 99.4
person 99
clothing 97.5
outdoor 93
man 86.6
text 83.8
footwear 78.6
old 78.2
vintage 25.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 78.1%
Calm 67.4%
Sad 22%
Confused 4.3%
Angry 1.8%
Disgusted 1.5%
Surprised 1.3%
Fear 1.2%
Happy 0.5%

AWS Rekognition

Age 36-44
Gender Male, 99%
Calm 98.9%
Sad 0.8%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%
Surprised 0%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 84.5%
Sad 10.8%
Angry 1.3%
Confused 1.3%
Disgusted 0.8%
Surprised 0.6%
Happy 0.5%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 92.5%
Calm 53.7%
Sad 32.3%
Fear 3.9%
Angry 3.8%
Disgusted 3.3%
Happy 1.3%
Confused 1.2%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat
Person 99.9%
Person 99.7%
Person 99.6%
Person 98.5%
Hat 54.8%

Categories

Imagga

people portraits 47.6%
paintings art 46.8%
pets animals 4.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of men sitting on steps with a cup of coffee -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image shows a group of four men dressed in traditional attire, sitting and interacting in an outdoor setting, likely from historical India. One person is seated on the ground while the others are on a raised platform near a decorative railing. A hookah is positioned among them, suggesting a moment of relaxation or conversation. The surroundings include architectural elements, such as carved stonework and steps, creating a cultural and historical ambiance. A pair of shoes is placed on the ground near the platform.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts four men in traditional attire seated outdoors near a stone structure. The men are wearing turbans and light-colored garments typical of the late 19th or early 20th century. One man is leaning against a low stone wall, while the other three are sitting nearby, with one person seated on the ground. There is a hookah placed prominently on the ground next to the man seated on the ground, suggesting a moment of relaxation or social interaction. The setting appears to be architectural, as indicated by the stone balustrade and building in the background.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of four men sitting on a stone bench, with one man standing next to them.

  • The man standing is leaning against a stone wall, wearing a white shirt and pants, with a turban on his head.
    • He has his left hand resting on the wall and his right arm hanging down by his side.
    • He is looking to the left of the image.
  • The man sitting on the left is wearing a white shirt and pants, with a turban on his head.
    • He is sitting on the ground with his legs crossed and his hands clasped together in front of him.
    • He is looking down at the ground.
  • The man sitting in the middle is wearing a white shirt and pants, with a turban on his head.
    • He is sitting on the bench with his legs crossed and his hands resting on his lap.
    • He is looking to the right of the image.
  • The man sitting on the right is wearing a white shirt and pants, with a turban on his head.
    • He is sitting on the bench with his legs crossed and his hands resting on his lap.
    • He is looking to the left of the image.

The background of the image is out of focus, but it appears to be a building with a large stone wall and columns. The overall atmosphere of the image is one of relaxation and conversation, as the men are all engaged in talking to each other.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of five men sitting on steps, with one man standing behind them. The men are dressed in traditional Indian clothing, including turbans and loose-fitting shirts and pants. They appear to be engaged in conversation, with some of them looking at each other and others gazing off into the distance.

In the foreground, one of the men is holding a hookah, a traditional Indian water pipe used for smoking tobacco or other substances. The hookah is placed on the ground next to him, and he appears to be preparing to take a puff.

The background of the image shows a stone wall with a decorative railing, suggesting that the men are sitting in a courtyard or other outdoor space. The overall atmosphere of the image is one of relaxation and camaraderie, with the men enjoying each other's company and engaging in conversation.

Overall, the image provides a glimpse into traditional Indian culture and social norms, highlighting the importance of community and social interaction in everyday life.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image shows a black-and-white photograph of four men sitting on a stone bench. The man in the middle is sitting on a stone slab with his legs crossed, while the man on the right is sitting on a stone bench with his legs stretched out. The man on the left is kneeling on the ground, and the man on the right is wearing a turban and a shawl.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black and white photograph of four men. They are sitting on a stone bench. The men are wearing turbans and long white clothing. The men are sitting in various positions. One man is sitting on the ground with his legs crossed, while the other three are sitting on the bench. There is a pipe lying on the ground near the man on the left.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The black and white photograph shows four Indian men relaxing outdoors. The man on the left is squatting on the ground. He wears a turban and tunic. His right hand is touching a long pipe attached to a hookah, which is standing nearby. To his right are three men. One is standing, wearing a turban and long-sleeved shirt. He is leaning against a low concrete wall. To his right, seated, is another turbaned man in a long-sleeved shirt and long pants. The fourth man is sitting on a step, wearing a turban and long-sleeved shirt. The sleeves are rolled to his elbows. A shawl is draped around his neck. He is wearing shorts and he sits with his legs crossed. A pair of sandals is discarded in front of the steps where he is sitting. In the background is the corner of a building with a doorway. The sky is dark, but not visible. The lighting is dim, and the image is not very sharp.

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

This is a sepia-toned photograph depicting a group of men in what appears to be a historic setting. The men are dressed in traditional Indian clothing, including turbans and white garments.

Here's a breakdown of the scene:

  • Composition: The photograph is a horizontal shot, with the men positioned in a somewhat informal arrangement. They are located on a stone or earthen surface, possibly a courtyard or the base of a structure.
  • People: There are four men in the image.
    • One man is squatting on the ground, holding a long pipe, likely connected to a hookah, which sits in front of him.
    • A man is standing behind him, leaning against a stone wall.
    • Two men are sitting, one in a cross-legged position and the other on a step.
  • Hookah: A hookah sits in front of the squatting man, suggesting the men are possibly sharing it.
  • Setting: The background includes elements of architectural detail, such as a wall and steps. There is a building in the background.
  • Details: The image has a somewhat faded quality, common with older photographs. The overall impression is of a moment frozen in time, perhaps a scene of leisure or conversation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a sepia-toned photograph depicting four men in traditional attire, seemingly engaged in a conversation. The setting appears to be an outdoor area, possibly a courtyard or a veranda, with architectural elements such as columns and a balustrade visible in the background.

Here are the details:

  1. Attire:

    • All four men are dressed in traditional clothing, which includes turbans, long shirts (likely kurta or similar garments), and dhotis or loose pants.
    • The man on the far left is kneeling and appears to be holding a rifle or a long object.
    • The man standing is leaning against the balustrade with one hand resting on it.
    • The other two men are seated on the steps, with one of them holding a hookah (a traditional smoking device).
  2. Postures and Interaction:

    • The men seem to be in a relaxed and casual conversation. The seated men are facing each other, indicating engagement in a discussion.
    • The standing man and the kneeling man also appear to be part of the conversation, as they are positioned close to the seated men.
  3. Setting:

    • The background features architectural elements typical of traditional Indian buildings, such as ornate columns and a balustrade.
    • The ground is paved with stone slabs, adding to the historical or traditional ambiance of the setting.
  4. Mood:

    • The overall mood of the photograph is calm and social, depicting a moment of leisure or a break from daily activities.

This photograph likely captures a moment from a bygone era, reflecting the cultural and social aspects of the time.