Human Generated Data

Title

Untitled (Brahmin scholars)

Date

1862-1863

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.62

Human Generated Data

Title

Untitled (Brahmin scholars)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.62

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.3
Person 99.2
Person 98.9
Chef 97.7
Helmet 86.3
Clothing 86.3
Apparel 86.3

Clarifai
created on 2023-10-26

people 100
adult 99.2
group 98.6
veil 98.2
two 97.6
man 96.5
lid 96.3
portrait 96
three 95.4
group together 94.9
military 94.2
wear 93.7
woman 92.4
four 89.6
several 86.5
outfit 86.2
uniform 85.8
leader 85.6
child 85.4
five 84.5

Imagga
created on 2022-01-23

kin 35
person 30
people 27.3
man 26.9
portrait 24.6
male 24.1
hat 21.1
adult 19.6
couple 18.3
love 17.3
dress 17.1
happy 16.9
ballplayer 15.8
player 14.9
face 14.2
happiness 14.1
men 13.7
attractive 13.3
black 13.2
athlete 13
clothing 12.7
romantic 12.5
smile 12.1
two 11.8
world 11.8
religion 11.6
married 11.5
costume 11.4
look 11.4
ruler 10.8
handsome 10.7
family 10.7
statue 10.6
fashion 10.5
bride 10.5
contestant 10.4
old 10.4
uniform 9.6
culture 9.4
tradition 9.2
wedding 9.2
traditional 9.1
father 9.1
child 9.1
sculpture 9
romance 8.9
lady 8.9
new 8.9
interior 8.8
sexy 8.8
celebration 8.8
husband 8.7
boy 8.7
lifestyle 8.7
sitting 8.6
pair 8.5
pretty 8.4
human 8.2
indoor 8.2
style 8.1
mother 8.1
guy 8.1
home 8
smiling 7.9
dad 7.9
prayer 7.7
wall 7.7
youth 7.7
worker 7.6
art 7.6
hand 7.6
wife 7.6
senior 7.5
religious 7.5
pose 7.2
success 7.2
decoration 7.2
looking 7.2
team 7.2
grandfather 7.1
businessman 7.1
architecture 7

Google
created on 2022-01-23

Hat 83.2
Cooking 79.3
Vintage clothing 74.2
Table 74
Event 69.4
Cook 68.2
Art 67.7
Sitting 66.1
History 65.8
Recreation 64.9
Room 62.3
Classic 60.6
Sun hat 56.8
Cuisine 54.1
Crew 54
Family 52.5
Team 52.4
Retro style 50.8

Microsoft
created on 2022-01-23

wall 97.1
text 96.7
old 96.5
person 95.2
sitting 94.8
clothing 93.3
man 92.4
hat 82
people 68
player 65.4
white 64.1
posing 56.9
vintage 33.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 99.7%
Calm 72.5%
Sad 20.8%
Disgusted 1.6%
Surprised 1.6%
Confused 1.5%
Fear 0.8%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 39-47
Gender Male, 99.6%
Calm 87.7%
Sad 7.9%
Confused 1.1%
Surprised 0.8%
Angry 0.7%
Disgusted 0.6%
Fear 0.6%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 61.2%
Surprised 16%
Fear 6.8%
Angry 4.6%
Disgusted 4%
Sad 2.7%
Happy 2.6%
Confused 2.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 68.6%
Sad 20.3%
Happy 2.7%
Disgusted 2.1%
Angry 2%
Confused 1.5%
Surprised 1.3%
Fear 1.3%

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet
Person 99.7%
Person 99.3%
Person 99.2%
Person 98.9%
Helmet 86.3%

Categories

Imagga

people portraits 79.5%
paintings art 19.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of men sitting on a rug -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image shows a group of four individuals seated on a patterned rug, positioned on a raised platform with decorative edges. They are dressed in traditional white attire, and each person wears a type of cap or head covering. One individual appears to be holding or sitting before a rectangular object, possibly a writing tablet or board. The photograph has a plain backdrop, minimal furnishings, and exudes a formal or cultural setting.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts four individuals seated on a raised platform, dressed in traditional white attire, with head coverings. They are sitting in a cross-legged position on an ornately patterned carpet. The background is a plain wall, and the platform has decorative stonework or carvings along its edge. The overall setting suggests a formal or ceremonial atmosphere.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows four men seated on the floor, wearing traditional white clothing and headgear. They appear to be engaged in some kind of activity or discussion, with one man holding what looks like a book or document. The background is plain, suggesting this is a formal portrait or studio setting. The men have serious expressions on their faces, indicating this is likely a formal or ceremonial occasion.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a historical black and white photograph showing four individuals seated on a patterned carpet or rug. They are all wearing similar traditional Indian white clothing and white caps. One person in the middle appears to have a book or document in front of them. The image appears to be from the colonial era in India, given the style of dress and the photographic technique used. All four individuals are seated in a traditional cross-legged position (padmasana), and the setting appears to be formal or ceremonial. The photograph has a sepia tone typical of late 19th century photography, and there's text visible at the bottom of the image which appears to be a caption or photographer's mark.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of four men seated on a platform, likely taken in the late 19th or early 20th century. The men are dressed in traditional Indian attire, with the two central figures wearing white turbans and the other two wearing white caps. They are all seated on a patterned rug, with the two men on the left and right positioned on the floor, while the two men in the center sit on cushions.

The platform they are sitting on is adorned with intricate carvings, and the background of the image is a plain wall. The overall atmosphere of the image suggests a formal or ceremonial setting, possibly a religious or cultural event.

The image appears to be a vintage photograph, possibly taken by a professional photographer, given the quality of the image and the presence of a signature in the bottom-left corner. The signature reads "Habibullah Habibullah, Photographer," which suggests that the photographer was likely a local artist or craftsman who specialized in capturing portraits and scenes of everyday life in India during this time period.

Overall, the image provides a glimpse into the lives and customs of people in India during the late 19th or early 20th century, and serves as a valuable historical document for understanding the cultural and social context of the time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a sepia-toned photograph of four men seated on the floor, dressed in white attire. The men are arranged in a row, with the first man on the left wearing a white cap and facing the second man, who is also wearing a white cap and holding an open book. The third man is positioned in the center, wearing a white cap and looking forward, while the fourth man on the right wears a white cap and faces the camera.

The men are seated on a patterned rug or mat, which appears to be placed on a stone or concrete floor. The background of the image is a plain wall, providing a simple and uncluttered setting for the scene. The overall atmosphere of the image suggests a sense of calmness and serenity, with the men engaged in a quiet activity, possibly reading or discussing the contents of the book.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph featuring five individuals sitting on a platform. The man in the center is holding a book, and all of them are dressed in white garments and white hats. The photograph has a watermark in the bottom left corner that reads "H.H. Robertson, Photo." The image captures a serene and formal moment, likely taken in a studio setting.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of four men sitting on a carpeted platform. The men are dressed in white clothing and are wearing white hats. The man on the left is sitting with his legs crossed, while the man in the middle is holding a book. The man on the right is sitting with his legs crossed, and the man on the far right is sitting with his legs crossed and his hands on his knees.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here is a description of the image:

The image is a sepia-toned photograph featuring four men seated on a low platform or dais. The platform has a decorative carved edge along the front. The men are uniformly dressed in white, consisting of long-sleeved shirts and matching hats or head coverings.

From left to right, the men are arranged as follows: The first man on the left appears younger than the others, with a slim build. The second man has a mustache and a more prominent facial structure; he also has a rectangular object, possibly a book or writing slate, on his lap. The third man has a mustache and wears a small beaded necklace. The fourth man also has a mustache, with his hair slightly visible under his hat.

They are all seated cross-legged, and a patterned cloth is spread beneath them on the platform. Behind them, the background is a plain wall or backdrop that is darker than the men's attire. The overall composition is formal, suggesting a posed portrait of the group. The photograph seems to be quite old, as the sepia tone and the style of clothing and headwear are indicative of historical photography. At the bottom left of the image, near the base of the platform, a handwritten inscription in cursive reads "Shepherd & Robertson, Photo". There is also a series of numbers after it but the are barely visible.

Created by gemini-2.0-flash-lite on 2025-05-08

Here's a description of the image:

Overall: The image is a sepia-toned photograph depicting four men seated in a row. The style and attire suggest the photograph was taken in a South Asian context, possibly in the 19th century.

Setting and Composition:

  • Background: The background is a plain, slightly blurred surface, possibly a wall.
  • Platform: The men are seated on a raised platform or bench, which has a decorative, possibly carved, edge. The top of the platform is covered with a patterned rug.
  • Arrangement: The men are arranged in a line, each facing toward the center of the frame. The person on the left appears to be the youngest.

Attire and Appearance:

  • Clothing: All four men are wearing similar traditional clothing. They are all wearing white, long-sleeved shirts, likely a type of kurta, and white or light-colored caps that covers the head.
  • Accessories: Some of the men appear to be wearing thin necklaces.
  • Facial Features: The men have dark hair and mustaches.

Activities:

  • One of the men, seated in the center, appears to have a small book or manuscript in front of him.
  • The men are generally looking at the camera, but are not necessarily posing in a formal way.

Overall Impression:

The photograph appears to capture a moment of daily life or perhaps a ritual or gathering. The image has an air of formality but not stiffness, and gives a sense of the culture.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a historical photograph depicting four men seated on a patterned carpet. They are dressed in traditional attire, which includes white clothing and headgear. The clothing appears to be simple and modest, likely made of lightweight fabric.

The setting is indoors, with a plain, dark backdrop behind the men. The men are seated in a row, facing the camera. The man second from the left is holding a book or a document on his lap, suggesting that he might be reading or engaged in a discussion. The other men appear to be listening attentively.

The photograph has a sepia tone, indicating that it is quite old, likely from the late 19th or early 20th century. The image has some wear and tear, with visible scratches and marks, adding to its antique appearance. The photograph is credited to "Shepherd & Robertson, Photo" and dated 1877, which is noted at the bottom left corner of the image.

Overall, the image captures a moment of intellectual or religious activity, possibly a discussion or a reading session, among a group of men in traditional attire.