Human Generated Data

Title

The Dog Wallah

Date

c. 1825

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.258

Human Generated Data

Title

The Dog Wallah

Date

c. 1825

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.258

Machine Generated Data

Tags

Amazon
created on 2019-04-04

Human 99.3
Strap 98
Mammal 95
Animal 95
Wildlife 95
Canine 82.2
Pet 82.2
Leash 78.8
Clothing 73
Apparel 73
Leisure Activities 63.8
Outdoors 60.9
Sleeve 56.2

Clarifai
created on 2018-03-23

dog 99.9
adult 98.9
people 98.8
mammal 98.6
canine 98.3
one 97.5
pet 97.1
woman 97
lid 96.9
wear 96.8
recreation 95.7
man 95.1
fun 95
two 94.8
motion 94
beach 93.7
friendship 93.2
leisure 92.8
enjoyment 89.6
group 88.1

Imagga
created on 2018-03-23

hound 49.3
dog 43.6
horse 43.2
hunting dog 38.7
leash 37.1
restraint 29.9
greyhound 28.4
canine 27.4
device 23.2
cowboy 22.5
farm 22.3
whippet 21.8
racer 20.8
horses 20.5
pasture 20.1
sand 20.1
animals 19.4
ranch 18.6
stallion 18.6
brown 18.4
rural 17.6
running 17.3
beach 16.9
field 16.7
pet 16.5
equine 16.2
sport 15.7
grass 15
summer 14.8
outdoors 14.2
wild 13.9
run 13.5
sky 13.4
domestic animal 13.2
desert 13.1
mane 12.7
landscape 12.6
wildlife 12.5
tail 12.5
mare 11.8
race 11.5
equestrian 10.8
meadow 10.8
outdoor 10.7
rope 10.7
trainer 10.3
camel 10.3
black 10.2
two 10.2
bull 9.9
male 9.8
riding 9.8
sun 9.7
sunny 9.5
gallop 8.9
dogs 8.8
dune 8.8
breed 8.7
safari 8.7
pets 8.6
walking 8.5
travel 8.5
speed 8.2
fall 8.1
saddle 7.9
arena 7.9
mammals 7.8
dingo 7.7
line 7.7
head 7.6
wilderness 7.6
laborer 7.5
dry 7.4
tourism 7.4
heat 7.4
man 7.4
people 7.3
domestic 7.2
sunset 7.2

Google
created on 2018-03-23

dog 78.6
leash 77.5
dog like mammal 76.7
illustration 54.1

Microsoft
created on 2018-03-23

dog 99.9
outdoor 94.5
man 91.1
mammal 53.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-38
Gender Male, 54.9%
Confused 45.3%
Angry 45.4%
Calm 45.7%
Surprised 45.4%
Sad 45.5%
Happy 52.6%
Disgusted 45.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Antelope
Dog

Clarifai

Dog
Person
Footwear
Human face

AWS Rekognition

Person 99.3%

AWS Rekognition

Antelope 95%

AWS Rekognition

Dog 82.2%

AWS Rekognition

Dog 76.2%

AWS Rekognition

Dog 52.3%

Clarifai

Dog 89.1%

Clarifai

Dog 70.2%

Clarifai

Dog 62.3%

Clarifai

Person 69.2%

Clarifai

Footwear 54.9%

Clarifai

Footwear 50.1%

Clarifai

Human face 44.5%

Categories

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a man in a red jacket and white pants with a dog on a leash

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man walking with two dogs

OpenAI GPT

Created by gpt-4 on 2024-01-24

This image portrays a person standing on flat ground, dressed in traditional attire that includes a red tailcoat with buttons, white knee-length breeches, white stockings, and black shoes. The individual dons a blue tricorne hat and appears to hold a whip in one hand and multiple leashes in the other, which are connected to a group of four dogs of varying breeds. The dogs are positioned attentively in front of the person, indicating they are out for a walk or being trained. The background suggests a clear sky over a simple, grassy horizon.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a historical illustration showing a dog handler or walker dressed in colonial Indian attire. He's wearing a bright red jacket with buttons, white shorts/dhoti, and a distinctive blue hat. The man is holding leashes for three dogs of different breeds and sizes - there's a taller brown dog that appears to be similar to a greyhound, a black and white spotted dog in the middle, and what looks like a smaller black dog. The illustration has a simple background with a hint of green horizon and beige/orange ground. The style suggests this is likely from a collection of Company School paintings, which were Indian artworks commissioned by European patrons in the 18th or 19th centuries to document various aspects of Indian life and occupations.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a man wearing a red uniform jacket and a blue cap, standing in a field and holding leashes attached to three dogs - a brown dog, a black dog, and a white-and-black dog. The man appears to be a dog handler or caretaker, likely assisting with or guiding the dogs in some capacity. The background is a plain, light-colored setting, emphasizing the central figures in the foreground.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a man walking three dogs on leashes. The man is dressed in a red jacket with gold trim and buttons, white shorts, and a blue hat. He wears black shoes and has a white cloth tied around his waist. The dogs are of different breeds and sizes, with the largest being brown, the middle-sized dog being white, and the smallest being black. The background features a light-colored sky and a green area at the bottom, suggesting a landscape or outdoor setting. The overall atmosphere of the image is one of leisure and companionship between the man and his dogs.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a man walking three dogs on leashes. The man is dressed in a red jacket with gold cuffs and buttons, white pants, and a blue hat. He has a black beard and mustache and is wearing black shoes. He is holding the leashes of the three dogs in his left hand, while his right hand is at his side.

The dogs are all different breeds and sizes. The dog on the left is a large brown dog, possibly a greyhound or whippet. The middle dog is a medium-sized white dog, possibly a terrier or foxhound. The dog on the right is a small black and white dog, possibly a Chihuahua or Pomeranian.

The background of the image is a plain white wall, with a green strip at the bottom. The overall atmosphere of the image suggests that the man is taking the dogs for a walk, possibly in a park or other outdoor setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a man in traditional attire, holding a leash with multiple dogs. The man is dressed in a red long-sleeved shirt, a blue turban, and white pants. He is standing on a sandy surface, possibly a beach or a park. The dogs are of different sizes and colors, and they are all wearing collars. The man is holding a leash with a long rope attached to it, and he is looking to the left. The image has a vintage or antique feel, with a slightly faded color palette.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a man walking with his dogs on leashes. The man is wearing a red jacket, a white skirt, and a blue turban. He is holding the leashes in his right hand. The dogs are a mix of different breeds, with one being a small black dog and the other two being larger white dogs. The painting has a vintage look, with a yellowish hue and a slightly blurry effect.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

The image shows a man walking four dogs. The man is dressed in a red jacket with gold buttons and trim at the cuffs, a white dhoti wrapped around his waist and legs, and a blue hat. He has dark skin, a mustache, and is looking to the left. He's holding a stick with a looped end and is also holding the leashes of the four dogs.

The dogs vary in size and color. The largest is a light brown, slender dog with a collar. Behind it is a white dog with black patches, and in front is a smaller black and brown dog. The fourth dog's position is mostly obscured by the others.

The background is simple, with a muted brown ground and a strip of light green suggesting grass behind the figures. The style of the image is illustrative and somewhat formal.

Created by gemini-2.0-flash-lite on 2025-04-26

Certainly! Here's a description of the image:

Overall Impression:

The image is a colorful, detailed illustration, likely a historical or artistic depiction. It features a man walking with a leash holding three dogs. The style suggests a traditional or classical approach to art.

Key Elements and Details:

  • The Man: He is the central figure. He has dark hair, a mustache, and wears a bright red jacket with gold buttons, a blue hat, and a white cloth wrapped around his lower body. He appears to be holding a leash and a whip.
  • The Dogs: There are three dogs of varying sizes and breeds.
    • One is a large, lean, light brown dog, likely a Greyhound.
    • Another appears to be a medium-sized white dog with black spots.
    • The third is a small, black dog with short legs, similar to a terrier.
  • Setting: The man and dogs stand on a ground that appears to be sandy or dirt-like, with a strip of green representing grass. The background is a plain, light-colored space, which directs the viewer's attention to the subjects.
  • Style and Composition: The artwork has a clear and crisp style, with careful rendering of details like the man's clothing, the dog's coats, and the leash. The composition is balanced, with the man and dogs arranged in a way that is both informative and visually pleasing.

Let me know if you would like a more specific or detailed description!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a man dressed in traditional attire, holding leashes attached to three dogs. Here is a detailed description:

  1. Man:

    • The man is wearing a red jacket with gold buttons and white trousers.
    • He has a blue turban on his head.
    • He is holding three leashes in his hands, each attached to a different dog.
    • He is standing on a dirt path with a green landscape in the background.
  2. Dogs:

    • There are three dogs of different breeds and colors.
    • The first dog, on the left, is a sleek, brown dog, possibly a Greyhound or a similar breed.
    • The second dog, in the middle, is white with black patches, possibly a Terrier or a similar breed.
    • The third dog, on the right, is black with tan markings, possibly a Manchester Terrier or a similar breed.
  3. Background:

    • The background is relatively simple, featuring a green landscape and a dirt path, giving a sense of an open, rural area.

The overall scene suggests a traditional or historical setting, possibly depicting a dog handler or someone involved in dog care or training. The attire and the setting hint at a cultural or historical context, possibly from a specific region or time period.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

This image is a watercolor painting depicting a man dressed in traditional attire, walking with three dogs. The man is wearing a red coat with yellow cuffs, white pants, and a blue hat. He is holding the leashes of the dogs, which are tied together. The dogs consist of one light brown or tan dog and two black-and-white dogs. The background is minimal, with a light green and brown ground, suggesting an outdoor setting. The style of the painting is reminiscent of colonial-era illustrations, possibly from the 18th or 19th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

This image is a painting or drawing depicting a man walking four dogs. The man is dressed in a red coat with white trim and white pants, and he is wearing a blue hat. He has a mustache and is holding the leashes of the dogs with one hand while holding a stick in the other. The dogs are of different breeds and colors, including a tan dog, a black and white dog, and two smaller black dogs. The background is a simple, flat landscape with a green horizon line and a brown ground. The overall style of the image is reminiscent of 19th-century European art.