Human Generated Data

Title

The Dog Wallah

Date

c. 1825

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.258

Human Generated Data

Title

The Dog Wallah

Date

c. 1825

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.258

Machine Generated Data

Tags

Amazon
created on 2019-04-04

Person 99.3
Human 99.3
Strap 98
Antelope 95
Mammal 95
Animal 95
Wildlife 95
Dog 82.2
Canine 82.2
Pet 82.2
Leash 78.8
Dog 76.2
Clothing 73
Apparel 73
Leisure Activities 63.8
Outdoors 60.9
Sleeve 56.2
Dog 52.3

Clarifai
created on 2018-03-23

dog 99.9
adult 98.9
people 98.8
mammal 98.6
canine 98.3
one 97.5
pet 97.1
woman 97
lid 96.9
wear 96.8
recreation 95.7
man 95.1
fun 95
two 94.8
motion 94
beach 93.7
friendship 93.2
leisure 92.8
enjoyment 89.6
group 88.1

Imagga
created on 2018-03-23

hound 49.3
dog 43.6
horse 43.2
hunting dog 38.7
leash 37.1
restraint 29.9
greyhound 28.4
canine 27.4
device 23.2
cowboy 22.5
farm 22.3
whippet 21.8
racer 20.8
horses 20.5
pasture 20.1
sand 20.1
animals 19.4
ranch 18.6
stallion 18.6
brown 18.4
rural 17.6
running 17.3
beach 16.9
field 16.7
pet 16.5
equine 16.2
sport 15.7
grass 15
summer 14.8
outdoors 14.2
wild 13.9
run 13.5
sky 13.4
domestic animal 13.2
desert 13.1
mane 12.7
landscape 12.6
wildlife 12.5
tail 12.5
mare 11.8
race 11.5
equestrian 10.8
meadow 10.8
outdoor 10.7
rope 10.7
trainer 10.3
camel 10.3
black 10.2
two 10.2
bull 9.9
male 9.8
riding 9.8
sun 9.7
sunny 9.5
gallop 8.9
dogs 8.8
dune 8.8
breed 8.7
safari 8.7
pets 8.6
walking 8.5
travel 8.5
speed 8.2
fall 8.1
saddle 7.9
arena 7.9
mammals 7.8
dingo 7.7
line 7.7
head 7.6
wilderness 7.6
laborer 7.5
dry 7.4
tourism 7.4
heat 7.4
man 7.4
people 7.3
domestic 7.2
sunset 7.2

Google
created on 2018-03-23

dog 78.6
leash 77.5
dog like mammal 76.7
illustration 54.1

Microsoft
created on 2018-03-23

dog 99.9
outdoor 94.5
man 91.1
mammal 53.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-38
Gender Male, 54.9%
Confused 45.3%
Angry 45.4%
Calm 45.7%
Surprised 45.4%
Sad 45.5%
Happy 52.6%
Disgusted 45.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Antelope 95%
Dog 82.2%

Captions

Azure OpenAI

Created on 2024-01-24

This image portrays a person standing on flat ground, dressed in traditional attire that includes a red tailcoat with buttons, white knee-length breeches, white stockings, and black shoes. The individual dons a blue tricorne hat and appears to hold a whip in one hand and multiple leashes in the other, which are connected to a group of four dogs of varying breeds. The dogs are positioned attentively in front of the person, indicating they are out for a walk or being trained. The background suggests a clear sky over a simple, grassy horizon.

Anthropic Claude

Created on 2024-03-29

The image depicts a man wearing a red uniform jacket and a blue cap, standing in a field and holding leashes attached to three dogs - a brown dog, a black dog, and a white-and-black dog. The man appears to be a dog handler or caretaker, likely assisting with or guiding the dogs in some capacity. The background is a plain, light-colored setting, emphasizing the central figures in the foreground.