Human Generated Data

Title

Untitled (horse race)

Date

c. 1920

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1700

Human Generated Data

Title

Untitled (horse race)

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Date

c. 1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Horse 99.4
Animal 99.4
Mammal 99.4
Horse 98.4
Horse 96.9
Horse 96.8
Horse 94.8
Transportation 94
Vehicle 93.7
Horse 90.2
Bicycle 83.9
Bike 83.9
Wagon 82.2
Horse Cart 82.2
Sport 76.1
Human 76.1
Sports 76.1
Cyclist 76.1
Horse 71.8
Person 67.2
Person 65
Person 64.8
Person 62.8
Carriage 56.7
Tarmac 55.9
Asphalt 55.9
Furniture 55.2
Couch 55.2
Person 43.3

Imagga
created on 2022-01-14

carriage 100
harness 62.4
support 42.7
horse 41.1
device 32.6
cart 23.2
horse cart 22.6
animal 22.3
horses 21.4
travel 16.9
wagon 15.4
transportation 15.2
ride 14.7
outdoors 14.2
rural 14.1
summer 13.5
sport 13.2
tree 13.1
landscape 12.6
old 12.5
vacation 12.3
people 12.3
speed 11.9
farm 11.6
tourism 11.6
sunset 10.8
recreation 10.8
riding 10.7
mammal 10.7
trees 10.7
grass 10.3
sky 10.2
field 10
city 10
tourist 10
country 9.7
animals 9.3
transport 9.1
equestrian 8.8
sea 8.6
architecture 8.6
wheeled vehicle 8.4
action 8.3
building 7.9
jockey 7.9
racing 7.8
livestock 7.8
running 7.7
race 7.6
outdoor 7.6
man 7.4
brown 7.4
water 7.3
competition 7.3
sun 7.2
vehicle 7.2

Google
created on 2022-01-14

Horse 93.5
White 92.2
Black 89.8
Working animal 89.2
Wheel 89
Tree 87.8
Vehicle 87.5
Motor vehicle 84.5
Horse tack 80.1
Asphalt 78.5
Bridle 78.2
Grass 77.3
Pack animal 77
Horse supplies 76.8
Rein 75.1
Recreation 74.5
Landscape 72.9
Monochrome photography 71.5
Livestock 71.3
Road 71.2

Microsoft
created on 2022-01-14

horse 100
outdoor 99.6
tree 99.2
carriage 98.7
drawn 98
pulling 96.9
riding 96.5
road 95.3
text 87.1
horse-drawn vehicle 83
transport 75.2
animal 74.2
people 73.1
group 65.2
cart 58.7
pulled 55.1
horse and buggy 50.1

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 92.3%
Happy 3.6%
Angry 1%
Sad 0.9%
Surprised 0.8%
Disgusted 0.7%
Fear 0.4%
Confused 0.3%

Feature analysis

Amazon

Horse 99.4%
Person 67.2%

Captions

Microsoft

a group of people riding on the back of a horse drawn carriage 97.6%
a group of people riding a horse drawn carriage 97.5%
a group of people riding on top of a horse drawn carriage 97.1%