Human Generated Data

Title

European Man on Horseback

Date

18th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Estate of Margaret F. Schroeder, 1999.342

Human Generated Data

Title

European Man on Horseback

Date

18th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Estate of Margaret F. Schroeder, 1999.342

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Person 98
Human 98
Animal 97.1
Mammal 97.1
Horse 97.1
Art 89.2
Clothing 77.7
Apparel 77.7
Painting 75.7
Equestrian 73.3
Poster 71.2
Advertisement 71.2
Modern Art 69.2
Text 65.5
People 63.8
Person 62.2
Horse 62.1
Team Sport 58.1
Sport 58.1
Team 58.1
Sports 58.1
Polo 58.1
Drawing 56.9
Collage 55.3
Bullfighter 55.3

Clarifai
created on 2020-04-23

cavalry 99.9
illustration 99.6
seated 99.4
horse 99.3
competition 98.7
equestrian 98.4
mammal 98.3
art 97.4
rider 97.3
people 97.2
recreation 96.6
wear 96.6
sport 96.4
man 96.4
horseback 96.1
action energy 95.9
jockey 94.9
champion 94.8
saddle 94.3
ride 94

Imagga
created on 2020-04-23

parachute 32.9
sport 30.4
rescue equipment 24.1
equipment 23.6
people 21.2
outdoor 20.6
man 19.5
person 18.4
leisure 17.4
extreme 16.3
activity 16.1
shield 15.9
active 15.7
water 15.3
adventure 15.2
adult 15
action 13.9
protective covering 13.8
covering 13.8
armor 13.5
summer 13.5
travel 13.4
happy 13.1
sports 12.9
male 12.8
snow 12.5
clothing 11.9
umbrella 11.9
winter 11.9
danger 11.8
recreation 11.6
bull 11.5
outdoors 11.3
fun 11.2
grass 11.1
bullfighting 10.9
mountain 10.7
helmet 10.1
park 9.9
vacation 9.8
cultural 9.7
blood 9.7
men 9.4
lifestyle 9.4
wet suit 9.1
exercise 9.1
canopy 9.1
bullring 8.9
climber 8.9
backpack 8.8
boy 8.7
high 8.7
hiking 8.7
attendant 8.6
dangerous 8.6
hat 8.4
tradition 8.3
uniform 8.3
sky 8.3
shelter 8.2
one 8.2
landscape 8.2
weapon 8
garment 8
to 8
gun 7.9
matador 7.9
bullfight 7.9
bravery 7.9
holiday 7.9
climb 7.8
season 7.8
cold 7.7
journey 7.5
animals 7.4
competition 7.3
black 7.2
game 7.2
cute 7.2
team 7.2

Google
created on 2020-04-23

Horse 92.6
Illustration 91.7
Art 79.3
Bridle 78.9
Recreation 74.2
Rein 73.5
Horse trainer 65
Jumping 60.3
Painting 59.3
English riding 59.3
Jumping 58.9
Horse supplies 51.7
Fiction 51.4
Stallion 50.4

Microsoft
created on 2020-04-23

horse 99.4
text 97.8
person 94.3
outdoor 87.9
animal 84.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 51.7%
Confused 45%
Surprised 45.1%
Fear 45%
Angry 45.1%
Happy 45%
Sad 45%
Disgusted 45.1%
Calm 54.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Horse 97.1%
Painting 75.7%

Captions

Microsoft
created on 2020-04-23

a group of people on a snow board 26.9%
a group of people in the snow 26.8%

Azure OpenAI

Created on 2024-01-25

The image shows a figure in classic equestrian attire, featuring a red jacket with white trousers, elegantly mounted on a dark brown horse in mid-gallop. The rider appears to be holding a rod or crop and is adorned with a hat featuring a decorative plume. The horse is captured in a dynamic pose with its mane and tail flowing with the motion. They are set against a green ground which suggests an open field, under a sky which appears to have once been blue but now shows substantial wear or damage to the artwork, giving it a mottled and aged appearance. The upper-right corner of the artwork is notably missing, and the edges seem weathered, contributing to a sense of historical context for the piece.

Anthropic Claude

Created on 2024-03-29

The image depicts a person riding a horse. The rider is wearing a red coat and a striped hat. The horse is a dark color and appears to be moving through a field or outdoor setting with a hazy, cloudy sky in the background. The image has an aged, vintage appearance with some wear and tear visible on the surface.