Human Generated Data

Title

European Man on Horseback

Date

18th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Estate of Margaret F. Schroeder, 1999.342

Human Generated Data

Title

European Man on Horseback

Date

18th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of the Estate of Margaret F. Schroeder, 1999.342

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Person 98
Human 98
Animal 97.1
Mammal 97.1
Horse 97.1
Art 89.2
Clothing 77.7
Apparel 77.7
Painting 75.7
Equestrian 73.3
Poster 71.2
Advertisement 71.2
Modern Art 69.2
Text 65.5
People 63.8
Person 62.2
Horse 62.1
Team Sport 58.1
Sport 58.1
Team 58.1
Sports 58.1
Polo 58.1
Drawing 56.9
Collage 55.3
Bullfighter 55.3

Clarifai
created on 2020-04-23

cavalry 99.9
illustration 99.6
seated 99.4
horse 99.3
competition 98.7
equestrian 98.4
mammal 98.3
art 97.4
rider 97.3
people 97.2
recreation 96.6
wear 96.6
sport 96.4
man 96.4
horseback 96.1
action energy 95.9
jockey 94.9
champion 94.8
saddle 94.3
ride 94

Imagga
created on 2020-04-23

parachute 32.9
sport 30.4
rescue equipment 24.1
equipment 23.6
people 21.2
outdoor 20.6
man 19.5
person 18.4
leisure 17.4
extreme 16.3
activity 16.1
shield 15.9
active 15.7
water 15.3
adventure 15.2
adult 15
action 13.9
protective covering 13.8
covering 13.8
armor 13.5
summer 13.5
travel 13.4
happy 13.1
sports 12.9
male 12.8
snow 12.5
clothing 11.9
umbrella 11.9
winter 11.9
danger 11.8
recreation 11.6
bull 11.5
outdoors 11.3
fun 11.2
grass 11.1
bullfighting 10.9
mountain 10.7
helmet 10.1
park 9.9
vacation 9.8
cultural 9.7
blood 9.7
men 9.4
lifestyle 9.4
wet suit 9.1
exercise 9.1
canopy 9.1
bullring 8.9
climber 8.9
backpack 8.8
boy 8.7
high 8.7
hiking 8.7
attendant 8.6
dangerous 8.6
hat 8.4
tradition 8.3
uniform 8.3
sky 8.3
shelter 8.2
one 8.2
landscape 8.2
weapon 8
garment 8
to 8
gun 7.9
matador 7.9
bullfight 7.9
bravery 7.9
holiday 7.9
climb 7.8
season 7.8
cold 7.7
journey 7.5
animals 7.4
competition 7.3
black 7.2
game 7.2
cute 7.2
team 7.2

Google
created on 2020-04-23

Horse 92.6
Illustration 91.7
Art 79.3
Bridle 78.9
Recreation 74.2
Rein 73.5
Horse trainer 65
Jumping 60.3
Painting 59.3
English riding 59.3
Jumping 58.9
Horse supplies 51.7
Fiction 51.4
Stallion 50.4

Microsoft
created on 2020-04-23

horse 99.4
text 97.8
person 94.3
outdoor 87.9
animal 84.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 51.7%
Confused 45%
Surprised 45.1%
Fear 45%
Angry 45.1%
Happy 45%
Sad 45%
Disgusted 45.1%
Calm 54.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Horse
Painting
Person 98%
Person 62.2%
Horse 97.1%
Horse 62.1%
Painting 75.7%

Captions

Microsoft
created on 2020-04-23

a group of people on a snow board 26.9%
a group of people in the snow 26.8%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image depicts a rider on a rearing horse. The rider is dressed in a red coat, white breeches, and black boots, and is wearing a feathered hat. The horse is brown and appears to be in motion, with its front legs raised off the ground. The background shows a landscape with a green field and a blue sky. The painting has visible signs of wear, with parts of the surface showing scratches and peeling.

Created by gpt-4 on 2024-01-25

The image shows a figure in classic equestrian attire, featuring a red jacket with white trousers, elegantly mounted on a dark brown horse in mid-gallop. The rider appears to be holding a rod or crop and is adorned with a hat featuring a decorative plume. The horse is captured in a dynamic pose with its mane and tail flowing with the motion. They are set against a green ground which suggests an open field, under a sky which appears to have once been blue but now shows substantial wear or damage to the artwork, giving it a mottled and aged appearance. The upper-right corner of the artwork is notably missing, and the edges seem weathered, contributing to a sense of historical context for the piece.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a person riding a horse. The rider is wearing a red coat and a striped hat. The horse is a dark color and appears to be moving through a field or outdoor setting with a hazy, cloudy sky in the background. The image has an aged, vintage appearance with some wear and tear visible on the surface.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image is a painting of a man riding a horse. The man is wearing a red jacket, white pants, and a black hat with a red and white feather. He is holding a stick in his right hand and has a blue saddle with red and yellow trim on the horse. The horse is brown and appears to be rearing up on its hind legs. The background of the painting is a blue sky with some green grass at the bottom. The painting appears to be old and worn, with some tears and scratches visible. It may have been created in the 18th or 19th century, but without more information, it is difficult to determine the exact date or origin of the painting.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a man riding a horse, with the man wearing a red jacket, white pants, and a black hat adorned with a red feather. He holds a long stick in his right hand and appears to be in motion, as evidenced by the horse's raised hooves. The horse is brown with a black mane and tail, and it is depicted in mid-gallop. The background of the image features a blue sky with white speckles, suggesting that the image may have been damaged or aged over time. The overall atmosphere of the image conveys a sense of energy and movement, capturing a moment in time as the man and horse ride across the landscape.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a watercolor painting of a man riding a horse. The painting appears to be somewhat aged and damaged, with visible wear and tear. The man is wearing a red uniform with white and red stripes, a black hat with a red and white feather, and yellow gloves. He is holding a stick in his right hand and appears to be riding the horse at a gallop. The horse is brown and has a white mane. The background is a light blue color with some white spots, possibly representing a sky or a distant landscape.

Created by amazon.nova-pro-v1:0 on 2025-01-04

In a painting, a person is riding a horse, and it seems like he is posing for a picture. He is wearing a red and white outfit with a hat, and he is holding a stick in his hand. The horse is brown, and it has a white spot on its forehead. The horse seems to be running, and its shadow is falling on the ground. The painting has some white spots.