Human Generated Data

Title

Colonel Mordaunt's Cockfight (after Zoffany)

Date

c. 1800

People

Artist after: John Zoffany, German 1733 - 1810

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.225

Human Generated Data

Title

Colonel Mordaunt's Cockfight (after Zoffany)

People

Artist after: John Zoffany, German 1733 - 1810

Date

c. 1800

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.225

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Human 98.7
Person 98.7
Painting 98.6
Art 98.6
Person 97.9
Person 94.6
Person 90.9
Person 82.7
Person 80.9
Person 80.4
Person 78.2
Person 73.4
Person 69.8
Person 69.4
Person 66.3
Person 65.2
Person 61.1
Person 52.4
Person 45.8
Person 44
Person 43.8

Clarifai
created on 2019-05-22

people 100
painting 99.5
man 99.4
adult 99.3
art 99.1
illustration 99.1
group 98.7
war 98.7
print 98.5
soldier 97.9
many 97.6
weapon 97
religion 96.7
force 96.3
skirmish 96.3
battle 96
woman 95
military 94.9
army 94.7
kneeling 91.1

Imagga
created on 2019-05-22

graffito 42.9
decoration 32.6
military 19.3
old 18.8
man 18.1
soldier 17.6
private 17.3
uniform 17.1
camouflage 16.6
war 16.3
art 16
weapon 15.1
gun 14.8
protection 14.5
religion 13.4
people 12.8
culture 12.8
danger 12.7
clothing 12.7
equipment 12.2
mask 11.8
architecture 11.7
army 11.7
sport 11.2
religious 11.2
sculpture 11.1
church 11.1
covering 10
temple 10
paint 10
male 9.9
history 9.8
helmet 9.7
extreme 9.6
statue 9.5
color 9.4
guy 9.2
outdoors 9
comic book 8.9
scene 8.7
ancient 8.6
person 8.6
god 8.6
car 8.5
training 8.3
vintage 8.3
landmark 8.1
recreation 8.1
activity 8.1
vehicle 8
building 8
colorful 7.9
wall 7.8
battle 7.8
pray 7.7
travel 7.7
spiritual 7.7
cathedral 7.7
faith 7.6
outdoor 7.6
traditional 7.5
city 7.5
sports 7.4
gold 7.4
tradition 7.4
military uniform 7.4
competition 7.3
adult 7.1
antique 7.1

Google
created on 2019-05-22

Painting 88.4
Art 86.5
Textile 65.6
Illustration 60.2
Visual arts 59.3

Microsoft
created on 2019-05-22

painting 96.2
text 90.4
clothing 89.7
person 85.9
drawing 82.3
art 82.2
man 80.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Disgusted 45.1%
Sad 53.4%
Happy 45.1%
Surprised 45.2%
Confused 45.3%
Angry 45.3%
Calm 45.7%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Angry 45.5%
Confused 45.5%
Disgusted 48.9%
Calm 46.8%
Happy 46.5%
Surprised 45.5%
Sad 46.3%

AWS Rekognition

Age 23-38
Gender Male, 54.1%
Calm 45%
Surprised 45%
Sad 54.9%
Angry 45%
Confused 45%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 27-44
Gender Male, 50.1%
Calm 45%
Angry 45.4%
Sad 52%
Disgusted 45.2%
Confused 45.1%
Surprised 45.1%
Happy 47.2%

AWS Rekognition

Age 26-43
Gender Male, 52.4%
Disgusted 45.3%
Surprised 46%
Happy 47.9%
Sad 45.2%
Calm 50.1%
Angry 45.3%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53%
Sad 47.9%
Calm 47.2%
Confused 45.6%
Disgusted 45.5%
Angry 45.6%
Surprised 46.5%
Happy 46.6%

AWS Rekognition

Age 35-52
Gender Male, 53.9%
Angry 45.1%
Sad 45.2%
Surprised 45.1%
Happy 45.1%
Calm 54.2%
Disgusted 45.2%
Confused 45%

AWS Rekognition

Age 35-52
Gender Female, 51.2%
Surprised 45.3%
Sad 52.8%
Confused 45.1%
Angry 45.3%
Happy 46.2%
Disgusted 45.2%
Calm 45.2%

AWS Rekognition

Age 48-68
Gender Female, 52%
Calm 45.4%
Angry 45.8%
Sad 50.3%
Disgusted 47.7%
Confused 45.6%
Surprised 45.2%
Happy 45.1%

AWS Rekognition

Age 30-47
Gender Male, 51.2%
Confused 45.1%
Sad 45.7%
Disgusted 52.7%
Angry 45.2%
Surprised 45.2%
Calm 45.9%
Happy 45.2%

AWS Rekognition

Age 45-63
Gender Female, 53.3%
Sad 54.5%
Angry 45.2%
Disgusted 45%
Confused 45%
Calm 45.1%
Happy 45%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Calm 45%
Disgusted 45%
Surprised 45%
Sad 54.9%
Confused 45%
Happy 45%
Angry 45%

AWS Rekognition

Age 10-15
Gender Female, 50.8%
Disgusted 45.4%
Surprised 45.3%
Calm 45.1%
Happy 45.3%
Confused 45.2%
Sad 53.3%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Happy 45.1%
Surprised 45.4%
Calm 49.8%
Disgusted 47.5%
Sad 46.1%
Confused 45.4%
Angry 45.7%

AWS Rekognition

Age 23-38
Gender Female, 51%
Disgusted 45.2%
Confused 45.3%
Sad 51.4%
Angry 45.5%
Happy 45.3%
Surprised 45.5%
Calm 46.8%

AWS Rekognition

Age 49-69
Gender Female, 53.8%
Surprised 45%
Angry 45%
Happy 45%
Confused 45%
Disgusted 45%
Calm 45%
Sad 54.9%

AWS Rekognition

Age 38-57
Gender Male, 54.8%
Happy 45.5%
Sad 51.7%
Disgusted 46.2%
Calm 45.5%
Confused 45.4%
Angry 45.5%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.6%
Sad 49.6%
Happy 49.6%
Angry 49.6%
Surprised 49.5%
Calm 50.1%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Calm 47.8%
Angry 45.9%
Sad 48.9%
Disgusted 45.1%
Confused 45.5%
Surprised 45.4%
Happy 46.4%

AWS Rekognition

Age 45-63
Gender Female, 51%
Sad 51.9%
Angry 45.3%
Disgusted 45.3%
Calm 46.6%
Surprised 45.2%
Confused 45.3%
Happy 45.3%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Disgusted 50.2%
Angry 49.6%
Happy 49.5%
Surprised 49.5%
Confused 49.5%
Sad 49.6%
Calm 49.5%

AWS Rekognition

Age 27-44
Gender Female, 50.4%
Confused 49.6%
Sad 49.6%
Angry 49.6%
Calm 50%
Happy 49.6%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Angry 45.2%
Happy 45.6%
Sad 53.3%
Surprised 45.1%
Confused 45.1%
Disgusted 45.2%
Calm 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Confused 45.4%
Calm 47.4%
Happy 46.1%
Angry 46.4%
Sad 46.2%
Surprised 46.1%
Disgusted 47.4%

AWS Rekognition

Age 15-25
Gender Female, 50.1%
Disgusted 49.5%
Confused 49.6%
Surprised 49.6%
Sad 50%
Calm 49.7%
Angry 49.6%
Happy 49.6%

AWS Rekognition

Age 38-57
Gender Male, 54.8%
Disgusted 45.1%
Confused 45.1%
Calm 45.1%
Surprised 45.1%
Angry 45.2%
Sad 46.4%
Happy 53%

AWS Rekognition

Age 35-52
Gender Female, 51.5%
Angry 46.3%
Confused 45.3%
Disgusted 49%
Calm 46.9%
Happy 45.3%
Surprised 45.4%
Sad 46.8%

AWS Rekognition

Age 30-47
Gender Female, 51.9%
Disgusted 45.1%
Sad 54.6%
Happy 45.1%
Surprised 45.1%
Confused 45.1%
Angry 45.1%
Calm 45.1%

AWS Rekognition

Age 4-7
Gender Male, 50.3%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.5%
Calm 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Disgusted 49.5%
Sad 50.4%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Male, 51.2%
Confused 45.6%
Sad 47.1%
Happy 45.3%
Disgusted 45.8%
Surprised 45.6%
Angry 46.1%
Calm 49.5%

AWS Rekognition

Age 15-25
Gender Male, 50.4%
Disgusted 49.5%
Angry 49.5%
Sad 50.2%
Happy 49.6%
Confused 49.5%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 26-44
Gender Male, 54.9%
Angry 45.2%
Happy 45.1%
Confused 46.1%
Disgusted 45%
Surprised 45.2%
Calm 53.1%
Sad 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.2%
Disgusted 45.2%
Confused 45.4%
Calm 50%
Happy 45.2%
Sad 48.2%
Surprised 45.5%
Angry 45.5%

AWS Rekognition

Age 38-59
Gender Male, 54.6%
Sad 47.4%
Happy 45.3%
Disgusted 48.2%
Confused 45.2%
Calm 47.9%
Surprised 45.3%
Angry 45.8%

AWS Rekognition

Age 30-47
Gender Male, 50.4%
Disgusted 49.9%
Surprised 49.5%
Confused 49.5%
Angry 49.6%
Happy 49.5%
Sad 49.9%
Calm 49.5%

AWS Rekognition

Age 57-77
Gender Female, 50.9%
Confused 45.3%
Calm 45.2%
Surprised 45.3%
Angry 45.3%
Disgusted 45.2%
Sad 53.1%
Happy 45.6%

AWS Rekognition

Age 26-44
Gender Female, 50.3%
Confused 49.5%
Happy 49.6%
Angry 49.8%
Sad 49.6%
Surprised 49.6%
Calm 49.6%
Disgusted 49.7%

AWS Rekognition

Age 45-63
Gender Female, 50.1%
Confused 49.5%
Surprised 49.6%
Sad 50.2%
Happy 49.5%
Calm 49.6%
Angry 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 49.5%
Angry 49.6%
Sad 50.2%
Calm 49.5%
Happy 49.5%
Confused 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Sad 49.6%
Surprised 49.5%
Happy 49.7%
Disgusted 49.7%
Angry 49.6%
Calm 49.9%
Confused 49.5%

AWS Rekognition

Age 38-57
Gender Female, 51.2%
Angry 45.6%
Happy 46.8%
Sad 46%
Disgusted 47.6%
Confused 45.4%
Calm 48%
Surprised 45.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Calm 49.8%
Surprised 49.6%
Angry 49.6%
Sad 49.8%
Disgusted 49.6%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.6%
Angry 49.6%
Surprised 49.5%
Sad 50.1%
Confused 49.5%
Happy 49.6%
Calm 49.6%

AWS Rekognition

Age 35-55
Gender Female, 50.2%
Disgusted 49.5%
Confused 49.5%
Sad 49.6%
Angry 49.6%
Happy 50%
Surprised 49.5%
Calm 49.8%

AWS Rekognition

Age 35-55
Gender Male, 50.4%
Surprised 45.1%
Angry 45.3%
Confused 45.1%
Sad 53.7%
Happy 45.1%
Disgusted 45%
Calm 45.7%

AWS Rekognition

Age 12-22
Gender Female, 50.4%
Calm 49.7%
Happy 49.6%
Sad 49.7%
Disgusted 49.7%
Angry 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 35-55
Gender Female, 50.4%
Calm 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.4%
Confused 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.2%
Calm 49.7%
Surprised 49.6%
Sad 49.8%
Angry 49.6%
Confused 49.6%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 52.6%
Happy 45.3%
Surprised 45.3%
Calm 46.9%
Disgusted 47.3%
Sad 48.6%
Confused 45.3%
Angry 46.4%

AWS Rekognition

Age 14-25
Gender Male, 50.4%
Confused 49.5%
Calm 49.6%
Happy 49.6%
Angry 49.6%
Sad 49.7%
Surprised 49.5%
Disgusted 50%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Happy 49.5%
Surprised 49.5%
Sad 50.3%
Angry 49.5%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%

AWS Rekognition

Age 27-44
Gender Female, 50.4%
Calm 49.6%
Sad 50.3%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

Feature analysis

Amazon

Person 98.7%
Painting 98.6%

Captions

Azure OpenAI

Created on 2024-12-03

The image appears to be a historical painting depicting a crowded scene, possibly from a market, a court, or a public gathering. Numerous figures are dressed in a variety of attire that suggests different roles or statuses, some are adorned with elaborate garments, while others are in more modest dress. The setting includes architectural elements like pillars and canopies, suggesting an outdoor or semi-open area. Several individuals are seated on elevated platforms, which may indicate positions of importance. At the foreground, some figures appear to be engaged in conversation, and there are items on the ground that might be goods or personal possessions. The painting has a dynamic quality with many interacting figures and a rich array of details that invite the viewer to explore the scene more closely.

Anthropic Claude

Created on 2024-11-27

This image depicts a colorful and crowded market or festival scene. There are many people in various traditional outfits gathered under a large canopy or tent structure. The central figures appear to be engaging in some kind of social interaction or transaction. The overall scene is lively and bustling, suggesting a vibrant cultural event or gathering.

Meta Llama

Created on 2024-11-24

The image depicts a vibrant and lively scene of a gathering or celebration, likely from the 18th or 19th century. The painting is characterized by its rich colors, intricate details, and the presence of various individuals dressed in traditional attire. In the foreground, a group of people are seated on the ground, engaged in conversation and socializing. Some are dressed in white, while others wear more vibrant colors such as red, blue, and yellow. The clothing appears to be a mix of formal and informal wear, suggesting that the occasion may be a special event or celebration. Behind the seated group, a larger crowd is visible, with people standing and sitting on benches or under canopies. The atmosphere appears to be festive, with some individuals playing musical instruments or singing. The overall mood is one of joy and community, with people gathered together to celebrate and socialize. The background of the painting is not clearly defined, but it appears to be a natural setting, possibly outdoors. Trees and other foliage are visible, and the sky is depicted as a soft, cloudy blue. Overall, the image conveys a sense of warmth and camaraderie, capturing a moment in time when people came together to celebrate and enjoy each other's company.