Human Generated Data

Title

Pen Box with Riverscape, Female Portraits, and Lions in Medallions

Date

c. 1880-1910

People

-

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.356

Human Generated Data

Title

Pen Box with Riverscape, Female Portraits, and Lions in Medallions

Date

c. 1880-1910

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.356

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 95.9
People 94.5
Sports 86.6
Sport 86.6
Weaponry 80.3
Weapon 80.3
Team Sport 80.2
Team 80.2
Blade 71.1
Knife 68.3
Person 67.2
Smoke Pipe 62.6
Softball 59.7
Baseball 59.7
Oars 59.4

Clarifai
created on 2018-02-10

prescription 99.9
medicine 99.7
addiction 99.7
medical 98.6
no person 98.2
healthcare 97.7
desktop 96.6
sausage 95.4
pill 95.4
science 94.3
one 94.3
smoke 94.1
symbol 93.4
closeup 93.4
illness 93.2
drug 93.1
cutout 91.5
still life 90.8
disease 89.3
food 86.9

Imagga
created on 2018-02-10

knife 43.9
scabbard 27.8
device 24.3
sheath 21.6
object 18.3
tool 17.7
dagger 17.4
food 17
weapon 16.2
close 16
pen 15.4
blade 14.9
closeup 14.8
single 14.8
brown 14
cigarette 12.7
addiction 12.6
cutter 12.5
metal 12.1
health 11.8
tobacco 11.8
equipment 11.6
unhealthy 11.5
healthy 11.3
diet 11.3
one 11.2
nobody 10.9
tasty 10.9
steel 10.9
cut 10.8
fresh 10.5
covering 10.4
smoke 10.2
paper 10.2
danger 10
meat 9.9
habit 9.8
meal 9.7
cooking 9.6
color 9.5
money 9.4
yellow 9.3
bread 9.3
wood 9.2
kitchen 8.9
handle 8.6
sharp 8.6
business 8.5
baked 8.4
horizontal 8.4
studio 8.4
slice 8.2
wealth 8.1
currency 8.1
wooden 7.9
objects 7.8
cancer 7.8
smoking 7.8
black 7.8
loaf 7.8
snack 7.7
dinner 7.6
eating 7.6
organic 7.6
nutrition 7.6
pencil 7.5
delicious 7.4
cook 7.3
silver 7.1

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

weapon 58.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Female, 55%
Happy 45.6%
Angry 45.2%
Disgusted 45.4%
Sad 50.3%
Surprised 45.1%
Confused 45.2%
Calm 48.3%

AWS Rekognition

Age 15-25
Gender Male, 54.5%
Surprised 45.2%
Happy 48.4%
Sad 45.5%
Disgusted 47.2%
Confused 45.1%
Calm 48.4%
Angry 45.2%

AWS Rekognition

Age 16-27
Gender Male, 54%
Happy 46.5%
Sad 46.1%
Surprised 45.4%
Confused 45.2%
Calm 47%
Angry 47.3%
Disgusted 47.5%

AWS Rekognition

Age 9-14
Gender Male, 53.2%
Calm 45.6%
Surprised 45.1%
Disgusted 45.1%
Angry 45.4%
Sad 53.1%
Confused 45.1%
Happy 45.5%

AWS Rekognition

Age 20-38
Gender Male, 51.5%
Confused 45.6%
Surprised 45.8%
Disgusted 46.2%
Sad 48.6%
Happy 46.3%
Angry 46.3%
Calm 46.2%

Feature analysis

Amazon

Person 67.2%
Smoke Pipe 62.6%

Captions

Microsoft
created on 2018-02-10

a close up of a knife 66%
close up of a knife 61.7%
a knife next to it 52.2%

Azure OpenAI

Created by gpt-4 on 2024-11-17

The image shows an elongated object, possibly an ornamental box or board, adorned with detailed artwork. The central panel features a landscape scene with trees, a body of water, and figures in the distance against a backdrop of a dusky or dawn sky. Flanking this central image, there are smaller oval panels with depictions of lions — two to the left and two to the right. Each lion scene shows a group of these animals in close contact, suggesting a familial or social interaction. The artwork is rendered in a warm, golden color palette with intricate borders and motifs surrounding the ovals and landscape, hinting at a decorative or possibly historical object.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-11-17

The image appears to be an ornately decorated box or container. The surface is covered with various intricate designs and illustrations in warm tones of gold and brown. The central scene depicts a landscape with a tower or structure in the distance, surrounded by smaller vignettes featuring various animals and figures. The overall aesthetic suggests this is an antique or historical object, likely created as a decorative or functional item.

Meta Llama

Created on 2024-11-30

The image presents a long, narrow, and elongated object with rounded ends, featuring a gold-colored frame adorned with intricate designs. The object is divided into six distinct sections, each showcasing a unique scene or figure. **Section 1:** The first section on the left side of the object depicts a lion lying down, accompanied by a woman in the background. The woman is dressed in a red and white outfit, with her hair styled in an updo. The scene is set against a light-colored background, which provides a subtle contrast to the rich colors of the figures. **Section 2:** The second section features a woman in a red dress, standing in front of a tree. Her hair is also styled in an updo, and she appears to be holding something in her hand. The tree is depicted in a more detailed manner than the other elements in the scene, with visible branches and leaves. **Section 3:** The third section showcases a landscape with a bridge and a body of water in the background. The sky above is cloudy, adding depth and texture to the scene. A small figure can be seen standing on the bridge, although it is difficult to discern any details due to the image's resolution. **Section 4:** The fourth section features a woman in a white dress, sitting on a rock or cliff. She is surrounded by trees and foliage, which creates a sense of tranquility and serenity. The woman's hair is styled in an updo, and she appears to be gazing out at the viewer. **Section 5:** The fifth section depicts a woman in a red dress, standing in front of a building or structure. Her hair is styled in an updo, and she appears to be holding something in her hand. The building is depicted in a more detailed manner than the other elements in the scene, with visible windows and a door. **Section 6:** The sixth and final section features a woman in a white dress, sitting on a rock or cliff. She is surrounded by trees and foliage, which creates a sense of tranquility and serenity. The woman's hair is styled in an updo, and she appears to be gazing out at the viewer. Overall, the object in the image appears to be a decorative piece, possibly a box or a frame, featuring a series of scenes and figures that are likely meant to convey a sense of beauty and elegance. The use of gold and other metallic colors adds to the object's luxurious feel, while the intricate designs and details create a sense of depth and complexity.