Human Generated Data

Title

Pen Box with a Visit to a Sage

Date

1870-1871

People

-

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.336

Human Generated Data

Title

Pen Box with a Visit to a Sage

Date

1870-1871

Classification

Artists' Tools

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 2014.336

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 98.8
Skateboard 98.6
Sports 98.6
Sport 98.6
Person 85.8
Person 76.8
Person 72.3
Photo 64.2
Photography 64.2
People 63.3
Blade 55.6
Weaponry 55.6
Weapon 55.6

Clarifai
created on 2018-02-10

medicine 97.6
no person 96.3
art 95.3
sausage 95
prescription 94.1
desktop 94.1
one 93.2
texture 92.2
color 91.3
medical 91.1
cutout 90.2
still life 90.1
science 89.8
pill 89.8
grow 87.9
closeup 87.8
food 87.3
symbol 87.3
illustration 86.6
dog 84.8

Imagga
created on 2018-02-10

device 27.7
knife 26.1
tool 25.1
object 22
blade 18.6
close 17.7
scabbard 16.7
food 15.8
metal 15.3
sheath 13.6
handle 13.4
single 13.2
weapon 12.8
steel 12.7
equipment 12.5
fresh 12.4
cooking 12.2
fastener 11.9
clip 11.8
health 11.1
brown 11
healthy 10.7
cuisine 10.6
meal 10.5
diet 10.5
sharp 10.5
old 10.4
closeup 10.1
nobody 10.1
one 9.7
baked 9.4
meat 9.1
gold 9
cut 9
color 8.9
silver 8.8
dagger 8.6
restraint 8.6
dinner 8.4
pencil 8.4
horizontal 8.4
bangle 8.3
plastic 8.3
sword 8.2
yellow 8
work 7.9
black 7.8
cigarette 7.8
loaf 7.8
space 7.8
stainless 7.8
cutting 7.7
preparation 7.7
grilled 7.6
plate 7.6
studio 7.6
roll 7.6
nutrition 7.6
tasty 7.5
wood 7.5
metallic 7.4
cook 7.3
danger 7.3
paper 7.1

Google
created on 2018-02-10

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 12-22
Gender Male, 52.8%
Surprised 45%
Happy 45%
Disgusted 54.8%
Confused 45%
Sad 45%
Angry 45%
Calm 45.1%

AWS Rekognition

Age 16-27
Gender Male, 52.4%
Sad 47.2%
Disgusted 45.8%
Angry 46.7%
Calm 45.6%
Surprised 45.7%
Happy 48.5%
Confused 45.4%

AWS Rekognition

Age 15-25
Gender Male, 54.8%
Calm 53%
Sad 45.9%
Surprised 45.2%
Happy 45.2%
Confused 45.2%
Angry 45.3%
Disgusted 45.3%

AWS Rekognition

Age 20-38
Gender Male, 53.6%
Happy 45.3%
Angry 45.5%
Disgusted 45.4%
Sad 45.6%
Surprised 45.4%
Calm 52.6%
Confused 45.1%

AWS Rekognition

Age 10-15
Gender Male, 54%
Confused 45.2%
Sad 45.6%
Disgusted 45.1%
Happy 45.8%
Angry 45.3%
Surprised 45.7%
Calm 52.3%

AWS Rekognition

Age 15-25
Gender Male, 53.7%
Confused 45.3%
Sad 45.4%
Disgusted 51.5%
Happy 45.3%
Surprised 45.4%
Angry 46.6%
Calm 45.4%

AWS Rekognition

Age 35-52
Gender Male, 52.1%
Surprised 45.3%
Angry 45.6%
Happy 45.4%
Sad 52.5%
Disgusted 45.3%
Confused 45.4%
Calm 45.5%

AWS Rekognition

Age 17-27
Gender Male, 50.6%
Disgusted 46.7%
Confused 45.6%
Happy 45.6%
Angry 45.9%
Calm 50.2%
Surprised 45.4%
Sad 45.5%

AWS Rekognition

Age 26-44
Gender Male, 50.1%
Calm 53.1%
Happy 45.2%
Disgusted 45.1%
Surprised 45.3%
Angry 45.2%
Sad 45.9%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Male, 51.2%
Sad 45.4%
Disgusted 50.6%
Angry 45.8%
Calm 46.1%
Surprised 46%
Happy 45.7%
Confused 45.6%

Feature analysis

Amazon

Person
Person 85.8%
Person 76.8%
Person 72.3%

Captions

Microsoft
created on 2018-02-10

a close up of a knife 57.6%
a knife next to it 49%
close up of a knife 48.9%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

The image shows a decorative rectangular object with rounded ends. The object features detailed, ornate miniature paintings depicting various scenes involving multiple figures dressed in traditional clothing. The background includes elements such as trees, buildings, and furnishings, suggesting an indoor or outdoor setting. The paintings are framed with intricate gold borders, adding an element of elegance to the overall design.

Created by gpt-4 on 2024-11-19

The image showcases an elongated, decorative object with a curved, narrow shape, possibly a bookmark or some form of a decorative panel. It features intricate, narrative artwork in warm, orange-toned hues, containing multiple figures engaged in various actions, giving the impression of a story or scenes from a larger narrative. The edges are embellished with a detailed ornamental border that complements the central imagery, suggesting that this object may have cultural or artistic significance. The artwork is reminiscent of traditional styles, perhaps indicating it may represent historical or mythological scenes. The background is a plain white surface that ensures the focus remains on the intricate design of the object.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-26

This appears to be a decorative pen case or elongated box with detailed Renaissance-style artwork painted on it. The item has an orange-brown background with several painted scenes divided into segments. The artwork depicts multiple figures in classical dress and robes, painted in rich colors including reds and oranges. The scenes appear to tell a continuous narrative story, with figures interacting in what looks like a medieval or Renaissance setting. The case features ornate gold decorative elements between the scenes and along the borders. The craftsmanship suggests this is a luxury item, likely from the Renaissance period or made in that style, possibly used to store writing implements or other small valuable items.

Created by claude-3-haiku-20240307 on 2024-11-19

The image appears to be a decorative panel or plaque with an intricate, colorful painting. The painting depicts a series of figures in ornate robes and poses, set against an architectural background with arches and columns. The figures seem to be engaged in some sort of narrative or scene, though without being able to identify any individuals, I can only describe the overall visual composition and artistic style, which appears to be in a classical or historical manner.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

The image depicts a long, narrow, oval-shaped object with a vibrant orange hue and intricate designs. The object is positioned horizontally in the center of the image, with its ends pointing towards the left and right sides. **Designs and Patterns:** * The object features a series of small, detailed images along its length, showcasing various scenes and characters. * The images are rendered in a warm, golden color scheme, with subtle shading and texture that gives them a sense of depth and dimensionality. * The object's surface is adorned with intricate patterns and designs, including floral motifs, geometric shapes, and other decorative elements. * The patterns are carefully arranged to create a sense of balance and harmony, with each element working together to create a cohesive whole. **Background:** * The background of the image is a plain, light gray color, which provides a clean and neutral backdrop for the object. * The gray tone helps to emphasize the object's vibrant colors and intricate designs, making it stand out against the surrounding environment. **Overall Impression:** * The image presents a beautiful and intricately designed object that showcases exceptional craftsmanship and attention to detail. * The combination of vibrant colors, intricate patterns, and detailed images creates a visually striking effect that draws the viewer's attention and invites closer inspection.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-30

The image depicts a long, narrow, oval-shaped object with a flat top and rounded bottom. The object is made of wood and features a painted design on its surface. The design consists of a series of scenes depicting people in various poses, including some with children. The scenes are arranged in a horizontal sequence, with each scene separated by a thin line. The object appears to be a piece of furniture or decorative item, possibly a table runner or wall hanging. The painted design adds an artistic touch to the object, making it a unique and eye-catching piece. The background of the image is a plain gray color, which helps to highlight the details of the object. Overall, the image presents a clear and detailed view of the object, showcasing its intricate design and craftsmanship.