Human Generated Data

Title

Commerce

Date

1844-1857

People

Artist: Toppan Carpenter & Co., American

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21626

Human Generated Data

Title

Commerce

People

Artist: Toppan Carpenter & Co., American

Date

1844-1857

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dorothy Rackemann, daughter of Francis Rackemann, class of 1909, M.D. 1912, M21626

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Person 96.2
Human 96.2
Person 95
Clothing 90.3
Apparel 90.3
Crash Helmet 88.7
Helmet 88.7
Person 79
People 76.4
Photography 61
Photo 61
Astronaut 56.2

Clarifai
created on 2023-10-22

desktop 98
vintage 97.3
retro 96.3
paper 94.7
old 93.4
dirty 93.3
abstract 93.2
design 91.7
illustration 91.3
antique 90.9
art 90.7
page 90.2
sooty 90
wear 89.7
sand 89.5
texture 89
card 89
sepia pigment 88.5
blank 87.9
margin 87.5

Imagga
created on 2022-03-12

sand 82.3
soil 39.5
beach 29.8
earth 28.9
desert 21.7
sea 20.5
wild 20
summer 19.9
travel 19.7
animal 19.7
wildlife 18.7
water 18
safari 17.3
landscape 17.1
crustacean 17
ocean 16.7
arthropod 16.3
gymnosperm 15.7
vacation 15.5
dune 14.1
tropical 13.6
mammal 13.5
sun 12.9
outdoors 12.7
coast 12.6
tourism 12.4
invertebrate 11.9
texture 11.8
spermatophyte 11.8
outdoor 11.5
natural 11.4
dry 11.1
sky 10.8
tarantula 10.6
shore 10.2
animals 10.2
wilderness 9.4
grunge 9.4
spider 9.3
crab 9.2
island 9.1
plant 9.1
park 9.1
game 9
brown 8.8
holiday 8.6
coastline 8.5
south 8.4
old 8.4
grain 8.3
arachnid 8.2
vascular plant 8
textured 7.9
antique 7.8
nobody 7.8
adventure 7.6
resort 7.5
vintage 7.4
rest 7.4
camel 7.3
national 7.2
aged 7.2
surface 7

Google
created on 2022-03-12

Microsoft
created on 2022-03-12

laying 80.5
drawing 78.7
black 76.3
text 74.8
sketch 59.1
vehicle 58.7
envelope 29

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Male, 94.2%
Surprised 39.2%
Calm 26.5%
Disgusted 14.1%
Fear 6.5%
Confused 6.2%
Angry 2.9%
Sad 2.5%
Happy 2.2%

AWS Rekognition

Age 6-16
Gender Male, 96.8%
Calm 97.6%
Sad 1.1%
Confused 0.4%
Fear 0.3%
Angry 0.2%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 96.2%
Person 95%
Person 79%

Categories

Imagga

pets animals 99.3%

Captions

Microsoft
created on 2022-03-12

a person lying on a bed 30.7%
a person lying on the ground 30.6%
a person lying on the floor 30.5%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-02-12

The image is a vintage illustration that features three allegorical female figures surrounding a large central shield. The shield is decorated with a horse's head crest. The figures are portrayed in classical attire and are positioned sitting on and around blocks and bundles, with one woman holding a spinning distaff. The scene in the background includes an industrial building with a smokestack emitting smoke, suggesting a connection to manufacturing or production. The illustration is centered on a piece of paper that has developed brown foxing spots, which are signs of aging and oxidation.

Created by gpt-4 on 2025-02-12

This is a sepia-toned image featuring a centrally placed, detailed illustration. The illustration shows a group of four people outdoors, engaged in an activity that seems leisurely and possibly educational. Two of them are seated on the ground, with a third person standing and pointing towards the distance, as if explaining or gesturing towards something. The fourth person is seated upon some sort of elevation, possibly a rock or a stool, and is also attending to the standing individual's actions or words. Behind the group, there's a hint of a landscape that includes classical architecture, which looks like it could be a part of a larger, idyllic scene. The paper of the image is mottled with age spots, indicating it could be quite old, and the edges are slightly irregular. The tone, along with the clothing style of the figures, suggests the image is from the 19th century or mimics that era's aesthetics. This type of image could potentially be found in an antique book or collection of prints.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-02-12

This is a historical black and white illustration featuring two classical figures in draped clothing seated on either side of what appears to be a decorative shield or crest with a horse's head above it. The composition includes some architectural elements in the background and various objects or cargo boxes beside the figures. The illustration has an aged appearance with foxing (brownish spots) on the paper, typical of vintage prints. The style suggests it may be from the 19th century and could have been used as a decorative element, perhaps for a book plate or commercial document. The overall scene has a symbolic or allegorical quality to it, common in artwork of that period.

Created by claude-3-opus-20240229 on 2025-02-12

The image is an antique engraving or etching showing two men and a horse. The men are wearing traditional clothing, possibly from the 18th or 19th century. One man is seated on the ground while the other stands, and they appear to be having a conversation or interaction. The horse is lying down on the ground between them, possibly resting. The entire scene has an aged, sepia-toned appearance consistent with an old print or illustration.

Created by claude-3-haiku-20240307 on 2025-02-12

The image appears to be an antique engraving or illustration depicting two people, possibly a man and a woman, sitting on what appears to be a bed or couch. Behind them is an ornate headboard or frame with a horse-like figure. The image has a vintage, sepia-toned aesthetic.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-02-12

The image shows two women sitting on a barrel, with a horse's head in between them. The woman on the left is holding a shield, while the woman on the right is holding a spear. They are both wearing dresses, and one of them is wearing a crown. The image is in black and white, and it is placed on a beige background. The image seems to be a vintage drawing.

Created by amazon.nova-lite-v1:0 on 2025-02-12

The image depicts a monochromatic print on a beige background. It features two women seated on the ground, possibly representing an allegory or a historical scene. The woman on the left holds a shield and a cornucopia, symbolizing abundance and protection. The woman on the right holds a lance and a shield, possibly representing strength and defense. Behind them, there is a horse with a rider, adding to the dynamic composition. The scene is set against a backdrop that includes a ship and a factory, suggesting a narrative related to trade, industry, or exploration.