Human Generated Data

Title

Examining the Pilot

Date

1841

People

Artist: Rudolph Jordan, German 1810 - 1870

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R6620

Human Generated Data

Title

Examining the Pilot

People

Artist: Rudolph Jordan, German 1810 - 1870

Date

1841

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R6620

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Painting 99.1
Art 99.1
Human 99
Person 99
Person 98.8
Person 98.7
Person 93.9
Person 91.6
Person 86.9
Person 83.7

Clarifai
created on 2019-08-10

illustration 99.5
people 99.2
art 99.2
group 97.8
adult 97.5
man 95.5
print 94.4
painting 94.3
furniture 92.5
woman 92.2
portrait 89.6
two 86.1
family 85.7
retro 85.7
old 85.3
picture frame 85.2
engraving 84.1
chalk out 83.8
wear 83.2
room 82.3

Imagga
created on 2019-08-10

envelope 100
container 60.1
old 32.8
vintage 31.4
paper 29.8
grunge 23.8
stamp 22.3
retro 22.1
currency 19.8
design 19.7
drawing 19.1
money 18.7
texture 18.1
sketch 17.6
letter 17.4
antique 17.3
aged 17.2
cash 16.5
mail 16.3
ancient 15.6
dirty 15.4
bill 15.2
finance 15.2
symbol 14.8
frame 14.7
bank 14.3
blank 13.7
business 13.4
banking 12.9
wealth 12.6
art 12.4
sign 12
card 12
postmark 11.8
postage 11.8
representation 11.7
states 11.6
artwork 11
global 10.9
pattern 10.9
wallpaper 10.7
financial 10.7
map 10.7
color 10.6
international 10.5
brown 10.3
dollar 10.2
note 10.1
communication 10.1
border 10
history 9.8
book jacket 9.7
post 9.5
united 9.5
grungy 9.5
graphic 9.5
page 9.3
book 9.2
one 9
philately 8.9
world 8.9
printed 8.9
postal 8.8
wrapping 8.7
geography 8.7
notebook 8.4
economy 8.3
collection 8.1
board 7.9
decoration 7.9
banknote 7.8
empty 7.7
dollars 7.7
us 7.7
pay 7.7
floral 7.7
exchange 7.6
jacket 7.6
china 7.5
savings 7.5
number 7.5
backdrop 7.4
insulating material 7.3
investment 7.3
object 7.3
message 7.3
backgrounds 7.3
detail 7.2
black 7.2
country 7.1

Google
created on 2019-08-10

Microsoft
created on 2019-08-10

room 99.9
scene 99.9
gallery 99.9
drawing 99.5
sketch 98.7
indoor 89.8
person 84.6
old 68.9
text 61.7
art 56.3
cartoon 53.4
clothing 50.7
painting 35.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-35
Gender Male, 54.4%
Confused 45.1%
Fear 45.1%
Calm 48.5%
Sad 45.1%
Disgusted 45.2%
Surprised 45.5%
Happy 50%
Angry 45.5%

AWS Rekognition

Age 29-45
Gender Female, 51.3%
Confused 45.1%
Calm 52.6%
Surprised 45.1%
Sad 45.2%
Happy 46.9%
Disgusted 45%
Fear 45%
Angry 45.2%

AWS Rekognition

Age 18-30
Gender Female, 50.1%
Angry 49.5%
Disgusted 50.1%
Fear 49.5%
Sad 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.7%

AWS Rekognition

Age 26-40
Gender Male, 52.9%
Surprised 45.1%
Sad 46.4%
Disgusted 45.1%
Angry 45.3%
Confused 45.1%
Calm 52.7%
Happy 45.2%
Fear 45.1%

AWS Rekognition

Age 4-14
Gender Male, 51.5%
Surprised 45%
Angry 45.1%
Confused 45%
Fear 45.2%
Sad 52.5%
Disgusted 45%
Happy 45.1%
Calm 47%

Feature analysis

Amazon

Person
Person 99%
Person 98.8%
Person 98.7%
Person 93.9%
Person 91.6%
Person 86.9%
Person 83.7%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-08-10

a vintage photo of a painting 62.8%
a painting on the wall 62.7%
a painting on a wall 62.6%

OpenAI GPT

Created by gpt-4 on 2025-02-11

The image is a monochromatic print that depicts an indoor scene with several figures, most likely male, gathered around a table upon which lies a small model of a sailing ship. The setting appears to be rustic or historical, suggested by the stone walls, the wooden beamed ceiling, and the simple furniture. The men are dressed in clothing that suggests perhaps a 19th-century timeframe, including hats, waistcoats, and trousers typical of that period. One man is standing at the center, next to the model ship, and appears to be engaged in explaining or demonstrating something about the model to the group. His posture and gesturing hand indicate that he is the focus of attention. To his right, two men are seated at the table, one of whom is leaning forward with interest. To his left, a group of four seated men are looking on, with varying levels of engagement – some seem attentive, while others appear more relaxed or contemplative. The expressions and body language convey a sense of attention and perhaps learning or discussion. There are other items in the room, such as papers, possibly maps, on the walls, and what appears to be a lantern hanging from the ceiling, further suggesting the maritime theme and the bygone era of sailing ships and exploration. Overall, the image captures a moment of thought, planning, or education, potentially related to nautical pursuits.

Created by gpt-4o-2024-05-13 on 2025-02-11

The image is a black-and-white illustration depicting an interior scene with several figures, likely sailors or shipbuilders, gathered around a tabletop model of a sailing ship. The room they are in appears rustic and is characterized by wooden beams on the ceiling and simple furnishings. The man standing in the center, wearing work clothes and a hat, seems to be explaining or discussing something about the ship model, which is placed on a table. The other men, dressed in similar attire, are variously seated or standing around, attentively watching or listening to the speaker. The setting suggests a workshop or a meeting place where the construction or design of ships is being deliberated. The detailed lines and shading of the illustration contribute to a sense of depth and realism, offering a glimpse into a historical or maritime activity.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-02-11

This is a historical engraving or drawing showing several people gathered around a table with what appears to be a model ship on display. The scene seems to be set in a rustic interior with wooden beams visible on the ceiling. The people are dressed in what looks like 18th or 19th century clothing, with loose-fitting garments, breeches, and hats typical of that era. One person stands and appears to be presenting or explaining the ship model to the others, who are seated on stools or benches around the table. The artwork has a sketch-like quality with fine line work characteristic of period engravings. The title "Jonathan" appears below the image, suggesting this might be part of a larger series or narrative work.

Created by claude-3-opus-20240229 on 2025-02-11

The image depicts a group of men gathered in a rustic interior, likely a tavern or inn. In the center, one man is standing and engaged in conversation with the others who are seated around a wooden table. On the table, there appears to be a scale or balance, suggesting they may be discussing business or trade. The men are dressed in period clothing, with loose shirts, vests, and hats typical of the era. The interior has exposed wooden beams and rough stone walls, giving it a rural, earthy atmosphere. The scene is rendered in a sketchy, expressive style with cross-hatching adding depth and texture to the forms.

Created by claude-3-haiku-20240307 on 2025-02-11

The image appears to depict a scene from the past, likely a historical or genre scene. It shows a group of people gathered in what seems to be an interior space, possibly a workshop or a small dwelling. The people are dressed in clothing typical of a bygone era, and they are engaged in various activities, such as observing or participating in what appears to be a demonstration or presentation of some kind. The overall atmosphere suggests a sense of community and shared experience.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-02-11

The image is a black-and-white drawing of a group of men sitting in a room. The men are wearing hats and shoes, and some of them are wearing belts. One of the men is standing in front of a desk, while the others are sitting on stools. The man standing is holding a piece of paper, while the others are looking at him. There is a shelf on the wall.

Created by amazon.nova-lite-v1:0 on 2025-02-11

The image depicts a black-and-white illustration of a group of people gathered in a room, possibly a meeting or a gathering. The room has wooden walls and a ceiling, and there is a table in the center with a small boat model on it. The people are seated on benches or stools, and some of them are standing, with one person holding a small object. The image has a vintage look, with a slightly faded color scheme and a slightly blurry effect.

Text analysis

Amazon

Jodamo

Google

Jordan.
Jordan.