Human Generated Data

Title

Illustration for "My Business Partner Gym"

Date

1913

People

Artist: Peter Sheaf Hersey Newell, American 1862 - 1924

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. John G. Pierce, 1964.116

Human Generated Data

Title

Illustration for "My Business Partner Gym"

People

Artist: Peter Sheaf Hersey Newell, American 1862 - 1924

Date

1913

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. John G. Pierce, 1964.116

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Nature 97.8
Human 97.6
Outdoors 96.5
Art 91.9
Ice 88.3
Snow 84.3
Clothing 80.2
Coat 80.2
Apparel 80.2
Animal 66.9
Wildlife 66.9
Mammal 66.9
Overcoat 58.5

Clarifai
created on 2020-05-02

people 99.9
adult 99.1
veil 99
wear 98.6
man 98.5
group 98.2
three 97.3
two 97
woman 95
lid 95
group together 94.8
child 94.7
monochrome 93.9
four 93.5
portrait 92.4
coat 91.7
street 89.1
outerwear 88.2
art 87.3
container 85.9

Imagga
created on 2020-05-02

old 27.2
sculpture 19.2
ancient 19
architecture 18
statue 17.2
stone 17
building 16.7
tourism 16.5
travel 16.2
history 16.1
wall 15.4
religion 15.2
robe 15.1
city 15
vintage 14.9
art 14.3
culture 13.7
monument 13.1
clothing 13.1
container 13
ruler 12.9
temple 12.3
antique 12.1
historic 11.9
black 11.8
people 11.7
garment 11.3
door 10.6
white 10.3
grunge 10.2
person 10
umbrella 9.9
scene 9.5
historical 9.4
covering 9.4
church 9.2
tradition 9.2
street 9.2
house 9.2
traditional 9.1
home 8.8
urban 8.7
holiday 8.6
world 8.5
tourist 8.3
metropolitan 8.2
aged 8.1
dirty 8.1
man 8.1
portrait 7.8
bag 7.7
texture 7.6
human 7.5
ashcan 7.4
vacation 7.4
bucket 7.3
seller 7.2
canopy 7.2
landmark 7.2
adult 7.2

Google
created on 2020-05-02

Microsoft
created on 2020-05-02

text 98.7
man 97.7
drawing 97.6
sketch 96.3
painting 87
person 86.8
clothing 80.3
black and white 74
waste container 73.1

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 38-56
Gender Male, 54.7%
Calm 45.6%
Surprised 52.2%
Fear 45.2%
Disgusted 45.1%
Angry 46.2%
Sad 45%
Happy 45.6%
Confused 45.1%

AWS Rekognition

Age 37-55
Gender Male, 52.1%
Confused 45.1%
Disgusted 45.1%
Happy 45.2%
Sad 45.4%
Calm 45.3%
Angry 47.1%
Fear 51.6%
Surprised 45.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Elephant

Clarifai

Clothing
Footwear
Human face
Human head
Wheel
Poster

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 76.3%

AWS Rekognition

Painting 91.9%

AWS Rekognition

Elephant 66.9%

Clarifai

Clothing 73.4%

Clarifai

Clothing 70.4%

Clarifai

Clothing 35.2%

Clarifai

Footwear 58.7%

Clarifai

Footwear 56.9%

Clarifai

Footwear 52.7%

Clarifai

Footwear 39%

Clarifai

Human face 43.6%

Clarifai

Human face 37.6%

Clarifai

Human head 41%

Clarifai

Wheel 38.6%

Clarifai

Poster 35.9%

Categories

Imagga
created on 2020-05-02

paintings art 95.6%
interior objects 1.5%
food drinks 1.1%

Captions

Microsoft
created by unknown on 2020-05-02

a man standing next to a book 61%
a man holding a book 48.3%
an old photo of a man 48.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-30

a photograph of a man in a coat and hat standing in the snow

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white drawing of two men talking

OpenAI GPT

Created by gpt-4 on 2025-02-20

This is a black-and-white image featuring two individuals standing on a snowy street. The person on the left appears to be facing the viewer, dressed in a dark overcoat and a hat. On the right, another individual is seen in profile, also wearing a dark coat, a hat, and carrying an open umbrella. Behind them is what seems to be the rear of a horse-drawn carriage, partially covered with a tarp and positioned on the snow-covered ground. To the far right, there's a cylindrical object that might be a trash can. The setting looks like a city street during winter, and the presence of snow suggests cold weather. There's a sign on the wall to the far left with text that is not fully legible. The artwork is signed at the bottom right corner, indicating it might be an illustration or painting.

Created by gpt-4o-2024-05-13 on 2025-02-20

The image depicts a winter scene illustrating two men dressed in long coats and hats having a conversation. The man on the left stands with his hands in his pockets, while the man on the right holds an umbrella protecting him from snow. A horse-drawn carriage with a driver or attendant tending to it is visible in the background. Snow covers the ground, and there's a trash bin in the foreground. The setting appears to be along a sidewalk or street, suggested by the railing on the left. The artwork is signed by the artist named Pierre Nuyttens.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2025-02-20

The image depicts two men standing in the snow, wearing long coats and hats. They appear to be having a conversation or interaction. The background includes a sign that says "Dam", indicating they may be in a rural or remote area. The overall scene has a somber, wintry atmosphere captured in the black and white illustration style.

Created by claude-3-opus-20240229 on 2025-02-20

The black and white illustration depicts two men standing in a snowy alleyway. One man is wearing a long coat and hat, facing the other man who has an umbrella. There appears to be a carriage wheel and crate next to them in the alley. The scene has an austere, mysterious atmosphere, perhaps taking place in an old city during winter based on the snow and old-fashioned clothing. The illustration is signed "Ren Wicks" in the lower right corner.

Created by claude-3-5-sonnet-20241022 on 2025-02-20

This appears to be a black and white artwork depicting a winter street scene. Two figures in long dark coats and hats are shown in conversation on what seems to be a snowy street or walkway. One figure is holding a black umbrella. In the background, there's a hint of buildings or architecture, and you can make out what appears to be a wheel of a cart or carriage. There's also what looks like a barrel or waste bin in the lower right corner of the image. The artwork has a moody, atmospheric quality typical of urban winter scenes from the late 19th or early 20th century. The signature "Ben Messick" is visible at the bottom right of the piece.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-27

This appears to be a black and white artwork depicting a winter street scene. Two figures are shown in long dark overcoats and hats engaged in conversation on what appears to be a snowy day. One figure is holding a black umbrella. In the background, there are hints of buildings and what looks like a wagon wheel. A barrel or container of some kind is visible in the lower right corner of the image. The scene has a moody, atmospheric quality typical of early 20th century urban winter scenes. The artist's signature is visible at the bottom right of the artwork.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-03-13

The image depicts a black-and-white drawing of two men standing on a snowy street, facing each other. The man on the left wears a long coat, hat, and boots, while the man on the right also wears a long coat and hat. An umbrella is positioned between them, and a trash can is visible to the right. In the background, a sign reading "BANK" is partially obscured by the man on the left, and a bicycle is leaning against a wall to the right. The overall atmosphere suggests a cold and possibly rainy day, with the men engaged in conversation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-03-13

The image is a black-and-white drawing of two men standing on a snowy street, facing each other. The man on the left wears a long coat and hat, while the man on the right holds an umbrella and also wears a long coat and hat.

In the background, there appears to be a horse-drawn carriage with a sign that reads "BANK" and another sign that is illegible. A trash can is visible on the right side of the image. The overall atmosphere suggests a cold winter day in an urban setting, possibly during the late 19th or early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-20

The image is a black-and-white drawing of two men standing in the snow, possibly in a city. They are both wearing long coats and hats, and one of them is holding an umbrella. Behind them, there is a cart with a wheel, and a trash can is on the right side. The drawing has a vintage look, and the image is slightly blurry. The drawing is signed by "Blon Newall."

Created by amazon.nova-pro-v1:0 on 2025-02-20

The black-and-white painting depicts two men standing in the snow. They are both wearing hats and coats. One of them is holding an umbrella. They are probably having a conversation. Behind them, there is a railing, and a person is walking on the stairs. On the right side, there is a trash can, and a cart is parked in front of it. The painting has a signature on the bottom right.

Google Gemini

Created by gemini-2.0-flash on 2025-05-23

Here's a description of the image:

This is a black and white illustration depicting a scene in what appears to be a city during winter or a snowstorm. Two men, both wearing long overcoats and hats, are the central figures. One man is facing forward, with his hands in his pockets. The second man is partially obscured by a black umbrella, and he seems to have something in his mouth, possibly a cigar or cigarette.

The scene is rendered in a painterly style, with visible brushstrokes and a soft, almost dreamy quality. Snow is visible on the ground and there are hints of a light dusting on the men's coats. Behind the men, there's a suggestion of a building with a sign that reads "LOANS" and "BANK." A horse-drawn carriage with a person inside is depicted in the background. To the right of the men is a cylindrical object, possibly a trash can.

The overall mood of the illustration is subdued and atmospheric, evoking a sense of the quiet stillness of a snowy day in the city. At the bottom right, there is a signature: "Peter Newell."

Created by gemini-2.0-flash-lite on 2025-05-23

Here's a description of the image:

The image is a black and white illustration or painting depicting a scene in a snowy outdoor setting. The style appears to be illustrative, possibly from the late 19th or early 20th century.

Overall Scene:

  • Setting: It's a snowy day. Snow covers the ground, and there are hints of snow on surrounding surfaces.
  • People: The main focus is on two men standing and talking. There are other figures present, but they are less prominent.
  • Mood: The overall mood is somber. The color palette contributes to this feeling.

Key Elements:

  • Men: Two men are the center of attention. They are wearing long overcoats and hats, characteristic of the period. The man on the right is holding an umbrella.
  • Details: There is a sign in the background that includes the words "LOANS" and "BANK." To the right is a horse-drawn carriage. A trash can is in the foreground.
  • Composition: The composition guides the viewer's eye through the scene. The men form the central point, with other elements providing context to the scene.

Overall Impression:
The image evokes a historical feel, possibly depicting a business exchange or a private conversation on a cold day. The style and setting suggest a classic era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white illustration depicting a scene on a snowy day. Two men are standing outside a building with signs indicating "GRAND" and "DANS R.O." One man is holding an umbrella and is facing away from the viewer, while the other man, who is not holding an umbrella, is standing with his hands in his coat pockets and facing the viewer. Both men are dressed in long overcoats and hats, appropriate for the cold weather.

In the background, there is a person bent over, possibly sweeping or shoveling snow near a wheelbarrow. The ground is covered in snow, and there is a trash bin nearby. The scene suggests a moment of interaction or waiting in a wintry urban setting. The artist's signature, "Peter Newell," is visible in the bottom right corner of the image.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-28

This image is a black and white illustration, depicting a winter scene. It features two men standing outdoors, dressed in long coats and hats, indicating cold weather. One man is holding an umbrella, suggesting it might have been raining or snowing previously. They appear to be conversing, with one man facing the other. The background includes a snow-covered street with a horse-drawn carriage partially visible, and a trash can in the foreground. The overall atmosphere is one of a chilly, perhaps urban setting, with a focus on the interaction between the two men. The artist's signature is located in the bottom right corner.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-28

This is a black-and-white illustration depicting two men standing in the snow. Both men are dressed in long coats and hats, suggesting a cold winter day. The man on the right is holding an umbrella, which is open and providing some cover from the snow. They appear to be engaged in a conversation. In the background, there are some buildings, a bicycle, and a trash can. The overall scene has a somewhat bleak and wintry atmosphere. The artist's signature, "Pete" Newell, is visible in the bottom right corner.

Text analysis

Amazon

DANE
DAnsi
PterN'sLn

Google

cANS DAN Rien Nawelle
cANS
DAN
Rien
Nawelle