Human Generated Data

Title

Street scene, Worthington, Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3039

Human Generated Data

Title

Street scene, Worthington, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3039

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.7
Clothing 97.8
Apparel 97.8
Meal 71.7
Food 71.7
Pants 68.5
People 65.2
Shorts 63
Hat 62.7
Hardhat 58.2
Helmet 58.2
Overcoat 57.7
Coat 57.7

Clarifai
created on 2023-10-15

people 100
adult 99
man 98.9
group together 98.9
group 98.7
woman 98
four 96.8
monochrome 96.8
street 96.6
three 95.2
several 94.5
recreation 94.2
two 94
veil 92.6
commerce 92.4
wear 91.6
lid 91.1
administration 90.2
child 88.4
police 87

Imagga
created on 2021-12-15

barbershop 100
shop 100
mercantile establishment 95.8
place of business 63.9
establishment 32
old 24.4
door 22.8
wall 22.2
building 21.2
vintage 18.2
window 15.7
retro 15.6
house 15
architecture 14.8
city 14.1
antique 13.8
urban 12.2
ancient 12.1
sign 12
grunge 11.9
aged 11.8
texture 10.4
glass 10.1
entrance 9.7
bakery 9.5
empty 9.4
brick 9.4
travel 9.2
history 8.9
decoration 8.9
brown 8.8
man 8.7
people 8.4
wood 8.3
exterior 8.3
street 8.3
structure 8.2
wooden 7.9
text 7.9
paper 7.8
color 7.8
closed 7.7
blank 7.7
construction 7.7
weathered 7.6
design 7.3
board 7.2
dirty 7.2
home 7.2
male 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 100
clothing 98.2
outdoor 97.8
person 92.7
man 90
standing 78.3
people 77.4
group 60.2
store 40.6
shop 11.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 97.4%
Angry 72%
Calm 18.8%
Happy 3.8%
Surprised 1.4%
Disgusted 1.3%
Sad 1.2%
Confused 0.9%
Fear 0.7%

AWS Rekognition

Age 47-65
Gender Male, 69.8%
Happy 97.6%
Calm 1.7%
Surprised 0.4%
Sad 0.1%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 38-56
Gender Male, 91.8%
Calm 85.5%
Happy 7.1%
Sad 4.8%
Confused 1.5%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-35
Gender Male, 98.9%
Calm 65.4%
Angry 22.6%
Sad 6.5%
Happy 2.7%
Fear 2.7%
Surprised 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Clothing
Human face
Human head
Human arm
Poster

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 61.4%

Clarifai

Clothing 96.1%

Clarifai

Clothing 94.9%

Clarifai

Clothing 91.5%

Clarifai

Clothing 90.4%

Clarifai

Clothing 67.6%

Clarifai

Human face 70.2%

Clarifai

Human face 54.1%

Clarifai

Human face 38.7%

Clarifai

Human head 43%

Clarifai

Human arm 38.7%

Clarifai

Poster 37.8%

Categories

Imagga
created on 2021-12-15

streetview architecture 65.1%
paintings art 30.9%
people portraits 1.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of a group of men and women in front of a butcher's shop.

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a group of men standing in front of a store

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This black-and-white image shows a group of men gathered outside a shop with signage on the windows advertising "Home Dressed Meats," "Poultry and Eggs," and "Chapin Bros." The shop front is worn, with peeling paint visible on the entrance and surrounding areas. The men are dressed in work attire, including hats, button-down shirts, and suspenders, suggesting a rural setting. One of the men holds a wrapped package, while another appears to be counting or examining something in his hands. They are casually positioned, with one man seated on the step and others standing or leaning against the storefront. The scene gives off a feeling of camaraderie and reflects everyday life in a bygone era.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a scene outside a shop with signage advertising "Home Dressed Meats" and "Poultry and Eggs." There are four people gathered on the front steps of the building. The person standing on the left is wearing suspenders and a hat, and appears to be casually leaning with hands in pockets. Seated beside him in the center is another individual, wearing a long-sleeve shirt and suspenders, sitting and looking relaxed. The person standing in the middle is wearing a hat, light-colored shirt, and trousers, and appears to be examining or handling something with their hands, possibly money or an item. The fourth person on the far right, standing and facing slightly towards the others, is wearing a hat and holding a wrapped package under one arm, suggesting he might have purchased something from the store. The building's worn and peeling exterior adds a rustic feel to the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows the exterior of a small business establishment, likely a poultry and egg shop called "Chapin Bros." Several men, dressed in typical 1930s-era attire, are standing or sitting outside the shop. The storefront has signage advertising "Home Dressed Meats" and "Poultry and Eggs." The overall scene appears to depict a small-town or rural setting from the early to mid-20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white historical photograph showing the storefront of what appears to be Chapin Bros., a poultry and eggs shop. The store's windows have text advertising "HOME DRESSED MEATS" and "POULTRY AND EGGS." Several men are gathered outside the store, wearing typical early 20th century attire including hats and work clothes. The building has a white-painted exterior with wooden posts supporting an awning or overhang. The image has the characteristic look of photographs from the early 1900s, capturing a slice of American small business life from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of four men standing in front of a storefront. The men are dressed in casual attire, with one wearing a hat and suspenders, another in a hat and overalls, a third in a hat and a button-down shirt, and the fourth in a hat and a long-sleeved shirt.

In the background, the storefront features two signs: "HOME DRESSED MEATS" on the left and "POULTRY AND EGGS" on the right. A door with a window is situated between the two signs, bearing the inscription "CHAPIN BROS." in white letters. The overall atmosphere of the image suggests a rural or small-town setting, possibly from the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of five men standing in front of a storefront. The men are dressed in casual attire, with four wearing hats and one sitting on the ground. The storefront features two windows with signs that read "HOME DRESSED MEATS" and "POULTRY AND EGGS." A door between the windows displays the name "CHAPIN BROS." in white letters. The overall atmosphere suggests a rural setting, possibly during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image depicts a black-and-white photograph of four men standing outside a shop. The shop has two signs above the door. The sign on the left reads "HOME DRESSED MEATS," while the sign on the right reads "POULTRY AND EGGS." The men are dressed in hats and suspenders, which is typical attire for the era depicted in the photograph. The man on the left is standing and looking straight ahead, while the man next to him is sitting on the steps of the shop, looking down. The man in the middle is standing and appears to be holding a piece of paper or a small object, while the man on the right is standing and holding a newspaper.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white photo shows four men standing outside a store. The men are wearing hats, and three of them are wearing suspenders. The man on the left is wearing a long-sleeved shirt and pants, while the man in the middle is wearing a short-sleeved shirt and pants. The man on the right is holding a newspaper, and the man sitting is wearing a hat. The store has a glass door and a sign that reads "POULTRY AND EGGS."

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here is a description of the image:

The black and white photograph depicts a scene from what appears to be a small-town storefront. The shop, likely a general store, has faded signage in its windows: "HOME DRESSED MEATS" on the left and "POULTRY AND EGGS" on the right. Above the entrance door, "CHAPIN BROS." is displayed.

Four men are standing and sitting outside the store. On the far left, a man wearing a hat and suspenders stands, his hand in his pocket. Next to him, a man sits on the steps. The man is also wearing a hat and has suspenders. He has his hands resting casually on his lap. In the middle of the frame, a man in a hat seems to be making notes on a small paper. A man on the right of the image is holding a package. All the men are dressed in simple, work-appropriate clothing. The men are probably customers or the owners of the shop. The photograph's overall aesthetic suggests it may have been taken during the early to mid-20th century.

Created by gemini-2.0-flash on 2025-05-04

Here's a description of the image:

The image is a black and white photograph featuring a group of four men posed in front of a store. The store's façade is weathered and appears to be a general store or a butcher shop. The signs on the windows read "HOME DRESSED MEATS" and "POULTRY AND EGGS." The door has the name "CHAPIN BROS." printed on it.

The men are all wearing casual clothing typical of the era. One man is standing with his hand in his pocket, wearing a hat and suspenders. Another is seated on the steps, also wearing suspenders and a cap. Two other men are standing beside them, one holding what appears to be money and the other holding a package or newspaper.

The overall composition suggests a candid moment capturing a slice of life from a bygone era. The textures of the building and the clothing, combined with the posed yet natural stance of the men, create a sense of authenticity and historical significance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a group of four men standing and sitting in front of a storefront. The store appears to be a butcher shop, as indicated by the signage on the windows. The window to the left reads "HOME DRESSED MEATS," and the window to the right reads "POULTRY AND EGGS." The door between the windows has "Chapin Bros." written on it, suggesting the name of the establishment.

The men are dressed in what appears to be early to mid-20th-century work attire, including hats, suspenders, and overalls. One man is seated on a step or low platform, leaning back against the wall with his hands on his knees. The other three men are standing, with two of them holding small packages, possibly purchases from the store. The overall atmosphere suggests a casual, everyday scene in a small town or rural setting. The photograph is in black and white, adding to the historical feel of the image.

Qwen

No captions written

Text analysis

Amazon

POULTRY
HOME
EGGS
BROS.
MEATS
AND
CHAPIN
DRESSED
TO
M
PO
C

Google

HOME POULTRY PO TO DRESSED AND MEATS CHAPIN EGGS BROS.
HOME
POULTRY
PO
TO
DRESSED
AND
MEATS
CHAPIN
EGGS
BROS.