Human Generated Data

Title

East Side Merchants (Lower East Side, New York City)

Date

April 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3143

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

East Side Merchants (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3143

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.2
Human 99.2
Text 72.7
Clothing 71
Apparel 71
Leisure Activities 56.4
Poster 55.7
Advertisement 55.7

Clarifai
created on 2018-03-16

people 99.8
adult 98.8
one 94.5
man 94.1
military 91.9
wear 89.5
vehicle 87.2
illustration 85.4
bill 85.1
uniform 84.1
transportation system 83
text 81.9
war 81.8
two 81.6
portrait 81.1
no person 80.2
retro 79.7
group 79.6
woman 77.9
outfit 76.8

Imagga
created on 2018-03-16

blackboard 100
chalk 25.3
chalkboard 22.5
education 21.7
board 20.8
school 20.6
grunge 20.4
classroom 20.4
black 18
retro 18
drawing 16.3
card 16.2
class 15.4
teacher 15.4
design 15.2
frame 14.1
student 13.6
symbol 13.5
study 13.1
old 12.5
texture 12.5
graphic 12.4
art 12.4
college 12.3
business 12.2
vintage 11.6
university 11.5
learn 11.3
learning 11.3
message 10
hand 9.9
sign 9.8
lesson 9.7
information 9.7
people 8.9
math 8.8
teach 8.8
teaching 8.8
text 8.7
decoration 8.2
aged 8.1
border 8.1
dirty 8.1
paper 7.8
space 7.8
empty 7.7
modern 7.7
knowledge 7.7
person 7.7
writing 7.5
human 7.5
style 7.4
letter 7.3
success 7.2
color 7.2

Google
created on 2018-03-16

photograph 94.8
text 86.5
black and white 80.3
poster 74.6
art 73.3
font 72.1
advertising 59.3
monochrome 50.2

Microsoft
created on 2018-03-16

black 70.7
old 50.9
posing 37.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Disgusted 0.3%
Angry 2%
Calm 85.3%
Sad 9.9%
Happy 0.1%
Confused 2%
Surprised 0.4%

Feature analysis

Amazon

Person
Person 99.2%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

The image depicts a storefront with a display window featuring a decorative sign, which includes an illustration of two birds (possibly ducks or geese) with text in a script that appears to be Yiddish. Below the birds is text that appears to say "Adler Sign," possibly indicating the creator of the sign. There is also an inscription reading "R. Lapinkoff." In the display window, there are a few paper bags on a shelf. To the right of the window, a person is leaning against the wall with their arms crossed. The overall setting suggests it might be a shop with a focus on poultry or related products.

Created by gpt-4 on 2024-01-27

The image appears to be a black-and-white photograph showing the partially visible exterior of a storefront with Hebrew lettering on its window. Featured prominently in the center of the window is a decorative element with two birds, possibly doves, facing each other with a floral or ornamental design between them. Below this decoration is more Hebrew text. In the bottom right corner of the window, there is a name written in Latin script, "R. Lapinkoff," accompanied by smaller text that seems to include an address and telephone number. A glimpse through the glass reveals some items inside the store, including what appears to be a crumpled paper bag resting on a counter or shelf near the window. The setting suggests a shopfront, likely for a business associated with the name displayed in the window.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image shows a black and white photograph depicting a person standing in front of a shop window. The window display features signs and decorations, including two cartoon duck figures. The person in the image appears to be a woman wearing a suit or outfit from an earlier era. The image has a somewhat somber and reflective mood to it.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a black-and-white photograph of a woman standing in front of a sign with Hebrew writing. The woman has dark hair and is wearing a dark dress with a white collar. She is looking down, possibly at something on the ground. Behind her, there is a sign with Hebrew writing in white letters. The sign appears to be advertising a business, possibly a restaurant or store. There are also some images on the sign, including what looks like a rooster and a menorah. In the foreground, there is a table with a dirty surface. It's unclear what the table is being used for, but it may be related to the business advertised on the sign. Overall, the image suggests that it was taken in a Jewish community, possibly in Eastern Europe or Israel. The woman's clothing and hairstyle are consistent with traditional Jewish attire, and the Hebrew writing on the sign indicates that the business is likely owned by Jews.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-01

The image depicts a black-and-white photograph of a storefront with a sign featuring Hebrew script and illustrations of a duck, goose, and chicken. The sign is situated above a table with a bag on it, and a woman stands to the right of the table, wearing a dark dress with a white collar. The storefront appears to be a small, possibly family-owned business, given the personal touch of the woman standing outside. The sign's use of Hebrew script suggests that the business may cater to a Jewish clientele or have Jewish roots. The presence of farm animals on the sign could indicate that the business sells food products, such as eggs or poultry. Overall, the image provides a glimpse into the daily life of a small business owner in a Jewish community, highlighting the importance of family and tradition in the business.

Text analysis

Amazon

RLapinkof
ADLER
y7y
y7y 15UN8YX ADLER RLapinkof
UTis
SI6WI
W'
URAY
15UN8YX
0700
YanS
UTis 1
1

Google

0700
0700