Human Generated Data

Title

East Side Merchants (Lower East Side, New York City)

Date

April 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3143

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

East Side Merchants (Lower East Side, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3143

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.2
Human 99.2
Text 72.7
Clothing 71
Apparel 71
Leisure Activities 56.4
Poster 55.7
Advertisement 55.7

Clarifai
created on 2018-03-16

people 99.8
adult 98.8
one 94.5
man 94.1
military 91.9
wear 89.5
vehicle 87.2
illustration 85.4
bill 85.1
uniform 84.1
transportation system 83
text 81.9
war 81.8
two 81.6
portrait 81.1
no person 80.2
retro 79.7
group 79.6
woman 77.9
outfit 76.8

Imagga
created on 2018-03-16

blackboard 100
chalk 25.3
chalkboard 22.5
education 21.7
board 20.8
school 20.6
grunge 20.4
classroom 20.4
black 18
retro 18
drawing 16.3
card 16.2
class 15.4
teacher 15.4
design 15.2
frame 14.1
student 13.6
symbol 13.5
study 13.1
old 12.5
texture 12.5
graphic 12.4
art 12.4
college 12.3
business 12.2
vintage 11.6
university 11.5
learn 11.3
learning 11.3
message 10
hand 9.9
sign 9.8
lesson 9.7
information 9.7
people 8.9
math 8.8
teach 8.8
teaching 8.8
text 8.7
decoration 8.2
aged 8.1
border 8.1
dirty 8.1
paper 7.8
space 7.8
empty 7.7
modern 7.7
knowledge 7.7
person 7.7
writing 7.5
human 7.5
style 7.4
letter 7.3
success 7.2
color 7.2

Google
created on 2018-03-16

photograph 94.8
text 86.5
black and white 80.3
poster 74.6
art 73.3
font 72.1
advertising 59.3
monochrome 50.2

Microsoft
created on 2018-03-16

black 70.7
old 50.9
posing 37.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.1%
Disgusted 0.3%
Angry 2%
Calm 85.3%
Sad 9.9%
Happy 0.1%
Confused 2%
Surprised 0.4%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Azure OpenAI

Created on 2024-01-27

The image appears to be a black-and-white photograph showing the partially visible exterior of a storefront with Hebrew lettering on its window. Featured prominently in the center of the window is a decorative element with two birds, possibly doves, facing each other with a floral or ornamental design between them. Below this decoration is more Hebrew text. In the bottom right corner of the window, there is a name written in Latin script, "R. Lapinkoff," accompanied by smaller text that seems to include an address and telephone number. A glimpse through the glass reveals some items inside the store, including what appears to be a crumpled paper bag resting on a counter or shelf near the window. The setting suggests a shopfront, likely for a business associated with the name displayed in the window.

Anthropic Claude

Created on 2024-03-29

The image shows a black and white photograph depicting a person standing in front of a shop window. The window display features signs and decorations, including two cartoon duck figures. The person in the image appears to be a woman wearing a suit or outfit from an earlier era. The image has a somewhat somber and reflective mood to it.

Meta Llama

Created on 2024-12-01

The image depicts a black-and-white photograph of a storefront with a sign featuring Hebrew script and illustrations of a duck, goose, and chicken. The sign is situated above a table with a bag on it, and a woman stands to the right of the table, wearing a dark dress with a white collar. The storefront appears to be a small, possibly family-owned business, given the personal touch of the woman standing outside. The sign's use of Hebrew script suggests that the business may cater to a Jewish clientele or have Jewish roots. The presence of farm animals on the sign could indicate that the business sells food products, such as eggs or poultry. Overall, the image provides a glimpse into the daily life of a small business owner in a Jewish community, highlighting the importance of family and tradition in the business.

Text analysis

Amazon

RLapinkof
ADLER
y7y
y7y 15UN8YX ADLER RLapinkof
UTis
SI6WI
W'
URAY
15UN8YX
0700
YanS
UTis 1
1

Google

0700
0700