Human Generated Data

Title

Untitled (Yogyakarta, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4539.2

Human Generated Data

Title

Untitled (Yogyakarta, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4539.2

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Machine 99.8
Spoke 99.8
Wheel 98.6
Wheel 98.5
Wheel 98
Wheel 97.8
Wheel 97.5
Person 97.5
Person 97.3
Person 96.6
Bicycle 96.4
Transportation 96.4
Vehicle 96.4
Person 96.3
Bicycle 96.2
Person 95.5
Wheel 94
Wheel 93.7
Person 93.6
Wheel 93.4
Person 90.4
Person 80.2
Face 78.9
Head 78.9
Person 78.2
Person 77.9
Person 73.5
Person 70.6
Motorcycle 69.1
Person 69.1
Cycling 64.3
Sport 64.3
Person 64.3
Carriage 64.2
Person 63.8
Car 62.9
Architecture 58.8
Building 58.8
Tricycle 57.6
Wagon 57.4
Neighborhood 55.8
Horse Cart 55.4
Road 55.3
Alloy Wheel 55.1
Car Wheel 55.1
Tire 55.1

Clarifai
created on 2018-05-10

people 99.7
transportation system 99.6
monochrome 99.1
street 99.1
vehicle 99.1
group together 97.8
adult 96.9
road 96.2
man 95
car 94.2
driver 94
group 92.9
bike 92.6
motorcyclist 92.6
wheel 88.8
many 86.9
biker 86
traffic 84.8
city 84.4
horizontal plane 84.1

Imagga
created on 2023-10-07

jinrikisha 100
cart 98.3
wagon 73.4
wheeled vehicle 64.5
vehicle 46.3
carriage 45.6
wheelchair 34.1
chair 25
street 24.8
wheel 24.5
bicycle 23.4
transportation 23.3
city 21.6
bike 21.5
tricycle 20.6
old 19.5
transport 18.3
road 17.2
travel 16.2
seat 15.8
ride 15.5
outdoors 14.2
people 13.9
cycle 13.7
man 12.8
disabled 11.8
health 11.8
care 11.5
outdoor 11.5
architecture 10.9
speed 10.1
sport 10
disability 9.9
urban 9.6
support 9.6
traffic 9.5
outside 9.4
help 9.3
historic 9.2
tourism 9.1
black 9
handicapped 8.9
person 8.9
riding 8.8
building 8.7
sick 8.7
motion 8.6
senior 8.4
park 8.2
active 8.1
metal 8
night 8
lifestyle 8
conveyance 7.9
invalid 7.9
pedal 7.9
cyclist 7.9
male 7.8
tour 7.7
helmet 7.7
illness 7.6
horse 7.6
hospital 7.5
town 7.4
exercise 7.3
tourist 7.2
sunset 7.2
activity 7.2
adult 7.1
summer 7.1
medical 7.1
sky 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

building 99.2
road 96.4
outdoor 95.6
store 40.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 47-53
Gender Male, 99.4%
Calm 78.3%
Happy 16.2%
Fear 6.7%
Surprised 6.5%
Sad 2.5%
Confused 0.7%
Angry 0.6%
Disgusted 0.6%

AWS Rekognition

Age 13-21
Gender Male, 99.7%
Calm 85.4%
Fear 7.1%
Surprised 6.4%
Angry 4.6%
Sad 3.1%
Happy 2.1%
Confused 1.1%
Disgusted 0.7%

AWS Rekognition

Age 27-37
Gender Male, 96.3%
Calm 31.9%
Happy 29.1%
Fear 15.2%
Sad 8%
Angry 7.4%
Surprised 7%
Disgusted 3.4%
Confused 1.3%

Feature analysis

Amazon

Wheel
Person
Bicycle
Motorcycle
Car
Building
Wheel 98.6%
Wheel 98.5%
Wheel 98%
Wheel 97.8%
Wheel 97.5%
Wheel 94%
Wheel 93.7%
Wheel 93.4%
Person 97.5%
Person 97.3%
Person 96.6%
Person 96.3%
Person 95.5%
Person 93.6%
Person 90.4%
Person 80.2%
Person 78.2%
Person 77.9%
Person 73.5%
Person 70.6%
Person 69.1%
Person 64.3%
Person 63.8%
Bicycle 96.4%
Bicycle 96.2%
Motorcycle 69.1%
Car 62.9%
Building 58.8%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of people riding on bicycles in a city -100%

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

This black and white image is a street scene, likely from a bygone era. The photo is somewhat grainy, and the color tones are reversed.

Here are some key observations:

  • Vehicles: There are several modes of transportation present. A couple of rickshaws are prominent. One is in the center of the image, occupied by two visible passengers and a driver. Two bicycles also appear, one in the foreground on the left, and another being ridden alongside a rickshaw on the right.
  • Buildings: There are buildings along the street. On the left, there's a storefront with a sign that appears to say "ESENIAN ASIA" and further to the right, another one labelled "KERADJINAN INDONESIA". These seem to be shops or commercial establishments.
  • People: Pedestrians are also present on the sidewalks in the background.
  • Atmosphere: The image evokes a sense of activity, with the various modes of transport and pedestrians giving an impression of a busy day.

The negative image creates a unique visual effect, making the light areas appear dark and vice versa. Overall, it is a well-composed scene that captures a moment in time.

Created by gemini-2.0-flash on 2025-05-24

Here is a description of the image:

This black and white photograph depicts a street scene with various modes of transportation and buildings lining the street.

On the left, there is a sign that reads "ESENIAN ASIA" and "ORO 191. JOGJAKARTA". To the right of this building, another building has a sign above that reads "KERADJINAN INDONESIA." Both buildings have open entrances, suggesting shops or businesses.

Several bicycle-rickshaws, also known as pedicabs or becaks, are moving along the street. The drivers are pedaling while passengers sit in the carriages. In the background, there are other individuals walking along the side of the road.

In the far background, one can see electrical poles and other buildings, suggesting this is an urban environment.

The photograph may be from an older era given the style of buildings, modes of transportation, and the quality of the image.

Text analysis

Amazon

College
and
Art
(Harvard
Fellows
of
Museums)
Harvard
University
ESENIAN
President
© President and Fellows of Harvard College (Harvard University Art Museums)
KERADJINAN
ORO
P1970.4539.0002
JOGJAKARTA.
©
ORO 191. JOGJAKARTA.
"ASIA"
191.
INDONESIA"
ESENIAN "ASIA" -
103
-
ЗАТВЕК
ЗАТВЕК TALIER
TALIER

Google

KERADJINAN ESENIAN,ASIA INDONESIA" ORO 191.JOGJAKARTA P1970.4539.0002 © President and Fellows of Harvard College (Harvard University Art Museums)
KERADJINAN
ESENIAN
,
ASIA
INDONESIA
"
ORO
191.JOGJAKARTA
P1970.4539.0002
©
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)