Human Generated Data

Title

Man with a bag 1

Date

2019

People

Artist: Jin Lee, American born 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Lisa Rich, 2019.315.52

Copyright

© Jin Lee

Human Generated Data

Title

Man with a bag 1

People

Artist: Jin Lee, American born 1961

Date

2019

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Lisa Rich, 2019.315.52

Copyright

© Jin Lee

Machine Generated Data

Tags

Amazon
created on 2022-05-03

Human 99.8
Path 99.3
Road 98.6
Transportation 94.9
Vehicle 94.9
Sidewalk 91
Pavement 91
Tarmac 85.5
Asphalt 85.5
Intersection 80.6
Automobile 74
Freeway 63.4
Pedestrian 62.1
Urban 60.6
Clothing 58.1
Apparel 58.1
Street 57.3
City 57.3
Town 57.3
Building 57.3
Highway 55.5

Clarifai
created on 2023-10-22

street 99.1
travel 97.1
train 96.6
road 95.2
railway 95.1
people 95.1
city 94.3
locomotive 94.3
storm 94.2
rain 93.6
landscape 92.4
calamity 92.3
no person 92.2
urban 91
flood 90.8
bridge 90.6
traffic 89.8
transportation system 89.5
car 89.5
sky 88.7

Imagga
created on 2022-05-03

intersection 97.2
semaphore 44.5
sky 38.4
apparatus 34.7
equipment 33.5
cable 29
industry 28.2
power 27.7
pole 27.5
high 26
tower 26
electricity 25.5
energy 23.6
industrial 22.7
electric 22.5
clouds 22
wire 21
structure 20.9
landscape 20.9
urban 20.1
field 19.3
city 19.2
building 18.3
road 18.1
metal 17.7
electrical 16.3
line 16.3
architecture 15
technology 14.9
voltage 14.7
station 14.5
steel 14.2
travel 14.1
transmission 13.8
cables 13.7
rod 13.6
environment 13.2
cloud 12.9
construction 12.9
light 12.7
lines 12.6
transportation 12.6
infrastructure 11.8
wires 11.8
outdoors 11.2
grass 11.1
street 11.1
summer 10.9
pylon 10.9
outdoor 10.7
supply 10.6
cloudy 10.3
water 10
silhouette 9.9
sunset 9.9
distribution 9.8
plant 9.7
antenna 9.7
engineering 9.5
day 9.4
tall 9.4
nobody 9.3
network 9.3
scene 8.7
dusk 8.6
tree 8.6
traffic 8.6
business 8.5
countryside 8.2
transport 8.2
landmark 8.1
river 8
railway 7.9
factory 7.7
old 7.7
tourism 7.4
town 7.4
park 7.4
track 7.4
tourist 7.3
sun 7.3
rural 7.1
scenic 7

Google
created on 2022-05-03

Sky 97.9
Cloud 96.8
Plant 94.6
Street light 93.1
Tire 90.8
Road surface 89.5
Car 89.4
Infrastructure 89
Tree 88.1
Wheel 87.8
Asphalt 87.2
Vehicle 87.1
Electricity 86.4
Overhead power line 85.7
Automotive lighting 85.3
Sunlight 84.3
Rolling 81.8
Residential area 80.8
Thoroughfare 80.7
Road 79.8

Microsoft
created on 2022-05-03

sky 100
outdoor 99.7
vehicle 97.4
car 96.5
land vehicle 96.5
road 88.4
sign 88.1
way 85.4
text 66.9
tree 56.4
sidewalk 31.7
day 13.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-28
Gender Female, 63.2%
Calm 92.7%
Surprised 6.4%
Fear 6%
Sad 4.2%
Disgusted 0.8%
Happy 0.6%
Angry 0.2%
Confused 0.2%

Feature analysis

Amazon

Person
Truck
Car

Clarifai

Street light
Car
Tree
Wheel
Truck
Person
Land vehicle
Traffic sign
Footwear

AWS Rekognition

Person 99.8%

AWS Rekognition

Truck 94.9%

AWS Rekognition

Truck 92.1%

AWS Rekognition

Truck 80.1%

AWS Rekognition

Car 74%

AWS Rekognition

Car 71.4%

AWS Rekognition

Car 57%

AWS Rekognition

Car 52.3%

Clarifai

Street light 82.3%

Clarifai

Street light 56.9%

Clarifai

Street light 51.9%

Clarifai

Street light 46.6%

Clarifai

Street light 45.1%

Clarifai

Street light 43.4%

Clarifai

Street light 43.2%

Clarifai

Street light 41.1%

Clarifai

Street light 38.9%

Clarifai

Street light 36.8%

Clarifai

Street light 36.7%

Clarifai

Car 74.5%

Clarifai

Car 73.4%

Clarifai

Car 72.2%

Clarifai

Car 69.9%

Clarifai

Car 69.3%

Clarifai

Car 62.6%

Clarifai

Car 53.2%

Clarifai

Car 50.2%

Clarifai

Car 50.1%

Clarifai

Car 44.2%

Clarifai

Car 42.8%

Clarifai

Car 41.6%

Clarifai

Car 37.7%

Clarifai

Car 33.1%

Clarifai

Tree 73%

Clarifai

Tree 67.1%

Clarifai

Tree 59.7%

Clarifai

Tree 57.1%

Clarifai

Tree 47.3%

Clarifai

Tree 46.8%

Clarifai

Tree 46.3%

Clarifai

Tree 45.8%

Clarifai

Tree 43.8%

Clarifai

Tree 43.8%

Clarifai

Tree 41.5%

Clarifai

Tree 41.3%

Clarifai

Tree 40.4%

Clarifai

Tree 39.5%

Clarifai

Tree 38.6%

Clarifai

Tree 36.4%

Clarifai

Tree 33.6%

Clarifai

Wheel 66.7%

Clarifai

Wheel 61.3%

Clarifai

Wheel 58.3%

Clarifai

Wheel 57.8%

Clarifai

Wheel 57.6%

Clarifai

Wheel 57.2%

Clarifai

Wheel 56.4%

Clarifai

Wheel 56.2%

Clarifai

Wheel 46%

Clarifai

Wheel 44.4%

Clarifai

Wheel 40.9%

Clarifai

Wheel 36.2%

Clarifai

Wheel 34%

Clarifai

Truck 61.1%

Clarifai

Person 54.2%

Clarifai

Land vehicle 45.9%

Clarifai

Land vehicle 43%

Clarifai

Land vehicle 38.1%

Clarifai

Land vehicle 35.4%

Clarifai

Traffic sign 44%

Clarifai

Traffic sign 41.5%

Clarifai

Traffic sign 40.1%

Clarifai

Footwear 40%

Categories

Imagga
created on 2022-05-03

streetview architecture 94.8%
beaches seaside 1.9%
nature landscape 1.9%
cars vehicles 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a man walking down a street with cars parked on the side of the road

Created by general-english-image-caption-blip-2 on 2025-07-06

a man is walking on the side of the road

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image depicts an urban scene featuring a small road with mixed vehicle traffic, including a red car, a large truck, and several parked cars to the left of the roadway. A pedestrian is walking on the sidewalk to the right of the road. In the foreground, there are railroad tracks cutting across the road and sidewalk, indicating a train crossing area.

On the right side of the road is a sparse lot with a "For Lease" sign and an "ABC" dealership or business sign visible. The area appears to include commercial spaces, such as a car dealership on the left, decorated with colorful pennants over a lot filled with vehicles. In the background, the environment seems suburban, with houses and scattered trees under a pale blue sky. The scene is calm and typical of a transitional space between urban and suburban areas.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a suburban street scene on a sunny day. In the foreground, there is a railroad crossing with tracks running across the road. A pedestrian, a man dressed in a blue jacket and gray pants, is walking along the sidewalk beside the tracks. To the left of the street, there are several vehicles, including a red convertible car, a black sedan, and a large blue semi-truck, all waiting at the crossing. There is a dealership lot with a variety of parked cars and festive pennant flags strung above them. To the right, there's a mostly vacant gravel lot with a sign that reads "FOR LEASE" and includes a phone number. In the distance, an ABC Auto Sales sign is visible, along with some trees and more cars parked further in the background. The sky is clear, indicating good weather.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-22

This image shows a typical American commercial street scene with railroad tracks in the foreground. There's a person standing on a sidewalk near the tracks. In the background, you can see various businesses, including what appears to be an ABC store sign, utility poles with power lines, and several parked vehicles including cars and a large truck. The area appears somewhat industrial or commercial in nature, with some bare or patchy ground visible alongside the tracks and sidewalk. The photo seems to be taken during daytime with clear skies.

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-22

The image shows a commercial area with various vehicles and a person walking on the sidewalk. There is a large sign for a business called "ABC" visible in the background. The scene appears to be a suburban or urban setting, with power lines and poles visible overhead. The ground in the foreground is bare and appears to be under construction or renovation. Overall, the image depicts a typical commercial street scene.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a man walking along the sidewalk of a busy road, with a mix of vehicles and commercial signs in the background.

  • The man is dressed in a blue jacket, khaki pants, and brown shoes, and is carrying a white bag in his left hand.
  • He is walking on the sidewalk, which is lined with a few trees and utility poles.
  • In the background, there are several vehicles on the road, including cars, trucks, and a semi-truck.
  • There are also several commercial signs visible, including one that reads "ABC" in large letters.
  • The sky above is blue and clear, with a few clouds scattered throughout.

Overall, the image captures a moment of everyday life in a busy urban area, with a focus on the man walking along the sidewalk and the surrounding environment.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a man walking along a sidewalk, with a road and railroad tracks in the foreground. The man is dressed in a blue shirt and khaki pants, and he appears to be holding a piece of paper or a folder.

In the background, there are several cars and trucks driving on the road, as well as a few buildings and trees. The sky is clear and blue, suggesting a sunny day. Overall, the image suggests a busy urban or suburban area, with people going about their daily activities.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

A man is walking on the sidewalk, which is next to the road. The road has several vehicles, including cars, trucks, and vans, driving on it. There are also streetlights and electric posts on the side of the road. There is a signboard with the text "ABC" on it. There are also some trees and plants on the side of the road. In the distance, there are houses and buildings.

Created by amazon.nova-pro-v1:0 on 2025-06-06

On a sunny day, a man is walking on the sidewalk, holding a piece of paper in his hand. He is wearing a hat, a long-sleeve shirt, pants, and shoes. He is walking towards the road, where cars and trucks are passing by. There are several electric poles with wires on the side of the road, and there are several trees in the distance. There is a signboard with the text "ABC" on it.

Google Gemini

Created by gemini-2.0-flash on 2025-05-25

The photo depicts a bright, sunny day on a busy street. A man dressed in a casual jacket and pants walks along the sidewalk, looking toward the camera.

On the left side of the street, a row of vehicles, including cars and trucks, is lined up near a business. A large semi-truck stands out, adding to the industrial feel of the scene. Flags and banners decorate the buildings, suggesting a commercial or retail area.

To the right of the man, there's a vacant lot with an "ABC" sign and a "For Lease" sign, indicating available commercial space. Utility poles and power lines are visible overhead, further emphasizing the urban or suburban setting.

In the foreground, railroad tracks run across the bottom of the frame, suggesting the proximity of a railway line and providing a sense of depth to the composition. The overall scene conveys a sense of everyday life in a bustling area with a mix of commercial and industrial elements.

Created by gemini-2.0-flash-lite on 2025-05-25

Here is a description of the image:

The image is a medium shot taken at ground level. The scene captures a sunny day on a street with a train track crossing in the foreground. A man stands on the sidewalk, holding a paper in his hand and looking towards the camera.

On the left side of the road, there is a line of cars, including a red convertible, and a semi-truck with a large cargo container. Further down the road, there are more vehicles, some parked in front of a building with flags on display.

On the right side of the road is a large empty lot with a sign that says "ABC" on it. There are also some smaller signs. A few trees without leaves are scattered in the background. The sky is clear and blue, suggesting a day in late winter or early spring.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts an urban street scene on a clear day. In the foreground, there is a person walking on a narrow sidewalk beside a road. The person is dressed in casual attire and is carrying a backpack. To the right of the sidewalk, there is a set of train tracks.

On the left side of the road, there are several vehicles, including a red car, a black SUV, and a white semi-truck with a trailer. The road appears to be busy with traffic.

In the background, there is a large, open, and somewhat barren area with sparse vegetation and some construction or development signs. One of the signs reads "ABC" and another reads "FOR LEASE." There are also utility poles and power lines along the road.

The scene is surrounded by leafless trees, indicating it might be late autumn or early spring. The sky is clear with minimal clouds, suggesting good weather. The overall atmosphere of the image is calm and typical of a suburban or light industrial area.

Qwen

No captions written

Text analysis

Amazon

ABC
630
FOR
FOR LEASE
LEASE
630 575-0700
Supply
575-0700
815-722
Stores
Hunter
Supply Co. inc.
108 E JACKSON ST
Stores Office
Hunter -
Co. inc.
ENROLL
-
Office
магум
ST магум
ST
EJCOM

Google

ABC Supply Co. ince. 108 E. JACKSON ST TERMS 615.714 Stores 0fes FOR LEASE st. MarUN 630 575-0700 Hunter ti tars ENROLL 02 815-722
ABC
Supply
Co.
ince.
108
E.
JACKSON
ST
TERMS
615.714
Stores
0fes
FOR
LEASE
st.
MarUN
630
575-0700
Hunter
ti
tars
ENROLL
02
815-722