Human Generated Data

Title

A resident talks to workers in the Hunters Point neighborhood of San Francisco, California on May 5, 2017.

Date

2017

People

Artist: Ashley Gilbertson, Australian born 1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2020.166

Copyright

© Ashley Gilbertson

Human Generated Data

Title

A resident talks to workers in the Hunters Point neighborhood of San Francisco, California on May 5, 2017.

People

Artist: Ashley Gilbertson, Australian born 1978

Date

2017

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2020.166

Copyright

© Ashley Gilbertson

Machine Generated Data

Tags

Amazon
created on 2022-05-03

Human 99.1
Outdoors 82
Urban 78.8
Clothing 78
Apparel 78
Nature 77
Path 72.6
Street 71.4
City 71.4
Town 71.4
Building 71.4
Road 71.4
Yard 71.2
Shelter 67.8
Rural 67.8
Countryside 67.8
People 67.3
Brick 59.6
Shorts 56

Clarifai
created on 2023-10-21

people 99.9
street 99.5
monochrome 99.2
adult 95.4
black and white 95.4
group together 95.1
man 95
group 93.3
home 93.2
war 92.3
two 90.8
soldier 89.6
one 89.4
waste 87.6
road 87.1
child 86.4
vehicle 85.2
decay 85.2
train 84.8
woman 82.4

Imagga
created on 2022-05-03

pole 64.2
rod 46.2
sky 28.1
structure 20.4
cable 19.2
industry 18.8
fence 18
travel 16.9
industrial 16.3
wire 16.3
swing 16
transportation 15.2
old 14.6
line 14.5
post 14.2
electricity 14.2
city 14.1
electric 14
station 13.5
tree 12.4
steel 12.4
track 12.3
urban 12.2
building 11.9
landscape 11.9
metal 11.3
barrier 11.1
mechanical device 10.9
architecture 10.9
energy 10.9
power 10.9
railway 10.8
voltage 10.8
trees 10.7
outdoors 10.5
high 10.4
construction 10.3
vehicle 10.2
rope 10.1
mechanism 10.1
transport 10
field 10
outdoor 9.9
environment 9.9
tower 9.8
railroad 9.8
plaything 9.8
maypole 9.8
train 9.7
summer 9.6
bridge 9.6
wall 9.5
grass 9.5
sidewalk 9.5
wood 9.2
infrastructure 8.9
scene 8.7
sea 8.6
clouds 8.4
street 8.3
tourism 8.2
road 8.1
water 8
rural 7.9
rail 7.9
day 7.8
cables 7.8
cloud 7.7
empty 7.7
electrical 7.7
area 7.6
obstruction 7.4
exterior 7.4
light 7.4
sun 7.2
scenery 7.2

Google
created on 2022-05-03

Photograph 94.2
Building 93.3
White 92.2
Black 90
Black-and-white 87
Style 84.1
House 80.9
Monochrome 80
Monochrome photography 79.3
Adaptation 79.3
Window 78.3
Snapshot 74.3
Plant 74.1
Road 73.6
Motor vehicle 73.1
Electricity 72.1
Sky 68.5
Stock photography 67.4
Street 66.4
Room 64.6

Microsoft
created on 2022-05-03

building 99.8
outdoor 98.1
black and white 97.4
street 97.1
monochrome 85.9
house 76.2
text 76.1
old 67.4
white 64

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 80.6%
Calm 64.7%
Surprised 17.8%
Sad 7.7%
Fear 6.9%
Angry 6.2%
Disgusted 1.7%
Happy 1.3%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Tree
Clothing
Footwear
House
Window
Man
Wheel
Plant
Furniture

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 88.7%

AWS Rekognition

Person 43.1%

Clarifai

Tree 93.4%

Clarifai

Tree 90.9%

Clarifai

Tree 82.1%

Clarifai

Tree 77.1%

Clarifai

Tree 74%

Clarifai

Tree 72.9%

Clarifai

Tree 63.3%

Clarifai

Tree 62.9%

Clarifai

Tree 58.7%

Clarifai

Tree 58.2%

Clarifai

Tree 57.7%

Clarifai

Tree 55.7%

Clarifai

Tree 42.3%

Clarifai

Tree 41.9%

Clarifai

Tree 41.8%

Clarifai

Tree 37.4%

Clarifai

Tree 35.7%

Clarifai

Tree 34.2%

Clarifai

Tree 34.1%

Clarifai

Tree 33%

Clarifai

Clothing 79.8%

Clarifai

Clothing 70.1%

Clarifai

Footwear 69.9%

Clarifai

Footwear 67.1%

Clarifai

House 67.3%

Clarifai

House 62.8%

Clarifai

House 54%

Clarifai

House 53.5%

Clarifai

House 44.7%

Clarifai

House 42.8%

Clarifai

House 42.4%

Clarifai

House 35.6%

Clarifai

Window 63.7%

Clarifai

Window 60.2%

Clarifai

Window 57.2%

Clarifai

Window 55.8%

Clarifai

Window 55.5%

Clarifai

Window 55%

Clarifai

Window 53.9%

Clarifai

Window 53.3%

Clarifai

Window 52.3%

Clarifai

Window 50.8%

Clarifai

Window 48.8%

Clarifai

Window 48.5%

Clarifai

Window 47.5%

Clarifai

Window 46.9%

Clarifai

Window 44.8%

Clarifai

Window 43.4%

Clarifai

Window 43.4%

Clarifai

Window 40.6%

Clarifai

Window 40.4%

Clarifai

Window 40.4%

Clarifai

Window 37.4%

Clarifai

Window 36.1%

Clarifai

Window 35.1%

Clarifai

Window 34.9%

Clarifai

Window 33.2%

Clarifai

Window 33.2%

Clarifai

Man 58.1%

Clarifai

Wheel 37.5%

Clarifai

Plant 34.7%

Clarifai

Furniture 33.9%

Categories

Imagga
created on 2022-05-03

streetview architecture 71%
nature landscape 13.5%
paintings art 5.2%
beaches seaside 4.2%
pets animals 2.6%
cars vehicles 2.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a man in a white shirt is standing in front of a fence

Created by general-english-image-caption-blip-2 on 2025-07-04

a black and white photo of people working on a fence

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This black-and-white photograph captures a moment in a residential area. The foreground features a woman dressed in a coat and patterned pants observing a construction site. She leans forward, peering over a chain-link fence that separates her from a group of workers. In the trench below, several construction workers are wearing white protective suits and hard hats as they dig or work on something concealed in the ground. The area surrounding the trench is muddy and littered with tools and equipment, including pipes and an overturned bucket marked "Asbestos."

The background reveals an urban landscape with apartment-style buildings and houses surrounded by trees and vegetation. The structures appear older and weathered, suggesting a lower-income neighborhood. Power lines stretch overhead, contributing to the gritty, utilitarian feel of the setting. The subdued tones of the photograph evoke a somber and contemplative mood.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a black and white photograph depicting a residential area with visible construction activity. In the foreground, a woman is bending down to look over a fence at a group of workers. The workers, wearing hard hats and protective suits, are in a trench, likely engaged in some sort of maintenance or construction work. The trench is surrounded by dirt, with tools and a caution sign in the vicinity.

The scene is set in a neighborhood with multi-story buildings visible on either side of the street. The buildings are characterized by their flat roofs and multiple windows. The setting gives off a somewhat overcast or cloudy day atmosphere, possibly due to its monochromatic nature. There is some foliage visible, as well as discarded furniture and construction materials near the houses, adding to the urban residential context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image depicts a construction site in an urban setting. In the foreground, there are several people wearing protective gear, including hard hats and hazmat suits, working on what appears to be an excavation or repair project. In the background, there are various buildings and structures, suggesting a residential or commercial area. The overall scene has a gritty, industrial feel, with the black and white color scheme adding to the sense of a working-class environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This black and white photograph appears to show a construction or maintenance scene on a hillside. Several workers in white protective suits and hard hats are working along what appears to be a pathway or slope. In the background, there are apartment buildings or residential structures visible. The scene has a somewhat urban feel, with utility poles and wires visible. The terrain appears to be rough and possibly under development or repair. The contrast between the workers in their white protective gear and the darker surroundings creates a striking visual element in the composition. The image seems to capture some kind of infrastructure work or environmental cleanup activity.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image depicts a black-and-white photograph of a residential area with a group of workers in the foreground, engaged in digging and construction activities. The scene is set against a backdrop of houses and trees, with a woman standing on the sidewalk, observing the workers.

Key Features:

  • Workers: Five individuals wearing hard hats and coveralls are shown digging and constructing a pipe or trench. One worker is partially buried in the dirt, while another is standing on the edge of the trench.
  • Residential Area: The background features a row of houses, with trees and power lines visible. The houses appear to be multi-story and have a mix of windows and doors.
  • Woman: A woman stands on the sidewalk, looking down at the workers. She is dressed in a long coat and boots, and appears to be observing the construction activity.
  • Construction Equipment: Various pieces of construction equipment, including a ladder, a bucket, and a shovel, are scattered throughout the scene.
  • Atmosphere: The overall atmosphere of the image is one of activity and construction, with the workers focused on their tasks and the woman observing from a distance.

Context:

The image appears to be a documentary-style photograph, capturing a moment in time in a residential area. The presence of construction workers and equipment suggests that the area is undergoing development or renovation. The woman's presence adds a sense of human interest to the scene, highlighting the impact of construction on the community.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

This image is a black-and-white photograph of a woman leaning over a fence, looking down at three workers in hard hats and protective gear who are working on a pipe in a trench. The woman is wearing a dark coat, leopard-print pants, and rain boots. She is standing on a sidewalk next to a chain-link fence that separates her from the workers.

In the background, there are several buildings, including houses and apartments. There are also trees and power lines visible. The overall atmosphere of the image suggests that it was taken during the daytime, possibly on a cloudy or overcast day. The presence of the workers and the pipe in the trench suggests that some kind of construction or maintenance work is being done in the area.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

A black-and-white photo of a woman in a coat, boots, and gloves standing on the concrete pathway, possibly looking at the workers in white protective suits, helmets, and gloves who are working on the ground, probably doing some construction work. The workers are using shovels and hammers. A bucket is placed on the ground. A chair and a trolley are placed on the pathway. A wooden fence is beside the pathway.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of a neighborhood scene. In the foreground, a woman is standing on a sidewalk, looking down at something on the ground. She is wearing a coat, boots, and a hat. Behind her, there is a wooden fence, and beyond that, a wooden structure with a tire and a chair. To the right, there are three people in white helmets and suits, working on the ground, possibly doing some kind of maintenance or construction. There are also some buckets and tools scattered around. In the background, there are several houses and trees.

Google Gemini

Created by gemini-2.0-flash on 2025-05-06

The black and white image shows a residential area undergoing construction work. In the foreground, a woman stands on a concrete walkway, leaning over a chain-link fence. She is wearing a dark coat, a patterned outfit, and boots.

To the right of the walkway, a group of workers are digging in a trench. They are wearing white hard hats and protective suits, and they appear to be working on underground pipes or cables. A utility bucket lies on the ground next to the trench.

In the background, there are residential buildings, typical of a suburban neighborhood. The landscape includes trees and a grassy hill. The sky is overcast, giving the scene a somewhat gloomy atmosphere.

Created by gemini-2.0-flash-lite on 2025-05-06

Here's a description of the image:

Overall Impression: The photograph is a black and white depiction of a scene with a somewhat somber and industrial feel. It presents a juxtaposition of the everyday life with a work in progress, possibly a utility project.

Foreground:

  • A woman dressed in a dark coat and patterned pants is standing on a concrete pathway. She is looking down at the ongoing work.
  • A metallic fence creates a visual barrier, separating the pathway from the worksite.

Midground:

  • Workers in full protective gear, including white suits, masks, and hard hats are inside a trench, suggesting they might be dealing with a hazardous material.
  • There's a steep slope of excavated earth.
  • Some equipment, like buckets, is visible near the excavation.

Background:

  • Apartment buildings are visible in the background.
  • Utility poles and power lines crisscross the sky, adding to the urban landscape.
  • A cloudy, overcast sky contributes to the mood of the image.

Composition:

  • The scene is shot from a slightly low angle, which could be intentional to include the trench.
  • The composition includes vertical and horizontal lines formed by buildings, fences, and utility poles, creating a sense of order amidst the somewhat chaotic worksite.
  • The stark contrast of black and white adds a dramatic effect.

Overall Feel: The image has a documentary quality to it, capturing a moment in time that depicts a situation involving human action and possible environmental intervention. The lighting and composition evokes a sense of quiet, observant documentation of a routine, but potentially hazardous, environment.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a scene in what appears to be a residential area. In the foreground, there are three individuals dressed in protective suits and helmets, working in a trench. They seem to be involved in some form of construction or repair work, possibly related to utilities or infrastructure.

In the background, a person dressed in casual clothing and rubber boots is leaning over a fence, seemingly observing the workers. The fence separates the residential area from the work site. The residential area includes houses with various items such as chairs, a ladder, and other household objects visible on the porch and in the yard.

The setting is outdoors, and the environment appears to be somewhat hilly, with more houses visible in the distance. Overhead, there are utility poles and wires, indicating the presence of electrical infrastructure. The overall mood of the image suggests a blend of everyday life and ongoing work or maintenance in the neighborhood.

Qwen

No captions written

Text analysis

Amazon

PPLY
KDSU
KDSU PPLY II
CSK
II

Google

OSUPPLY TE CAF
OSUPPLY
TE
CAF