You are on page 1of 70

How to

Evaluate
Street
Transformations
A Focus on Pop-up and Interim Road Safety Projects

Global Designing Cities Initiative


How to
Evaluate
Street
Transformations
A Focus on Pop-up and Interim Road Safety Projects

Edition I - May, 2022


About GDCI Special Thanks
Global Designing Cities Initiative (GDCI) The genesis, ideas, and content of this handbook are rooted in
the experiences and lessons learned in the various contexts that
The mission of the Global Designing Cities Initiative (GDCI) is to inspire a the GDCI team has been fortunate to work in over the last six
shift toward safe, sustainable, and healthy cities through transforming years, particularly as a partner of the Bloomberg Philanthropies
streets around the world. We are a team of designers, planners, and Initiative for Global Road Safety (BIGRS) and the National
urban strategists committed to working in support of city practitioners
Association of City Transportation Officials (NACTO), as well as
to get projects on the ground. We focus on empowering local officials
and communities to become changemakers, equipping them with the
Bloomberg Associates and the Streets for Kids program.
knowledge, tools, and tactics needed to improve urban mobility and Special thanks to the city teams we’ve had the pleasure of
fundamentally change the role of streets in our cities.
working and learning with, including Addis Ababa, Bogotá, Cali,
Fortaleza, Guayaquil, Istanbul, Milan, Mumbai, Quito, Recife,
GDCI Publications Referenced
Salvador, São Paulo, Tirana, and more. We are honored to have
learned so much from these experiences and look forward to
Global Street Designing How to
Design Guide Streets for Implement continuing this important work together.
Kids Street
Transformations
This handbook also builds on the work, research, studies, and
publications of many individuals and organizations that, through
the years, helped establish and consolidate the importance of
measuring and evaluating street transformations.

We would like to acknowledge the wonderful work of authors,


scholars, and practitioners such as William H. Whyte, Donald
Appleyard, Jan Gehl, Jane Jacobs, Christopher Alexander, Allan
Jacobs, and the work of organizations such as Vital Strategies,
Johns Hopkins University, the World Resources Institute (WRI)
and all the partners of the Bloomberg Philanthropies Initiative
for Global Road Safety (BIGRS), the Institute for Transportation
and Development Policy (ITDP), Project for Public Spaces, Street
Plans Collaborative, Gehl Architects, Better Block, and many
others that directly or indirectly contributed to or inspired
this work. We are truly grateful to our external reviewers and
contributors who have amiably reviewed this handbook and
shared their invaluable knowledge and insights with us. See
page 78 for a list of these individuals in the Acknowledgements
section.

Fortaleza, Brazil

II How to Evaluate Street Transformations How to Evaluate Street Transformations III


Contents
?!

Introduction Section A Section B


The importance of data 01 Identify where to start 11 Measure the impact 25 Resources 75

Harness short-term impact 02 A1 Understand and prioritize 12 B1 Organize the team 26 Acknowledgements 76
Street transformations 04 the issues at hand Identify surveyors and resources 26 Key terms 78
How to navigate this handbook 08 Train and brief surveyors 27
References 79
A2 Select metrics that will 16 Define data collection schedule 28
evaluate the project goals Make a surveyor location map 29 Appendix 80
Library of metrics 17 How to use the templates 81
Measure what matters most 20 B2 Select appropriate tools 32 Templates 83
Visual documentation tools 32
A3 Determine when to collect data 22 Data collection tools 36

B3 Collect data on site 40


Site analysis 42
Measuring perception 44
Counting pedestrians 48
Counting cyclists and 56
micromobility users
Counting vehicles 58
Legend
Pro tips Measuring vehicle speeds 60
To facilitate the navigation of this handbook, look
These boxes indicate key tips and
for these buttons and boxes. B4 Standardize and analyze data 62
important things to keep in mind

B5 Communicate the results 68


Bookmark Case studies Use collected data to support the 70
These buttons refer to external resources or These boxes show inspiration from cities we’ve communications deliverables
parts of this handbook with complementary worked with, showing how they’ve applied the
guidance on specific subjects methods and tools covered in this handbook

IV How to Evaluate Street Transformations How to Evaluate Street Transformations V


The importance
of data
Harness short-term impact 02

Street transformations 04
How to navigate this handbook 08

São Paulo, Brazil How to Evaluate Street Transformations 1


The importance of data | Harness short-term impact

Harness short-term impact Meaningful metrics can


City authorities around the world are finding Since 2015, primarily within the Bloomberg
help cities to:
that investing in pop-up and interim projects Philanthropies Initiative for Global Road
can help build community support, improve Safety (BIGRS) program, GDCI has worked
designs, and speed up the pace of change. with governments and data collection teams
Data plays a critical role in propelling these in cities around the world—including in Expand upon data collection practices
short-term projects into permanent and Addis Ababa, Bogotá, Fortaleza, Mumbai, to focus on more types of street users, mobility, and
widespread changes on streets. The How to São Paulo and more—to design, implement, place functions
Evaluate Street Transformations handbook is and measure the impact of temporary
an approachable tool that provides a starting street transformation projects. Through
point for any reader to measure, evaluate, this experience, GDCI has developed the
and communicate street design data related approach, tools, and practices outlined in Measure the impact
to road safety impact and their co-benefits. this handbook. of project designs

This handbook is designed to complement This handbook is intended for a diverse


the Global Street Design Guide. It draws on audience of public sector leaders,
the experience of the Global Designing Cities practitioners, community members, Analyze the performance
Initiative (GDCI) and our partner, the National and other stakeholders interested in of new materials and ideas
Association of City Transportation Officials demonstrating the impacts of safer street
(NACTO), in demonstrating the impact transformation projects to encourage a
of street transformation projects. While broader conversation about what matters
implementing shorter-term, cost-effective most on our streets as a key step toward
Encourage fairer conversations
focused on equitable design strategies
solutions with quick-build materials, these longer-term, more permanent change.
interventions often lead to permanent
projects through capital construction.
Build evidence
on the importance and impact of safe, healthy, and
sustainable streets

Strengthen community and political support


for projects through engagement

2 How to Evaluate Street Transformations


The importance of data | Harness short-term impact The importance of data | Harness short-term impact

Street transformations
This handbook is intended to be applicable for “pop-up”, “interim”, and capital construction
street transformation projects, with a focus on the first two types. Data can, and should, be
collected at all phases whenever possible.

How do we define these different types of street transformations? The three types of street transformations may occur in a sequence:

Pop-up street transformation project Typical steps of street transformation project Project planning Build Post-implementation

Lasting a few hours up to a few days, a pop-up project is a quick way Analyze site challenges and opportunities
to generate excitement, demonstrate the immediate impacts of a Engage stakeholders
design on a project site, trial a new design, and make the case for an
interim project. A pop-up project uses temporary paint, cones, free- Develop a project vision
standing delineators, movable street furniture, and/or barriers. Plan and design

Build pop-up street transformation

Adjust and refine


Interim street transformation project Build interim street transformation
Lasting a few weeks, months, or years, an interim project generally Monitor and maintain the project
uses street markings, paint, signs, free-standing delineators, plants,
Evaluate the project
movable street furniture, and/or barriers. It gives the opportunity to
experience the project and collect data over a slightly longer time Advance permanent design
frame­: before, during, and after the project.
Build permanent project (capital construction)

Update policies as a result of evaluation

Data collection periods


Capital construction project
Often, the ultimate goal of pop-up and interim projects is to lead to a
permanent project through capital construction. This type of project allows
for long-term impact evaluation over several years. Although this document’s
methodology can be applied to capital construction projects, the focus is
on using data effectively during pop-up and interim street transformation
projects to enable capital construction, or permanent change.

Collect data Collect data during Collect data weeks,


These three types of street transformation processes are not necessarily mutually exclusive before implementing and immediately months, and years
or linear by nature. Depending on the budget, capacity, and political will behind your project, it the project after implementing after implementing
could fall into any one (or any combination of) these categories. the project the project

For more information on how to implement a pop-up or interim street transformation effectively,
reference the How to Implement Street Transformations handbook.

4 How to Evaluate Street Transformations How to Evaluate Street Transformations 5


The importance of data | Harness short-term impact The importance of data | Harness short-term impact

USING DATA TO ADVOCATE FOR A PROJECT’S PERMANENCE


LeGare, Addis Ababa, Ethiopia
Data collection Data collection
of existing conditions of redesign
In partnership with the City of Addis Ababa, GDCI Site selection and planning Evaluation report
helped support the goal of improving road safety
and reducing traffic injuries and fatalities around
the city. Data collection Data collection
on existing conditions on redesign
One key strategy for improving road safety
is through effective street design. In order to
test design approaches, a pop-up project was March 2016 June December June 2017 August October
implemented at LeGare intersection in June 2016
and data was collected to understand the best
long-term solution for this location. BEFORE

Street transformation type:


Pop-up, interim, and capital

Project site:
LeGare intersection had long been a hotspot for
road crashes, with more than 80 crashes recorded
between June 1 and November 30, 2015. Given its POP-UP
POP-UP PROJECT INTERIM PROJECT CAPITAL CONSTRUCTION
poor safety record and high pedestrian volume,
LeGare was chosen for the first pop-up project in The intersection geometry was The successful one-day trial In October 2017, a longer-term
the city. transformed using chalk, string, helped gain support from local design was implemented.
and plants borrowed from a local officials to pursue a six-month
The data collected at the
nursery. Lanes were narrowed interim street transformation.
previous stage garnered
Project outcome and aligned to shorten crossing
A lack of proven local precedents, support for the permanent
distances and lower vehicle
limited funding, and regulatory construction of the project.
After the interim transformation, turning speeds.
restrictions created barriers for The LeGare experience led to
there was a 33% reduction in innovative solutions. The interim the development of the citywide
The one-day implementation, a
vehicular speeds on weekends, project allowed Addis Ababa to Safe Intersections Program, and
INTERIM first for the city, gave the team the
opportunity to engage with head trial ideas in a flexible, low-cost over 17 intersections have been
92% of surveyed pedestrians way before investing in permanent transformed since 2018.
city officials. They were able to see
were satisfied with levels of construction. The six-month
and experience the site, analyze
safety, comfort, convenience, and duration also provided enough
critical movements, and to collect
attractiveness (compared to 24% time to collect longer-term data,
data quickly. This was a powerful
before), which showed reduced vehicle
tool to get permission to paint
and enter the interim project turning speeds and increased
and 13% more pedestrians pedestrian satisfaction and
stage to collect more robust data.
crossed the street on protection.
protected facilities
CAPITAL

6 How to Evaluate Street Transformations How to Evaluate Street Transformations 7


The importance of data | Harness short-term impact The importance of data | Harness short-term impact

How to navigate this handbook


The sections outlined below will walk you through how to
set up your data evaluation plan. Refer to each chapter
listed in the first row of the chart for more information.

A Identify where to start B Measuring impact

Reference A1 A2 A3 B1 B2 B3 B4 B5
section

Process of Understand and Select metrics that Determine when Organize Select Collect data Standardize and Communicate
evaluating a street prioritize the issues will evaluate the to collect data the team appropriate tools on site analyze the data the results
transformation at hand project goals

What you will find → Compile data from → Define what a → Create a schedule → Identify, train, → Select visual → Prepare → Use → Use a variety
in this section existing databases, successful project to collect the same and brief documentation forms/boards spreadsheets of visual tools
archives, and online would look like and data before, during, surveyors tools according to support and other and strategies
research about the achieve and after the project to what you standardized tools to extract to disseminate
project site and → Define the
is implemented want to capture data collection valuable information
surrounding network → Prioritize the metrics data collection
to understand the and show metrics about your
that matter most schedule → Understand
impact over time project
→ Identify preliminary to demonstrate the and prepare → Prepare data different → Analyze the
throughout the
data to collect on site impact of the project a surveyor collection types of data, variation in
process and
from conversations location map to tools that will tools that can data (before,
beyond
with communities, guide the team support the support its during, and
site observation, etc. on site counts and collection, and after the → Encourage
measurements things to look project is built) broader
→ Come to an
on site out for while on to understand conversations
agreement about the
the project site shifts in use about the
collective goals and
and function, important
priorities
and to evaluate role of our city
the resulting streets
impacts

8 How to Evaluate Street Transformations How to Evaluate Street Transformations 9


?!
A
Identify where to
start
A1 Understand and prioritize 12
the issues at hand

A2 Select metrics that will evaluate 16


the project goals

Library of metrics 17
Measure what matters most 20

A3 Determine when to collect data 22

10 How to Evaluate Street Transformations São Paulo, Brazil How to Evaluate Street Transformations 11
Identify where to start | Understand and prioritize the issues Identify where to start | Understand and prioritize the issues at

A1 | Understand and prioritize


the issues at hand
Collecting data at the planning stage is fundamental to the success of the Initial steps
project. Studying the existing site dynamics through various sources of data Below is an overview of how to launch the data collection process for a chosen site, and
will provide a stronger understanding of the site and what is possible. define what success will look like. If available, begin by compiling data from existing
databases, archives, and online research about the project site and surrounding network.
The collected data will also serve as a benchmark of the site conditions and Examine existing city planning documents and strategic plans. This will help align the
community voices, which can be referred to after the implementation to project to current city goals, and determine what data gaps exist, potential impediments,
measure success, and to inform the planning and design processes. and what still needs to be collected. Considering the often fast-paced timelines of pop-up
and interim projects, it is essential to prioritize which data to collect, measure, and analyze.
The process described begins after the project site has been selected. For information on how to
select the site, see How to Implement Street Transformations, Section A.

Types of data: What data exists, what is missing, and how can it be sourced or collected?
→ What should be collected at the site, online, and/or from the city’s existing databases and archives?
Online research → What preliminary data do we already have about the city and neighborhood scales?
Existing databases and
→ What additonal data do we need to study the challenges, potential benefits and impacts of the project?
archival research Additional baseline data
→ What resources are available? (Staff, finances, materials?)
can be found outside of city
For instance, crash, injury,
archives, including local news
and traffic fatality data can Collect more background data on site
and research conducted by
typically be sourced from
other organizations. → With whom in the community can the team conduct preliminary conversations and surveys to better
your city’s police department
understand the needs and priorities for the space?
or paramedic records. Other
→ Who are the main users of the street and what are their stories, key destinations, and activities?
useful data could include
→ Do the site dimensions match the existing technical drawings?
land use, demographic Interviews, focus groups,
information, street user and intercept surveys Identify collective goals and priorities
counts, and more.
To understand the priorities, → What is the main issue that the project seeks to address?
insights and feedback of → Which street user(s) will the project prioritize?
community members and → What do communities at and adjacent to the project site care about the most?
G
S Information from other stakeholders. → What changes might the project cause, and how will they be managed? (For instance: redirected traffic
D
G technical drawings routes)
→ What are the top three to five project priorities, being cognizant of the timeline and the city’s goals?
Study and confirm
dimensions of existing base Observational data Define success
maps or create new ones
To understand behavior, → What is the desired, measurable impact of the project?
to include the necessary
activity, challenges, and → Does success mean different things to the decision maker (who may have final say on whether an interim
details that can influence
characteristics of a project project is made permanent) and to the community? Where are the commonalities?
your design decisions and
site. This can be qualitative → In one year’s time, what would the team aspire to say about the project to the community? To other city
operational changes.
and/or quantitative. agencies? How would this be communicated?
→ How would communities ideally be using the new space?

12 How to Evaluate Street Transformations How to Evaluate Street Transformations 13


Identify where to start | Understand and prioritize the issues Identify where to start | Understand and prioritize the issues at

PRIORITIZING A ROAD SAFETY-FOCUSED AGENDA


Barão do Rio Branco, Fortaleza, Brazil

GDCI partnered with the City of Fortaleza to improve pedestrian Collect more background data on site
safety and walkability in the heart of the city’s commercial center on → Existing pedestrian desire lines: especially midblock locations where there were no crosswalks
the Barão do Rio Branco corridor. → The number of pedestrians walking on the roadbed: with inadequate sidewalk space, an average
This case study breaks down how to define a vision for success and of 200 people per hour were left to walk on the roadbed, putting themselves at risk from oncoming
the subsequent data to collect following the steps listed on the vehicles.
previous page. → Number of street users by travel mode: 67% of the street space was allocated for motorized
Reference the continuation of this case study on page 72 for more vehicles, although that mode accounts for less than 25% of the street users.
information on how outcomes were communicated in this project.
→ Speeds of motor vehicles to show the need for traffic-calming elements: peak speeds measured
at the site reached 50 km/h.
→ Perceptions of the project site: the Fortaleza team surveyed people to understand their
What data exists, what is missing, and how can it be sourced or collected? perceptions of the challenges and opportunities on site.
1,984
The examples below highlight a couple metrics that were created from data that was sourced and collected
pedestrians/hour Reference Section B for tips on how to document the existing
prior to project development. conditions mentioned in this case study.

544
motorized vehicles/hour Identify collective goals and priorities
Existing database and Observational data
→ Which street user(s) will the project prioritize?
archival research
Pedestrians walking in the downtown area
→ Ultimate project priority:
Reduce pedestrian road traffic fatalities. This will take multiple years of recurring data collection,
The chance that a pedestrian will be Before the transformation of Rua Barão
P paired
P with a broader, citywide data collection effort to measure this resulting impact.
struck by a vehicle is 90% higher in the do Rio Branco, 67% of the street space
downtown core than the rest of the city was allocated for motorized vehicles, → Top three immediate priorities:
• Reallocate space between the different modes, giving more space to pedestrians and less
33
although that mode accounts for less than
% of the street users
25%
60 % space to motor vehicles.
pedestrian facilities pedestrian facilities
downtown • Reduce speeds with traffic-calming elements.
• Reduce pedestrians’ risk and exposure to vehicles while crossing the street.

Define success
→ What is the desired, measurable impact of the project?
• Fewer pedestrians walking on the roadbed
• Reduced vehicle speeds
Barão do Rio Branco corridor
• Increased number of traffic-calming elements
• Increased square footage and quantity of pedestrian space and facilities
• High approval rating from community
91 pedestrians were killed
in traffic crashes in the City → In one year’s time, what would the team ideally like to say about the project?
BEFORE How would the team respond to critics?
of Fortaleza in 2018
The project created safe walking environments for pedestrians, supported the most vulnerable
road users, and brought the community into the process.

14 How to Evaluate Street Transformations How to Evaluate Street Transformations 15


Identify where to start | Select metrics that will evaluate the proj- Identify where to start | Select metrics that will evaluate the proj-

A2 | Select metrics that will Library of metrics


Below is a sample library of metrics that cities can use to
evaluate the project goals understand the impact of their projects and to compare with
their own data collection and evaluation plans. Note that this is
not a comprehensive list but a suggestion of where to start. Refer
For decades, streets have been evaluated based on the to page 47 and 54 for more information on qualitative metrics.
efficiency and capacity of vehicles, but true mobility function
and road safety improvements should focus on a combination Remember that every metric will not be applicable to all street
of data types, road user types, place functions, and the projects or all contexts and to focus on what matters most for
your project.
resulting co-benefits.

Physical and operational changes


Document the change in facilities, technologies, and infrastructure as a result of the project and track short-
term results. Most of the metrics below can be analyzed by comparing technical drawings of the existing
conditions to those of the new project.

Pedestrian-focused accessibility, Cycling-focused accessibility,


safety, and comfort safety, and comfort

→ Presence and width of sidewalks → Length and width of cycle facilities


→ Materiality of sidewalks (slipperiness, etc.) → Percentage of bike lanes that are protected
→ Water management from vehicular traffic
(drainage issues close to crossings) → Bollards (type, height, and visibility if
→ Accessibility of sidewalks applicable)
(obstacles, potholes, etc.) → Number of bike share stations and docks
→ Number and quality of accessibility ramps
→ Number of handrails or similar facilities
→ Furniture for pedestrians to rest/sit Motor-vehicle-focused
accessibility, parking, and geometry
→ Areas with shelter/shade
→ Type and direction of street lighting → Kilometers of dedicated transit facilities

→ Number and quality of pedestrian crossings → Number of transit stops


→ Number of parking spaces and loading bays
→ Crossing distance
→ Percentage of parking spaces for
→ Distance between crossings
mobility-impaired accessibility
→ Refuge islands (dimensions, level of → Number of vehicles illegally parked on site
protection from vehicular traffic)
→ Average parking turnover time
→ Number of accessible pedestrian signals
→ Width of each travel lane
→ Number of adequate waiting areas for → Size of the curb radii at intersections
Fortaleza, Brazil
transit

16 How to Evaluate Street Transformations How to Evaluate Street Transformations 17


Identify where to start | Select metrics that will evaluate the proj- Identify where to start | Select metrics that will evaluate the proj-

Changes in use and function Resulting impacts


Understand how and why a street functions differently as a result of the project. Measure changes that This longer-term evaluation of a project is an important part of understanding whether an investment or
affect pedestrians, cyclists and motorists and the level of satisfaction with the changes. These quantitative implementation is having the desired outcomes as set forth by the larger goals of public health and safety,
and qualitative changes can be assessed at the project site, and adjacent streets and networks. quality of life, environmental sustainability, economic sustainability, and equity for the city.
It can take many years to fully understand the impact on the city, and how different projects played a role.
These metrics are important to track as they can have implications for the allocation of transportation
Pedestrian counts, behavior, Cyclist and micromobility counts, investments based on indicators such as increased ridership demand or to correct inequities in specific
and perception behavior, and perception areas.

→ Number of pedestrians by age and gender → Number of cyclists and micromobility users
→ Number of pedestrians by type of activity per day These might include, but are not limited to:
and duration of stay → Percentage of cyclists and shared
→ The number of pedestrians and cyclists killed → Degree of public involvement in the planning
→ Number of pedestrians walking on the micromobility users riding within facilities
or seriously injured (KSI) process
roadbed vs. on dedicated facilities vs. on the sidewalk
→ The levels of pedestrian/cyclist/motorist → The public and personal fiscal cost of
→ Number of pedestrians crossing the street → Change in volume of clients at local
perceptions of risk and comfort commuting
with and without crossing facilities businesses before and after a cycle lane is
implemented → The percentage of overall street network with → The urban heat island effect at a local and
→ Number of people at transit stops safe access for all users city scale
→ Cyclists’ level of stress and comfort
→ Average time it takes for pedestrians to → Mode share breakdown and travel times → Ambient concentration of air pollution
finish crossing the street (particulate matter, nitrogen dioxide,
→ Frequency, reliability and affordability of
→ Number of people using spaces with public transit services by neighborhood measured at a local and city scale)
polluted/clean air Motor vehicle → Prevalence of asthma and new cases of
→ The percentage of population living...
→ Pedestrians’ perception of safety and behavior and speed asthma attributed to air pollution
→ ... near public transit stations and stops
comfort level → Percentage of kids with respiratory issues
→ Peak and average motor vehicle speed → ... near safe cycle facilities
→ Percentage of traffic traveling within the → Change in sales tax receipts and in number of
Different survey questions can help → ... within a 10-minute walk to bike share
speed limit total customers from adjacent businesses
understand the nuances of the facilities
→ Percentage of drivers yielding for pedestrians → Overall economic health of local businesses
perception of safety and comfort: → ... within a 60-minute transit ride to
at crossings
→ Do you feel empowered to move education and employment opportunities
around as a result of this project? → Percentage of motorcyclists wearing helmets
→ ...within a 10-minute walk to quality parks,
→ Is this a place where you would → On-street parking spaces converted into play areas, and public spaces
choose to meet your friends? pedestrian spaces
→ Can people easily walk/bike to this
→ Average travel time of buses/transit Being that walking, cycling and public transit are frequently the most affordable way to
place?
→ Do you see a mix of ages and → Loading locations and durations travel, providing ample opportunities to safely use these modes of travel within a reasonable
ethnic groups that generally reflect → Vehicular drop-off locations and durations distance from home to areas of opportunity (education, jobs, healthcare, groceries, etc.) are
the community at large? key to transportation equity improvement. For this analysis, metrics can be disaggregated
→ Noise pollution levels
→ Are there activities happening here for specific population groups, including: by race and ethnicity, by income level, for users with
→ Emission of air pollutants and number of disabilities, etc.
that you enjoy?
polluting vehicles in the area

18 How to Evaluate Street Transformations How to Evaluate Street Transformations 19


Identify where to start | Select metrics that will evaluate the proj- Identify where to start | Select metrics that will evaluate the proj-

Measure what matters most This data contributes to project goals, such as:
Collect data related to existing challenges and defined project → Making pedestrians and vulnerable road users feel safe
Consider studying multiple scales
goals before and after the street transformation to understand → Reducing vehicle speeds
of the site to identify how it
its impact. The diagrams below show an example of a project functions as part of the immediate → Accommodating freight deliveries
site’s existing challenges, project goals, the corresponding and larger street network: at the → Providing adequate pedestrian/cycling infrastructure
data points to collect, and the relationship among the three. local scale, neighborhood scale, → Encouraging safer driving behavior
and city scale. → Eliminating road safety crashes and fatalities

BEFORE STREET AFTER STREET


TRANSFORMATION TRANSFORMATION

Pedestrians perceive the Pedestrian and cyclist crash High pedestrian volumes Cyclists do not have Survey how pedestrians Measure the new travel lane Count pedestrians who Count the number of cyclists
street as an unsafe and rates and fatalities are crossing without pedestrian dedicated infrastructure
1 perceive the street’s safety at
2 dimensions and calculate
3 are walking on and off of
4 and micromobility users who
unpleasant place to walk. reported to be high. infrastructure and lack of and are forced to ride with locations where there have how the narrower travel sidewalks and crossings are using the new bike lane
space for stationary activities vehicular traffic at unsafe been transformations. lanes impact corridor to understand if new or riding with vehicle traffic.
1 Survey how pedestrians Document lane width
2 near a pick-up/drop-off zone. speeds. speeds. pedestrian infrastructure
perceive the street’s safety dimensions, blind spots, and adequately addresses need
at different locations and corridor speeds. Count pedestrians who are Count the number of cyclists
3 4 and reduces risk.
how it can be improved. walking on and off of the and micromobility users
sidewalk to understand risk on the street, and note any
levels and where additional qualitative observations
pedestrian infrastructure is about behaviors and their
needed. safety in these conditions.

4
1
4 1
7
1

5 2
7 5
1 3
2 3

3
3

Photograph existing High pedestrian volumes


5 crossing long distances 6
challenges in how the
without crossing facilities.
6
Travel lanes are very wide
street functions, such as
and motor vehicles are
people walking on the Mark pedestrian desire lines After implementing a new Measure new turning speeds
6 traveling at high speeds.
Take aligned “after” photos 6 7
roadbed, running to cross and note where there are 5 crosswalk, document the due to tightened radius and
the street, or cycling in existing pedestrian crossings, Measure turning speeds and from the same vantage number of people using the new design elements to
or if they are crossing at risk
7 count vehicles to determine point as before the new pedestrian crossing vs. determine change in risk to
speeding traffic.
on the roadbed. if a slip lane is necessary. transformation. walking on the roadbed. pedestrians.

20 How to Evaluate Street Transformations How to Evaluate Street Transformations 21


Identify where to start | Determine when to collect data Identify where to start | Determine when to collect data

A3 | Determine when
to collect data Collect the data at various stages
Data collection before the project has been implemented provides the baseline with which to compare the
Once the priorities are set, create a plan to measure and collect after conditions. Many physical and operational changes can be measured from design drawings or plans,
data before, during, and after your street transformation project and confirmed on site afterward. The change in use or function of the street can sometimes be measured
is built. Examine the variation between the sets of data to immediately after implementation, with follow-up weeks or months afterwards. The longer-term resulting
understand the changes to the street condition, measure shifts impacts may take months or years to determine.
in use and function, and evaluate the resulting impacts of the The table below shows a sample of data to collect at various stages before and after the project is
project. implemented to reveal the impact.

Collect data before implementing the project to: Examples of data points to collect and measure When to collect and measure
→ Understand the site and define a vision
→ Have a benchmark to compare future data. Remember that the “after” data needs to be Physical and operational changes
collected at the same time/conditions/place as the baseline data Presence and width of sidewalks (in square meters)
→ Document and understand community members’ and other stakeholders’ needs, interests, Number and quality of pedestrian crossings
and knowledge
→ Locate activities, obstacles, and opportunities to implement specific design elements and
Changes in use and function
take plenty of “before” photos to show the change!
Number of pedestrians walking on the roadbed
vs. on dedicated pedestrian facilities
Collect data during or immediately after implementing the project to:
→ Keep up momentum and continue to be transparent by communicating short-term results Pedestrians’ perception of safety and comfort level
and initial reactions from the community Volume of cyclists and micromobility users per day
→ Document immediate physical and operational changes Average motor vehicle speeds
→ Refine the design based on new observations
→ Begin to build the case for a more permanent project
Resulting impacts
Percent of road users walking and cycling
Collect data weeks, months, or years after implementing the project to:
Number of pedestrians killed or seriously injured (KSI)
→ Assess longer-term changes in usage, function, and perception of the site
→ Inform new policies and future designs for similar projects

Weeks, months, or years after


For more information on selecting the right metrics for your
→ Evaluate the impact on the frequency and severity of road traffic injuries, air quality, etc. project, and a more comprehensive list of suggested metrics,
reference the Global Street Design Guide, Chapter 3, and
→ Make the case for a more permanent project
Appendix B.

Immediately after
In order to replicate the data collection methodology and accurately measure change,
the research design needs to remain stable throughout studies conducted over successive
months and years. It is crucial to collect the before and after data and documentation at

Before

During
the same time of day, the same day of the week, and in comparable conditions.

22 How to Evaluate Street Transformations How to Evaluate Street Transformations 23


B
Measure the impact
B1 Organize the team 26

Identify surveyors and resources 26


Train and brief surveyors 27
Define data collection schedule 28
Make a surveyor location map 29

B2 Select appropriate tools 32

Visual documentation tools 32


Data collection tools 36

B3 Collect data on site 40

Site analysis 42
Measuring perception 44
Counting pedestrians 48
Counting cyclists and micromobility users 56
Counting vehicles 58
Measuring vehicle speeds 60

B4 Standardize and analyze data 62

B5 Communicate the results 68

Use collected data to support the 70


communications deliverables

Addis Ababa, Ethiopia How to Evaluate Street Transformations 25


Measure the impact | Organize the team Measure the impact | Organize the team

B1 | Organize the team Train and brief surveyors


Clear, approachable training sessions are crucial for informing
Once you have planned and prioritized the most relevant data team members about overall project goals, methodology,
to collect for the project in Section A, evaluate how to proceed tools, and specific tasks, and to situate them within the
with the number of staff available, the site conditions and size, site. The following points outline content that is typically
and the number of person-hours needed. helpful to cover in these sessions, such as methodologies for
collecting data, the forms and tools to use, and how to ensure
consistency and accuracy among surveyors.

Identify surveyors and resources


The team of surveyors can be composed of city staff, consultants, or students. Identify a Communicate → Start by explaining the goals and scope of the project.
1
team leader to coordinate logistics and serve as the main point of contact. Community goals → Explain the context of the site through maps and photos: show
organizations and local volunteers can be brought into the project to develop co-ownership activities, operations, and conditions that the team should take note of.
of the process.
Review schedules → Review the schedule and times that each surveyor will be collecting
Team size affects the data collection method; a larger team of surveyors may be able to 2
and materials to data. Refer to page 28 for more information.
rotate shifts and cover more ground, while a smaller group may benefit from installing bring on site → Share contact information for everyone who will be on site.
cameras at various locations to analyze recorded videos at a later time.
→ Provide checklists that indicate what materials, safety gear, and
paperwork that each surveyor is responsible for, and what the team
leader will bring on site. Refer to the Surveyor Checklist in the Appendix.
PRIORITIZE SAFETY
Ecuador, 2021
3 Review data → Review how to collect data on the specific forms, and provide
Make sure that surveyors feel supported and The following photos from Ecuador show surveyors collection forms instruction sheets.
comfortable with their assigned responsibilities. in Guayaquil and Quito who are interacting with the and tools
→ Conduct trial counts and use each of the tools; review surveyor results
Conducting intercept surveys in certain community in a masked and socially distant manner and make corrections or retrain as needed.
conditions, like poorly lit areas in the evening, or to accommodate public safety recommendations in
→ Remind participants about how each of the data points contributes
during a public health crisis when contact might response to the COVID-19 pandemic.
to the larger project goal. For example: Collecting data on pedestrian
be risky, can compromise the safety of your staff.
desire lines will help define where to implement crossings and
contribute to making streets safer and more livable.

→ Establish a meeting point and time, and walk through the site with all
4 On-site debrief
the surveyors before beginning the counts.
→ Give an overview of the site conditions, operations, and functions at
each data collection location.
→ Be clear about how surveyors can communicate the project goals to
passersby when they are not conducting counts, and keep track of
potential local partners.

Community meeting in Guayaquil, Ecuador Intercept survey in Quito, Ecuador


→ When returning data collection forms, have staff review results and
5 End of day
clarify any discrepancies as quickly as possible.

26 How to Evaluate Street Transformations How to Evaluate Street Transformations 27


Measure the impact | Organize the team Measure the impact | Organize the team

Define data collection schedule Make a surveyor location map


Develop a surveyor schedule to plan the time commitments Pairing a surveyor location map with a data collection schedule
required of each surveyor. will help communicate the plan to your team as clearly as
possible. These resources will facilitate the process of collecting
data before, as well as days, weeks, or months after a project
Questions to guide scheduling: has been implemented, by reminding surveyors of the context
1. How often and for how long should data 3. What contextual considerations about and exact data collection location. Overview maps can be
be collected? how the site operates should be taken into supplemented with photos and zoomed-in maps that divide the
account while scheduling data collection? site into smaller sections. Refer to pages 30-31 for an example
To capture the performance fluctuations and for
schedule and map from a GDCI project in São Paulo, Brazil.
a comprehensive understanding of the street The following areas may have different peak
operations and peaks throughout the day: hours due to their varying modes of travel,
→ Measure at multiple times of day: peak and operations, and activities:
off-peak hours for vehicles, pedestrians, → School zones
micromobility, and transit for at least one hour → Commercial/business districts
at a time → Residential areas
→ Measure multiple days of the week (weekdays → Weekend/weekday destinations PVC
XX
People and
vehicle counts
Surveyor 1 to complete Remember that collecting each
and weekends): Tuesday, Wednesday, and → Transit routes and operations “Invisible line” reference Surveyor 2 to complete data type at every location on
Thursday can be used interchangeably for → Climate considerations C
XX
Crossing and
desire line counts
Area that each
surveyor will
the project site is not effective.
counts on a weekday → Hospitals cover
PAM Pedestrian For instance, consider collecting
→ Divide daily tasks in shifts of 2-4 hours → Parks and recreational areas XX activities mapping
motor vehicle speeds at locations
→ Ensure that breaks are scheduled between → Government buildings and institutions
LEITURAS URBANAS - PENHA where travel lanes are wide, where
shifts, allowing surveyors to change locations, → Squares and public spaces DATA COLLECTION MAP - PHASE I
speeding has been observed,
rest, and take bathroom and snack breaks
or where sidewalks are narrow
→ If possible, count multiple times of the year, for
4. Are there any events that might impact C
PV 1
and pedestrians are exposed to
multiple years 0

the typical operations of the street? C


PV 1 oncoming traffic.
→ Count during different seasons and with 0

different weather conditions To have exact comparisons of before and after


PVC
Ensure that the data collection
conditions, look out for atypical operations that 02
spot does not obstruct the
C
2. Can the team save time and resources by might impact the results, such as those listed

PVC
01
sidewalk’s clear path to interfere

03
PVC
estimating certain counts? below. Cancel and reschedule if conditions will 04
PAM

PVC
01
with pedestrian movement and
not be reasonably comparable.
04

While it is best practice to count for at least one


C
PV 5
0
safety.
hour during each of the data collection sessions in → Rain, snow, and other weather conditions C
PV 5
0 PAM

the morning, noon, and evening hours, sometimes → Holidays 02 Each surveyor should mark their

PV 7
→ Festivals, markets, parades, strikes, sporting standing location for all “before”

C
0
C
the time or staff are limited. In that case, collect PV 6
0

data for a portion of an hour and then estimate events C data collection on a basemap.
02

hourly sum. For example, to collect pedestrian → Construction activities C


Anticipate if any new development
PV 8

volumes on a street, collect this data for intervals → Seasonal or recurring events (summer streets, 0
or construction will hinder the
of 15-, 20-, or 30-minutes. Multiply the results to block parties) surveyor’s ability to return to the

PV 9

PV 0
C
0

C
exact same location to measure

1
calculate the hourly totals. → Road closures
→ Ensure school is consistently in session or C
the “after” data, and adjust the
PV 1
These short interval counts should be repeated at not in session as it impacts travel times and 1
PV position accordingly.
C
PV 1 12 C
least three times a day to get an accurate sample. volumes 1

PAM PV
03 12 C

28 How to Evaluate Street Transformations How to Evaluate Street Transformations 29


Measure the impact | Organize the team Measure the impact | Organize the team

MATCHING THE SCHEDULE TO SURVEYOR LOCATION MAPS


Penha, São Paulo, Brazil

This interim street transformation project was implemented on a mixed-use commercial corridor in
the borough of Penha, São Paulo. Data was collected on pedestrian and vehicle movements to assess In this schedule, note that more surveyors are present during hours that are popular for lunch
the impact of the project design on road safety. time to capture peak volumes for pedestrians. More surveyors are also present to count vehicles
at 7 am when people are commonly driving to work in order to capture the different peak hours
The chart below clearly notes the data type, the surveyor who will be responsible, and the timeframe,
for each mode of travel.
and it gives basic instructions. The data codes correspond with locations on the map on next page.

3 days (2 weekdays + 1 weekend day)


Data Data Street
Detail
Type Code Name 7:00- 7:35- 9:00- 9:35- 12:00- 12:35- 18:00- 18:35-
7:30 8:05 9:30 10:05 12:30 13:05 18:35 19:05

S-1
Pedestrian

Count S-2 V P
Counts

pedestrians by Surveyor Surveyor Surveyor Surveyor Surveyor


P Street A
type and 01 01 01 03 01
direction Street A
A I
Crossings

Show number of C CR

Str
Counts

people crossing Surveyor Surveyor Surveyor Surveyor Surveyor

eet
CR Street A
the road and 01 01 03 01 01

B
main desire lines
Vehicle
Counts

Count vehicles
Surveyor Surveyor Surveyor Surveyor Surveyor
V Street A by type and
02 03 02 02 02
direction

Legend
Counts
Cyclist

Count cyclists
Surveyor Surveyor Surveyor Surveyor Surveyor
C Street A by type and
03 02 02 02 02
direction “Invisible line” reference xx Data code Path the Activity Map (A) will cover
Intercept
Survey

Surveyor Surveyor Surveyor Surveyor Surveyor


I Street A
04 04 04 04 03
Decide on an “invisible line” on the project site,
Activities

and count only pedestrians/cyclists/motor vehicles


Mapping

Indicate main
Surveyor Surveyor Surveyor Surveyor Surveyor
A Street A activities at
04 04 04 03 04 crossing that line. Mark it on your basemap: this
location
“invisible line” will help the surveyor focus on one
section of the street to facilitate the counts, minimize
Vehicle Speeds

Document Surveyor Surveyor Surveyor Surveyor


S-1 Street A
midblock speeds 05 05 05 05 the chance of counting people twice, and provide
a reference for future surveyors to count from the
S-2 Street B
Document Surveyor Surveyor Surveyor Surveyor same location.
turning speeds 05 05 05 05

30 How to Evaluate Street Transformations How to Evaluate Street Transformations 31


Measure the impact | Select appropriate tools Measure the impact | Select appropriate tools

B2 | Select appropriate tools Time-lapse videos


Keep in mind:
Using time-lapse videos can be very powerful to
Visual documentation tools demonstrate change. Use this tool as part of the
→ Choose a safe location for the camera
such as a shop’s window or the top of
site analysis process to document activity and
Photos, time-lapses, and videos are the most common and accessible tools to document a a street light
nighttime operations where it may be unsafe to
project. Use a combination to compare the existing conditions (before), the implementation → Consider the sun’s position and
collect data in person during night hours. Inform
process (during), and the completed street transformation project (after) to best show the potential glare or shadows
the neighbors or local establishments such as
→ Check batteries
changes on your site over time. shops and schools, and get permission from local
→ Select the right memory card capacity
entities or community organizations, if needed.

Before After

Basic camera settings


Cameras and video equipment will vary. However, the → Exposure: Default - 0.0
following list considers some sample basic settings → Low light: On
to take quality time-lapses: → Time stamp: Keep it on if the frame can be
→ Frame rate: 20 FPS cropped later
Cameras and smartphones Time-lapse videos Before-and-after photos → Set date and time: Make sure it is configured to
→ White balance: Auto
When possible, set your Align photos side by side of Quality: Better or Best, depending on memory the specific time zone
Capture images that →
time-lapse camera in a before-and-after conditions Scene: Night, unless using only during the day → LED indicator: On
represent the challenges →
secure location to capture to explain the changes of Timer: Not necessary → Band filter: None
and opportunities to support →
the different uses of the the street in a way that HDR: Medium → Focus: Make sure image is sharp
communication about the →
project space throughout the day; will connect with a larger
it can also document the audience. Refer to pg. 34-35
implementation process. about the best methods to What this could look like:
achieve this.

Cameras and smartphones


Be cautious about potential legal constraints
of taking close-up photos of people, Document the
data collection process
especially children. Always bring printed child
confidentiality/consent waivers on site. Use the correct size SD card Battery life (night mode)
Capture the ambiance
of the site before, SD card size Stored photos *Capture interval Frames to low battery Stored photos

Be conscious about the weather and time of during, and after 4 GB 30,000 5 min 9,300 32.0
day. If there are shadows in the “before” photos, 8 GB 60,000 10 min 5,400 37.0
try to capture the same time of day in the
16 GB 120,000 1 hr 1,040 43.0
“after.” If possible, shoot at twilight/dusk when
the light is softer but the streets are still active. 32 GB 240,000 4 hr 268 44.0

*Your capture interval should be influenced by your objectives, e.g., a


desire lines study will need a capture interval of less than five seconds,
but a general change-over-time reel could have hourly capture intervals

32 How to Evaluate Street Transformations How to Evaluate Street Transformations 33


Measure the impact | Select appropriate tools Measure the impact | Select appropriate tools

Before-and-after photos and videos


Before-and-after photos taken at street level are very street elements that will guide you to take the same
Model photographs Photographs that could be improved
effective in demonstrating the process, appreciating image on different days and at different times. Mark
the exact changes that were made in the geometry this on a site map in case the same photographer Ideally, the “before” photo should show some key The images are not aligned.
and the operations of the street. To plan for effective cannot return for the “after” shot. It is also helpful to challenges on site, and the “after” photo should show → Different perspective: it helps to have the camera
some key improvements. When placed together, the photos perpendicular to the ground plane
before-and-after images, determine an imaginary take “during” shots of the implementation process.
match almost exactly. The perspective, frame, angle, → Different location (farther away)
frame that includes trees, signs, and/or identifiable and elements all have the same position in both photos, → Different elements show up in the photos
making it easier to see the changes. Small differences
Tools you’ll need: are to be expected, but the main features of the image Images that don’t align can sometimes be adjusted or
should align (e.g., a light pole or building edge in the same cropped with computer software, but alterations may
location). affect the quality of the images.

Camera Drone Site map

Pay attention to “Imaginary frame”


building heights

BEFORE BEFORE

Identify trees, light poles, fixed


furniture, etc.

Capture challenges in the “before”


photos, such as crossing without
pedestrian infrastructure AFTER AFTER
BEFORE

Match where your frame hits the


objects in your “before” image as Tips when taking before-and-afters If a smartphone is the only camera
closely as possible
→ Capture many different angles and → Smartphones are great for taking
locations, and crop for an exact illustrative pictures “on the fly” of
match. how people use the street.
→ Photos must not only show the design → Take a time-lapse video moving
improvement, but also people using through the site or record the change
it! Pick active times to document the over time from one spot.
project and wait until you get people → Take aerial photos and videos by
Capture new designs that solve within the frame. using a bucket truck, ladder, nearby
the site’s challenges → Capture moments without large rooftops, or second-story retail/
AFTER shadows cast over the site, and at the office windows.
same time of day. → Check resolution of photos.

34 How to Evaluate Street Transformations How to Evaluate Street Transformations 35


Measure the impact | Select appropriate tools Measure the impact | Select appropriate tools

Data collection tools


Create a plan about the types and numbers of tools required
for each data type and surveyor on site. There are many more In addition to the following data collection tools, make sure surveyors and staff have what
they need for safety, such as safety vests and sun protection gear. They also need to be aware
tools that can be used depending on what is being measured,
of local laws related to filming and photography, and should have the appropriate insurance,
the duration of the project, and the available resources. Below consent forms, and waivers.
are some tools to consider.
For a more comprehensive printable checklist of what your data collection
team might need on site, see the Surveyor Checklist in the Appendix.

Portable speed radar Tally counters Timers Measuring tapes Noise and air Sensor and digital
and wheels quality devices counter technology
Portable speed radars User volumes can be Set stopwatches or personal
document moving vehicle counted with analog phone timers for the duration Use measuring tapes or Decibel meters, air sensors, When available, high-
speeds on site. It is helpful to tally counters, digital of the counting interval to let lasers to get dimensions of and smartphones are used resolution video analysis
know the existing speed limit tally counters, or phone surveyors know when to stop/ lanes, sidewalks, building to measure noise and air tools, laser scanners,
and if there are other speed applications (if it is safe to start a new round of counts, heights, and street elements’ pollution on the project infrared beams, and more
controls such as cameras or use phones openly). Count or to measure the time street distances. Even if a base site and in surrounding can be used for collecting
display boards in the area. pedestrians, bicycles, motor users need to cross. drawing exists, plan to verify areas. These are especially data. These systems can
vehicles, and other modes. the dimensions and any important to further document speed, mode
recent changes on site. arguments for street designs share breakdowns, and
that improve public health user volumes, and they can
and livability, especially for process results through
vulnerable populations such specific software. However,
as young children, older since video is the most
adults, people with health commonly available tool, this
issues, and disabled people. handbook focuses on video
and manual analysis.

36 How to Evaluate Street Transformations How to Evaluate Street Transformations 37


Measure the impact | Select appropriate tools Measure the impact | Select appropriate tools

Surveys and count forms


Develop forms or use the templates in the Appendix and practice with the surveyors on how to use the
to collect site data. Using standardized forms forms before each data collection session; include
ensures consistency throughout the process, even short instructions and descriptions of the activities
if the data is collected at different times, dates, for clarity. The next section will give more in-depth
or by different surveyors. It is important to brief information about using each form.
Consider digital forms
and surveys QUESTIONS RESPONSES

General information Forms can also be formatted Site #1 Community Survey


1
Document date, time, surveyor digitally on a smartphone or
1 (description)

name, and weather conditions. tablet to allow for more efficient


Note any relevant information data input on site and less SURVEY QUESTION #1

processing time afterwards. They


(valid email address)

about the site that is not


included in the form. consolidate and visualize results
EMAIL ADDRESS*

2 instantly for easier understanding Yes

and sharing. Make sure to have No

2 Instructions batteries and chargers for the Other: (explain)

3 Include short instructions and duration of the collection shifts.


descriptions of the activity to
remind the surveyor how to
correctly use the form.
With staff guidance, tablets and
smartphones can also be used to
3 Site map digitize surveys and make the data
Include location maps of the analysis process more immediately
data collection points. The maps accessible and efficient.
can be satellite images, digital
4 plans, or hand-drawn maps.

4 User groups
Select user groups and the level
of detail (age, gender, ability,
etc.) to be collected according to
project goals and context.

5 Data input
5
Clearly document data
according to the instructions.
Annotate totals to facilitate
data tabulation.

Measuring perception in Fortaleza, Brazil

38 How to Evaluate Street Transformations How to Evaluate Street Transformations 39


Measure the impact | Collect data on site Measure the impact | Collect data on site

B3 | Collect data on site


This section gives further instructions on how to use each form How to use the forms
and methods to count effectively on site. Ensure surveyor safety Spend time understanding, testing, and adapting the forms before data Refer to the Appendix to find form
templates and instructions on how to
and comfort on site by planning ahead, equipping everyone collection starts. They are meant to be an easy and replicable way to print and adapt them.

with the relevant tools, and providing information about where annotate information about the project site.
surveyors can find water, food, restrooms, health services, and
extra materials if needed. When counting pedestrians and cyclists, it is helpful to indicate any observational data
Refer to the the Surveyor Checklist in about age, ability, and gender. Each form should focus on the user groups most relevant to the
the Appendix. context. This handbook breaks down multiple ages and abilities when collecting data about
pedestrians and cyclists. Delete or replace the user groups as necessary, and simplify what
is collected on high-volume streets. This data must always be used anonymously, but can be
useful in furthering agendas that prioritize the safety and comfort of groups such as children,
caregivers, women, and older people, who might need more nuanced design accommodations.

Maintaining accuracy on busy streets


Some of the most dangerous crash hotspots are
characterized by wide streets with high volumes
and many travel modes. Below are some general
1
rules of thumb to help maintain surveyors’ accuracy
when using forms on high-volume or wide streets.


1 Locate one surveyor on each side of the
street to count movement going in each travel
direction. For instance, on busy crossings 2
surveyors on opposite sidewalks can count only
the pedestrians crossing towards them.


2 A surveyor should focus on only one street
user and type of movement at a time.

→ Set up video devices that can capture the


activities on site for your team to revisit and
document later if needed.


3 Use a tally counter for the most common user
type and draw tally marks on your count form
for all others. For instance, if children are the 3
most common pedestrian, use a tally counter
Site analysis in São Paulo, Brazil for them, and tally marks on your count form for
adult caregivers and older people.

40 How to Evaluate Street Transformations How to Evaluate Street Transformations 41


Measure the impact | Collect data on site Measure the impact | Collect data on site

Site analysis: Existing conditions and geometry What your forms could look like:

Spend time understanding the neighborhood elements, and activities on site to create 1 General information
and specific site. Place existing plans or an accurate basemap. Be intentional about 2 Descriptive legend
maps of the site in the blank space on what is marked on the basemap, as not 1

the form, and take this to the project site. everything will be relevant to your project 2 3 Mark key elements for street context
Mark exact dimensions, geometries, street design.
4 Street section with dimensions

Tools you’ll need: Why is this important? 5 Corresponding plan drawing


→ To have a comprehensive site analysis to develop
evidence-based design proposals See Appendix for printable versions of these forms.
→ To decide on data collection locations and help
Measuring tape Basemap Cameras surveyors navigate the site 3
→ To understand what elements are missing or
causing obstructions
→ To confirm dimensions on basemaps

Marking street elements on the basemap


1
Drawing the exact conditions on site can be tricky and time consuming, so you can use icons to make
this process simpler. You will find this list of suggested icons on the top of the provided Site Analysis
form template, but we encourage you to add more as needed or even to develop your own. Refer to the
Site Analysis Checklist in the Appendix for further ideas about what to look out for. Remember to also
mark obstructions, and elements that do not exist, but should, such as pedestrian crossings. 4

→ Pedestrian crossings → Signage →


T Taxi stand

→ Pedestrian signal → Tree / tree pit → On-street parking


5
→ Refuge islands → Green space → Illegally parked cars

→ Ramps / curb cuts → Shaded areas →


L Loading areas Bring multiple copies of
these forms on site, as they
→ Tactile paving → Bike rack → Pick-up/drop-off
can start to get cluttered
→ Accessibility issues → Bike lane →
SV Street vendor with information while trying
to capture as many details
→ Seating/bench →
B Bus stop → Entries as possible. Use different
sheets for different levels
→ Improvised seating →
B Bus shelter → Outdoor dining of information; for example,
one could focus on street

W Waste bins →
B Bus lane → Potholes / cracked pavement
elements, dimensions, or
→ Light pole →
M Metro station → Speed bumps and cushions qualitative observations.

42 How to Evaluate Street Transformations How to Evaluate Street Transformations 43


Measure the impact | Collect data on site Measure the impact | Collect data on site

Measuring perception: Interactive boards What your boards could look like:

Be present on site, make connections Why is this important? 1 Data about the site
with local residents and street users, and → To know how people feel about the site and learn 2 Clear question and
create an opportunity for conversation and from local insights instructions
participation. Engagement through posters → To collect information on feelings of personal
and boards is one of many methods to gather safety, accessibility and belonging 1 3 Space for leaving
input and understand priorities for the site. → To locate the specific parts of the street where comments and voting
challenges exist
→ To communicate the process that contributed to 4 Photos of the site
the site selection and the project goals 2
→ To demonstrate possibilities for the site, and the 5 Entities involved
Tools you’ll need:
expected benefits and outcomes of the project in the process
→ To display examples of potential design See Appendix for printable versions
interventions, and receive feedback of these and other boards.
3
Stickers/markers Printed boards Refer to the How to Implement Street Transformations
handbook for more detail on how to communicate
specific information at each stage of the project.

Enable participation
Provide methods so people of all ages and abilities → Have people on the team who are ready to listen 4
can easily share their ideas without relying on and document what the community has to say
technical knowledge and vocabulary: → Provide online tools to engage virtual audiences 5
→ Avoid technical drawings and plans to present → Provide interpretation services and prints, and
the design; simple diagrams and graphics that support for visual and hearing impairments
show the main changes are preferable
→ Post boards at different locations around the site
→ Use photos and footage of the site to discuss and in high-traffic public spaces/buildings
existing challenges and design possibilities by
overlaying the images with the proposed changes
→ Use images of real-life examples to showcase
design possibilities
5
→ Use cut-out elements to scale, that people
can pin or stick to a base map, to assist in
communication of design ideas 3
→ Hang banners, maps, and posters with clear
questions and information at the project site,
where passersby can write, draw, or use colored
stickers to respond (see example on the right
page)
Surveyor explaining the boards in Mumbai, India
5

44 How to Evaluate Street Transformations How to Evaluate Street Transformations 45


Measure the impact | Collect data on site Measure the impact | Collect data on site

Measuring perception: Intercept surveys


While surveys are not the only way to do Why is this important? Engage a diverse audience
so, the current perceptions of different → To know how people feel about the site, use Ask a wide range of people to gain a more investigate why. Are the streets accessible for
pedestrians, motorists, and other street the site, and to learn from local insights comprehensive view. Talk to people who are walking, disabled people? Is public transportation connected
users interacting with the project site can → To learn where people feel least safe walking, biking, or using mobility devices. Talk to people of to this site? What conditions exist that might
different genders and ages, and talk to caretakers dissuade different genders, ethnicities, and ages
be understood through 5-minute intercept crossing the street, waiting, and cycling
→ To discover the social dynamics of the site with children. If certain groups are not present, from being here?
surveys taken at different hours of the day.
and who is represented in the street and in
Make sure to survey at least 80-100 people
the area
that represent a diverse sample size.
→ To demonstrate the need for improved
pedestrian, cycling and public spaces, transit
NOTE: People you survey on site may not be
Tools you’ll need: routes, night lighting, or otherwise
representative of the whole population in
→ To humanize the data being collected, when
this neighborhood. It is important to prepare a
telling the story about the project later
stakeholder map to understand all the different
→ To measure against census data
groups involved that the team should reach out
Surveys Tablets/kiosks to and ensure are included in the process.
Intercept survey in Bogotá, Colombia

What your form could look like:


1 General
Information
Qualitative data
1
2 Ask more detailed questions in surveys and conversations to understand the nuances of people’s
2 Location Map
perceptions and experiences within the neighborhood, for example:
→ Mark the location
the survey took → Do you feel safe from oncoming traffic while → What do you wish for this place?
place crossing the street here? → Would you like this project to be permanent?
→ Do you feel safe from oncoming traffic while
3 3 Type of user: walking in this sidewalk? Is it wide enough?
→ Age group → Do you feel empowered to move around as a
→ Gender
result of this project?
→ Income
→ Is this a place where you would choose to
4 Survey: meet your friends?

→ Add space for extra → Can people easily walk/bike to this place?
notes that they may → Do you see a mix of ages and ethnic groups
have about the site
that generally reflect the community at large?
4 → Are there activities happening here that you
See Appendix for a printable
version of this form. enjoy?
Refer to page 18 for additional → Are there enough place to sit? Are seats
survey question ideas. Intercept survey in Istanbul, Turkey
conveniently located?

46 How to Evaluate Street Transformations How to Evaluate Street Transformations 47


Measure the impact | Collect data on site Measure the impact | Collect data on site

Counting pedestrians: On and off sidewalks Pedestrians are forced to walk on the roadbed due to narrow
sidewalks and obstructions to the clear path
Identify different pedestrian types Why is this important?
according to which user groups are relevant → To understand who uses the street
to the context and if they are walking on the → To count pedestrian volumes
sidewalk. Separate sidewalk counts by side → To understand if existing pedestrian facilities
of the street if relevant. Count for a period such as sidewalks are adequately maintained,
of at least 15 minutes. free of obstructions, wide enough, etc.
→ To use this information to assess pedestrian
exposure to risk from oncoming traffic
Tools you’ll need:

*Automated counting Count the number of people walking


Timers Count forms Tally counters Cameras technology
on the roadbed vs. the sidewalk
*An optional alternative or complement to surveyors if resources allow. This technology to document areas where more
allows for data to be collected for a longer, and more continuous, amount of time. pedestrian space is needed

What your form could look like:


Measuring before street transformation
1 General
information
1
2 Location map Update the user groups
based on the context
2 3 Pedestrian type The users shown in the
→ Use a tally mark and/ form to the left are just
or an icon to keep
examples and you can
track of numbers
and age groups of choose to remove or add
3 information you want
street users
to collect based on your
4 4 Separate counts project goals. For example
of pedestrians gender, age, level of ability,
on the roadbed people carrying goods,
vs. the sidewalk transit riders etc.
in each row Count from the same location after the
project has been implemented

See Appendix for a


printable version of this
form. Measuring after street transformation
NOTE: This form can be
adapted for different Sidewalk New space for pedestrians Surveyor Pedestrians counted off sidewalk
pedestrian counts.
For instance, numbers Pedestrians counted on sidewalk
Roadbed New space for bicycles Invisible line surveyed
of people boarding/
disembarking from transit. Road users not counted

48 How to Evaluate Street Transformations How to Evaluate Street Transformations 49


Measure the impact | Collect data on site Measure the impact | Collect data on site

Counting pedestrians: Desire lines High pedestrian volumes crossing long distances without
crossing facilities
Desire lines indicate pedestrians’ desired Why is this important?
paths. Drawing where people cross the street → To document the need for pedestrian facilities
can reveal specific locations where there is at specific locations (such as sidewalks, refuge
a need for improved or additional facilities to islands, or new pedestrian crossings where the
allow pedestrians to cross safely. This can be distances between existing crossings are too far)
especially important to observe in the middle → To explain pedestrian exposure to risk by

of a block and at intersections. Use multiple documenting long crossing distances without
protection
forms to allow you to focus on small sections
→ To design for easier and safer access to popular
of the street at a time. origins and destinations
Tools you’ll need:
Observe pedestrians’ desire
Timelapse-cameras can be especially
lines to determine where a new
effective for capturing desire lines and
pedestrian queuing. crossing would allow them to
Timers Count forms Tally counters Cameras safely cross to key destinations

What your form could look like:


Measuring before street transformation
1 Instructions for
surveyor
→ Helpful for larger
teams or to reinforce
methods
1

2 Location map

3 Surveyor position
2 → Surveyor should
mark their position
and the perimeter
that is visible

See Appendix for a printable Count the volumes of pedestrians


version of this form. using the new crossing to share
NOTE: Safe, accessible how many pedestrians are walking
3 crossings should be in protected facilities
provided every 80-100 m, and
at all legs of an intersection, to
ensure a connected walkable
network.
Measuring after street transformation

Sidewalk New space for pedestrians Surveyor Pedestrians counted off crossing

New space for bicycles Area surveyed Pedestrians counted on crossing


Roadbed
Invisible desire line Road users not counted

50 How to Evaluate Street Transformations How to Evaluate Street Transformations 51


Measure the impact | Collect data on site Measure the impact | Collect data on site

Counting pedestrians: Safe crossings The crossing is not in line with the natural flow of pedestrians.
People are observed walking in the roadbed.
Identify different pedestrian types, the the distance is too long, or the signal is too
volumes, and if they are crossing the street short. Adjust the counts to the signal cycle
on existing crossings or on the roadbed. The if applicable. For instance, if the cycle is 90
Identify different pedestrian
form below identifies whether pedestrians seconds (1.5 minutes), count 10 cycles for 15 types and if they are moving
are walking or rushing across the street minutes. within designated pedestrian
during the signal cycle. Rushing may indicate facilities or on the roadbed

Why is this important?


Tools you’ll need:
→ To justify the need for new crossings
→ To evaluate effectiveness of existing crossings
→ To observe whether the implemented design
serves pedestrian desire lines
Timers Count forms Tally counters Cameras → To measure pedestrian volumes at crossings
→ To measure pedestrian comfort crossing the
street (running vs. walking, during signal vs.
without signal)
→ To observe if crossing distances are too long
What your form could look like: → To design sidewalk extensions, refuge islands,
wider crossings and other solutions Measuring before street transformation

1 1 General 4 Tally counts


2 information → Pedestrians walking Collect the same data after
on crossings in both the crossing has been built
2 Location map directions to observe whether this
→ Include location → Pedestrians walking facility protects pedestrians’
map with the data outside of crossings movements better
collection points → Totals
3
and mark the
invisible line to guide See Appendix for a
printable version of this
surveyors form.
4 → Add conventions and
notes to describe the
context

3 Pedestrian type

Be sure to pair this qualitative data


Measuring after street transformation
with observational notes, survey
responses, and photographic evidence
Sidewalk New space for pedestrians Surveyor Pedestrians counted off crossing
to comprehensively evaluate the change
in pedestrian crossing safety. Roadbed New space for bicycles Area surveyed Pedestrians counted on crossing

Reference desire line Road users not counted

52 How to Evaluate Street Transformations How to Evaluate Street Transformations 53


Measure the impact | Collect data on site Measure the impact | Collect data on site

Counting pedestrians: Activity mapping Lack of space for various activities

Street transformation projects can also hour. Alternatively, you can stand in a central
generate public spaces as they redistribute location, depending on the scale of the site.
space to pedestrians. Define the boundary Collect information about co-benefits of the Note locations where people are
of the area being surveyed and create a project, such as new stationary activities setting up informal seating, for
route to walk around the boundary once an after the project is built. instance, without adequate space
that could block pedestrian clear
paths
Tools you’ll need: Why is this important?
→ To enhance understanding of the place, dynamics
and activities in public space, and the change
after the project is built
→ To design better spaces according to observed
Count forms Cameras
activities
→ To demonstrate that streets can be used for more
functions and activities than moving vehicles
→ To make the case for other public spaces
throughout the city
What your form could look like:
Measuring before street transformation

Qualitative data to observe


1
→ Are people able to walk comfortably across the
Collect volumes by pedestrian
street? Do they have to run between moving cars?
type and activity in newly
2
→ Who is using the space? Are different ages and designated areas and document
genders, groups and individuals present? the change in stationary activities
→ Are people using wheelchairs or pushing
3 strollers able to move through the space without
difficulty?
→ Are spaces clean and free of garbage?
→ Which activities or popular destinations could
benefit from more pedestrian space?
→ Is transit connected to this area? Is it frequent
and reliable?

1 General 3 Location map


information Measuring after street transformation
→ Walk around the site (follow
the boundary to be consistent)
Legend Sidewalk New space for pedestrians Surveyor Pedestrians counted staying
2 or stand in a central location
/ doing an activity
→ Define codes or icons and mark where activities are New space for bicycles
Roadbed Path that the surveyor walks
happening using the codes Road users not counted
for each activity to observe the site
defined in the legend

54 How to Evaluate Street Transformations How to Evaluate Street Transformations 55


Measure the impact | Collect data on site Measure the impact | Collect data on site

Counting cyclists and micromobility users Cyclists do not have dedicated infrastructure and are
forced to ride with vehicles driving at unsafe speeds
Count all bicyclists and micromobility users counts those who are riding within a cycle
riding through the project site according to facility, the second row for those traveling
age, type of bicycle, or other category that on the sidewalk, and the third row to mark Count the number of cyclists and
corresponds most with the project goals. cyclists traveling in the roadbed with other micromobility users on the street as
Separate counts into three rows: one row vehicles. Count for at least 15 minutes. they cross the imaginary line

Tools you’ll need: Why is this important?


→ To assess bicyclists’ and micromobility users’
exposure to risk (riding on bicycle infrastructure,
pedestrian infrastructure, or the roadbed)
Timers Count forms Tally counters Cameras → To understand cycling volumes and the change as
a result of the project
→ To understand and document cyclist/scooter user
types and behaviors

What your form could look like:


Measuring before the street transformation
1 General
information
1
2 Count the number of cyclists and
2 Location map
micromobility users on the street as
they cross the imaginary line
3 Cyclist type

3 4 Tally counts

See Appendix for a printable


version of this form.

NOTE: An increase in kids,


4 families, and women riding
are a strong indication of safer
facilities.

Documenting counter-flow cyclists can


Measuring after street transformation
also be helpful to understand whether
this street could benefit from a two-way
Sidewalk New space for pedestrians Surveyor Cyclist or micromobility user
cycle lane. counted off protected facility
Roadbed New space for bicycles Invisible line surveyed
Cyclist or micromobility user
Road users not counted counted on protected facility

56 How to Evaluate Street Transformations How to Evaluate Street Transformations 57


Measure the impact | Collect data on site Measure the impact | Collect data on site

Counting vehicles Pedestrian and cyclist crash rates and fatalities are high
at this location
Count different vehicles types driving Why is this important?
through the project site. It is recommended → To count vehicle volumes by type and movement
to separate counts by direction, especially → To understand movements of taxis, transit,
if there are high volumes. This can be freight, ride-shares, etc.
measured in the middle of a block and at → To compare space distribution by mode
→ To understand if low traffic areas can be
intersections, and the appendix includes
pedestrianized at certain hours, or permanently
forms for both locations. Adjust the tally
counts to the signal phasing, if applicable.

Tools you’ll need:


It may be helpful to distinguish
between short and long trucks
Count the number of motor
(e.g., trucks with trailers) because
vehicles by type to understand the
those vehicles can influence what
Count forms Tally counters Cameras
Automated counting use of the street by mode as they
technology is possible in terms of reducing
cross the imaginary line
turning radii.

What your form could look like:


Measuring before street transformation
1 General
information
1
2 Vehicle type
→ Car
→ Bus
→ Truck
→ Motorcycle
2 → Cyclist

See Appendix for printable


versions of this form.

NOTE: Mark locations of loading and


unloading on the basemap if applicable.

Count the number of motor vehicles by


type to understand the change in use of
the street by mode after the project has
been implemented

Measuring after street transformation

Sidewalk New space for pedestrians Surveyor Vehicles counted

Counting vehicles in Addis Ababa, Ethiopia Roadbed New space for bicycles Invisible line surveyed Road users not counted

58 How to Evaluate Street Transformations How to Evaluate Street Transformations 59


Measure the impact | Collect data on site Measure the impact | Collect data on site

Measuring vehicle speeds


How to point your speed radar and/or gun:
Use compact speed radars to document Why is this important?
1 Speed radar
the speed of vehicles on specific corridors → To observe characteristics of the site that affect
→ A compact speed radar has the advantage of
and corners, according to vehicle type. vehicle speed, such as extra-wide lanes, and 2
being more discreet (it looks like a smartphone)
Count a minimum of 40 vehicle speeds identify design solutions
than classic “speed guns.” If drivers identify the
to have a significant sample size, and → To identify peak speeds at specific locations 1
surveyor as speed enforcement by the city, this
more if possible. Count turning speeds at → To document speeds of different vehicle types
may influence their behavior and survey results.
moving through the site, before and after
corners, and free-flowing speeds at mid- → The radar must be pointed at oncoming traffic
→ To understand if the operating speed of the
block locations. (instead of across the road) in order to work.
street segment is appropriate for its surrounding
→ Note that compact radars may be inaccurate
context
Tools you’ll need: for speeds below 15-20 km/h, limiting its
applicability for turning speeds.
Always measure speeds in free-flowing 2 Speed gun
conditions; select a time to avoid
Count forms Tally counters Speed radar moments of traffic congestion

MEASURING SPEED
What your form could look like: Bosa - Bogotá, Colombia

1 General 4 Midblock or Due to street parking, this two-lane street


information turning speed regularly operates as a wide, one-lane street,
1 → Check one of the encouraging higher traffic speeds and exposing a
2 boxes
2 Location map high volume of pedestrians to traffic violence. The
first pop-up chicane project in Bogotá narrowed
5 Speed the street with paint and cones as a traffic
3 Vehicle type
→ Turning speed calming strategy to reduce speeds.
→ Car → Corridor speed
3 → Motorcycle → Register speed of all
Speed reduction during pop-up:
→ Bus vehicles passing by BEFORE
4 → Truck
→ Other (register) See Appendix for a printable
Private car 31% reduction
version of this form.

Taxi 25% reduction

5
If vehicle volumes are
Motorcycle 37% reduction
too high, divide vehicle
types into multiple Truck 8% reduction
forms to facilitate
data collection
Bus 28% reduction
POP-UP

60 How to Evaluate Street Transformations How to Evaluate Street Transformations 61


Measure the impact | Standardize and analyze data Measure the impact | Standardize and analyze data

B4 | Standardize and analyze data USING DATA TO INFLUENCE DESIGN ADJUSTMENTS


Penha - São Paulo, Brazil
To understand a street transformation’s impact, organize
the collected data of each project into standardized formats.
Organizing data into clear before-and-after comparisons reveals
The main goal for this street transformation project
was to improve pedestrian safety at the site of a 52 %
crash hotspot in São Paulo’s borough of Penha. of people still crossing
valuable analyses that can inform design decisions, influence The data collected during the two-month interim
outside facility
policies, and inspire the scaling up of similar types of projects. street transformation revealed additional locations

46%
where people were crossing the street without
Analyze and share metrics at multiple stages throughout the
protected pedestrian facilities. Initial designs had
project’s lifespan to continually assess whether project goals on-street parking spaces that blocked the possibility of people still walking
have been met. Evaluation processes are often most effective for crossings at these locations. on the roadbed
when nuances and observational anecdotes in datasets are
After the data collection process showed 77 people
celebrated and bias towards initial project goals are not limiting
per hour crossing the street at a location between
to opportunities for learning and improvement.
two other new crossings, it became clear that the
distance between the existing crossings was too
proposed new crossing
great to meet the demand, and pedestrians were
Standardize the data that has been collected still at risk. The curb would need to be extended to
accommodate an additional crossing at this location.
Standardize all collected data from different sources into spreadsheets by
the following categories to have accurate data comparisons: Presenting this evidence to the Department of Traffic
Engineering resulted in a quick agreement to do so,
→ Location of data collection point and the parking spaces were relocated elsewhere.
→ Before or after project implementation
→ By day (weekday or weekend, school in session
or not, holiday or working day, etc.)
→ By time (Peak or off-peak hour, morning or evening, etc.)

Analyze the data and evaluate the impact


Study the standardized datasets and extracting meaningful information
that relates to your project goals. As shown on page 66-67, when collecting
data about speeds, for example, you can focus on the following metrics to
analyze them: change in average speed, peak speeds, and the mode (or
most repeated speed), among others. Peak speeds can be tracked over
time to evaluate if the design influenced safer driving speeds.

Refine the design


After the initial results of a project become apparent, this is an optimal time
to refer back to the project goals and assess whether the design has achieved
them. The case study on the next page shows how the City of São Paulo
revised a design after initial data indicated that some adjustments would be
beneficial.

62 How to Evaluate Street Transformations How to Evaluate Street Transformations 63


Measure the impact | Standardize and analyze data Measure the impact | Standardize and analyze data

EXAMPLE SPREADSHEET TO ANALYZE PEDESTRIAN DATA


This spreadsheet focuses on understanding 1 General information 0121345678ÿ 1ÿ 843
Pedestrian Volume Counts
pedestrian volumes. It compiles and standardizes Note the day of the week, date, and  ÿÿÿ!ÿ"# $%&'ÿ)*+'ÿ,-./,.01ÿ&'1*2
the counts by user type, separated by those taken
“before” and “after” project implementation.
time the data was collected, plus
weather conditions and notes 345114ÿ4 1
5116277ÿ89 1:9; < =>ÿ?ÿ:ÿ=ÿ?
The spreadsheet then extracts the most powerful
metrics to highlight and share in relation to the 2 User types 05@1A4ÿB 73ÿ782ÿC 4A 13 5 6 4 9 473
project goals. For instance, the change in percentage
B 7ÿ213A56?468 C 4A 1 B 7ÿ7A;61D12E F1G51 4G415
Clearly note the relevant data
of people walking on the roadbed is highlighted to subjects on the spreadsheets
HÿÿÿIJ" KLM N KOPQRST KOLKPST
demonstrate the initial hazard posed to pedestrians, Uÿÿÿ!JVWÿÿWÿXJ YPM N QSZM KSTM
and to assess whether it has been resolved through [!ÿ\Jÿ!JVWÿÿ]Wÿ ÿÿ\ÿ] ^RM N ^S_M PS^M
the design. 3 Before/after Hÿÿ\JÿIJ" KPZM N QR RZ
Standardize the data collection input
As shown , the data findings indicate a 126%
to be able to easily make before- `ÿJÿ!\ÿ]JÿJ aP^M b KSKQM TSR^M
increase in the volume of children walking or
and-after comparisons about the
being carried compared to before the project was same time of day, before and after
implemented. the project has been implemented c8? 4ÿd747

4 Totals 2
Be open! 9 47ÿ
Separate totals by street ?15ÿ; 5ÿ eJ fJ gJÿ hÿÿ
Stakeholder input and collected data may user type to compare 84 ÿ47?13< fJJÿ#  !\J\ i\Jje Ta^
show that the initial expected priority or
F1G51ÿ 843 3
key goal needs to change after deeper
knowledge of the site. Listen and be open
e" =k>lÿ0m 1
to changing gears.
5 Variation over time n 512oÿCA4ÿ=poÿ>l=q
Compare before-and-after iÿXnQTminutes
data to evaluate the impact of
implementations
3621u76ÿ4ÿXÿ!\ÿXÿ# vvw PYY PZL Q K R K

FrsCtr
t 72x12ÿJ!ÿÿ\ÿJÿXÿ]# ww PP K_ T K K K
Note the importance of collecting data
3621u76ÿFÿXÿ!\ÿXÿ# ywl QPT QKT P T R T
at comparable days/times to ensure
6 Project goals met? eJ ^_Q ^ P KY P
comparability of the before/after figures Analyze metrics related to your 9 47ÿ?zÿ; 5 =>{q ==qy =l w {w w
project visions for success to |ÿu7668}ÿ8ÿ4;1ÿ572x12 {~y| QSPM TSTM ^TSTM ^S_M ^TSTM
see if they have been achieved
4G415ÿ 843 3
e" =k>lÿ0m 1
n 512oÿ Dÿ>qoÿ>l=q
iÿXnQTminutes
3621u76ÿ4ÿXÿ!\ÿXÿ# y=l QT^ PRT P P KR Q
4s9rt t 72x12ÿJ!ÿÿ\ÿJÿXÿ]# =w Y Z T T K T
3621u76ÿFÿXÿ!\ÿXÿ# pqq Q_L QYK K K PK T
eJ Z^Y Q Q LT Q
9 47ÿ?zÿ; 5 =w=> ={=w y y ql y
|ÿu7668}ÿ8ÿ4;1ÿ572x12 =~l| KM TM TM QM TM

64 How to Evaluate Street Transformations How to Evaluate Street Transformations 65


Measure the impact | Standardize and analyze data Measure the impact | Standardize and analyze data

EXAMPLE SPREADSHEET TO ANALYZE SPEED DATA


This spreadsheet focuses on analyzing speed data
Vehicle speeds | Midblock
that was collected on a corridor. It separates the
data by vehicle type, before and after the project was 01234516 738ÿ48 ÿ ÿ1 16ÿ 6  5 ÿ ÿ1 16ÿ 6 
implemented. ÿ 1
ÿ!"ÿ#$%& ''ÿ$ÿ(ÿ')ÿ"
The data is then summarized according to
the information that is most valuable to be *+,-ÿ.+$&ÿ$/#ÿ0-+& 5 6 4 1+$&
communicated, or how the data is requested.
2&-!"!+/ 0-+ .+$ÿ$-3!#4 56+ 6
This will help the team understand whether the 7  ÿ8952:ÿ;2 56<ÿ=>ÿ?@9 ABCD E F=GHD CGHD
project contributes to the goal of creating a safer 7  ÿFA9 :ÿ;2 56<ÿ=>ÿ?@9 AIID E JBGBD >GFD
environment for pedestrians: vehicles going over the K  24516ÿ56ÿ8952:ÿ41 ÿ ÿIL49ÿ 2645: AJLD E FHGH =HG>
speed limit, vehicles in the 95th percentile, etc.
7  ÿ9 388ÿ8952:ÿ;2 56<ÿ=>ÿ?@9 AH>>D E L>D >D
For instance , the findings show an 86% reduction
in vehicles exceeding the speed limit, compared to
before the project was implemented, which meets 2$$ÿ/$%&!& M/"ÿ2$$
their goal of increasing road safety. NOPQ3ÿRÿST-&&!ÿ"# 56+ 6 5 U$!$!+/ 56+ÿV+/& 3 6ÿV+/& 3
General information
 ÿ3!-& WN'X Y'X (ZYX 5 [ ''ÿ$ÿ(ÿ')ÿ" 734[ ''ÿ$ÿ(ÿ')ÿ"
1
Note the day of the week, date, and time the data was 2
FA9 : JBGBD >GFD AIID 734[ ÿ!"ÿ#$%& 1 5 ÿ!"ÿ#$%& 1

collected, plus weather conditions and notes


\ 388ÿ8952: L>G>D >D AH>>D
JA9 : LIG>D HCGJD A]=D ^++-%-& V$& 5&& 1-P& ^++-%-& V$& 5&& 1-P& 2
JI =J =H JF HI J= HF HF
2 User types _`3ÿ*-/!ÿ"# 56+ 6 U$!$!+/ J] J] FJ JI J= HB HC HH
Clearly note the relevant data subjects on the  ÿ3!-& W'' N'O ()`X F> JI =H HH =L HB HF HF
spreadsheets
FA9 : =]G> J=G> A=BD =H JC L> HB HB HI JH HH
\ 388ÿ8952: FCGF HBGB AC>D JI =L =H J> =J HC H= HH
3 Before/after JA9 : FJG> =FG> AHID J] JI JF J=
Standardize the data collection input to be able to =L JF JC JH
easily make before-and-after comparisons about the ^#!$/ÿ"#ÿa`O3ÿ*-/!b 56+ 6 U$!$!+/ FJ JI JH HI
same time of day, before and after the project has
been implemented
 ÿ3!-& )_O '`O (WZX =L J] J= J=
FA9 : JCG> HFG> AFCD =] JI LH JC
\ 388ÿ8952: =>G> HFG> AL=D JI JF =] JF
4 Totals JA9 : =HG> HIG> A=ID =F JC =F JH
View the totals according to those in the 95th percentile F> HB =F JH
for speed, those going above the speed limit, etc. $"ÿ!c 56+ 6 J] J> =J JH
 ÿ3!-& '_O )ZZ =] HI =H HI
5 Variation over time FA9 : H>> HBL JI =J J] JF
Compare before-and-after data to evaluate the \ 388ÿ8952: H> H> HB JC J= HB
impact of implementations JA9 : I> H>= F> JF =F HC
=H HB =F HF
6 Project goals met?
=] =H JF J]
JI =J HI JI
Analyze metrics related to your project visions for =] J] JF HC
success to see if they have been achieved

66 How to Evaluate Street Transformations How to Evaluate Street Transformations 67


Measure the impact | Communicate the results Measure the impact | Communicate the results

B5 | Communicate the results Infographic over photo


Inform the public about project-related goals and impacts in a visually
engaging way and through a clear communications strategy. Depending
on who the audience is, the extracted metrics can be visualized as a
table, infographic, graph, map, plan drawing, or something else. Most
people respond best to photos and simpler graphics, as well as specific 54% Decrease in vehicle
drivers speeding
statistics. The following visuals exemplify a few different ways that over 40 mph
the same metrics can be formatted.

Example table

Speeds 50th Percentile 85th Percentile 40+ MPH Speeders

Before 25.6 MPH 31.2 MPH 1119

After 23.1 MPH 29.0 MPH 513

% Change -9.8% -7.1% -54.2%

Example graph Plan drawings, before and after


BEFORE AFTER
Before and after speed data

30
Before After
25
FREQUENCY (%)

20

15

10

0
10

15-20

20-25

25-30

30-35

35-40

40-45

45-50

50-55

55-60

60-65

SPEED (km/h)

68 How to Evaluate Street Transformations How to Evaluate Street Transformations 69


Measure the impact | Communicate the results Measure the impact | Communicate the results

Use collected data to support the


communications deliverables
Use each interaction as a chance to garner
Feature key metrics in easily digestible online/print formats more feedback, information, and stories
such as social media posts, blogs, and articles; you can also about the site to tell in the future stages.
include them on photos. Your metrics can be prepared and
shared at various stages of the project.
Refer to the How to Implement Pop-up and Interim
Street Transformations handbook, Section A3 for more Frame the narrative Explain the project Share initial impacts Share long-term impacts
information.

At each stage in a project’s


lifespan:

Raise awareness about Visit the project site before Share immediate impacts! Share key findings,
existing conditions, implementation and share This can be done through impacts, and next steps to
challenges, and the need information about the goals of a combination of the advocate for the success
for the upcoming project. the upcoming project. Present following: and longevity of the
This could be done key challenges and design → Informational posters/ project. This can be shown
through: concepts to stakeholders. This boards through a combination of
→ Blog posts or articles can be done through: → Press releases / media the following:
→ Social media posts → Stakeholder meetings coverage → Long-form blog posts
→ Posters, flyers, and (in-person or virtual) → Social media posts or articles
announcements → Posters, flyers, and → Blog posts or articles → Technical reports
→ Stakeholder meetings announcements → Presentations
(in-person or virtual) → Social media posts

Include these visual Photos of the site/challenges/implementation


elements:
Short video clips (30-60 seconds)

Time-lapse videos

Before-and-after photo sets

Perception surveys
Use collected data:
Site maps / informational boards

Crash location maps and road safety statistics

Written/recorded testimonials/interviews/stories

Dissemination of metrics through graphics

70 How to Evaluate Street Transformations How to Evaluate Street Transformations 71


Measure the impact | Communicate the results Measure the impact | Communicate the results

BRINGING IT ALL TOGETHER: SHARING LONG-TERM IMPACT


Barão do Rio Branco, Fortaleza, Brazil

Approximately one month after implementing a 2. Be intentional with justifying the “why” behind 4. Break down new design components and 6. Videos including testimonials from
project in downtown Fortaleza, a blog post was site selection quantify the physical changes made on site stakeholders experiencing the street are an
published with a comprehensive collection of This crashmap, sourced from the City of Fortaleza’s Infographics were created to quickly understand the effective way to show excitement around the
metrics and visual materials that demonstrated police department, helped make the case for the overview of the physical and operational changes new project
how the road safety concerns on the site were specific project site location. of the project design, new user counts, mode share This video is also great to have on hand for
addressed and advocated to make the redesign counts, and changes in speed. These were overlaid meetings with communities and government
permanent. on photos of the new street. officials to quickly and powerfully summarize the
The steps highlighted below break down the The chance that a pedestrian will be project process, experience, and reactions from
different visual components in this long-format struck by a vehicle is 90% higher in the street users.
blog post. downtown core than the rest of the city

The full blog is available


at https://bit.ly/3CYPuzK
downtown

1. Clearly reiterate the goal


The title featured the overarching project goal,
followed by a before-and-after photo comparison
to clearly and visually demonstrate how the project Barão do Rio Branco corridor
site has changed.

For guidance on how to start your goal-setting


process, see page 13.
3. Return to the specific goal of the project 5. Share a time-lapse video to allow viewers to
The infographics below demonstrate the “experience” the site in a quick and engaging way If you don’t have internal graphic
percentage of space allocated to pedestrians and A short time-lapse video was embedded into the design capacity
motor vehicles before and after the project. blogpost. This was recorded while walking through → Use Microsoft Word or Google Docs to
the new sidewalk extension space, and shows format your photos side by side (you
the experience and new usage of the street in a can screenshot your selection to quickly
Before relatable way. turn the pairing into a .jpg)

33% → Use Microsoft Excel or Google Sheets


to create charts from your datasets to
pedestrian P
show changes between your before/
facilities
after data (road space allocation, mode
user breakdown, etc.)
→ You can download icons of road users
After from the internet, and place them
60% in Microsoft PowerPoint / Google
Slides with your text to create basic
pedestrian
facilities
P
infographics

72 How to Evaluate Street Transformations How to Evaluate Street Transformations 73


Resources
Acknowledgements 76

Key terms and definitions 78

References 79

Appendix 80

How to use the templates 81


Templates 83

Addis Ababa, Ethiopia How to Evaluate Street Transformations 75


Acknowledgements
Global Designing Cities Initiative External reviewers Photo credits

CORE PROJECT TEAM Abdul Bachani All images used in this handbook are taken by the
Johns Hopkins University, Baltimore, United States authors, unless specified below.
Skye Duncan, Director
Fabrizio Prati, Director of Design Adriana Jakovcevic
II Paulo Winz; IV left Cidade Ativa.
Najwa Doughman, Program Manager World Resources Institute (WRI), Buenos Aires, Argentina
Kat Gowland, Design Associate Introduction: 1 Cidade Ativa.
Alina Burlacu
Vivi Tiezzi, Program Associate World Bank, Washington DC, United States A Identify where to start: 14 left Paulo Winz; 16
Paulo Winz.
CONTRIBUTORS Anna Nord
NZ Transport Agency (NZTA), Auckland, New Zealand B Measure the impact: 35 left Paulo Winz; 47 top
Abhimanyu Prakash
Juan Paez, bottom right EPMMOP Quito; 63 bottom
Anna Siprikova Beatriz Rodrigues
Hannah Machado; 72 City of Fortaleza crash map;
Annah MacKenzie Bloomberg Initiative for Global Road Safety, Fortaleza, Brazil
75 EPMMOP Quito.
Annie Peyton Bernardo Baranda
Brianna Williams Institute for Transportation and Development Policy (ITDP),
Eduarda Aun Mexico City, Mexico
Eduardo Pompeo Martins
Ezequiel Dantas
Francisca Benitez
Vital Strategies, São Paulo, Brazil
Hayrettin Günç
Lucia De La Mora Giovanni Zayas
Majed Abdulsamad World Bank, Puebla, Mexico

Paul Supawanich Hannah Machado


Solomon Green-Eames Vital Strategies, São Paulo, Brazil

Irene Figueroa Ortiz


National Association of City NYC Department of Transportation, New York City, United States
Transportation Officials (NACTO)
Javier Vergara Petrescu
Ciudad Emergente, Santiago, Chile
Celine Schmidt, Design Associate
Corinne Kisner, Executive Director Jennifer Rivera
Jenny O’Connell, Program Manager Monash University, Melbourne, Australia
Kate Fillin-Yeh, Director of Strategy Mariana Campos Sánchez
Matthew Roe, Technical Lead Universidad Nacional Autónoma de México, Mexico City, Mexico
Zabe Bent, Director of Design
Rita Jacinto
City of Lisbon, Portugal
Key contributors
Robin Abad
Catalina Parra Ramirez, Design Consultant SF Planning, San Francisco, United States

Grace Duggan, Copy Editor Sarah Whitehead


Vital Strategies, Toronto, Canada

Sofie Kvist
Gehl Studio, San Francisco, United States

Yohannes Legesse
City of Addis Ababa, Ethiopia

76 How to Evaluate Street Transformations How to Evaluate Street Transformations 77


Key terms and definitions References
Data analysis Pop-up and interim street Publications National Cooperative Highway Research Program.
Guidebook on Pedestrian and Bicycle Volume Data
transformations Collection. Report 797, Transportation Research
The process of extracting meaningful information AARP and Smart Growth America. “Evaluating
from standardized datasets for evaluation. Within this handbook, a temporary transformation Complete Streets Projects: A guide for Board, 2014.
of one to a few days is referred to as a “pop‑up,” practitioners,” 2015. NYC DOT. “Measuring the Street: New Metrics for
while a longer-term transformation (lasting Appleyard, Donald, M. Sue Gerson, and Mark 21st Century Streets,” 2012.
Data collection
weeks to months) is called “interim.” Refer to Lintell. Livable Streets. Berkeley, CA: University of NYC DOT. “The Economic Benefits of Sustainable
The process of gathering, measuring, or counting page 4 for additional details, or reference the California Press, 1981. Streets,” 2013.
variables of interest in a planned, systematic How to Implement Pop-up and Interim Street
Transformations handbook. California Bicycle Coalition and Alta Planning + People For Bikes and the Alliance for Biking &
manner. In this handbook, the data collection
Design. “Quick-build Guide: How to Build Safer Walking. “Protected Bike Lanes Mean Business,”
process enables movement, perception, and
Streets Quickly and Affordably,” 2020. 2014.
activity in urban streets to be captured so that Quantitative data
outcomes of a project can be evaluated. Despacio. “Caminar En Bogotá: Las Cuentas 2017.” Philippe Panerai. Urban Analysis. Paris: Editions
What you can count, measure, rate, or scale. Gehl Institute, City of San Francisco’s Planning Parenthèse, 2003
Data standardization Quantitative data measures the change in physical Department, Copenhagen Municipality’s City San Francisco Planning Department. “Public Life
space, operations, number of people or vehicles, Data Department, Seattle Department of Study: Standards Manual,” 2019
The process of organizing collected data into movements, and more. Transportation, Gehl. “Public Life Data Protocol -
groups such as by date or time it was collected, Version: Beta,” 2017. San Francisco Municipal Transportation Agency.
street user type, mode, etc. This formatting Equity Toolkit. Accessed January 2022, https://
enables it to be analyzed.
Qualitative data Gehl, Jan, and Birgitte Svarre. How to Study Public sfgov.maps.arcgis.com/apps/MapSeries/index.
Life. Washington, DC: Island Press, 2013. html?appid=0ed0f731fd09458386193
Intangible qualities that can be observed or shared
Gehl, Jan. Life between Buildings: Using Public b5747e18584#.
Evaluation through stories. Qualitative data is subjective and
Space. New York, NY: Van Nostrand Reinhold, 1987. Swanson, J. M., Roehler, D. R., & Sauber-Schatz, E.
relates to how space is perceived rather than
The determination of whether a project has Gehl Studio. “Volume I: Makers on Market,” 2015. K. “Traffic Conflict Technique Toolkit: Making the
measured.
achieved its initial goals. This process can be Journey to and from School Safer for Students.”
informed by both qualitative and quantitative Gehl Studio. “Volume II: Planning by Doing,” 2016.
CDC Foundation and FIA Foundation, 2020.
analysis, and should be made at multiple points India’s Ministry of Housing and Urban Affairs,
throughout a project’s lifespan to understand the Todd Alexander Litman, Victoria Transport Policy
Town and Country Planning Organisation, CEPT
degree of success, strategy for improvement, or Institute. “Evaluating Transportation Equity:
University. “LAP (Local Area Plan) for transit,” 2000.
inform particular next steps to be taken. Guidance for Incorporating Distributional Impacts
ITDP. “Pedestrians First: Tools for a Walkable City,” in Transport Planning,” 2022.
2018.
Metric Transit Center. Equity Dashboard. Accessed
ITDP. “TOD Standard,” 2017. January 2022, https://dashboard.transitcenter.
A simplified measurement of impact that may org/.
LA DOT. “People St: Project Evaluation Manual V1.1.”
indicate the attainment of a goal or the result of a
William H. Whyte. The Social Life of Small Urban
specific change over time. The methodology in this National Association of City Transportation
Spaces. New York, NY: PPS, 1980.
handbook uses metrics as a means of embodying Officials. Urban Street Design Guide. Washington,
the change in collected data before and after a DC: Island Press, 2013.
street transformation, in comparable conditions,
National Association of City Transportation
to enable understanding of overall project impact,
Officials’ Global Designing Cities Initiative. Global
indications of success, and areas of improvement.
Street Design Guide. New York City, NY: Island
Press, 2016.

78 How to Evaluate Street Transformations How to Evaluate Street Transformations 79


Appendix
Appendix Appendix

How to use the templates


This section contains basic, ready-to-print checklists, forms, and 3. Edit as needed
community engagement boards to support your data collection. Make all the changes you want to the text and images in the forms:
You can digitally add basemaps of your site where needed or
simply hand-draw it once it has been printed. Refer back to Form title Add basemap Edit instructions
Section B3 for examples of what the forms might look like when to your context
completed.

If you prefer to work with digital resources, or customize the


forms provided, we are also offering a digital version. Use the
editable file below and follow the instructions to prepare your
own forms from our templates.

1. Access the editable file


Click the button below to access the online spreadsheets where you will find:
→ One tab for each of the provided forms
→ A reference library of street users and the corresponding icons that you
can copy and paste into your new forms. These are just suggestions, you
can also create your own.
→ Sample data processing tables for pedestrian counts and vehicular
speeds, like the ones shown on pages 64 to 67.

Metrics collection forms


https://bit.ly/3GIbbX7
Choose the information Change user groups Use tabs to navigate the
to be collected and icons as needed different form templates

2. Create your own copy


Start by making a copy of the file on your own drive so you can work freely:
4. Print your forms
→ In the menu, click File and then Make a copy.
→ Name your file and choose where to save it. Once you are done with the edits, export PDFs and print your forms:
→ If you want to copy the comments, click Copy comments and suggestions. → In the menu, click on the printer icon or go to Menu > Print.
→ Click Ok. → The file is already set up to print in “letter” format.
→ Click Next:
If you prefer to work offline, follow these steps: → If you’re using Chrome, click Print in the window that appears. You can
→ In the menu, click File and then Download. choose to print directly from there or save it as a PDF first.
→ Choose a file type (.xlsx or .ods will keep it editable). → If you’re using Firefox or Safari, a PDF file will automatically
→ The file will download onto your computer. download. In your PDF viewer, go to File and then Print.

81 How to Evaluate Street Transformations How to Evaluate Street Transformations 82


www. globaldesigningcities.org

You might also like