You are on page 1of 10

Application of Microscopic

Simulation Model Calibration


and Validation Procedure
Case Study of Coordinated Actuated Signal System

Byungkyu (Brian) Park, Jongsun Won, and Ilsoo Yun

In the application of microscopic simulation models, the importance of without proper calibration and validation, the results could be mis-
model calibration and validation cannot be overemphasized. A recent leading and would lose the trust of the public, decision makers, or
study proposed a systematic approach for conducting a simulation model both. Therefore, the simulation models need to be well calibrated and
calibration and validation procedure on the basis of experimental design validated before being used for evaluation purposes.
and optimization and applied it to an isolated intersection with a VISSIM Most microscopic simulation models require many different types
simulation model. The present study further evaluates the previously of parameters to describe traffic flow characteristics, traffic control
developed simulation model calibration and validation procedure by systems, driving behavior, and so forth.
applying it to an urban arterial network consisting of 12 coordinated Basic input parameters such as geometry, number of cars, and
actuated signalized intersections. Both VISSIM and CORSIM simulation traffic signal setting are easy to obtain. However, some calibration
models were used. Travel time was used for the calibration measure, parameters related to drivers’ behaviors are almost impossible to
and maximum queue length was used for the validation measure. collect from the field. Thus, it is common practice to use either default
Study results showed that calibrated and validated simulation models parameters provided by the microscopic simulation model developer
were able to represent field conditions adequately, whereas default or a minimally calibrated model based on engineering judgments.
parameter–based models could not. As such, the previously developed However, researchers have shown that the simulation models under
simulation model calibration and validation procedure was proved default calibration parameters may not accurately represent field
effective for an arterial network under both VISSIM and CORSIM conditions and may possibly produce unreliable results (1, 2).
simulation models. In recent years several researchers have proposed microscopic traf-
fic simulation model calibration and validation procedures and have
tested them using various microscopic traffic simulation models.
As the surface transportation system becomes more complex and Sacks et al. (3) identified four key issues on model validation and
broader in its coverage area, it is very challenging to accurately demonstrated an informal validation process by using CORSIM. They
analyze and evaluate the performance of the system itself before emphasize the importance of data quality and visualization. Milam
implementing new control strategies, physical changes, or both. and Choa (4) proposed a guideline for the calibration and validation
Obviously, the Highway Capacity Manual (HCM), the most widely of traffic simulation models. Cohen (5) recommended that key param-
used engineering guidebook in the analysis of surface transportation eters be adjusted close to field-measured data. Dowling et al. (6)
systems, cannot be used for a large-scale transportation system analy- proposed a practical, top-down approach. Kim et al. (7) proposed a
sis. One alternative option is the use of simulation models. Fortu- nonparametric statistical technique for calibration and applied it to
nately, current computational technology has advanced to such an a real network by using VISSIM. They claim that simple metrics
extent that a sizable surface transportation system network can be could lead to erroneous results.
simulated in a reasonable amount of time. Not surprisingly, micro- In the process of microscopic simulation model calibration and
scopic traffic simulation models have become one of traffic engi- validation, a genetic algorithm (GA) has been widely applied. Cheu
neers’ most popular tools for analyzing and evaluating transportation et al. (8) applied a GA as an optimization method to find a suitable
systems. The microscopic traffic simulation models have been used combination of FRESIM parameter values for a real network. A
for various purposes, such as evaluating geometry changes and traf- similar effort for PARAMICS model calibration was made by Lee
fic signal timing plan updates and estimating the benefits of new et al. (9), and their evaluation results were seen to be reliable. Kim
intelligent transportation systems strategies. Microscopic simulation and Rilett (10) conducted a calibration process with a GA by using
models are much faster, safer, and cheaper than actual field imple- both CORSIM and TRANSIMS and showed the benefits of using a
mentations. However, when a microscopic simulation model is used GA for automated calibration. However, most of these approaches
used a few selected calibration parameters because of the complex-
ity of the optimization surface (i.e., stochastic nature of microscopic
Department of Civil Engineering, University of Virginia, P.O. Box 400742, simulation models and the total number of combinations when all
Charlottesville, VA 22904-4742. possible calibration parameters are considered). A few exceptions
Transportation Research Record: Journal of the Transportation Research Board, were Park and Schneeberger (1) and Park and Qi (2). They adopted
No. 1978, Transportation Research Board of the National Academies, Washington, a statistical experimental design approach to reduce the number of
D.C., 2006, pp. 113–122. combinations and also considered the feasibility of the initial ranges

113
114 Transportation Research Record 1978

of calibration parameters. In addition, Park and Qi (2) emphasized Measures of Performance Data
the importance of feasibility testing. They showed that if the initial
ranges of calibration parameters do not contain the optimal solution Travel time data were selected as calibration data because of the
(i.e., field condition), the simulation model cannot be calibrated ease with which they are collected from the field and because of
even if the optimization method finds the optimal solution in the the availability of simulation outputs. Also, they directly reflect
search region. Obviously, this is because the search region does not the level of service of the signalized arterial network. Two cam-
include field conditions. Even though their approach was success- eras were installed to record each vehicle’s license plate on both
fully tested at an isolated signalized intersection with a VISSIM ends of the corridor to capture the travel time of the left-most lane
simulation model, it is desirable to test it with a sizable arterial on Route 50. After the data collection from the field, all license
network. plate data were extracted from the videotape and matched to mea-
The objective of this paper is to evaluate the systematic simula- sure the travel time of each vehicle. The average travel time of the
tion model calibration and validation procedure proposed by Park vehicles on the left-most lane was 613.2 s.
and Qi (2) using a coordinated actuated traffic signal system with In addition to the calibration data, validation data were also col-
both VISSIM and CORSIM simulation models. lected with the smart travel van equipped with an AUTOSCOPE
The rest of the paper is organized as follows. The section on the test video detection system. The maximum queue length data were col-
bed network presents test site descriptions, data collection efforts, and lected in August 2001 on a weekday different from the travel time
simulation models used in this study; the proposed procedure sec- data collection, so they could be used as an untested data set for the
tion provides details on the procedure developed by Park and Qi (2). validation process. The maximum queue length for each cycle was
The section on the application of the calibration and validation pro- counted at the end of each red time, and the field-measured maximum
cedure provides implementations of the procedure with a test bed queue length of 24 vehicles was obtained.
network using VISSIM and CORSIM simulation models. The final
section presents conclusions and recommendations.
Simulation Models

TEST BED DEVELOPMENT VISSIM (Verkehr In Staedten SIMulation) was selected as the first
simulation model. It was developed at the University of Karlsruhe,
Test Site Germany, during the 1970s. VISSIM is a microscopic, behavior-
based simulation model that uses a psychophysical driver behavior
A coordinated actuated signalized network was modeled in VISSIM model developed by Wiedemann (1991), which employs stochas-
and CORSIM microscopic simulation models. These networks are tic car-following models and dynamic speeds (11). It consists of
used for applying the proposed calibration and validation procedure. two different programs, a traffic simulator and signal state genera-
The test site contains an urban arterial, Lee Jackson Memorial High- tor. The traffic simulator includes car-following and lane-changing
way (US Route 50), and 12 intermediate intersections between Sully logic, and it is capable of simulating up to one-tenth of a second.
Road and the Fairfax County Parkway in Fairfax, Virginia. The net- VISSIM Version 4.0 was used in this paper.
work consists of 11 consecutive intersections on US Route 50 and CORSIM (CORridor SIMulation), which was selected as the second
one adjacent intersection on Majestic Lane, which was added to the simulation model, is also a stochastic microscopic simulation model
network because it is located close enough to affect the traffic flow (12). It was first developed by FHWA during the 1970s. CORSIM
on US Route 50. The test site is referred to as Route 50 throughout is a core component of the traffic software integrated system (TSIS)
the rest of this paper. package, which is one of the most widely used microscopic simulation
models in the United States. CORSIM combines two different mod-
els: the arterial network model NETSIM and the freeway network
Data Collection
model FRESIM. Traffic flow algorithms in CORSIM, such as the
The data needed for this application study include simulation input car-following and traffic control module, simulate the interactions
data and measures of effectiveness (MOE) data for calibration and of individual vehicles. TSIS Version 5.1 was used in this paper.
validation purposes. The data were obtained from a previous study Performance measures such as travel times and maximum queue
conducted by Park and Schneeberger (1). A brief description of the length are extracted from the simulation models. In the case of
data collection process is provided below. VISSIM, performance measures were provided as a standard text
format at locations specified by the user. For example, path travel times
were obtained from two data collection points. However, CORSIM
Geometry, Traffic Signal Timing Plan, does not provide path travel times as a standard output. Thus, they
and Traffic Counts were extracted from the individual vehicle trajectory file (.tsd file)
that stores individual vehicle information during the simulation.
Geometric characteristics such as distance, speed limits, and detec-
tor locations for this Route 50 network were obtained from a Synchro
file provided by the Virginia Department of Transportation. The sig- PROPOSED PROCEDURE
nal timing plans for intersections in the test site were extracted from
the Management Information System for Transportation terminal The previously proposed microscopic simulation model calibration
located at the Smart Travel Laboratory at the University of Virginia. and validation procedure by Park and Qi (2) was applied to evalu-
Traffic counts were collected on a normal weekday, Wednesday, ate an arterial network with VISSIM and CORSIM. To provide
July 11, 2001, between 4:45 p.m. and 6:15 p.m., via video cameras readers with the completed procedure, a brief description of the pro-
and human counters. cedure is provided in this section. Readers who want to access the
Park, Won, and Yun 115

entire procedure should refer to Park and Qi (2). The procedure is mization, multiple runs were conducted for each feasible param-
also depicted in a flowchart presented in Figure 1. eter set to consider the variability of simulation results. Each indi-
vidual fitness value was calculated by comparing field data and
simulation results using Equation 1.
Simulation Model Setup
TTfield − TTsim
The simulation model setup includes defining study scope and FV = (1)
TTfield
purpose, site selection, MOE determination, data collection, and
network coding.
where
FV = fitness value,
Initial Evaluation TTfield = average field-measured travel time, and
TTsim = average travel time output from multiple simulation runs
The initial evaluation is done to test whether or not default calibra-
with the same parameter set.
tion parameters in the simulation model are sufficient to represent
field conditions.
Evaluation of Parameter Set
Initial Calibration Once the GA finds an optimal calibration parameter set, multiple
runs (e.g., 100 runs) with the calibrated parameter set are con-
The initial calibration consisted of three steps:
ducted to compare the performance of the simulation model with
field data. Thus, a distribution of calibrated simulation model
1. Identify calibration parameters and their acceptable ranges;
outputs is compared with field data. Visualization testing is also
2. Conduct statistical experimental design and generate a rea-
conducted.
sonable number of parameter sets; and
3. Implement multiple runs with each parameter set.
Validation and Visualization
Feasibility Test To validate the calibrated simulation model, it is desirable to collect
a new set of data under different conditions (e.g., new traffic signal
The feasibility test is done to verify whether the distribution of simu-
timing plan, new traffic volume). Thus, in this case study, the data
lation results from previous multiple runs includes field data. If the
collected on a different day were used as a new data set. Again,
distribution includes the field data, then it is determined to be the
multiple runs (e.g., 100 runs) are to be made, and a distribution of
acceptable range. Otherwise, modifications to the existing parameter
simulation model outputs is compared with validation field data. If
sets need to be done to adjust either the ranges or the list of parameters.
the field data fall in the 95th percentile range of the model output
distribution, the calibrated model is considered to be valid. In addi-
tion, visualization testing is conducted for a few selected runs (e.g.,
Parameter Calibration Using Genetic Algorithm
25th, 50th, and 75th percentile runs).
The parameter calibration was performed to find an optimal cali-
bration parameter set using a GA optimizer. During the GA opti-
APPLICATION OF CALIBRATION
AND VALIDATION PROCEDURE

Simulation Model Setup End VISSIM Case Study


Yes
The proposed procedure was applied to the Route 50 network with
Initial Evaluation Passed? No
Satisfied VISSIM. A description of the details of each step in the calibration
Unsatisfied and validation procedure for VISSIM follows.
Experimental Design
Model Validation &
Visualization
Simulation Model Setup
Feasibility Test Satisfied

Evaluation of Calibrated Unsatisfied


The Route 50 network was coded into the VISSIM simulation model,
Parameter Set and data collection points for calibration and validation measures
Yes
Passed? were installed.
Parameter Calibration
No
Using Genetic Algorithm
Adjust Key Parameter Initial Evaluation
Ranges
A total of 100 simulation runs with the default parameters were con-
FIGURE 1 Calibration and validation procedure flowchart ducted, and the distribution of simulation outputs (i.e., travel time)
[modified from Park and Qi (2)]. were compared with the field travel time. As shown in Figure 2, the
116 Transportation Research Record 1978

Frequency
12

10

613.2 sec
4

0
590 610 630 650 670 690 710 730 750 770 790 810 830 850 870 890 910 930
Travel Time

FIGURE 2 Initial evaluation results for Route 50, VISSIM model.

simulated travel time (average of 724.3 s) was significantly higher time. Thus, a total of 200 evaluation parameter sets were gener-
than the field travel time of 613.2 s. The decision was, therefore, ated with the Latin Hypercube sampling method (13). The method
made to conduct the calibration and validation procedure. was coded in a Visual Basic Application in MS Excel. The num-
ber of evaluation parameter sets should be determined on the basis
of the number of parameters considered, the size of the network,
Initial Calibration computation run time, and so forth. This study used 200 sets that
have been accumulated by the authors on the basis of experience.
Identification of Calibration Parameters As an initial phase, It appeared to be quite effective. Of course, more is better, even
14 calibration parameters in the VISSIM model were selected. These though it is costly.
include the car-following model, lane change behavior, and priority
rules. The following is the initially determined list of parameters and Multiple Runs For 200 calibration parameter sets, five random
their ranges. The detailed descriptions of each parameter can be seeded runs were conducted for each set to consider the variability
found in the VISSIM user manual (11). The simulation resolution is of the microscopic simulation outputs. As a result, 1,000 runs were
included because it has an effect on the response to traffic controls, made, and the average travel time for each five runs was recorded.
such as priority rules or traffic signals. A distribution of average travel times for 200 cases was prepared
for feasibility testing.
• Simulation resolution (time steps/simulation seconds): 1 to 9;
• Number of observed preceding vehicles: 1 to 4;
• Maximum look-ahead distance (m): 200 to 300; Feasibility Test
• Average standstill distance (m): 1 to 5;
• Saturation flow rate: The distribution of 200 average travel times developed in the
– Additive part of desired safety distance: 1.0 to 5.0 and previous step is compared with field-measured travel time. As
– Multiple part of desired safety distance: 1.0 to 6.0; shown in Figure 3, the field travel time lies within the distribu-
• Priority rules: tion; this indicates that an optimal parameter set can be found
– Minimum gap time (s): 3 to 6 and from the calibration parameters and their ranges. Thus, the param-
– Minimum headway (m): 3 to 20; eters and their ranges were considered feasible, and the next step
• Desired speed distribution (mph): 30∼60, 35∼55, 40∼50; was implemented.
• Waiting time before diffusion (s): 20 to 40;
• Minimum headway (m): 0.5 to 7.0;
• Maximum deceleration (m/s2): −5.00 to −1.00; Parameter Calibration Using Genetic Algorithm
• Reduction rate (m): 20 to 80; and
• Accepted deceleration (m/s2): −1.50 to −0.10. A GA program integrated with the VISSIM model was used to cal-
ibrate parameters within the feasible ranges. The GA parameters
Experimental Design for Calibration When 14 calibration param- used in this study included the maximum number of generations of
eters with five possible values for each parameter are considered, the 10, population size of 10, crossover rate of 0.8, and mutation rate of
total number of possible combinations is 514 (i.e., 6,103,515,625). 0.05. The GA program converged within 10 generations. A few
That is almost impossible to evaluate in a reasonable amount of multiple GA runs showed similar convergences.
Park, Won, and Yun 117

Frequency
25

20

15
613.2 sec
10

0
550 650 750 850 950 1050 1150 1250 1350 1450 1550
Travel Time

FIGURE 3 Feasibility test result for Route 50, VISSIM model.

Evaluation of Parameter Sets Validation with New Data and Visualization Testing

An optimal calibration parameter set (the first trial) was selected To validate the calibrated parameter set identified from the pre-
from the best solution at the last generation. One hundred multiple vious section, new field data that had not been exposed during
simulation runs were made with the optimal parameter set, and the calibration were used. A distribution of maximum queue lengths
distribution of the travel time from the simulation model outputs obtained from VISSIM simulation runs was compared with field-
was compared with the field travel time. Even though, as shown in measured maximum queue length. As was mentioned briefly, results
Figure 4, the optimal calibration parameters show a good match from the first calibrated model (first trial) were not acceptable
with the field data, the validation results were not acceptable. (see Figure 6). This triggered the second optimization, and its results
Another GA-based calibration parameter optimization attempt (the (second trial) were acceptable. Furthermore, the visualization test-
second trial) was made, and the distribution of travel times was ing was conducted by carefully watching simulation animations
developed with 100 multiple runs. Figure 5 shows travel time dis- during the validation procedure. No abnormal vehicle movements
tributions of both trials and field travel time. Visualization testing were observed.
conducted for both calibrated models indicated that both models For comparison purposes, three calibration parameter sets
were acceptable. (i.e., default, first trial, and second trial) and their average travel

Frequency
35
613.2 sec
1st Trial 2nd Trial
30

25

20

15

10

0
595 600 605 610 615 620 625 630 635 640 645 650 655 660
Travel Time

FIGURE 4 Travel time distribution of GA-based parameter set, VISSIM model.


118 Transportation Research Record 1978

Frequency
80

70

60

50

40
613.2 sec
30

20

10

0
400 420 440 460 480 500 520 540 560 580 600 620 640
Travel Time

FIGURE 5 Initial evaluation results for Route 50, CORSIM model.

times are summarized in Table 1. On the basis of the analysis of Initial Evaluation
variance, the most significant key parameters were the additive part
of the desired safety distance and desired speed distribution. Multiple simulation runs with the default parameter set were con-
ducted, and the average travel time for each run was extracted. Then
a distribution of CORSIM-generated travel times was compared
CORSIM Case Study
with field travel time. As shown in Figure 5, the travel time distri-
CORSIM was also selected as a model to use for the microscopic bution based on the default parameter set was not even close to the
simulation model calibration and validation procedure. The appli- field average travel time. Thus, it is deemed that the calibration and
cation procedure for the CORSIM simulation model and the results validation procedure should be implemented.
are presented in this section.

Initial Calibration
Simulation Model Setup
Identification of Calibration Parameters CORSIM provides
The network geometry, signal timing plan, traffic volume, and other numerous calibration parameters that the user can fine-tune to repli-
input variables were coded into CORSIM. cate field conditions. CORSIM contains several distinctive param-

Frequency
35
1st Trial 2nd Trial
30

25

20
24 Vehicles
15

10

0
20 22 24 26 28 30 32 34 36 38 40 42 44
Maximum Queue Length

FIGURE 6 Maximum queue length distribution of calibrated parameter set, VISSIM model.
Park, Won, and Yun 119

TABLE 1 Comparison of Three Parameter Sets for Route 50, VISSIM Model

Calibrated

Default 1st Trial 2nd Trial

Simulation resolution 5 2 5
Number of observed preceding vehicles 2 1 1
Maximum look-ahead distance (m) 250.00 244.44 273.74
Average standstill distance (m) 2.00 1.93 1.73
Additive part of desired safety distance 3.00 1.53 1.08
Multiple part of desired safety distance 3.00 2.67 2.57
Priority rules, minimum gap time (s) 5.0 4.58 5.82
Priority rules, minimum headway (m) 8.0 11.06 9.09
Desired speed distribution (mph) 40–50 30–60 30–60
Waiting time before diffusion (s) 60.00 38.59 32.73
Minimum headway (m) 0.50 1.68 1.75
Maximum deceleration (m/s2) −4.00 −4.47 −3.26
Reduction rate (m) 100.00 50.30 52.12
Accepted deceleration (m/s2) −1.00 −0.41 −0.28
Average travel time (s) 724.3 617.6 611.6

eters that are represented by a discrete distribution or 10 percentile Experimental Design The 200 candidate parameter sets were
values indexed by driver types. To change behaviors of drivers, param- generated using a Latin Hypercube sampling method. The num-
eters that control the proportions of driver types are included. The ber of evaluation parameter sets should be determined on the
following is the initially determined list of parameters and their basis of the number of parameters, the size of the network, com-
ranges. The detailed description of each parameter can be found in putation run time, and so forth. The 200 sets appeared to work
the CORSIM user’s guide (6). well for this study.

• Link mean free-flow speed (mph): −10, 0, +10 (from each free- Multiple Runs Five random seeded simulation runs were con-
ducted in CORSIM for each of 200 parameter sets, for a total of
flow speed);
• Mean queue discharge headway (s): 1.5 to 2.5; 1,000 runs. An average travel time for each of the five runs was
recorded.
• Mean start-up lost time (s): 1.5 to 3.0;
• Left-turn jumper probability (%): 10 to 40;
• Left-turn speed (mph): 13 to 31;
• Right-turn speed (mph): 13 to 25; Feasibility Test
• Left-turn lagging within 2 s (%): 20 to 50;
A distribution of average travel times for 200 parameter sets was
• Left-turn lagging for 2 to 4 s (%): 5 to 15;
prepared for feasibility testing. The distribution was compared with
• Amber interval response (ft/s2):
field travel time. As shown in Figure 7, the travel time distribution
– Shift to left: 19, 16, 13, 10, 7, 5, 4, 3, 2, 2; obtained from the initial parameters and their ranges definitely
– Shift to right1: 23, 20, 17, 14, 11, 9, 8, 7, 6, 6; and contains the field travel time. Thus, the next step is conducted.
– Shift to right2: 25, 22, 19, 16, 13, 11, 10, 9, 8, 8;
• Gap distribution for left turns (s):
– Shift to left: 6.8, 5.6, 5.0, 4.4, 3.8, 3.5, 3.2, 2.9, 2.6, 1.7 and Parameter Calibration Using Genetic Algorithm
– Shift to right: 8.8, 7.6, 7.0, 6.4, 5.8, 5.5, 5.2, 4.9, 4.6, 3.7;
• Gap distribution for right turns (s): The GA-based optimization run was conducted, and the optimal cal-
– Shift to left1: 9.0, 7.8, 7.0, 6.2, 5.4, 5.0, 4.6, 4.2, 3.8, 2.6 and ibration parameter set was obtained. The GA parameters used in the
– Shift to left2: 8.0, 6.8, 6.0, 5.2, 4.4, 4.0, 3.6, 3.2, 2.8, 1.6; CORSIM calibration were the same as those used in the VISSIM
• Distribution of free-flow speed by driver type (%): calibration.
– Narrow (0.8): 82, 86, 94, 96, 98, 100, 105, 108, 112, 119 and
– Wider (1.2): 73, 80, 91, 94, 97, 100, 107, 112, 118, 128;
• Start-up lost time distribution (%): Evaluation of Parameter Sets
– Narrow (0.8): 195, 132, 120, 115, 102, 89, 82, 70, 57, 38 and
– Wider (1.2): 240, 147, 130, 121, 102, 83, 74, 56, 37, 10; Again, 100 multiple CORSIM runs were made using the optimal
• Discharge headway distribution (%): parameter set found in the GA optimization. The distribution of
– Narrow (0.8): 156, 116, 116, 108, 100, 100, 92, 76, 76, 60 and CORSIM-produced travel times was compared with field travel
– Wider (1.2): 184, 124, 124, 112, 100, 100, 88, 64, 64, 40. time. As shown in Figure 8, the field travel time lies reasonably
120 Transportation Research Record 1978

Frequency
50
45
40
35
30
613.2 sec
25
20
15
10
5
0
300 400 500 600 700 800 900 1000 1100 1200 1300
Travel Time

FIGURE 7 Feasibility test result for Route 50, CORSIM model.

within the distribution of travel times. Thus, it was determined that For comparison purposes, default and calibrated simulation
the CORSIM model is well calibrated. parameter sets as well as their average travel times are summarized
in Table 2. Apparently, some significant changes were made between
these two parameter sets. In general, the calibrated parameters made
Validation with New Data
the CORSIM model more conservative than the default parameters to
To validate the calibrated CORSIM simulation model, a maximum match with field conditions (i.e., both travel time and maximum
queue length data set that was not exposed during the calibration queue length).
optimization was used. The maximum queue length data from a pre-
determined approach were extracted from each of 100 simulation runs. CONCLUSIONS AND RECOMMENDATIONS
Figure 9 shows the distribution of maximum queue lengths obtained
from CORSIM. It is clear that the field data lie within the distribution. This paper applied a previously developed calibration and validation
In addition, the animations of the CORSIM models were carefully procedure that had been tested only with an isolated signalized inter-
checked for visual verification, and no abnormal situations were section. Two microscopic simulation models, VISSIM and CORSIM,
observed. As such, the validation of the calibrated model is considered were applied for the calibration and validation of a coordinated actu-
to be satisfactory. ated arterial network. The performance of the calibration and vali-

Frequency
25

20

613.2 sec
15

10

0
500 525 550 575 600 625 650 675 700 725 750 775 800 825
Travel Time

FIGURE 8 Travel time distribution of GA-based parameter set, CORSIM model.


Park, Won, and Yun 121

Frequency
45
24 Vehicles
40

35

30

25

20

15

10

0
20 22 24 26 28 30 32 34 36 38 40 42
Maximum Queue Length

FIGURE 9 Maximum queue length distribution of calibrated parameter set,


CORSIM model.

dation procedure was evaluated by comparing the distribution of sim- indicates that the validation test should be conducted to make sure
ulation outputs and an average value of field data. The travel time mea- that the calibrated model can be used for untried conditions. In the
sure was used for calibration; the maximum queue length measure was case of the CORSIM simulation model, the simulation outputs of
used for validation. the calibrated parameters were able to replicate the field-measured
The results based on the Route 50 network indicate that the validation condition. Thus, this study validated that the previously
default parameters of both VISSIM and CORSIM simulation mod- developed microscopic simulation model calibration and valida-
els were not able to replicate field travel times. The calibrated tion procedure can be used for a sizable signalized network and
parameters obtained from the procedure for both models showed other microscopic simulation models.
that the field travel time lies within the distributions of travel In this paper, only one field-collected data point was used dur-
times, indicating that the optimal parameters were well calibrated. ing each of the calibration and validation tests. It is more desirable
In addition, maximum queue length (a validation data set) was to collect over time multiple data points of field data to account for
used for verifying that the calibrated models can replicate addi- day-to-day variability. In addition, more data can be collected to
tional field data that were not used for calibration. In VISSIM, the reduce the number of calibration parameters such as standstill dis-
calibrated parameters did not pass the validation test at the first tance or saturation flow rate. Although a sizable signalized arte-
trial, and thus a second trial was done, and it was successful. This rial network was used in this study, a more complex network that

TABLE 2 Comparison of Two Parameter Sets for Route 50, CORSIM Model

Default Calibrated

Link mean free-flow speed (mph) 45–55 35–45


Mean queue discharge headway (s) 1.8 2.5
Mean start-up lost time (s) 2.0 4.0
Left-turn jumper probability (%) 38 13
Left-turn speed (ft/s) 22 17
Right-turn speed (ft/s) 13 40
Left-turn lagging within 2 s (%) 50 10
Left-turn lagging within 2 to 4 s (%) 15 25
Amber interval response (ft/s2) index 1 2
Gap distribution for left turns (s) index 1 2
Gap distribution for right turns (s) index 1 1
Distribution of free-flow speed by driver type (%) index 1 2
Start-up lost time distribution (%) index 1 1
Discharge headway distribution (%) index 1 2
Average travel time (s) 429.7 609.6
122 Transportation Research Record 1978

includes multiple arterials should be considered to verify the per- 6. Dowling, R., A. Skabardonis, J. Halkias, G. McHale, and G. Zammit.
formance of this procedure. Furthermore, it is more desirable to Guidelines for Calibration of Microsimulation Models: Framework and
Applications. In Transportation Research Record: Journal of the Trans-
consider many different calibration parameters such as parame-
portation Research Board, No. 1876, Transportation Research Board of
ters related to the dynamic origin–destination demand and multi- the National Academies, Washington, D.C., 2004, pp. 1–9.
ple MOEs to understand inherent variability associated with the 7. Kim, S., W. Kim, and L. R. Rilett. Calibration of Microsimulation
simulation models. Models Using Nonparametric Statistical Techniques. Presented at 84th
Annual Meeting of the Transportation Research Board, Washington,
D.C., 2005.
8. Cheu, R. L., X. Jin, K. C. Ng, Y. L. Ng, and D. Srinivasan. Calibra-
REFERENCES tion of FRESIM for a Singapore Expressway Using Genetic Algo-
rithm. Journal of Transportation Engineering, Vol. 124, No. 6, 1998,
1. Park, B., and J. D. Schneeberger. Microscopic Simulation Model Cal- pp. 526–535.
ibration and Validation: Case Study of VISSIM Simulation Model for 9. Lee, D. H., Y. Xu, and P. Chandrasekar. Parameter Calibration for
a Coordinated Actuated Signal System. In Transportation Research PARAMICS Using Genetic Algorithm. Presented at 80th Annual Meet-
Record: Journal of the Transportation Research Board, No. 1856, ing of the Transportation Research Board, Washington, D.C., 2001.
Transportation Research Board of the National Academies, Washing- 10. Kim, K.-O., and L. R. Rilett. A Genetic Algorithm Based Approach to
ton, D.C., 2003, pp. 185–192. Traffic Micro-Simulation Calibration Using ITS Data. Presented at 83rd
2. Park, B., and H. Qi. Development and Evaluation of Simulation Model Annual Meeting of the Transportation Research Board, Washington,
Calibration Procedure. Presented at 84th Annual Meeting of the Trans-
D.C., 2004.
portation Research Board, Washington, D.C., 2005.
11. VISSIM Version 4.0 User Manual. PTV Planung Transport Verkehr AG.
3. Sacks, J., N. Rouphail, B. Park, and P. Thakuriah. Statistically Based
Innovative Transportation Concepts, Inc., June 2004.
Validation of Computer Simulation Models in Traffic Operations and
12. CORSIM User’s Manual. Office of Safety and Traffic Operations,
Management. Journal of Transportation and Statistics, Vol. 5, No. 1,
2002, pp. 1–24. FHWA, U.S. Department of Transportation, McLean, Va., 1997.
4. Milam, R. T., and F. Choa. Recommended Guidelines for the Calibration 13. McKay, M. D., R. J. Beckman, and W. J. Conover. A Comparison of
and Validation of Traffic Simulation Models. Fehr & Peers Associates, Three Methods for Selecting Values of Input Variables in the Analysis
Inc., Roseville, Calif., 2000. of Output from a Computer Code. Technometrics, Vol. 21, No. 2, 1979,
5. Cohen, S. L. An Approach to Calibration and Validation of Traffic pp. 239–245.
Simulation Models. Presented at 83rd Annual Meeting of the Trans-
portation Research Board, Washington, D.C., 2004. The Traffic Signal Systems Committee sponsored publication of this paper.

You might also like