Professional Documents
Culture Documents
761–767
Keywords: road surface conditions, tire noise, frequency analysis, intelligent transportation system
The detection of road surface conditions is an important process states is feasible when the difference between the two distribution
for efficient road management. In particular, in snowy seasons, prior curves is the largest. One indicator is the normalized mangitude of
information about the road conditions, such as an icy state, helps overline P̄( f ) at a frequency of 1.5 kHz or the ‘indicator at 1.5 kHz’.
road users or automobile drivers to obviate serious traffic accidents. The other indicator is the frequency at which the normalized magni-
This paper is basically in line with the approach of Ueda et al. To tude takes a value of 0.5 or the ‘indicator at 0.5’. Without changing
know general tendencies of the power spectrum, we recorded a num- the observation location, we detected tire noise for the road surface
ber of tire noises at near The University of Electro-Communications in different states. These surface states were monitored visually us-
(UEC) and near Sapporo city. We detected the state of the road sur- ing a video camera. It should be noted that both the indicators in-
face: i.e., dry, wet, or snowy state. Tire noise emitted from moving deed represent the changes of the surface states.
vehicles on the road surface by various mechanisms was recorded Figure 2 shows the natural transition process between the three
with a PCM recoder. The noise signals are processed through a different states. It is also allowed to change from dry to wet and wet
high-pass filter with a cut off frequency of 300 Hz to remove un- to snowy. However, the direct transition from the snowy state to the
necessary signals such as engine noises and wind noise, and are dry state is not allowed: i.e., the wet state always exists in the pro-
converted into the power spectrum by fast Fourier transform (FFT). cess. For the wet state, the indicator at 0.5 has the highest frequency
After that, we determine the frequency at which the power spec- of the three, while the wet state in the natural process exists between
trum reaches the maximum. Additionally, our predicting approach the other two states. This interchanged situation makes it difficult to
relies on the normalized magnitude of the spectrum at a frequency classify successfully the three states. This is important information
of 1.5 kHz and on a frequency at which the normalized magnitude for classifying the dry and slushy states.
takes a value of 0.5. The effectiveness of these three classification Using the observed data, accurate classification into three states
indicators are verified by noise data samples obtained at the three seems to be feasible by employing either indicator on the basis of
experimental locations and are compared with visual inspections of certain threshold values. The accuracy of correct detection is low
actual road surfaces. overall, the use of the indicator at 0.5 gives the highest accuracy,
For instance, the cumulative distribution curves P̄( f ) obtained and the peak-frequency method has the lowest accuracy. The main
from passing vehicles for five-minute data near UEC are shown in reason why relatively high detection errors arise is that the road was
Fig. 1. The magnitudes for the wet state are all lower than those for covered with slushy water and was predicted to be dry in the transi-
the dry state through all frequencies. We propose two classification tion process.
indicators in accordance with the fact that easy classification of the Four kinds of road surfaces are exhibited. It is noted that the
curves for the slushy road are more obviously scattered than the
curves of the remaining three states. Therefore, the accuracy in clas-
sification is improved by introducing the standard deviation σ.
– 13 –
Paper
Information on road surface conditions is important and helpful for road users such as automobile drivers, partic-
ularly in snowy seasons. In practice, the surface conditions depend greatly on the weather, road users, location, and
other relevant factors. This report is concerned with the reliable detection of the surface conditions using tire noise
from road vehicles. The road/tire noise emitted from moving vehicles varies momentarily depending on the road sur-
face properties. Then, it may be possible to passively and easily detect the state of the road surface: i.e., dry, wet, or
snowy state. To detect tire noise, we used a commercially available microphone as an acoustic sensor, which enabled
us to easily reduce the cost and size in realizing a practical system for detecting road surface conditions. We propose
a couple of simple detection methods to classify the conditions into several categories of state and to improve the clas-
sification accuracy. From the experimental results obtained in snowy areas, it has been demonstrated that an accuracy
of up to about 81% is attained in predicting the road surface states using only tire noise data.
Keywords: road surface conditions, tire noise, frequency analysis, intelligent transportation system
c 2009 The Institute of Electrical Engineers of Japan. 761
Fig. 1. Experimental setup for detecting tire noise from
vehicles (UEC)
to have winter or studless tires. The roads have four lanes, Fig. 2. Peak frequencies for all vehicles in the power
and vehicles were traveling at 60 km/h to 80 km/h on aver- spectra of their tire noise
age. Basically, the data acquisition system was the same as
that described above, except for the microphone being set at
a height of 4.4 m from the ground. Tire noise was recorded
continuously for more than one hour.
3. Classification Methods
3.1 Peak Frequencies Sound signals recorded with
a microphone are fed to a high-pass filter with a cut off fre-
quency of 300 Hz to remove unnecessary signals such as en-
gine noise and wind noise. Then, FFT is applied to obtain a
power spectrum p( f ) ( f is frequency) for the tire noise signal Fig. 3. Peak frequencies averaged over every 20 vehi-
from each vehicle. cles (UEC)
Incidentally, we usually observe that the timbre of tire
noise is dependent on road conditions. When a road has seen in Fig. 3, the peak frequencies are within the range of
water on its surface, for example, the pressure level of tire 0.8 kHz to 1 kHz for the ‘wet’ state and are about 0.3 kHz
noise generally increases because of water splashing. Addi- higher than the frequencies for the ‘dry’ state, which are con-
tionally, high-frequency components seem to be auditorily centrated around 0.6 kHz. This observation supports our au-
increased on the whole compared with the case when the ditory sense described above.
surface is dry. We then first focus our attention on the fre- Tire noises from trucks and buses are generally louder than
quency at which each tire noise attains a peak in its power those from the remaining small cars, and difference in sig-
spectrum. All spectra are obtained by executing FFT on the nal characteristic might exist between the two vehicle groups.
signal waveform that lasts for 1.5 s. We extracted manually Actually, the tire signals we observed included those from 20
the individual waveforms from time history records observed small cars, 10 trucks, 2 buses, and 2 motorcycles in the first
over about one hour using a free sound engine program. Fig- 5 minutes. From all the data, we picked out only the signals
ure 2 shows the peak frequencies of about 1500 vehicles that from small cars using the sound engine program. Figure 4
passed by the UEC observation point. Two different condi- shows the time history records of the peak frequencies aver-
tions, the ‘wet’ and ‘dry’ states on the road, are the targets aged over every 20 small cars. Apparently, almost the same
of classification. Obviously, the frequency varies from vehi- patterns are obtained for the two different road states: i.e., the
cle to vehicle, and it appears difficult to obtain information peak frequencies for the wet state are 0.2 kHz or much higher
on the road surface conditions from these randomly scattered than those for the dry state. Consequently, the following two
frequencies. However, upon averaging the frequencies over important findings are obtained. First, it is of great neces-
every 20 vehicles, a definite difference appears. As can be sity to execute averaging for the data obtained from vehicles
(a)
(b)
Fig. 6. Time histories of the ‘indicator at 1.5 kHz’ for
50-minute observation near UEC (a) and Sapporo city (b)
(b)
Fig. 8. One-day observation near Sapporo city. The in-
dicator at 1.5 kHz (a) and the indicator at 0.5 (b) are pre-
sented. The observation started at 0 a.m. and ended at
0 a.m. of the next day
(a) (b)
(a)
Fig. 9. Transition diagram for the different surface
states. Fl and Fh are the threshold frequencies for the
indicator at 0.5. Specifically, Fl = 1.70 kHz and Fh =
2.07 kHz in the present experiment
(a) (b)
Fig. 11. Flowchart for a simple method of classifying
road surface states using the indicator frequency at 0.5
(a), and typical distribution curves for four kinds of sur-
face states (b)
the three states. In fact, at around 10 a.m. in Fig. 8(b), the in-
dicator takes almost the same frequencies as those in the dry
state after 2 p.m., but it does not mean that the road surface is
dry in the former time zone: the frequency happens to tem-
porarily take a value of 2 kHz in the transition process from
the snowy state to the wet state. This is important informa-
tion for classifying the dry and slushy states.
(b) Three-day observation data for the indicator at 0.5, includ-
ing sound signals from the preceding day and the following
day of the day corresponding to Fig. 8, are shown in Fig. 10.
Data (b) is the same as that in Fig. 8(b). Using a simple classi-
fication method based on only the threshold frequencies and
the flowchart shown in Fig. 11(a), we attempted to classify
the road surface into the three states. Table 1 shows the re-
sults, where the results of the other two methods of using the
indicator at 1.5 kHz and the peak frequency of the tire noise
spectrum are listed for comparison. Although the accuracy of
correct detection is low overall, the use of the indicator at 0.5
gives the highest accuracy, and the peak-frequency method
has the lowest accuracy. The main reason why relatively high
(c) detection errors arise is that the road was covered with slushy
Fig. 10. Time histories of the indicator at 0.5 and the water at around 10 a.m. and was predicted to be dry in the
road surface temperature for the three-day observation transition process from the snowy state to the wet state, as
near Sapporo city. Data (b) is the same as in Fig. 8(b).
Data (a) to (c) were taken over three days at the same shown in Fig. 9(b).
observation location As is described in Sec. 2, a slushy surface is expediently
categorized into the wet state. Actual surfaces for such roads
Indicator at 1.5 kHz 0.32 ∼ 0.38 < 0.32 > 0.38 77.8 71.5 43.8 64.4
Indicator at 0.5 [kHz] 1.70 ∼ 2.07 > 2.07 < 1.7 75.4 93.7 50.0 73
Peak frequency [kHz] 0.61 ∼ 0.76 > 0.76 < 0.61 65.8 58.3 34.8 53.0
Table 2. Experimental results of detecting the road surface states over three days using 5-minute sound signals
Threshold values Accuracy
Frequency [kHz] Standard deviation: σt [Hz] [%]
Wet Snowy Dry Slushy 1st day 2nd day 3rd day Total (average)
> 2.07 < 1.70 < 151 > 151 79.5 95.8 66.7 80.7
6. Conclusions
We presented new methods for classifying road surface
conditions using only the tire sound noise emitted from mov-
ing vehicles. A couple of detection indicators were proposed:
the normalized magnitude at 1.5 kHz in the cumulative distri-
bution and the frequency at which the normalized magnitude
takes a value of 0.5. From various field experiments, it was
found that the two indicators have almost the same classifi-
cation accuracy. It was also demonstrated that averaging of
the noise data is important in order to extract distinct differ-
ences among various states of road surfaces. At the present
time, classification accuracy is, at most, 81%. However, the
Fig. 12. Flowchart for an advanced method of classify- accuray may be improved by incorporating the natural tran-
ing road surface states using the indicator frequency at sition process and meteorological information such as road
0.5. The information of the standard deviation is included temperature. Further studies concerning such problems are
under way.
are not always covered with slush: i.e., parts of the surface (Manuscript received Nov. 13, 2008,
are still snowy and other parts are already dry owing to water revised Feb. 21, 2009)
evaporation.
Additionally, not all vehicles pass over the slushy surfaces.
Figure 11(b) shows typical cumulative distributions for an References
observation time of about 30 minutes. Four kinds of road
surfaces, wet, dry, snowy, and slushy states, are exhibited. It (1) A. Saegusa and Y. Fujiwara: “A Study on Forecasting Road Surface Condi-
is noted that the curves for the slushy road are more obvi- tions Based on Weather and Road Surface Data”, IEICE Trans. INF. & SYST.,
ously scattered than the curves of the remaining three states, Vol.E90-D, No.2, pp.509–516 (2007-2)
(2) K. McFall and T. Niittula: “Results of AV Winter Road Condition Sensor
particularly the curves of the dry state. Prototype”, The 11th Standing International Road Weather Commission in
Therefore, it seems to be feasible to discriminate the dry Sapporo (2002-1)
and slushy surfaces by introducing some statistical measures, (3) AerotechTelub and Dalarna University: “Final Report on Signal and Image
such as the standard deviation σ. The flowchart in Fig. 12 is Processing for Road Condition Classification”, pp.1–30 (2002-2)
(4) T. Kubo, C. Shimomura, and T. Haruyama: “Discriminant Analysis System
an advanced classification method that makes use of the sta- for Winter Roads Utilizing Automobile Tire Sounds”, AIPCR·PIARC, The
tistical factor σ. Specifically, the value of σ for the indicator 12th International Winter Road Congress in Italy (2006-3)
at 0.5 was determined to be 151 Hz from one-hour data at (5) K. Ueda, K. Nakamura, H. Onodera, N. Konagai, and T. Kamakura: “De-
velopment of Road Condition Detecting Sensor Using Vehicle Running
around 10 a.m. in Fig. 10(b).
Sounds”, The Papers of Technical Meeting on Intelligent Transport Systems,
Table 2 shows the results obtained using the advanced IEE Japan, No.ITS-07-13, pp.25–30 (2007) (in Japanese)
classification method. It is already shown in Table 1 that (6) M. Yamada, K. Ueda, I. Horiba, and N. Sugie: “Discrimination of the Road
when the indicator at 0.5 takes a value between 1.7 kHz and Condition Toward Understanding of Vehicle Driving Environments”, Intel-
ligent Transportation Systems, IEEE Transaction, Vol.2, No.1, pp.26–31
2.07 kHz, the road surface is either dry or slushy. In this case, (2001-3)
we use the standard deviation σ for judging the classification.
If σ < 151 Hz, the surface is dry. Otherwise, the surface is in
the slushy state. Table 1 reveals that the accuracy in classifi-
cation is improved by introducing the standard deviation.
Wuttiwat Kongrattanaprasert (Student Member) received his Tomoo Kamakura (Non-member) received his B. E. degree from
B. Eng degree in Electrical Engineering from Kanazawa University, and M. E. and Dr. E. degrees
Rajamangala Institute of Technology, Thailand, in from Nagoya University in 1971, 1973, and 1977,
May 1995. In March 2001, he received his respectively. He was an Associate Professor at the
M. Eng degree in Electrical Engineering from Department of Electronics, the University of Electro-
King Mongkut’s University of Technology, Thon- Communications from 1985 to 1997. He is cur-
buri, Thailand. He is currently a PhD student of rently a Professor at the the University of Electro-
Electronic Engineering at The University of Electro- Communications. His current research interests in-
Communications (UEC), Japan. His research inter- clude nonlinear acoustics, ultrasonic measurement,
ests are in the detection of road surface conditions us- and acoust-electronics. He received the Sato Prizes
ing tire noise from vehicles and nondestructive determination using force from ASJ in 2003 and 2006, and received the best paper award from MASJ
vibration and ultrasound. in 2003. He is a member of the Acoustical Society of Japan, the Acoustical
Society of America, the Marine Acoustics Society of Japan, and the Institute
of Electronics, Information and Communication Engineering.
Hideyuki Nomura (Non-member) received his B. E., M. E., and
Dr. Eng. degrees in Electronic Engineering from
the University of Electro-Communications in 1996, Koji Ueda (Non-member) received B. E. and M. E. degrees in Elec-
1998, and 2001, respectively. He was a Research trical Engineering from Meijo University in 1981 and
Associate at the Department of Information and Sys- 1988, respectively. Since 1981, he has been working
tems Engineering, Kanazawa University from 2001 in Nagoya Electric Works, Co., Ltd. He is currently
to 2007. He is currently an Assistant Professor at the a manager of the research and development division.
Department of Electronic Engineering, the Univer- He received Dr. E. degree from Nagoya University in
sity of Electro-Communications. His current research 1996. He is a member of the Information Process-
interests include computational acoustics, acoustical ing Society of Japan and the Institute of Electronics,
electronics, and speech dynamics. He received the Awaya Prize ans the Information and Communication Engineering.
Sato Prize from ASJ in 2001 and 2003, respectively. He is a member of
the Acoustical Society of Japan, the Acoustical Society of America, and the
Marine Acoustics Society of Japan.