Professional Documents
Culture Documents
1999 - Guler Et Al. - Masurement of Particle Movement in Granular Soils Using Image Analysis
1999 - Guler Et Al. - Masurement of Particle Movement in Granular Soils Using Image Analysis
IMAGE ANALYSIS
By Murat Guler,1 Tuncer B. Edil,2 and Peter J. Bosscher3
ABSTRACT: The flowing behavior of granular soils in the form of localized deformations and shear bands is
a difficult phenomenon to define explicitly in the modeling of soil-structure interface problems. However, for
Downloaded from ascelibrary.org by UFRGS - Universidade Federal do Rio Grande do Sul on 07/15/16. Copyright ASCE. For personal use only; all rights reserved.
development of accurate numerical solutions for these problems, an estimation of particle movements is impor-
tant in determining the nature of displacement fields within the granular media. Video images from direct shear
tests were used to capture the movement of individual grains relative to the movement of a ribbed structural
surface. Two different algorithms have been developed to determine particle displacements in an image sequence
of the interface during a direct shear test. BMAD employs a block-matching algorithm using unit patterns of
images to determine two-dimensional particle displacement vectors. MATCH, on the other hand, computes
displacements based on centroid locations of segmented particles that are matched using a four-level filter
algorithm in successive image frames. Measured hardware dependent noise was reduced during image acquisition
by means of a frame averaging technique implemented in BMAD. BMAD was successfully employed to deter-
mine particle displacements in Ottawa sand images obtained during shearing on a ribbed surface. The results
were verified with MATCH using the same image frames.
to analyze displacements between image frames. In this FIG. 2. Parameters Used in Minimum Absolute Difference Cri-
terion
method, groups of pixels rather than particles are used for the
matching operation. MATCH, on the other hand, employs
four-level filtering algorithms to match previously analyzed of the pixel values between two sequential image frames.
colored sand particles dispersed in the particulate media. Re- There are three factors that may control the performance of
sults of both algorithms are compared using Ottawa sand par- the method: the matching criterion, the search strategy, and the
ticles during an interface shear test, and the performance of macro block size (Tekalp 1995), as discussed in detail in the
the block-based matching method with an added frame aver- subsequent sections. Fig. 1 illustrates the input parameters for
aging algorithm is verified with the results of MATCH, an the method. The macro block is a block of pixels used to
object matching algorithm. match in the successive image, the size of which is predeter-
mined with respect to the average size of objects within those
PARTICLE MOTION ESTIMATION THROUGH BLOCK images. It is required to define an integer number of macro
MATCHING METHOD — BMAD blocks where the image horizontal and vertical resolutions are
divided by the macro block horizontal and vertical sizes, re-
Block-based matching is a widely used method in industrial spectively. The side length, on the other hand, can be any
applications because of its moderate hardware requirements as value, depending on the estimated magnitude of motion be-
well as the ease of implementations in complex motion detec- tween successive frames.
tion and pattern recognition problems. It is the accepted mo-
tion estimation and compensation method of the Moving Pic- Matching Criterion
ture Expert Group, a section of the International Organization
for Standardization (ISO), working on digital video image op- There are different matching criteria defined for block
timization techniques. The principal assumption in this method matching methods, depending on the type of application. Be-
is that small patterns of pixel blocks can be tracked from one cause of computational simplicity, the minimum absolute dif-
image to the next and that their movement is directly related ference criterion MAD is considered the most effective search-
to the movement of particles contained in the pixel block. Fun- ing criteria. The MAD can be defined as follows:
damentally, the method employs a searching algorithm to find
the best match of a pixel block taken from the reference frame
to pixel blocks in the next frame. The method applies only to
MAD(d1, d2) = 冘 兩 p(xk, yk) ⫺ p(xk⫹1 ⫹ d1, yk⫹1 ⫹ d2)兩 (1a)
&1, d
(d &2) = arg min MAD(d1, d2) (1b)
translational motion estimation, not rotational motion. How-
ever, more sophisticated algorithms using the same approach where & d1, &
d2 = displacements in the horizontal and vertical
exist to account for rotating objects. Because the search range directions, respectively, corresponding to the minimum of the
for blocks is determined by a distance criterion, typically sum of the absolute differences, MAD, for the current macro
known as a ‘‘search window,’’ block-based matching is also block; p(xk, yk) = gray scale pixel values at xk, yk location
called a ‘‘spatial domain search approach.’’ within the current macro block in frame k; and p(xk⫹1 ⫹ d1,
The block matching method that was employed in this study yk⫹1 ⫹ d2) = gray scale pixel values at xk⫹1 ⫹ d1, yk⫹1 ⫹ d2 in
is a subalgorithm of the M.P.E.G. II based on the minimum frame k ⫹ 1, as seen in Fig. 2.
absolute difference-matching criterion. The best motion vector
is computed by searching for the minimum absolute difference
Search Strategy
To find the best matching macro block in the closest prox-
imity relative to its original position in the reference frame, a
spiral searching path was implemented in the algorithm. The
search starts from the center of the search window, seeking
the best matching macro block in the current frame by scan-
ning through all the pixels within the search window, as illus-
trated in Fig. 3. As the macro block travels within this search
range in the current frame, the absolute difference of each
pixel grayscale value is computed for each possible position.
At the end of this process, a motion vector is drawn starting
from its original position in the reference frame to the current
position in the current frame where the minimum of the com-
puted absolute differences is found, i.e., when (1) is satisfied.
Using this strategy, however, may not reflect the actual dis-
placement vectors in the corners and the sides of the image
frames because of the constrained motion of the macro blocks
within the search window. This condition is also shown in Fig.
3. Considering this limitation, it is recommended that the dis-
FIG. 1. Geometrical Parameters Used in Block-Based Match- placement fields at these regions be evaluated with the neigh-
ing Method borhood displacement vectors computed in the vicinity of
JOURNAL OF COMPUTING IN CIVIL ENGINEERING / APRIL 1999 / 117
significant limitations on the number of frames acquired and Description of Algorithm Built Into MATCH
processed per second and the selection of the suitable macro MATCH was developed in the Matlab environment in text
block size, even though the IMAQ PCI 1408 has an acquisi- format, having subfiles for the analysis of the input data as
tion rate of 30 frames/s. This restriction was eliminated by well as the presentation of the results. Matlab (Student 1995)
first saving all necessary image frames onto a disk and sub- is a powerful programming language oriented to scientific
sequently analyzing them. This allowed the selection of vari- computation using data elements in matrix form. A sketch of
ous image acquisition rates and macro block sizes for the var- the filtering algorithms for MATCH is given in Fig. 5. As
ious tests conducted at different displacement rates. indicated in the figure, there are four levels of filter algorithms
built to match particles between two sequentially acquired im-
ALTERNATIVE METHOD FOR PARTICLE TRACKING — ages. In the first-level filter, particles are matched based on a
MATCH minimum translation criterion. This criterion is defined as the
particles in the previous frame that match the particles in the
Considering that granular particles are accumulations of next frame having the smallest translation relative to the pre-
rigid particle groups, their motions under loading conditions vious frame. The results of this operation are described in Fig.
can be regarded as coupled rotations and translations within 6 as matching particle 1 with particle 5, particle 2 with particle
the media, unless the loading conditions lead to significant 5, particle 3 with void 8, and void 4 with void 7. Because of
particle deformation or breakage. Based on this observation, the overlapping problem in the image frames, some particles
the displacement fields of granular particles were determined may be lost in the next frame, and the first-level filter may
using digital image analysis techniques on the captured image result in some particles in the previous frame that were
frames in a certain time interval. To track individual particles matched with only one particle in the next frame. This con-
using this method requires determining the particle centroid dition is also shown in Fig. 6 as the matching of particle 2
locations. Particle overlapping can cause tracked particles to with particle 5 even though particle 2 is further away relative
be temporarily hidden between successive images. This situ- to particle 5 as compared with the location of particle 1. This
ation requires significant effort from the user to ‘‘find’’ the discrepancy is eliminated using the second-level filter based
‘‘lost’’ particle in the subsequent images. The algorithm de- on the results of the first-level filter. Because the regions be-
veloped for MATCH is, on the other hand, capable of auto- tween particles (voids) are also defined as particles in the anal-
JOURNAL OF COMPUTING IN CIVIL ENGINEERING / APRIL 1999 / 119
FIG. 8. Calculated Displacement Vectors for Image Frame Shown in Fig. 7 (10 Times Scaled Displacement Vectors for Visual Clarity)
captured per second that can eliminate the effects of accu- lighting conditions because of the difficulty in the seg-
mulated noise and other test variables between frames. The mentation process. However, it can be efficiently used by
noise generated from the hardware system as well as the light- spreading dark sand particles, e.g., foundry sand parti-
ing conditions were measured to be around 6 pixel grayscale cles, at the interface region to help detect displacement
levels (out of 256 pixel gray-scale levels) during the image fields. Dark foundry sand particles are easily distinguish-
acquisition. Using the frame averaging technique, it was re- able from the other granular materials and produce high
duced to 2 gray-scale levels before recording the image contrast in digital images that can minimize the manual
frames. However, the generated displacement vectors using the work for the restoration of boundary discontinuities prior
block-based matching method were successful in capturing to the image analysis. Although this method of particle
rapid deformations with an acceptable bias. tracking is reliable, only a limited number of particles
can be analyzed due to significant loss resulting from the
CONCLUSIONS overlapping problem.
Determination of particle displacements by means of the 2. BMAD is fairly effective and efficient in analysis of im-
digital image analysis techniques was investigated using two age frames without rigorous hardware requirements. It
different approaches: the particle matching analysis with does not include manual modification of already captured
MATCH and the block-based matching method implemented frames, and the algorithm use is fully computerized,
in BMAD. Both algorithms were tested and evaluated in terms which speeds up the acquisition, analysis, and presenta-
of their efficiency, accuracy, and practicality in the study of tion of the results. In addition, the algorithm is capable
particle displacements using sequences of images of deforming of detecting particle displacements nearly equivalent to
Ottawa sand particles. The following observations can be the particle segmentation technique, provided that the re-
made in terms of the developed methods: quired input parameters (macro block size and search
window) are defined appropriately. The measurement of
1. The algorithm for MATCH, based on the particle seg- noise in the acquisition system showed that the lighting
mentation technique, may not be practical at low contrast condition and hardware system can produce a certain
images produced by granular materials having transpar- range of change in the pixel intensity levels, which may
ent crystalline structures (e.g., Ottawa sand) or poor affect the accuracy of results that are generated by the
JOURNAL OF COMPUTING IN CIVIL ENGINEERING / APRIL 1999 / 121
FIG. 9. Distribution of Average Horizontal and Vertical Displacements for Image Frame Shown in Fig. 7
block-based matching method at high noise levels. In this methods in studying soil characteristics,’’ MS thesis, Civ. and Envir.
case, the frame-averaging technique can be employed to Engrg. Dept., University of Wisconsin-Madison, Madison, Wis.
Gustafsson, L., and Gustafsson, P. (1996). ‘‘Studying mixed granular
reduce the noise for the stability of the analysis results. flows by image analysis.’’ Proc., 11th Conf., ASCE Engrg. Mechanics
Div., ASCE, Reston, Va., 100 – 103.
ACKNOWLEDGMENTS Gustafsson, L., and Marklund, O. (1995). ‘‘Image analysis of fine grain
granular flow.’’ Proc., 10th Conf., ASCE Engrg. Mechanics Div.,
This research was performed with financial support from the National ASCE, Reston, Va., 614 – 617.
Science Foundation Grant CMS-9302281 and U.S. Air Force Office of Hryciw, R. D., and Raschke, S. A. (1996). ‘‘Development of computer
Scientific Research Grant MIPR-93-0031. The Turkish Ministry of Na- vision technique for in situ soil characterization.’’ Transp. Res. Rec.
tional Education provided financial support to the first writer. The con- 1526, Transportation Research Board, Washington, D.C., 86 – 97.
tributions of Mr. Seyfullah Oguz and Mr. Keith Ligler are also gratefully Hryciw, R. D., Raschke, S. A., and Donohoe, G. W. (1996). ‘‘Microde-
acknowledged. formations in sands by digital image processing and analysis.’’ Transp.
Res. Rec. 1548, Transportation Research Board, Washington, D.C.,
APPENDIX. REFERENCES 31 – 37.
Hryciw, R. D., and Irsyam, M. (1993). ‘‘Behavior of sand particles around
Donohoe, G. W., and Bocabella, M. F. (1991). ‘‘Segmentation and object rigid ribbed inclusions during shear.’’ Soils and Found., 33(3), 1 – 13.
tracking for the microstructure analysis of soil.’’ IEEE, 1 – 2(2), LabVIEW威 for Windows tutorial. (1994). National Instruments Corpora-
1215 – 1219. tion, Austin, Tex.
GLOBAL LAB IMAGE娃 user manual. (1994). 5th Ed., Data Translation Student edition of MATLAB威 Version 4 user’s guide. (1995). Prentice
Inc., Marlboro, Mass. Hall, Englewood Cliffs, N.J.
Guler, M. (1997). ‘‘Applications of digital image analysis and processing Tekalp, A. M. (1995). Digital video processing. Prentice Hall, New York.