You are on page 1of 6

Object Extraction in Data Mining Framework for Video Sequence

Prof. Manish Manoria Samrat Ashok Technological Institute, Vidisha,M.P.,India

Ms. Stuti Dave Samrat Ashok Technological Institute, Vidisha, M.P., India

Abstract - We are aware that the emerging video coding standard such as MPEG-4 enables various contentbased functionalities for multimedia applications. To support such functionalities and also to improve the coding efficiency, each frame of an image sequence is decomposed into video object planes (VOP’s). Each VOP corresponds to a single moving object in the scene. This paper proposes an algorithm of key object(s) extraction from video database. Here we describe a framework of data mining by applying segmentation and enhancement based technique to the image and video data set, for the purpose of knowledge discovery. The objective of this particular segmentation algorithm is to segment the huge image and video data sets in order to extract important objects from them. This proposed method covers both spatial and temporal aspects of data mining. The video data set is parsed to create the image data set by preserving temporal information, then the background subtraction method is applied to get the moving object, and then double differencing operator is applied to get better result. The gamma enhancement function is applied with histogram equalization with a number of different parameters to improve the contrast of the resultant images. This method is thus able to detect moving object(s) with surprisingly good location capability, and eliminate noise, which occurs due to camera movements. The proposed approach is applied to a traffic video data set to demonstrate the segmentation for data mining of video database. KEYWORDS: Video mining, Video object segmentation, background subtraction, enhancement technique. 1 Introduction There is an enormous need for visual information management in the growing field of medical imaging and telemedicine, traffic monitoring etc. In particular, image understanding form image database queries and retrieval are major topics of research [1,2]. This newly emerging field combines aspects from databases, image processing and understanding, knowledge-based systems and context-based compression. Thus this growing amount of video information requires efficient management, and to support more efficient video database management, a video segmentation method has become necessary. Segmentation is one of the most challenging tasks in the field of video mining, since it lies at the base of virtually any scene analysis problem. The general approach that motivates the need for segmentation is that the problem of analyzing a complete scene can be subdivided into a set of simpler problems, of analyzing its primitives. Then, each primitive object in the scene can be processed independently [3][4]. This approach greatly simplifies many high-level vision problems, such as recognition, classification, scene analysis, etc. However, the ultimate goal of the segmentation process is to divide an image into the physical objects composing it, so that each region constitutes a semantically meaningful entity. In order to identify and track the temporal and relative spatial positions of objects in video sequences, it is necessary to have object-based representation of video data. For this purpose, attention has been devoted to segmenting video frames into regions such that each region, or a group of regions, corresponds to an object that is meaningful to human viewers [7, 8]. While most of the previous works [5] [6] are based on low-level global features, such as color histogram, shape and texture feature, our method focuses on obtaining object level segmentation; obtaining objects in each frame and their traces across the frames. There has been a large amount of researches [18, 19] to find object from video sequence when the segmentation problem is considered for a fixed camera domain, a usual technique is required to resolve the foreground


thus. Video parsing divides large video sequence in to frames or images. The proposed background substraction method is applied which is able to detect moving object from each frame. 1. This involves the creation of a background model that is subtracted from the input image to create a difference image.e. [12] suggested a different segmentation technique based on change detection. Here accumulating and averaging images of the target area in some time interval construct a reference frame. then global motion compensation be applied first. Step1: Once reference frame of stationary component is created. Prior to performing segmentation and extraction. It is able to detect moving points with surprisingly good location P21/2 . 14] have addressed the problem of object segmentation and tracking using an active camera. The method assumes that the objects are moving over a static background. Those pixels resulting from new (moving) objects will generate a difference not equal to zero. The new difference image only contains objects or new features that have not yet appeared in the background.1 Background subtraction Background subtraction is a technique to remove nonmoving components from a video sequence. Few references [13. s = clog (1+|dij|) (1) Where dij is the value for the difference at pixel ij Step3: The double-difference operator (also called three-frame difference) has been applied to improve the performance of background subtraction. It is a temporal data because it contains before-after sequence relationship that is first frame comes before second frame and second frame comes after first frame. 2 Video Objects Extraction Figure 1 depicts the diagram of the proposed object extraction scheme. Potential foreground regions are detected in a preliminary stage by applying a higher-order statistics (HOS) test to a group of inter-frame differences. which is very inefficient and non-flexible This method is thus able to detect moving object(s) with surprisingly good location capability. where the backgrounds remain still.The results are scaled by eq. Video file Image Database Background Subtraction Object Detection Perform gamma correction Create negative image Improve contrast Object extracted Figure 1 diagram of the proposed object segmentation and extraction method The number of images/frames per second gives motion in video. background subtraction [9]. 2.objects i. Neri et al. The non-zero values in these difference frames are due to moving objects. The main assumption for its application is that the camera remains stationary. if a moving camera is detected. the reference frame is subtracted from any subsequent images. a video database is created. The basic principle is to create a reference frame of the stationary components in the image. This method is especially suitable for video conferencing [10] and surveillance [11] applications. The image sequence used consists of about 16 minutes of video from a traffic intersection with approximately constant lighting conditions. Step2: In the video sequences the nonmoving objects were manually selected from the video data and then averaged together. Then reference frame of stationary component is created. they cannot able to give spatial information of moving object. (The difference image is created by subtracting the reference frame from the current image) .

For simplicity and real-time processing purpose. which occurs due to camera movements and able to filter very small moving objects in the scene.[16]. Hereafter. here different perimeters are tried to obtain best result.j) = 0 otherwise (3) The non-zero values in these difference frames are either due to noise or moving objects. Eq.j) .j) > T ) D` Dri (i. we sketch the double-difference operator.3 which perform a logical AND between pixels belonging to two subsequent difference-images. The original video frames were of size 390 rows 510 columns. 3 Experimental Setup We have applied the proposed scheme to the traffic video sequence in our experiments. we made our test video clips by extracting frames from these originals at the rate of 4 frames per second.I r.i-1(i. The color video clips used for this study were originally digitized in AVI format at 16 frames/second. Dri (i.2 defines the difference-image. The color video sequence consists of about 10 minutes of video from a traffic intersection with approximately constant lighting conditions. As mentioned above.j) = [ Iri(i. A small portion P21/3 . which used background subtraction method. In this paper the computation of images has performed on gray level images because the gray level of the images or region is having uniform intensity.j) ] (2) Step 4: The double-difference image is obtained by eq. threshold by T 1. we transform the color video frames to gray scale images and resize them to half of the original size (195 rows 255 columns). The intensity of the resultant image is improved by gamma correction. 24bit color.j) >T ) ∧ ( Dri (i. constructed the reference by accumulating and averaging images of the target area for some time interval. The segmentation algorithms usually start with the gray value difference image between two consecutive frames. and eliminate noise. To reduce computation time. Then the gamma correction function is applied to improve the contrast of the resultant image as shown in figure 3. Their resolution is 195 x 255 pixels. this is not a robust technique as it is sensitive to intensity variations [15]. if (Dri+1 (i.capability. Some approaches [17] or [12]. 2(a) Reference frame 2(b) Frame 4 2(c) key object extracted from frame 4 Figure 2: Example result of background subtraction Figure 2(c) is the resultant image having key object occurring after applying the background substraction algorithm. The intensity change in data flow can very well be observed in gray level.

The extracted key object is shown in the third column (Figure 2(d)). and documentary. and animation).3. 3. The second column (Figure 2(b)) shows the original frame. movie. 1. Those pixels resulting from new (moving) objects will generate a difference not equal to zero .of the traffic video is used to illustrate how the proposed framework can be applied in various kinds (i. This proposed framework. By using this background subtraction method the accuracy of segmentation is increased and this thus provides support for real-time processing.5. 1. 2. Figure 3 shows the result gamma corrected images with parameters 0. Figure 3 gamma corrected frame with parameters 0.3.1 Figure 4 Histogram before Equalization (a) and After Equalization (b) P21/4 .5. In Figure 2. This process can be done in real-time or off-line. The result shown in figure 5 shows the improved intensity of the resultant frame compared with original one. The segmentation results for a few frames are shown in Figure 2 along with the original frames adjacent to them. The reference frame is subtracted from any subsequent images.. 2. TV dramas. The figure 2(c) shows the images after background subtraction.e. however can deal with more complex situations with more accuracy. Some of the objects. are extracted in single segment. 3. the frame in the left most column (Figure 2(a)) is the background reference frame. 3. TV commercials.1.1 Experiment Results The enhanced background subtraction method to the video sequences is able to remove nonmoving components from a video sequence. The main principle is to create a reference frame of the stationary components in the image. which is able to detect moving points with amazingly good location capability.The double-difference operator is used. which are closely located to each other. Related work has been done based on image processing and rule-based reasoning. and is proved robust to noise due to camera movements and able to filter very small moving objects in the scene. Here we applied the gamma correction and tried different perimeters to increase the contrast of the resultant image.

M. IASTED. The main assumption underlying by proposed algorithm is that a motion characterizes physical objects that is separate from background. Christos Faloutsos.No. Speech. Jiawei Han.2002. The proposed work extract small moving component(s) from image sequence and therefore this opens scope for possible future work in the area of doing all operation in image processing. By considering more than one reference frame in the segmentation process. Dragutin Petkovic. Using image mining for image retrieval. Eduardo H. 3 R. Data Mining Techniques. IEEE Transactions on. 2657. First SIAM International Conference on Data Mining. Glasman.2002. The existing schemes try to extract key frames from the video shot. conf. Will Equitz. F.Knowledge. Myron D. 2002. the algorithm is able to perform the correct segmentation and show the position of object in each frame. Maxico. A. 2002 P21/5 . and Signal Processing (ICASSP'97) Volume 4. References 1. Michael C.pp [4-9]. 214-218. background subtraction techniques are employed. SIGMOD.India under RPS grant F. Duisburg. Mclean. Ron Barber.Volume. DBLP. Wollborn. "Geoplot": Spatial Data Mining on Video Libraries. Hosticka. CIKM. It is easy to implement and fast to compute since it uses the segmentation result of the previous video frame to speed up the segmentation process of the current video frame. The algorithm is based on background substraction method. May 19-21. using color. Circuits & Syst. November . Here we proposed a simple and efficient technique for object segmentation in video sequence. and shape Carlton W. Management. Experimental results demonstrate that proposed technique can successfully extract moving objects from video sequence. Publication Date: Feb. Volume: 4.. 4 Xiaodong CAI. Mech.H. The boundaries of the extracted objects are accurate enough to place them in different frames. Issue: 6 On page(s): 863-870 8 Jia-Yu Pan and Christos Faloutsos. 1997 IEEE International Conference on Acoustics.Issue:2." p. Mining Patterns of Activity from Video Data. Unsupervised texture segmentation of images using tuned matched Gabor filters. Cancum. clusttering and association mining on video data set. both the efficiency of the segmentation process and the accuracy of the segmentation results are improved achieving more accurate video indexing and annotation. Fraunhofer Inst.. and the global motion estimation and compensation.Stanchev. This work opens scope for futher study on data mining work. 5. Conclusion This paper introduces an algorithm for key object extraction for segmentation in video sequences. Niblack. but in this proposed scheme is able to extract key object(s) instead of key frame(s). B. Burl. April 1993. P21 7 Teuner. which occurs due to camera movements.Ali and E.New Delhi. In Proceedings of the Eleventh International conference on information and.4. "A Noise Robust Method for Segmentation of Moving Objects in Video Sequences. 1996. 1997. Image Processing.-8022/RID/NPROJ/RPS-14/2003-04.12. If there is insufficient motion. texture. Department of Computer Science University of Colorado. and Gabriel Taubin .J. pp: 545 [Conf] 2. Flickner. of Microelectron. Using the background subtraction technique. In order to extract the key object(s) from the video sequence.2003 6 QBIC project: querying images by content. the motion can be estimated by comparing each frame with more than one reference frame so as to detect all the information of video scene. [173-187] Paper No. pp. Boulder.Stipidis ‘An Integrated framework for Robust and Fast Automatic Video Segmentation’ Communication Research Group School of Engineering and Information Technology University of Sussex.On page(s): [122-129] P21-5 5 P. It is able to detect moving points with surprisingly good location capability. Acknowledgement This work was supported by all India council of technical education AICTE). VA (near Washington DC). CSE. Jun 1995.Pichler. and eliminate noise. Peter Yanker.

-J.DBLP. Russo. J. “Automatic segmentation of moving objects for video object plane generation”. September 1998. “Motion detection and segmentation using image mosaics. and L. Tsotsos. pp:199-207 [Journal] 10 C. IEEE Int. 18.N. No. Meier and K. 1998. July 2000.T.N. Multimedia and Expo. pp. Ngan. Larry S. K. 15 Cheung. SPIE Electronic Imaging. F. Conf.9 YuriA. n:2. and M. 2000.Bobick. Sun. Davis. Automatic moving object and background separation. tilt. D.W. Tokyo. P.5. on Circuits and Systems for Video Technology. JohnLiu. 8. Colonnese. Y. Japan. IEEE Workshop on Visual Surveillance.1998.Doc. USA. “Implementation of a real time object-based virtual meeting system. Robust Techniques for Back-ground Subtraction in Urban Traffic Video". Ngan.. Harley. Nara.[10-17]. Vol. Conf. “Tracking a person with pre-recorded image database and a pan. pp.. Ivanov. “W4: Who? When? Where? What? A real-time system for detecting and tracking people. [222227]. Chang. Ismail Haritaoglu. Kamath. pp. San Jose 2004 16. Davis: A Fast Background Scene Modeling and Maintenance for Outdoor Surveillance. August 2001. Harwood.Neri. ISO/IEC JTC1/SC29/WG11 MPEG97/m2238. K.” in Proc. NY.” in Proc. P21/6 . K. and zoom camera. G. v:37. IEEE Int. Bennet. Japan. Aaron. 11 I. [565-568]. Meier. 12 A. T. [219-232]. Chen. July 1997. Signal Processing 66 (1998). 1577-1580. In Video Comm and Image Proc. Y. International Journal of Computer Vision. Haritaoglu. Conf. IEEE Trans. IEEE Int. 13 Y.S. and K. Ye. S.-T. Lin. 14 Hat.” in Proc. and P. M.-C. pp. C. Multimedia and Expo. ICPR 2000: 4179-4183 17. Saptharishi. Khosla.Fast Lighting Independent Background Subtraction’. and E. Automatic Face and Gesture Recognition. David Harwood.” in Proc. Automatic segmentation based on Hausdorff object tracking. Talone. pp.