Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.

com Volume 2, Issue 2, March April 2013 ISSN 2278-6856

Recognition of Polyps in the Images of Wireless Capsule Endoscopy

Kukushkin Alexander1, Mikhaylov Dmitry2, Zhukov Igor3, Starikovskiy Andrey4, Konev Vladimir5, Tolstaya Anastasia6, Khabibullin Timur7
1,2,3,4,5,6,7

Youth Engineering Centre, National Research Nuclear University MEPhI, Kashirskoye highway, 31, 115409, Moscow, Russian Federation

Abstract:

This article is devoted to description of the software module that allows recognition of polyps in gastrointestinal tract. It detects the convexity in the pictures of the wireless capsule endoscopy and shows its location in the gastrointestinal tract images. This method uses a colour image from the endoscopic capsule that is converted into black and white colour scheme. After analysing the brightness value of each image pixel and creating the 3D image the surface curvature in each pixel is measured. Derivatives are taken and the set of lattice points is formed. As a result of this selection the elements that exceed a predetermined level are obtained. That means that there is a polyp in the original image at the pixel corresponding to this element.

processing of endoscopic capsule images that assists the physician in pre-analysis identifying problem areas, such as polyps. Some existing developments demonstrate the capabilities of decision-making systems to detect areas with abnormalities in endoscopic capsule images. Such forms of image recognition significantly reduce the time of records reading and make the process more confident [3]. This article describes the work of the software module that determines such pathology as presence of polyps in the gastrointestinal tract of a patient.

2. PRE-PROCESSING OF IMAGES
In the diagnosis of the gastrointestinal tract wireless capsule travels taking two images per second and by the end of the examination there are more than 57 000 images. After that images are transmitted by means of radio frequency to a sensor array in a belt placed around the patients abdomen and from there to a recording device on the belt. [1] When the examination is completed the recording device is removed and the images are transmitted to a desktop computer for further processing. In the end this images are analysed by a physician [4]. In order to accelerate the process it is proposed to use the following tools and algorithms for optimizing and automating the analysis of the images transmitted by wireless endoscopic capsule. 2.1 Removal of Repeat Frames Consider a stream of frames [a1 an], with a degree of similarity between the frames given by d(ai, aj) (the lower the d, the more similar the frames are to each other). The stream is divided into a minimum number of pieces, such that each piece [ak al], d(ak, a i) < D for all i, in other words, so that the frames in that piece are not too different from each other. Only the first frame needs to remain for viewing by the physician. D is selected experimentally, and is typically around 0.5 (roughly in the interval 0.35 to 0.65). D can also change during the viewing the process, and can be adjusted by the user. Page 485

Keywords: polyp, convexity, dimension, pixel, curvature, brightness value, capsule endoscopy.

1. INTRODUCTION
The wireless capsule endoscopy is a modern technology that gives a possibility of the non-invasive examination of the gastrointestinal tract organs of a person. Capsule endoscopy is a way to record images of the digestive tract for use in medical examination and diagnosis. A typical capsule is the size and shape of a large pill and contains a miniature camera. After a patient swallows the capsule, the camera takes pictures as it traverses the inside of the gastrointestinal tract of the patient. [1] The primary use of capsule endoscopy is to examine areas of the small intestine that cannot be seen by other types of endoscopy, such as colonoscopy or esophagogastroduodenoscopy (EGD). The ability of capsule to make an automatic analysis is now of great interest because of its potential in recognition of pathologies in any part of gastroenterological tract [2]. The capsule can be retained in the stomach and/or intestinal tract for a relatively long period of time, as much as 6-12 hours, and waiting for the capsule to reach various areas of interest in the gastrointestinal tract might require several hours of a physicians time. Also, review of images requires a high degree of concentration by the physician, if performed in real time mode. Accordingly, there is a need in special software for Volume 2, Issue 2 March April 2013

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 2, March April 2013 ISSN 2278-6856
2.2Automatic Speed Adjustment In addition to deleting some of the frames, each piece of the stream can be shown in the same amount of time, despite having different numbers of frames. For example, long pieces with many frames can be shown at higher speed, while short pieces can be shown at normal speed. If a physician can view and comprehend F different frames per second, then each piece can be displayed in 1/F seconds. For a piece of length L (i.e., L frames), the playing speed is L/F per second. A typical value of F is 2. image can be converted into the 3D picture. After this procedure recognition of the polyp placement begins. In this case the surface curvature of the 3D image at each pixel is measured. Finally by formula (1) the curvature of the Gaussian at each pixel of the model is calculated [5], [6].

(1) curvature value. Fx ; Fxx ; Fy ; Fyy ; Fxy derivatives in the pixel on the corresponding oriented line. Derivatives are obtained by applying Sobel operator. To calculate the derivative of Fxy Sobel operator is applied consistently for the y-axis and x-axis [5].The resulting derivatives are shown in Figure 2. The red colour indicates the positive value of the derivative, blue negative.

3. TWO-STEP RECOGNITION OF POLYPS

Analysis of medical images often requires a number of analysis techniques. The described software module can be used for image analysis in wifeless capsule endoscopy during the polyp examination of the gastrointestinal tract. It is based on the analysis of the curvature of threedimensional (hereinafter 3D) surface to reveal the lumps of the gastrointestinal tract. The proposed method can be explained in two steps: mathematical model and image noise smoothing. 3.1. Mathematical Model The software module that detects polyps in gastrointestinal tract is based on the analysis of the convexity in the images of the wireless capsule endoscopy. It shows location and size of abnormalities and pathologies in the digestive tract. The described software module uses a colour image from the endoscopic capsule that is converted into black and white colour scheme (Figure 1). As a result of this operation the following image can be accepted:

Figure 2: Derivatives of the original images.: (a) Fx, (b) Fx2, (c) Fy, (d) Fy2 ,(e) Fxy. After taking the derivatives the curvature of the Gaussian and the average curvature for each pixel of the image are calculated [6]. It is an intrinsic measure of curvature. Curvature value depends only on how distances are measured on the surface. In Figure 3 the images of calculated Gaussian curvature and the average curvature for each pixel are shown.

Figure 1: The supposed approximate model of polyp. The mathematical model assumes that the polyp is an abnormality in a shape of a convex in relation to the surrounding landscape and it has a form of a perfect sphere. In its centre this sphere has brightness significantly greater than on the periphery. For each pixel of the image the value of brightness is calculated. The brighter the pixel is the bigger number it corresponds to. Then the brightness value at each image pixel is analysed. According to these numbers and analysed brightness value the two-dimensional (or 2D) Volume 2, Issue 2 March April 2013

Figure 3:

curvature of the Gaussian, (b) average curvature.

Page 486

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 2, March April 2013 ISSN 2278-6856
Thus, we form two 2D sets of lattice points G (Gaussian) and M (Mean) in mxn size (m number of pixels in the original picture horizontal; n vertical). Elements of the set of lattice points G(i,j) are the values of the Gaussian curvature at points (i, j) [6]. For the set of lattice points M the situation is the same. The more the curvature is incurved the bigger value G has. The value of M is positive if the surface of the curvature is gibbose and M is negative if curvature is concave. From these sets of lattice points G and M the set of lattice points P (Polyp Curvature) is formed. All elements of P are defined according to the formula (2): P(i,j) = G(i,j) * min(0;M(i,j)) (2) As a result, smoothed images are obtained that enhances the quality of the analysis and improves accuracy of recognition of polyps in the gastrointestinal tract of a person.

4. RESULTS
The method of recognition of polyps in the gastrointestinal tract images using a wireless capsule endoscopy was experimentally verified. 76 images of the gastrointestinal tract were taken: 26 of which were with polyp and 50 without it. Inaccuracy was the following: in 4 images algorithm has not found polyp although it took place; in 5 images algorithm has found polyp where it actually was not. The quality of the camera that takes images of the gastrointestinal tract greatly affects algorithm accuracy. However, the described algorithm is going to be improved.

As a result of this selection the elements that exceed a predetermined level are obtained. That means that there is a polyp in the original image at the pixel corresponding to this element. In Figure 4 Polyp Curvature for the image is shown. Bright pixels indicate presence and location of the polyp.

4. CONCLUSION
The proposed software module for recognition of polyps in the images of wireless capsule endoscopy gives the possibility to recognize the presents of such abnormalities and pathologies as polyps in the digestive tract and to determine their place automatically using capsule reading software. Such a specialized method that continues to change and improve is designed to detect polyps, as well as to allow easier reading and facilitates rapid diagnosis of such a gastrointestinal disease.

Figure 4: Polyp Curvature for the image. Bright pixels indicate the location of the polyp. 3.2. Image Noise Smoothing However, in real situation there is a fact that in image conversion of colour scheme into black and white colours so-called "grain" becomes noticeably. "Grain" is an interchange of pixels with relatively high and small value of brightness. While converting into a 3D model these pixels will become stages with a large difference in height. It affects curvature calculation and accuracy of the analysis goes to decline. That can lead to a mistake detection of polyp in the place it does not actually exist. In order to prevent this, inaccuracy smoothing (Gaussian Blur) is applied. Gaussian smoothing is used in order to enhance image structure at different scales and to reduce image noise [7]. To smooth the original image as well as derivatives radiuses of Gauss kernels rI and rdI were defined experimentally. Experiments carried out show the following coefficients for image noise smoothing: rI = 3, rdI = 27 = 0.9. Volume 2, Issue 2 March April 2013

Acknowledgment
We would like to thank PhD in medical sciences, doctor of higher category of The Clinical Moscow, Russian Federation Gubaidulina Landish Ildousovna as well as Fedorov Evgeny and Ivanova Ekaterina from Moscow University Hospital , Russian Federation for their support and inestimable contribution in this study.

References
[1] Zhukov Igor, Fedorov Evgeny, Mikhaylov Dmitry, Ivanova Ekaterina, Kukushkin Alexander, Starikovski Andrey, Tolstaya Anastasia. The method of image shrinking for the wireless capsule endoscopy. International Journal of Image, Graphics and Signal Processing (IJIGSP), ISSN Print: 20749074, ISSN Online: 2074-9082, Volume 4, Number 3, April 2012. [2] Alexander Kukushkin, Mikhaylov Dmitry, Ekaterina Ivanova. Recognition of Hemorrhage in the Images of Wireless Capsule Endoscopy. The 16th IEEE Page 487

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 2, March April 2013 ISSN 2278-6856
Mediterranean Electrotechnical Conference MELECON 2012. Conference Guide. C 99. [3] Ivanov M.A. - Endoscopic capsule complex Landish. Scientific session of NRNU MEPhI 2010. XIII International Telecommunication conference "Youth and Science". In 3 Parts. Part 2 // Moscow, NRNU MEPhI, p. 276, p.202-203. (2010). [4] Timur Khabibullin, Ph.D. candidate of National Research Nuclear University MEPhI, Moscow, Russia. Youth Engineering Centre, Computer Systems and Technologies Department.

-203.) [5] Eliakim R, Fischer D, Suissa A, Yassin K, Katz D, Migdal M, Guttman N. Wireless capsule video endoscopy is a superior diagnostic tool compared to barium folloew through and CT in patients with suspectrd Crohns disease. Europ J Gastroenterol Hepatol 2003; 15: 363-367. [6] Roberto de Franchis, Blair S. Lewis, Daniel S. Mishkin. Capsule Endoscopy Simplified - Slack Inc. 160p. (2010). [7] Klaus Engel, Markus Hadwiger, Joe M. Kniss, Christof Rezk-Salama, Daniel Weiskopf. Real-Time Volume Graphics. // A K Peters, (2006). [8] Khnel, Wolfgang. Differential Geometry: Curves Sur-faces - Manifolds. // American Mathematical Society, (2006). AUTHOR
Alexander Kukushkin, graduate of National Research Nuclear University MEPhI, Moscow, Russia. Youth Engineering Centre, Computer Systems and Technologies Department. Dmitry Mikhaylov, PhD, associate professor of National Research Nuclear University MEPhI, Moscow, Russia. Youth Engineering Centre, Computer Systems and Technologies Department. Igor Zhukov, Doctor of Engineering Science, Professor. National Research Nuclear University MEPhI, Moscow, Russia. Computer Systems and Technologies Department. Andrey Starikovskiy, teaching assistant of National Research Nuclear University MEPhI, Moscow, Russia. Youth Engineering Centre, Computer Systems and Technologies Department. Vladimir Konev, Ph.D. candidate of National Research Nuclear University MEPhI, Moscow, Russia. Youth Engineering Centre, Computer Systems and Technologies Department. Anastasia Tolstaya, graduate of National Research Nuclear University MEPhI, Moscow, Russia. Youth Engineering Centre, Department of Management and Economics of High Technologies.

Volume 2, Issue 2 March April 2013

Page 488