Tuyn tp Bo co Hi ngh Sinh vin Nghin cu Khoa hc ln th 6

i hc Nng - 2008

T NG NHN DNG BIN S NG K XE TRONG NH CHP T CAMERA

AUTOMATIC LICENSE PLATE RECOGNIZATION IN CAMERA PICTURES SVTH: DON T PHC
NGUYN NG HI PHNG Lp: 05D1, Trng i hc Bch Khoa

GVHD: THS TRN THI ANH U

Khoa in k thut, Trng i hc Bch Khoa
TM TT Nghin cu ny trnh by mt cch tip cn trong vic xc nh v nhn dng bin s ng k xe ca Vit Nam vi d liu u vo l nh chp t camera. gii quyt vn ny, nghin cu phi gii quyt ba bi ton ring r l: xc nh v tr bin s xe, tch k t v nhn dng cc k t. Phng php xuyn sut c s dng trong nghin cu ny gii quyt cc bi ton t ra l phng php Hnh thi hc. Ngoi ra, nng cao hiu qu trong vic xc nh v tr bin s xe, nghin cu s dng thm Php bin i Hough. Nghin cu tin hnh thc nghim trn c s nh chp bin s ng k xe my ca Vit Nam v a ra nh gi v mt hiu qu ca phng php c s ng ng thi a ra nhng hng p dng nghin cu ny. ABSTRACT This study presents an approach to Vietnamese license plate localization and recognition in camera picture. To deal with this problem, this consist three main modules: License Plate detection (LPD), License Plate Character segmentation and Optical Character Recognition (OCR). The main method used in this study to deal with modules is Morphology. Besides, we also uses Hough Transformation to enhance the effect of detecting License Plate region. This study does an experiment in the input database of Vietnamese License Plate pictures and evaluates the effect of the methods used in the research and also presents the application of this research.

1. M u: Cng vi s pht trin ca khoa hc k thut v nhu cu i li ngy cng tng s lng phng tin giao thng trn ng ngy cng xut hin nhiu. Vi s lng phng tin giao thng ln v cn khng ngng tng ln nh vy lm ny sinh nhiu vn trong vic kim sot cng nh qun l cc phng tin. gii quyt vn ny nhu cu t ra l p dng cc h thng t ng. Mt trong nhng h thng nh vy l h thng t ng nhn dng bin s xe l h thng c kh nng thu nhn hnh nh cng nh l c v hiu cc bin s xe mt cch t ng. Mt h thng nh vy c th c s dng trong rt nhiu cc ng dng chng hn nh: trm cn v ra xe t ng hon ton, bi gi xe t ng, kim sot lu lng giao thng hay trong cc ng dng v an ninh nh tm kim xe mt cp Nh mi h thng t ng khc, h thng nh vy cng s yu cu c c phn cng ln phn mm. Phn cng ca n c phn chnh s l mt camera c tc dng thu nhn hnh nh cn phn mm s c tc dng x l hnh nh . Vi s pht trin ca k thut in t, cc camera s d dng c kh nng thu nhn c hnh nh do m vn t ra v lun l vn quan trng nht trong h thng, quyt nh tnh hiu qu ca h thng x l nh nh vy s l phn mm x l nh. Vi vai tr nh phn tch trn nghin cu ny tp trung vo gii quyt cc vn t ra khi x l nh a ra chnh xc bin s ng k xe.

91

Tuyn tp Bo co Hi ngh Sinh vin Nghin cu Khoa hc ln th 6

i hc Nng - 2008

Vi s ph bin ca xe my trn cc ng ph Vit Nam nghin cu tp trung vo i tng l bin s ng k xe my thu thp hnh nh lm c s d liu cho vic x l. Yu cu ca bi ton l p dng cc thut ton thch hp tm vng cha bin s, trch vng bin s, cch li cc k t trn bin s, t my tnh c kh nng x l v nhn dng c. C th tm tt yu cu ca bi ton theo s nh sau:
nh u vo Trch vng bin s Cch ly cc k t

X l kt qu

Nhn dng k t

Hnh 1.1: Cc yu cu bi ton t ng nhn dng bin s xe

T s trn ta thy rng bi ton t ng nhn dng bin s xe my ny c th chia thnh 3 bi ton chnh: trch bin s xe, tch k t v x l cc k t. 2. Ni dung: 2.1. Trch bin s xe Mc ch: T bc nh chp c trong bc thu nhn nh, p dng cc thut ton trch ra c vng nh nh nht cha bin s. Cc phng php: c nhiu phng php khc nhau thc hin nhim v ny nhng tt c u c th qui v 3 phng php chnh sau y: - Phng php dng chuyn i Hough: da vo c trng cnh bin trch c, p dng cc phng php xc nh ng thng nh php bin i Hough pht hin cc cp ng thng gn song song ghp thnh mt nh bin s. - Phng php hnh thi hc: da vo c trng hnh thi ca bin s xe nh mu sc, sng, s i xng xc nh v trch ra nh bin s. - Phng php khp mu: xem bin s l mt i tng c khung nn ring v s dng cc ca s d trch tng i tng a qua mng noron (neural network), tr tu nhn to (artificial intelligence) chng hn phn loi c phi l vng bin s hay khng. Nghin cu ny s s dng kt hp 2 phng php l Hnh thi hc v Chuyn i Hough. 2.1.1. Phng php hnh thi hc Ni dung ca phng php: Da vo c trng quan trng l bin s xe my c sng (tc mc xm khi chuyn bc nh v dng xm) l tng i khc so vi cc vng khc trong bc nh, cng nh s phn b mc xm l kh ng u trn bin s v v vy khi c nh phn ho, vng bin s l mt i tng c c th hnh thi, c th phn bit c vi cc vng khc . Nh vy cc bc thc hin y l: - Xc nh ngng xm. Thc cht l khng c phng php no chn cho ng ngng xm thc hin. Thay vo , ngng xm s c qut trong mt khong no . Thng qua lc xm ta nhn thy vng bin s thng s c sng tng i ln (t 130200) v vy ta s xc nh lc xm ln nht trong khong ny v ngng xm cn chn s thuc vng ny nh ta s gim c thi gian lp tm ngng xm.

92

Tuyn tp Bo co Hi ngh Sinh vin Nghin cu Khoa hc ln th 6

i hc Nng - 2008

Hnh 2.1: nh xm u vo

Hnh 2.2: Lc xm ca bc nh xm

- Nh phn ho nh xm u vo vi ngng xm xc nh. - Lc cc nhiu (salt and pepper noise) gy nh hng xu ti i tng bin s. - Gn nhn cho cc i tng cn li trong nh nh phn thu c. - Trch ra cc i tng ng vin bin s theo tiu ch c th ca bin s xe v chiu cao, chiu rng, t l cc cnh, din tch, trng tm C th nghin cu chn: 7000 pixel din tch 150000 pixel 0,68 chiu cao/chiu rng 0,8 u im: - n gin - chn ra chnh xc vng bin s Nhc im: - thi gian x l ln 2.1.2. Phng php chuyn i Hough Ni dung ca phng php: gm cc bc: - D c trng bin ngang, dc: lm ni bt cc vin bao ca tt c cc i tng trong nh trong c vin bao bin s. Phng php l s dng cc b lc gradient trch c cc c trng cnh bin ny. Nghin cu ny s dng b lc Sobel tin hnh d. - Dng chuyn i Hough tm cc on thng ngang dc trn c s ca nh nh phn bin cnh thu c t bc trn. y s chn cc ng thng cch u nhau 5 pixel d ng, v loi b cc on thng nh hn ngng, c th l c t hn 30 pixel thuc n. - Tch cc on thng ngang, dc c th l cnh ca bin s. - Trch ng vin bin s: thnh lp cc hnh ch nht l ng vin cho bin s vi tiu ch c th l: cc b 4 on thng thu c s qua nh gi v kch thc: 80< chiu rng <400 63< chiu cao <350 0.63< chiu cao/ chiu rng <0.8 u im: khng ph thuc vo mu sc ca bin s xe Nhc im: ph thuc rt ln vo bc trch c trng bin cnh dn n l cc on thng ng vin thu c thng ngn hn nhiu so vi chiu dc cng nh chiu ngang ca bin s. 2.2. Cch ly cc k t Mc ch: tch thnh 8 nh n cha cc k t t nh vng bin s thu c. Phng php: cng c nhiu phng php thc hin nhim v ny. C th k ra y nh tch tnh, lng t ha vecto (vector quantization), lc chiu ngang v dc (vertical and horizontal projection), mng noron (neural network), tr tu nhn to (AI), hnh thi hc (Morphology)...Nghin cu ny la chn phng php Hnh thi hc thc hin.

93

Tuyn tp Bo co Hi ngh Sinh vin Nghin cu Khoa hc ln th 6

i hc Nng - 2008

Hnh 2.3: Tch tnh

Hnh 2.4: Lc chiu ngang v dc ca k t

Phng php hnh thi hc: mi 1 k t trn bin s s l 1 i tng c c im hnh thi hc c th nh l chiu cao, chiu rng, t l 2 chiubin i tng i t (nu nh bin s c a v cng mt kch c) m da vo ta c th tch ra c c th tng k t mt. T ta c thut ton tch k t t nh xm bin s sau y: - a nh xm bin s v cng phn gii 160x210 sau thc hin xa bin nh bin s. - Xc nh ngng xm nh phn bc nh bin s. Khu ny rt quan trng quyt nh tnh chnh xc ca vic nhn dng k t. Nghin cu chn ngng xm theo cc bc sau: Nng cao tnh tng phn ca nh bin s bng thut ton cn bng ha lc xm (histogram equalization). Dng thut ton Otsu xc nh ngng xm ca bc nh mi ny, y l ngng xm cn tm. - Lc nhiu loi b bt cc i tng v gn nhn cho cc i tng cn li. - Tch ra cc k t thng qua c tnh v hnh thi hc, c th l: 8 pixel chiu rng 45 pixel 45 pixel chiu cao 85 pixel u im: - Khng ph thuc vo nghing ca bin s. - Khng ph thuc vo nhiu. - Bin s c th khng lm sch c nhng vn nhn dng chnh xc. Nhc im: - Ph thuc vo chnh xc ca nh nh phn c ly ht c nh k t t nh xm. 2.3. Nhn dng k t: Phng php: phng php ph bin nht nhn dng k t l s dng mng noron tc l hun luyn cho my tnh nhn dng cc k t. Tuy nhin do s lng k t trn bin s l khng nhiu nn m bo tc x l nghin cu s dng phng php Hnh thi hc gii quyt khu ny bi v cc k t u c nhng c im hnh thi c bit c th phn bit vi nhau chng hn nh 0 c l trng gia, 8 c 2 l trng hay X i xng 2 trc dc v ngangc bit khu ny c thc hin trn c s xy dng cy nh phn ti u ca cc c im hnh thi nn m bo tnh khoa hc v tnh chnh xc cao. T thc t thc hin, nghin cu a ra thut ton ca khu ny nh sau: - Quan st chn ra cc c tnh phn bit k t xy dng ma trn c tnh. - Xy dng cy nh phn ti u t ma trn c tnh v tp k t thu c t bc tch k t. - Quan st cy nh phn v kim tra xem s c tnh nh vy nhn dng cha, thiu (d) th phi b sung (b i) v quay li bc u tin. - Tin hnh nhn dng cc k t trn c s cy nh phn ti u tm c. Qua tin hnh cc bc ca thut ton trn, nghin cu s dng nhm cc c tnh phn bit cc k t l ch s v cc k t l ch ci. C th i vi ch s: s im ct dc

94

Tuyn tp Bo co Hi ngh Sinh vin Nghin cu Khoa hc ln th 6

i hc Nng - 2008

1/2, tc dc, trc ngang, s l trn, v tr l trn; i vi ch ci: s l trn, m trn hay ng trn, m di hay ng di, trc dc, trc ngang, s im ct dc 1/2 v s im ct ngang . 3. Thc nghim: Nghin cu tin hnh thc nghim trn c s d liu l nh bin s xe my Vit Nam thu c H Ni, Nng v thnh ph H Ch Minh vi phn gii l 640x480. Sau khi tin hnh vit chng trnh da trn thut ton nu v x l c s d liu, nghin cu thu c kt qu nh sau: Thut ton Thnh cng (%) Li (%) Trch nh bin s 98,6 1,4 Tch k t 95,9 4,1 Nhn dng k t 96,4 3,6 Kt qu nhn dng chung 92 8 4. Hng pht trin nghin cu: - Nng cao hiu qu chng trnh nhn dng k t, tch li cc k t trong bin s trong cc trng hp bin s b nhiu nhiu, mt mt thng tin do nhiu t iu kin mi trng. - Pht trin chng trnh thnh module phn cng trn h vi x l dnh ring cho x l tn hiu s khng cn ph thuc vo my tnh, gim nh kch thc ng thi kt hp giao tip vi camera v cc cm bin c th tr thnh mt thit b nhn dng bin s hot ng c lp c th s dng cho cc ng dng c th nu trn. - Nghin cu ngh mt hng ng dng c th l h thng gim st phng tin ra vo mt a im c th v gi xe hon ton t ng. TI LIU THAM KHO [1] Duan, T.D., Du, T.L.H., Phuoc, T.V., Hoang, N.V. (2005), Building an Automatic Vehicle License-Plate Recognition System, International Conference in Computer Science, pp. 59-63.

[2] w.w.w.Mathworks.com
[3] Otsu, N. (1979), A Threshold Selection Method from Gray-Level Histograms IEEE Transactions on Systems, Man, and Cybernetics, Vol. 9, No. 1, pp. 62-66. [4] Humayun Karim Sulehria, Ye Zhang (2007), Extraction of Vehicle Number Plates Using Mathematical Morphological Techniques, Proceedings of the 8th WSEAS International Conference on Automation and Information, Vancouver, Canada, June 19-21, 2007 pp. 258-261. [5] Linda Shapiro and George Stockman (2000), Computer Vision E-book, pp.97-99: Histogram, pp.101-105: Binary Threshoding, pp.150-153: Noise & Smoothing, pp.156160: Edge detection.Ballard Brown, Computer Vision, pp.123-129: Line Detection with the Hough Algorithm. http://www.dai.ed.ac.uk/homes/rbf/BANDB/LIB/bandb4_3.pdf [6] [7] Amin Sarafraz (2004), Detects lines in a binary image using common computer vision operation known as the Hough Transform, University of Tehran, Iran.

95