Bi dch Multimedia(Phn 10F1)

Mt phng php siu lp lch da trn kt hp nhiu li khng ng nht

Hyung-Jun Choi, Eunsung Kim, Yoonki Lee, Heon Y. Yeom B Khoa hc v K thut my tnh i hc quc gia Seoul, Hn Quc Email: {hjchoi, eskim, yklee, yeom}@dcslab.snu.ac.kr Dukyun Nam, Soonwook Hwang Hc vin Khoa hc v Cng ngh thng tin Hn Quc Daejeon, Korea Email: {dynam, hwang}@kisti.re.kr Tm tt--- Trong nhng nm qua, nhiu s ch v vic kt hp nhiu li khng ng nht c a ra. Gn y, mt siu lp lch Grid da trn b chuyn i c xut nh mt phng tin cho php lin kt cc hot ng gia cc li khc nhau. Tuy nhin, mt nhc im ca phng php l khi nhiu siu lp lch cng tham gia vo li Grid th tt c cc trng hp lp k hoch lm vic mt cch ring bit, do dn n cn bng ti km. Trong bi bo ny, chng ti xut mt phng php siu lp lch gip ci thin vic s dng v loi b vic tranh ngun ti nguyn bng cch phi hp cc qu trnh lp k hoch. Hn na, n c li ch trong vic ngn cc siu lp lch khc lm gin on cc chnh sch lp k hoch bi v tt c cc tng tc min giao nhau c x l lp siu lp lch. T kha --- Grid, Metascheduler, Interoperation

1. Gii thiu:
in ton li c tho lun l mt trong nhng gic m cng ngh, trong lnh vc tnh ton phn tn, n c th a cho chng ta vo o tng v kh nng tnh ton v lu tr v hn. Tuy nhin, thc t th vn cn xa mi t c Grid quy m ton cu. Mt trong nhng l do chnh cho cc thiu st nh vy l do qu trnh chun ha chm ca cc cng ngh Grid. Theo , nhiu li sn xut tn ti ngy nay lm vic trong s c lp v khng tng thch vi nhau. thc hin tm nhn ban u ca Tnh ton li [1],chng ta phi c kh nng lin kt nhng li b c lp. Mt cch lm iu ny l mi ngi xy dng li c s h tng ca h middlewares ph hp vi nhng tiu chun chung. Tuy nhin, iu ny c mt s cc vn v k thut v chnh tr - x hi. u tin, cc tiu chun ngh ca OGF(Open Grid Forum)[2] hin ang khng mnh. Th hai, nhiu t chc ang khng mun nng cp middlewares ca h v n c tc ng rt ln trn ton b c s h tng ca h. V vy, thay v tp trung vo cho php kh nng tng tc di hn ca cc dch v li, trc tin chng ta phi gii quyt vn cho php phi hp ngn hn nhiu li. p ng yu cu ny, cng ng Grid thnh lp Cng ng Nhm GIN (Grid
Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091 Page 1

Bi dch Multimedia(Phn 10F1)

Interoperation Now) [3]. Mi quan tm chnh ca h l cung cp nhanh chng, ngn hn, cc gii php chuyn i cn bn t c s phi hp gia cc c s h tng Grid khng ng nht. Cc b chuyn i v c bn l nhng dch gi c bit c th tr gip cc thnh phn khc nhau ca Grid giao tip vi nhau. V d nh GridWay s dng cc b iu hp c gi l trnh iu khin truy cp trung gian (MAD) trong khun kh metascheduler truy cp vo nhiu Grids khng ng nht. Siu lp lch li da trn b chuyn i cn bn th hu ch v n che giu cc chi tit cp thp hn ca tng tc li c bn. Tuy nhin, mt trong nhng hn ch quan trng ca phng php da trn b chuyn i l khi nhiu siu lp lch tham gia vo Grid th tt c cc trng hp lp k hoch lm vic trong s c lp, do dn n cn bng ti km. Hn na, n tr nn ngy cng kh khn bo v quyn t ch ca tng li . Trong bi bo ny, chng ti c mt ci nhn cn cnh phng php siu lp lch da trn b chuyn i cn bn cho php phi hp nhiu Grid v ch ra mt s hn ch ca n khi s dng vt qu ngun ti nguyn. Sau , chng ti nh gi hiu qu ca n trong cch biu din th bc, m chng ta gi l phng php Super-Metascheduler. Khi nim v kin trc siu Metascheduling phn cp c tho lun trong cc cng trnh khc nh [4, 5]. ng gp chnh ca chng ti v bi vit ny l cho mt phn tch so snh k lng gia phng php Adaptor-based metascheduling v phng php Hierarchical SuperMetascheduling approach. Trong , phng php Adaptor-based metascheduling tp trung vo vic phi hp lp dch v bn di metaschedulers, phng php Super-Metascheduler ca chng ti qun l qu trnh lin kt ti cc lp siu lin kt mc cao bn trn participating Grid metaschedulers. Phn cn li ca bi bo c t chc nh sau. Trong phn 2, chng ti xc nh nhng c im chnh v cc vn ca phng Adaptor-based metascheduling. Trong phn 3, chng ti a ra Super-Metascheduler ci m t c t l s dng li Grid tt hn. Mc 4 bo co kt qu th nghim v chng ti kt lun ti mc 5.

2. Nhng vn ca phng php Adaptor-based

Mt trong nhng khc bit ca Grid metaschdulers ci m s dng b iu hp truy cp vo c s h tng a Grid l GridWay [6]. Trong bi bo ny, chng ti s dng GridWay l mc tiu chnh phn tch phng php Adaptor-based v n l i din tt nht ca c ch ny. GridWay l mt metascheduler trong Globus Toolkit 4, v n s dng m-un b iu hp gi l MADs giao tip vi c s h tng Grid khc nhau. GridWay hin nay c th tng thch vi EGEE [7], TeraGrid [8], v OSG [9] s dng thch hp Mads. Hnh 1 cho thy mt cch tng qut, n gin ha ca phng php tip cn da trn b chuyn i ca GridWay truy cp vo nhiu Grid. Trong phn ny, chng ti phn tch mt s hn ch ca phng php Adaptor-based khi ni n kt hp nhiu li khng ng nht.

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 2

Bi dch Multimedia(Phn 10F1)

Hnh 1. Phng php ca GridWay trong kt hp nhiu Grid

2.1. D liu c
Mt trong nhng nhim v quan trng nht ca mt Grid metascheduler l tm ra s ph hp nht gia yu cu cng vic c a ra bi ngi s dng v cc ngun lc sn c. Kt ni ny [10] da trn nhng thng tin c cung cp bi li Dch v thng tin (GIS) [11] chng hn nh Globus Monitoring v Discovery Service (MDS). Mt GIS in hnh thu thp thng tin (chng hn nh tc CPU, kch thc b nh v khng gian a) th hin bi cc nh cung cp ti nguyn a phng [12] mt khong cch c nh. Tuy nhin, i vi cc l do v hiu sut v kh nng m rng, t l b phiu mc nh thng c cu hnh c n v thi gian ca mt vi pht. Adaptor-based metaschedulers ly thng tin lp k hoch t cc h GIS do phi da ch yu vo cc d liu c, v vy c th cung cp cho n mt ci nhn sai lch cc ngun ti nguyn Grid c bn.

2.2. S tranh chp ngun ti nguyn

Mt nhc im chnh ca Adaptor-based Grid metascheduler l n b tranh ti nguyn khi nhiu metascheduler tham gia trong mi trng Grids kt hp. iu ny xy ra bi v metaschedulers li cnh tranh tt c u khng bit nhau. Hnh 2 minh ha mt kch bn khi tranh ti nguyn xy ra. Gi s rng mt nhm 50 khe cm CPU c chia s bi hai li. Chng ti cng gi nh rng cc ngun lc trong khu vc ny tt hn ng k hn so vi cc ngun ti nguyn li a phng khng c chia s. V vy, bt c khi no cc thnh phn chia s tr thnh b trng, c hai metaschedulers s c xu hng trnh vic lm n ny cm chia s. C hai metaschedulers Grid, ch thch l UserA v UserB trong hnh 2, nhn ra thnh phn ny c chia s ti 50 khe cm. Gi s rng 40 vic lm mi n ng thi c hai metaschedulers tng ng. UserA sau quyt nh gi tt c 40 vic lm cc cm c chia s. Trong trng hp xu nht, UserB cng nhn thy iu ny cm chia s trng v quyt nh gi tt c cc cng vic ca mnh khu vc ny. Sau chng ti c 80 cng vic ang chng cho ln nhau trong mt khu vc, ni ch c 50 cng vic c th c x l ng thi. iu ny xy ra v khng UserA cng khng UserB c th tm ra mt cch nhanh chng v nhng thay i c kch hot bi metaschedulers khc do chm tr

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 3

Bi dch Multimedia(Phn 10F1)

truyn thng tin m chng ti tho lun trong phn trc. Tnh hnh s ch cng ti t hn khi c thm nhiu metaschedulers tham gia vo chia s mi trng Grids.

Hnh 2. Minh ha ca vic tranh ti nguyn khi hai Grids c kt hp

2.3. Quyn t ch ca li
Mt cch n gin gii quyt vn tranh ci ngun lc thc thi tt c cc li s dng mt metascheduler tp trung bi v mt nh mi gii ti nguyn tp trung [13] c th phi hp v ng b ha tt c cc giao dch cng vic rt hiu qu. Tuy nhin, mt trong nhng nhc im ca vic s dng mt metascheduler tp trung, bn cnh cc vn kh nng m rng, mi li phi t b metascheduler li a phng ca h. iu ny s tr thnh vn khi li in tng nhn mnh vo vic gi h thng metascheduling a phng ca n. V vy, chng ti cn thn phi xem xt v nhng cch thc bo tn quyn t ch ca mi li in, chng ta phi cho php h chn metaschedulers ring ca h, chnh sch lp k hoch, v cc thnh phn trung gian ... Trong phn tip theo, chng ti xut mt phng php mi c th thot khi vn ca tranh ti nguyn v bo tn quyn t ch ca mi li.

3. xut chng trnh: siu metascheduler cch tip cn 3.1. Thit k xem xt

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 4

Bi dch Multimedia(Phn 10F1)

Hnh 3. Thit k Super-Metascheduler h tr truy cp trong sut v lin mch vi nhiu Grid, chng ti thit k mt kin trc m trong chng ta xy dng mt lp lp k hoch b sung trn u trang ca Grid metaschedulers hin c. Lp mi ny c gi l lp Super-Metascheduler. Hnh 3 m t mt ci nhn tng quan v cch tip cn da trn Super-Metascheduler ca chng ti tch hp nhiu Grids khng ng nht. Thch thc l xy dng mt h thng c th s dng nhiu dch v Grid khng ng nht m khng b tranh chp ti nguyn. ng thi, mi Grid c nhn phi c kh nng bo tn quyn t ch ca n bng cch cho php chng chn schedulers ring ca mnh, chnh sch lp k hoch... Mt Super-Metascheduler v c bn l mt dch v mi gii m t trn u trang ca cc dch v Grids metascheduling. Nhim v chnh ca n l chuyn tip cc yu cu cng vic n Grid metascheduler thch hp nht. Khi Super-Metascheduler chn mt Grid, n c th mt nhiu yu t vo ti khon nh kch thc hng i metascheduler, s lng khe cm ti a, khong cch mng, chnh sch lp k hoch. Chng ti c th cung cp nhng trng lng khc nhau n nhng yu t ny v chn mt trong c s im tng hp cao nht. V d, chng ta c th thit lp mt chnh sch Super-Metascheduler ci m chn Grid c c s s dng nhiu nht ti bt k thi im no. Do , mt Super-Metascheduler phi c kh nng ly li thng tin c th ca tng dch v Grid. Thay v trnh cng vic trc tip di hu ht cc qun l ti nguyn a phng nh PBS, SGE, v Condor [14, 15, 16], mt SuperMetascheduler ch o n cng vic ca mnh n Grid metascheduler chn, v cho php n chm sc phn cn li ca vic kt hp ngun ti nguyn. Super-Metaschedulers phi, do , nhn thc ca metaschedulers li c bn, v n phi c kh nng trnh vic lm cho cc metaschedulers nh mt "ngi s dng" (ngha l nu trnh mt cng vic metascheduler chn cng ging nh mt ngi dng thng thng s lm). Khi Super-Metascheduler gi yu cu n Grid metaschedulers nh l mt "ngi s dng" n khng cn c th tham gia trong qu trnh lp k hoch bi v n giao ton quyn kim sot cho metascheduler . Bng cch ny, chng ta c th bo v quyn t ch ca tng li. Mt li th khc ca phng php ny l chnh bn thn Super-Metascheduler ny khng cn phi bn tm v cc chi tit cp thp hn ca mi c s h tng Grid. Do , khng c b iu hp nh Mads ca
Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091 Page 5

Bi dch Multimedia(Phn 10F1)

GridWay cn phi c b sung cho mi thnh phn Grid, ci m n gin ho ng k qu trnh phi hp ton b. Tuy nhin, chng ta phi thc thi mi metascheduler Grid l mt li vo n im vo c s h tng Grid ca n. Ni cch khc, chng ti gi nh rng mi c s h tng Grid c qun l mt cch tp trung. Trong trng hp ny, tranh chp ti nguyn s khng xy ra, bi v mi li c nhn c qun l bi h thng mi gii trung tm ti nguyn ca n. n nay, gi nh rng chng ti c mt Super-Metascheduler ci m phi hp tt c cc qu trnh lp k hoch ca metaschedulers c bn. Tuy nhin, duy tr tp trung duy nht Super-Metascheduler c th p t chi ph qu nhiu trn my ch. Do , chng ti phi xem xt mt phng php phn cp v cho php nhiu trng hp ca Super-Metaschedulers i vo. Trong mt chng trnh phn cp, nhiu Super-Metaschedulers phi cnh tranh vi nhau cho c s h tng Grid tt nht nh th hin trong hnh 4. Tranh chp ngun ti nguyn xy ra mt ln na, nhng hiu qu l ti thiu mc ny, bi v s lng ti a ca trnh ng thi vi mi Grid l t l thun vi s lng Super-Metaschedulers. V d, nu ba Super-Metaschedulers tham gia, ch c ba cng vic cng mt lc s c tch ly trong mt Grid, nhng metascheduler ny, ln lt, cui cng s phn tn cc cng vic cho cc metaschedulers a phng. Ln k tip ngi s dng gi mt cng vic, nhn ra rng s dng ca li ny tng ln, v s chn gi cng vic ca n n metascheduler khc c s dng thp hn. Ti a ca ba cng vic ng thi cng s c trnh ln Grid duy nht thi gian ny. Sau nhiu ln lt lp k hoch, cng vic cui cng s c phn phi ng u gia cc li. Khng ging nh Grid metaschedulers, Super-Metaschedulers khng b nh hng ng k t d liu c v Super-Metaschedulers ch ph thuc vo thng tin thu thp t bn trong Grid metascheduler. Thng tin ny c lp vi nhng thng tin cm cc b thu thp c t h thng thng tin li bi v thng tin metascheduler c trch ra mt cch trc tip t chnh h thng metascheduler ca n.

Hnh 4. Phng php Super-Metascheduler phn cp

3.2. Vn thi hnh

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091 Page 6

Bi dch Multimedia(Phn 10F1)

C mt s tiu chun phi c xem xt thc hin mt Super-Metascheduler. Trc tin, chng ta cn phi c mt ngn ng thng nht m t cng vic. Job Submission v Description Language (JSDL [17]) tiu chun th thch hp cho vic ny. Rt nhiu cng c tn ti ci m dch nh dng ny sang cc ngn ng m t cng vic khc. Th hai, chng ta cn mt giao din metascheduler ph bin m cho thy cc tnh nng thit lp cn thit v thng tin metascheduler-c th nh chiu di hng i chnh sch v lp k hoch. OGF tiu chun nh l Distributed Resource Management Application API (DRMAA [18]) c th ng mt vai tr quan trng cho iu ny, nhng nhiu Grid-level metaschedulers vn cha p dng tiu chun ny. S thiu vng giao din ph bin metascheduler li cho chng ta khng c s la chn, nhng pht trin nhng kch bn b chuyn i qung co n gin c bit m t xa gi mi giao din dng lnh metascheduler. Th ba, chng ta cn mt khun kh an ninh chung hot ng tt trn tt c cc li tham gia. Nhm Gin-AUTH ca OGF ch yu tp trung vo lnh vc ny v chng minh cng vic gng mu trn xc thc lien kt v y quyn qun l. Chng ti s khng tho lun thm v phi hp an ninh bi v iu ny vt qu phm vi nghin cu ca chng ti. Chng ti gi nh rng tt c cc Grid Security Infrastructure (GSI [19]) c s dng v chng ti chn giao tip vi cc metaschedulers bng cch s dng cng c GSI-enabled OpenSSH [20]. Yu t quyt nh chnh cn phi c a vo ti khon cho vic la chn Grids l t l s dng Grid. V vy, trong vic thc hin ca chng ti, Super-Metaschedulers chn dch v Grid t s dng nht khi lng cng vic lun lun c phn phi cho cc ngun lc sn c nht. S dng c th d dng thu c bng cch truy vn metascheduler, bi v mi metascheduler bit kch thc tng hp cc ngun ti nguyn ca n. N cng theo di tt c cc cng vic hoc ang chy hoc ang ch x l, do , tnh ton t l ca cc khe cn trng n tim nng ti a ca n cho vic s dng Grid. iu ny ch c th bi v khng c i tng lp k hoch no c th nhp vo ngun ti nguyn ngi khc m khng cn phi thng qua metascheduler ca h. N i m khng ni rng yu t s dng ny nn c t mc cao nht trn tt c cc yu t khc. Khi chng ta c s rng buc, chng ta c th khai thc thng tin khc nh trng thi gn, chnh sch mng. Khong cch mng, chng ti c ni l mt s ngi dng s thch trnh vic lm ca mnh n metascheduler tng i gn gi hn. Khi metascheduler cho php ngi dng c c thng tin chnh sch ni b ca mnh, ngi dng cng c th da vo d liu ny la chn Grids cho n.

4. nh gi thc nghim
Trong phn ny, chng ti thc hin mt phn tch ton din v mt b chuyn i phng php tip cn da trn metascheduler v so snh hiu qu ca n vi phng php tip cn Super-Metascheduler. Trong th nghim sau y, chng ti chun b hai mi trng Grid bao gm 4 nt lm vic cho mi Grid. Chng ti s dng hai li n v su li kp Pentium3 b vi x l 850 MHz cho cc nt lm vic ca chng ti. Chng ti thit lp hai my Linux Pentium4 2.8MHz cho metaschedulers ca chng ti (GridWay 5.2.3) v ci t Globus Toolkit 4.0.6 trn tt c cc nt. Hnh 5 cho thy cc thit lp th nghim ca tng th.
Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091 Page 7

Bi dch Multimedia(Phn 10F1)

Hnh 5. Mi trng kim tra

Chng ti hai li b c lp, mi metascheduler s ch c s dng ti a bn nt ti mt thi im. Mt khc, nu chng ta kt hp hai li bng cch s dng b iu hp GridWay, mi metascheduler c th tn dng li th ngun lc bn ngoi ca c s h tng Grid khc. iu ny s tng gp i cng sut ti a ca h thng v cho php chng ta x l cc nhu cu cao nht vt qu kh nng Grid c nhn. Mc d li ch nh vy, cch tip cn da trn b chuyn i ca GridWay b s dng ngun ti nguyn ngho nn do tranh ti nguyn. kim tra bao nhiu ti nguyn tranh chp thc s xy ra khi phng php GridWays adaptor-based c s dng, chng ti tnh c vic s dng ngun ti nguyn trung bnh ca cc c s h tng Grid ti bn hon cnh khc nhau bng cch thay i cc loi cng vic v chnh sch lp k hoch. Vic s dng, trong trng hp ny, l khng s dng CPU, nhng cc khe cm CPU b chim ng t l nghch vi tng s khe cm CPU. V vy, khi 7 trong 14 khe cm CPU ang c s dng, chng ta ni rng vic s dng ca h thng Grid kt hp l 50%. Do loi cng vic, m chng ti ni n hoc tp trung vo I / O hoc tp trung vo cng vic CPU. V d, mt trong cc cng vic chuyn su CPU m chng ti s dng cho th nghim ny l mt chng trnh tm tt c cc s nguyn t trong khong thi gian nht nh. Ngu nhin, chng ti ch yu tp trung vo cng vic song song gy ri c th c hiu qu phn chia v thc hin ng thi trn Grid.

Cng loi cng vic, cng mt chnh sch: iu ny s cung cp cho chng ta vic s dng km nht k t khi c hai metaschedulers s lun cho cc quyt nh tng t trn tt c cc cng vic n. Loi cng vic ngu nhin, cng mt chnh sch: C chnh sch tng t c th l yu t quan trng nh c hai metaschedulers c im tng t ca cc ti nguyn chia s. Ngay c khi cc loi cng vic khc nhau, s va chm c th xy ra thng xuyn. Cng mt loi cng vic, chnh sch ngu nhin: N s c tt hn mt cht so vi loi cng vic ngu nhin, cng mt chnh sch bi v c nhiu hn c hi vic lm s c phn b n nhng ni khc nhau.
Page 8

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Bi dch Multimedia(Phn 10F1)

Loi cng vic ngu nhin v chnh sch ngu nhin: y l trng hp thng xy ra trong mt h thng lin kt cc Grid in hnh. iu ny cho thy y l vic s dng tt nht trong tt c cc phng n khc c cp trn.

Ngoi ra, chng ti phn phi cng vic khc nhau trn mi Grid kim tra s mt cn i ca khi lng cng vic gia c s h tng Grid nh hng nh th no n vic s dng ti nguyn trung bnh. Kt qu trong hnh 6 cho thy "Loi cng vic ngu nhin & Chnh sch Lp k hoch ngu nhin" cho vic s dng ti nguyn trung bnh tt nht. N cng cho thy rng 50% / 50% phn phi khi lng cng vic, vic s dng trung bnh khong 75%. Tuy nhin, s mt cn bng ti cc (100% / 0%), chng ti t c s dng ti a tim nng tt c cc ln. iu ny l bi v n c tc dng tng t nh c mt metascheduler tp trung. Tuy nhin, iu ny him khi xy ra, chng ti ch ra rng, trong nhiu trng hp khc, ngun ti nguyn li khng th hon ton s dng khi b chuyn i da trn cch tip cn metascheduling c s dng. Vn ny tr nn quan trng hn khi metaschedulers li phi cnh tranh vi nhau, nh th hin trong hnh 7.

Hnh 6. S dng ti nguyn trong nhng hon cnh khc nhau

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 9

Bi dch Multimedia(Phn 10F1)

Hnh 7. S dng ti nguyn nhiu khi Grid c kt hp Gi s rng cng vic c phn b u trong s tt c cc metaschedulers tham gia, s dng gim xung khong 45% khi mt lin kt ca 4 li c s dng. Ni chung, cng nhiu tranh chp schedulers, cng nhiu kh nng dn n cn bng ti km. Cc nh hng tc thi c s dng ngun lc thp hn c th hin trong hnh 8. Trong th nghim ny, chng ti xem xt nhiu trng hp ca nhn cng vic tng t thng mt khong 220 giy khi chy hon ton trn mt my tnh 850MHz. Mc ch ca th nghim ny l nghin cu cch s dng ti nguyn nh hng n thi gian trung bnh hon thnh cng vic. Ti 50%/50% phn phi khi lng cng vic (tc l c hai cng ng ngi s dng u a ra 7 cng vic cho mi ngi), thi gian hon thnh cng vic trung bnh t gn gp i so vi cch tip cn Super-Metascheduler. Ti 85%/15%, thi gian hon thnh cng vic trung bnh gim xung khong 280 giy, bi v s dng ti nguyn tng ln bt c khi no c khi lng cng vic mt cn bng gia li tham gia. R rng, cch tip cn Super-Metascheduler t c hiu sut tt hn trung bnh, bi v n phn phi cng vic mt cch cn bng. Ch rng phng php tip cn Super-Metascheduler ca chng ti l khng b nh hng bi phn phi khi lng cng vic. iu ny l bi v tt c cng vic chnh tch ly Super-Metascheduler trc khi n c chuyn tip n Grid kt hp ca n.

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 10

Bi dch Multimedia(Phn 10F1)

Hnh 8. So snh thi gian hon thnh trung bnh Hnh 9 cho thy hiu sut ng dng ca phng php tip cn Super-Metascheduler cho khi lng cng vic khc nhau. Chng ti thay i cc ti trng ca mi Grid t 0% n 200%, nhng chng ti sa cha ti kt hp n 200%. Hnh v hin th cc ng dng trung bnh l thng qua kinh nghim ca mt cng ng ngi dng Grid. Chng ti xc nh mt cng ng ngi s dng nh l mt tp hp cc ngi dng ngi m trnh cng vic ca h n mt metascheduler no . V d, cng ng ngi s dng Grid A ch l mt nhm ngi s dng trnh cng vic ca h n Grid A's metascheduler.

Hnh 9. Hiu sut ca phng php tip cn Super-Metascheduler so vi phng php tip cn thay th ca n

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 11

Bi dch Multimedia(Phn 10F1)

Kt qu ca chng trnh th nghim m 30%/170% khi lng cng vic phn phi, thng qua ng dng trung bnh l kinh nghim ca nhm ngi s dng Grid A, khi phng php Super-Metascheduler c s dng, 50 cng vic/gi. Ti 170%/30%, ng dng thng qua kinh nghim ca nhm ngi s dng Grid A tng ln n 275 cng vic/gi bi v c thm cng vic c x l bi Grid As metascheduler trong trng hp ny. Trong mt trng hp l tng, ngi dng s dng thng lng ti a khi c hai Grid tr nn bo ha v khng c cc nt no nhn ri. Con s ny cho thy rng trong nhiu trng hp, phng php Super-Metascheduler t c thng lng ng dng cao hn so vi cc phng php Adaptor-based Metascheduler bi v Super-Metaschedulers c kh nng cn bng ti hiu qu hn so vi phng php Adaptor Super-Metascheduler. Mt SuperMetascheduler t c s tng tc trung bnh 1.5 ln, so vi phng php Adaptor-based Metascheduler. N cng ng ch cc cp ti di 100%, cc phng php Adaptor-based Metascheduler t c thng lng ng dng thm ch cn thp hn so vi khi Gris chy ring bit. Nu chng ta tch hp cc Grid bng cch s dng cc phng php adaptor-based approach, chi ph pht sinh bng cch cn bng ti km i khi c th ln hn nhng li ch ca vic c mt h thng ln hn. V vy, vi phng php adaptor-based approach, li ti nh c th ti bn ngoi t li i tc, v thng lng trung bnh ca cng vic ti a phng trnh gim khi cc cng vic t xa chng cho vi cng vic a phng. Mt khc, thng qua ng dng trung bnh Grid t xa qu ti tng ln do cn bng ti. Tuy nhin, vic thc hin b sung ca phng php Super-Metascheduler i km vi chi ph. Ti 200%/0% phng php adaptor-based t c thng lng tt hn mt cht so vi phng php Super-Metascheduler. Ti thi im s mt cn bng ln n nh im, c hai phng php hon ton bo ha Grid kt hp, nhng Super-Metascheduler phi tr chi ph b sung cho vic truy vn mi Grid metascheduler. Super-Metaschedulers phi truy vn mi metascheduler la chn Grid tt nht cho cng vic c yu cu. Do , n phi to cho mt vi li gi t xa ca cc dch v Grid. Chi ph ny lm tng tuyn tnh khi c thm nhiu Grid tham gia trong mi trng Grid kt hp.

5. Kt lun
Trong bi bo ny, chng ti phn tch cc phng php tip cn da trn b chuyn i tiu chun s dng nhiu li khng ng nht. Chng ti a ra cc th nghim nh l phng php adaptor-based dn n vic s dng ti nguyn km do tranh ti nguyn nghim trng gia cc metaschedulers tham gia. Cc nguyn nhn chnh ca vic tranh ti nguyn c da trn yu t l tt c cc metaschedulers khng bit nhau, trong khi chng phi lm vic phi hp mang li mt quyt nh lp k hoch ton cu. Khi cc metascheduler khng phi l nhn thc ca mi khc, mi metascheduler quyt nh lp k hoch ring ca mnh mt cch ring bit, m rt c th s to ra cc im nng v ti nguyn my tnh, ci m tng i mnh m hn nhng ci khc. Kt qu cho thy vic s dng ti nguyn gim xung di 80% khi hai etaschedulers c s dng, v n tip tc gim xung n 45% khi ln n 4 metaschedulers cnh tranh c a vo. S nh gi ca chng ti v vic s dng ti nguyn cng cho thy rng
Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091 Page 12

Bi dch Multimedia(Phn 10F1)

phng php adaptor-based c kh nng cn bng ti km, c bit l khi h thng c load cao. Phn tch thm hiu sut cho thy phng php Super-Metascheduler t c thng lng cao hn 1.5 ln so vi phng php adaptor-based. Mt nhc im ca phng php adaptor-based l quyn t ch trang web khng c bo qun khi nhiu trng hp ca metaschedulers tham gia vo Grid v cc cng vic n t min qun l khc nhau, c th ph v nhng k hoch lp lch cc b v nh hng n chnh sch Grid cc b. gii quyt nhng vn ny, chng ti xut mt phng php tip cn da trn Super-Metascheduler, trong , xy dng mt lp mi gii trn u trang ca li metascheduler. Lp ny c nhim v la chn Grid thch hp nht da trn thng tin (nh h thng s dng) c ly ra t mi Grid, v n yu cu chuyn tip n Grid c la chn. Super-Metascheduler t chc v phn x qu trnh la chn ngun ti nguyn ca mi Grid khng c tranh chp ti nguyn xy ra trn cc ngun ti nguyn GridPhng php ny c th c hiu qu loi b tranh chp ti nguyn, bi v tt c metaschedulers tr thnh nhn thc ca nhau thng qua lp Super-Metascheduling. Chng ti ch ra rng chng ta lun lun c th t c vic s dng ti a tim nng bng cch s dng phng php Super-Metascheduler, v kt qu cho thy rng, vic s dng phng php Super-Metascheduler hon thnh cc cng vic trung bnh nhanh gp hai ln so vi cc phng php adaptor-based khi khi lng cng vic c phn b u. Mt li ch ca phng php Super-Metascheduling khc l n gi cho mi t chc tham gia c lp. Chng ta c th gi cho mi trang web b c lp v tt c s phi hp c thc hin trn lp topmost Super-Metascheduling. iu ny c nh hng trong vic gi mc thp nht chi ph qun l v bo tn cc chnh sch cc b ca mi trang web Grid. Cui cng, v l do kh nng m rng, chng ti cng xut mt m hnh Super-Metascheduling phn cp ni m nhiu trng hp Super-Metascheduling ng vai tr l mt phn trong Partner Grid. Phng php phn cp khng ch l kh nng m rng m cn chu li bi v h thng khng cn c mt im duy nht ca vic khng thch hp. R rng, phng php SuperMetascheduler cung cp mt mi trng n gin, ng tin cy, v hiu qu cho nhng ngi dng mun s dng li khng ng nht kt hp vi nhau.

Ti liu tham kho

[1] I. Foster, C. Kesselman, The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann Pub., 1999. [2] Open Grid Forum, http://ogf.org/ [3] GIN Community Group, https://forge.gridforum.org/projects/gin [4] A. Kertsz, P. Kacsuk, Grid Meta-Broker Architecture: Towards an Interoperable Grid Resource Brokering Service, CoreGRID Workshop on Grid Middleware, Aug. 28-29, 2006. [5] I. Rodero, J. Corbalan, F. Guim, L. L. Fong, Y. G. Liu, and S. M. Sadjadi, Looking for at ISC2007, 2007. [6] E. Huedo, R. S. Montero, and I. M. Llorente, A Modular Meta-Scheduling Architecture for Interfacing with Pre-WS and WS Grid Resource Management Services, Future Generation Computer Systems, vol. 23, no. 2, pp. 252261, Feb. 2007. [7] EGEE Project. gLite, http://glite.web.cern.ch/glite/
Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091 Page 13

Bi dch Multimedia(Phn 10F1)

[8] TeraGrid, http://www.teragrid.org/ [9] Open Science Grid, http://www.opensciencegrid.org/ [10] J. M. Schopf, A General Architecture for Scheduling on the Grid, Technical Report, Argonne National Laboratory ANL/MCS-P1000-10002. [11] K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman, Grid Information Services for Distributed Resource Sharing, In Proc. of 10th IEEE Symp. On High Performance Distributed Computing, 7-9 Aug 2001, pp. 181-194. [12] M. L. Massie, B. N. Chun, and D. E. Culler, The Ganglia Distributed Monitoring System: Design, Implementation, and Experience, Parallel Computing, Vol. 30, Issue 7, July, 2004. [13] N. Tonellotto, P. Wieder, R. Yahyapour, A Proposal for a Generic Grid Scheduling Architecture, In Proc. of the Integrated Research in Grid Computing Workshop, 2005. [14] Portal Batch System (PBS), http://www.pbsgridworks.com/ [15] W. Gentzsch, Sun Grid Engine: Towards Creating a Compute Power Grid, In Proc. of 1st Int. Symp. on Cluster Computing and the Grid, 2001. [16] D. Thain, T. Tannenbaum, and M. Livny, Distributed computing in practice: The ondor experience, Concurrency and Computation: Practice and Experience, vol. 17, no. 2-4, pp. 323-356, Feb-Apr. 2005. [17] A. Anjomshoaa et al., Job Submission Description Language (JSDL) - Specification Version 1.0., Open Grid Forum Proposed Recommendation, 2006. [18] P. Troger, H. Rajic, A. Haas and P. Domagalski, Standardization of an API for distributed Resource Management Systems, In Proc. of the 7th IEEE Int. Symp. on Cluster Computing and the Grid, 2007. [19] V. Welch, Globus Toolkit Version 4 Grid Security Infrastructure: A Standards Perspective, http://www.globus.org/toolkit/docs/4.0/security/GT4-GSI-Overview.pdf [20] GSI-Enabled OpenSSH, http://grid.ncsa.uiuc.edu/ssh/

Nguyn Th Yn Nhi_D08HTTT_MSSV: 408170091

Page 14