Detai Grid Computing

Tnh ton li: Grid Computing Management

GV: TS. Tn Hnh

MC LC1. Introduction.........................................................................................................................................2 2. Cng ngh Grid Computing ( tnh ton li ).....................................................................................3 3. Mc tiu ca ti..............................................................................................................................5 4. Gii thiu mi trng li ................................................................................................................5 ............................................................................................................................................................6 nh ngha Grid Middleware.............................................................................................................6 Nhim v v li ch ca grid middleware..........................................................................................6 5.1 Gii thiu ......................................................................................................................................7 5.2 Lch s pht trin ..........................................................................................................................8 a) OGSA l g?................................................................................................................................9 b) Open Grid Services Infrastructure...........................................................................................10 5.5 Cc Core Service ca OGSI........................................................................................................12 Resource and Service Management..................................................................................................13 5.8 Tng quan v WSRF...................................................................................................................13 5.9 Hin thc WSRF :.......................................................................................................................15 6. Cc cng ngh...................................................................................................................................15 6.1 Service Oriented Architeture (SOA)...........................................................................................15 6.2 Gii thiu v SOA ......................................................................................................................15 6.3 Kin trc ca SOA......................................................................................................................16

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

1/31


GV: TS. Tn Hnh

Tm tt: Tnh ton li l thc hin lin kt ti nguyn phn b theo a l gii quyt vn quy m ln ang tr nn ph bin. Vic qun l cc ngun ti nguyn trong mi trng li s tr thnh phc tp khi cc ti nguyn phn tn, khng ng nht. V cng v chng thuc s hu ca c nhn / t chc khc nhau, c p dng cc chnh sch qun l ti nguyn, truy cp v tnh ton chi ph trn cc m hnh cng khc nhau. Bi vit ny gii thiu 3 m hnh dng trong qun l ti nguyn li (grid resource management): hierarchical model, abstract owner model, v economic mode. Hierarchical model c p dng ph bin trong cc h thng grid hin ti theo m hnh phn cp. Abstract owner model tip cn theo hng order and delivery (yu cu v chuyn giao). Economic model p dng c hai m hnh hierarchical v abstract owner models phc v cho vic gii quyt bi ton v chi ph cho cc nh cung cp v ngi s dng ti nguyn

1. IntroductionS pht trin ngy cng ph bin ca Internet, cng vi nng lc tnh ton ca my tnh ngy cng mnh v mng tc cao cng nh cc thit b c chi ph ngy cng thp ang thay i cch tnh ton v s dng cc my tnh. Cc ti nguyn c phn b theo cc v tr a l khc nhau, cn phi c lin kt kt vi nhau phc v cc bi ton tnh ton ln. Chnh v vy cn p dng tnh ton li gii quyt vic kt hp cc ti nguyn li. Trong mi trng ny, nhiu ti nguyn tnh ton nh cc siu my tnh, cc cm my tnh, thit b trc quan, h thng lu tr v c s d liu, c bit cc thit b khoa hc nh knh thin vn kt ni mc lun l vi nhau v th hin ra bn ngoi n ngi s dng nh l mt ti nguyn tch hp n (single integrated resource) (xem hnh 1). V c bn, ngi s dng tng tc vi resource broker. Nh vy s khng thy c nhng phc tp ca tnh ton li. Khi Broker pht hin ra ti nguyn m ngi s dng c th truy cp thng qua mt hoc nhiu h thng qun l thng tin li (grid information server), Broker s thng lng (negotiates) vi cc resource hoc cc agent ca chng bng cch s dng middleware services. Khi t c tha thun vi cc resource, s thc hin vic lp lch (scheduling) bng cch nh x cc task n cc resource, sp xp ng dng v d liu x l v cui cng tr v tp hp kt qu. Trong qu trnh , cn theo di tin trnh thc hin ng dng vic qun l cc thay i trong c s h tng li (grid infrastructure) v resource failure. C mt s d n trn th gii, ang pht trin cc thnh phn, cc dch v v cc ng dng trn h thng tnh ton li: Globus, Legion, NetSolve, Ninf, Apple, Nimrod/G, v JaWS.

Hnh 1: Gc nhn tng qut ca h thng GRID.

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

2/31


GV: TS. Tn Hnh

Trong mi trng tnh ton li, vic truy cp vo cc ti nguyn phn b theo c ch truy cp ngang hng. V vy cn phi p dng cc chnh sch bo mt cng nh xc thc quyn truy cp ca ngi dng. Vi vic Internet ngy cng pht trin manh, nhu cu s dng cc ti nguyn sn c ngy cng nhiu, v cc ti nguyn tng tc vi nhau phc v cc yu cu ca ngi s dng. Tuy nhin, trong mi trng phn b, cc ti nguyn li c qun l bi cc t chc khc nhau, c chnh sch khc nhau v vy s pht sinh cc vn rt phc tp trong vic kt hp cc ti nguyn ny vi nhau. V vy cn c m hnh qun l ti nguyn.

2. Cng ngh Grid Computing ( tnh ton li ). Vi nhng tin b trong nn cng nghip sn xut phn cng my tnh, cc th h my tnh ngay nay tr nn mnh m v r hn rt nhiu so vi cc th h trc . Cng vi s hu ch, my tnh tr nn ph dng khp ni trn th gii, i su vo mi cng vic ca con ngi, t cng vic hng ngy, cng s, kinh doanh n sn xut, nghin cu khoa hc. Do s lng my tnh hin nay trn th gii l rt ln vi tng cng nng lc x l v lu tr khng l. Tuy nhin, cc ng dng ngy nay ch mi s dng c mt phn rt nh nng lc x l v lu tr do cc ng dng ch chy trn my tnh cc b, n l, phn tn khp ni theo a l. T dn n lng ph rt ln. Mt cu hi t ra l lm sao tn dng tt hn nng lc ca my tnh. Mc khc, theo pht trin, con ngi ngy cng i mt vi nhiu vn ln, phc tp trong khoa hc, thng mi i hi nng lc x l tnh ton, lu tr ln : Trong khoa hc : Cch y 10 nm cc nh sinh hc rt vui mng khi h c th gi lp mt n phn t trn my tnh. Ngy nay h mun gi lp hng ngn phn t thuc, protein v tc dng tng h gia chng to ra cc loi thuc mi. nghin cu cc ht c bn v tng tc gia chng, hng nm ngnh vt l nng lng cao (High Enegy Physics) to ra khong 10 Petabyte (dung lng khong 20 triu a CD-ROM) d liu. hay cc nh vt l a cu thc hin theo di bu kh quyn, tng ozone, hng ngy phi lu tr v phn tch khong 100 Gigabytes d liu nh chp t v tinh.

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

3/31


GV: TS. Tn Hnh

Vic phn tch, gii m b gen ngi, cc d n nghin cu v tr, . . . . . cng cn nng lc x l rt ln.

Vn hp tc gia hng ngn nh khoa hc trn ton th gii, h tr vic chia s mt lng ln d liu, thc hin cc tnh ton phc tp trc tuyn trn cc d liu . Trong thng mi : Cc bi ton phn tch x l s liu kinh t ca cc quc gia, cc cng ty a quc gia, . . . . Cc cng ty cung cp dch v mng cho hng triu ngi dng trn ton th gii. Cc bi ton m phng, gi lp trong thit k sn phm cng nghip. Bi ton x l thng tin trong qun tr mng, cc h thng pht hin tn cng, xm nhp mng. Mt my tnh n, mt nhm cc my tnh (cluster) hay thm ch mt siu my tnh thng dng cng khng th p ng c nhu cu tnh ton, lu tr ngy cng ln nh vy. Mt s bi ton cng c th c gii quyt nhng rt kh khn, vi chi ph rt cao m khng phi quc gia, t chc no cng thc hin c (c bit l cc nc ang pht trin), cn nhng bi ton khc c th ni l khng th gii quyt c vi cng ngh tnh ton hin nay. Thc t khin ngi ta ny sinh tng phi kt hp cc my tnh phn tn khp ni trn th gii tr thnh mt siu my tnh khng l nhm tn dng nng lc tnh ton, lu tr hin ang lng ph gii quyt bi ton phc tp trn y vi chi ph thp hn.SV : o Anh V | | Trng Mc Cng

MSSV :

4/31


GV: TS. Tn Hnh

Trc y, khi cc cng ngh mng cha pht trin th tng trn hu nh cha thc hin c. Nhng hin nay, cc cng ngh my tnh pht trin vc bc, hiu nng mng tng gp i sau mi nm, tng v siu my tnh ton cu c c s tr thnh hin thc. n nhng nm cui th k XX, cc d n nghin cu u tin v lnh vc ny khai sinh ra cng ngh Grid Computing. Cng ngh Gird Computing ra i cd on l cng ngh nn tng ca th k XXI, lm thay i cch thc tnh ton ca chng ta, ging nh internet tng lm thay i cch thc trao i thng tin trong th k XX. Cng ngh Grid Computing m ra mt c hi mi cho cc nc khng c nn cng nghip thit k, ch to phn cng my tnh mng, to ra cc siu my tnh gii quyt cc bi ton ca ring mnh vi chi ph thp v lm ch cao. vit nam, nhu cu ng dng cng ngh thng tin vo cc hot ng nghin cu khoa hc, qun l kinh t x hi ngy cng cao, i hi phi x l nhng khi lng d liu ln, khi lng tnh ton khng l (v nc chng ta cn ngho, kinh ph u t cho nghnh cng ngh thng tin cha cao). Do , vic nghin cu, pht trin cng ngh Grid Computing vo thc t c xem l mt gii php quang trng gii quyt cc bi ton trn. 3. Mc tiu ca ti Nhm tm hiu, gp phn vo vic pht trin v ng dng cng ngh Grid Computing vo thc tin, ti : Xy dng mt ng dng chia s ti nguyn da trn Grid Computing c thc hin vi mt s mc tiu nh sau : Tm hiu v cng ngh Grid Computing hin nay c mt bc tranh tng quan v cng ngh, cc vn , cc hng gii quyt ch yu ca n nhm lm tin tham kho cho vic ng dng, pht trin cng ngh Grid Computing trong tng lai. Ci t, tm hiu m hnh, kin trc mi trng, cch thc lp trnh v pht trin ng dng ca b Globus Toolkit, mt b cng c xy dng Grid hng u hin nay.

4. Gii thiu mi trng liMt s c im thng thy trn h thng li nh: Tnh khng ng nht (Heterogeneity): ti nguyn trn li l a dng, thuc nhiu loi khc nhau t kin trc phn cng (CPU, cc loi thit b lu tr, thit b truyn thng,) n phn mm (h iu hnh, cc th vin, cng c), ngn ng. Tnh quy m ln (large-scale): mt h thng li kt hp nhiu dng ti nguyn trn phm vi c th gii cho nn mt h thng li s rt phc tp v kh m c th bit c mt hnh th c th ca n ti mt thi im Mt h thng li phi c tnh thch nghi, p ng cao v c kh nng m rng: h thng li pht trin trn mi trng khng ng nht ng nhin phi c kh nng x l ngoi l, chu ng li tt, c th bt tay vi mt s h thng khc thc hin tc v nhng vn m bo vn an ton thng tin. Bn cnh , h thng li phi c kh nng m rng, h thng phi m bo l khi gia tng hay gim i cc phn t trn li (tng gim quy m) th h thng

-

-

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

5/31


GV: TS. Tn Hnh

khng cn phi iu chnh ln lao lm nh hng n hot ng ca c h thng nh l c h thng phi sp tm thi khi thm, bt mt n v li no sau mi hot ng tr li. T , cho thy tnh cp thit ca mt thnh phn ca h thng li c th p ng c cc yu cu, mt nhm chng trnh c chc nng, nhim v lm trung gian tng tc gia cc ng dng li t pha ngi dng v mi trng li bn di, gi l middleware

ch v dch cn tm sau

Hnh 4: Ngi dng cn cm s dng v m khng quan n pha l g.

nh ngha Grid Middleware Grid middleware l gi phn mm nm gia lp ng dng v h iu hnh. Grid middleware qun l sercurity, truy cp v trao i thng tin: Cung cp kh nng kt ni s lng ln user Che du cc ti nguyn chia s ri rc nh my tnh, trung tm d liu,cc thit b khc

Cung cp cc cng c qun l,khi to cc lin kt trao i thng tin.

Nhim v v li ch ca grid middlewareC 3 mc ch: Xy dng cc giao tip, v cc giao thc c tnh mc ch chung, tnh m v tnh chun. Bi v h thng li c xy dng trn nhng giao tip v giao thc vi rt nhiu mc ch khc nhau. Nhng giao tip v giao thc ny iu ch ra c cc kt qu c bn, mang tnh nn tng nh v vic xc nhn, xc thc, khm ph ti nguyn, truy xut ti nguyn. Do , vic xy dng cc giao tip, giao thc chun v m l rt quan trng, nu khng, chng ta ch xy dng c nhng ng dng mang tnh c th m thi. nh ngha cc giao thc chun: N nh ngha ni dung v chui cc s kin trao i thng ip s dng cc thao tc yu cu t xa. iu ny rt quan trng v thit thc : o Anh V | | Trng Mc Cng

SV

MSSV :

6/31


GV: TS. Tn Hnh

hin tnh interoperability (ngha l kh nng m 2 thc th khc nhau c th lm vic vi nhau, v c thc hin bi cc giao thc thng thng) m h thng li ph thuc vo. Cung cp cc API chun: l cc giao din lp trnh ng dng chun, nh ngha cc giao tip chun vit m th vin, v cu trc cc thnh phn ca Grid bng cch cho php cc thnh phn m c s dng li.

Khi c grid middleware th gip: Trnh cho cc nh pht trin ng dng khng cn lp trnh cc mc thp, trnh errorprone flatform nh vic lp trnh mng mc socket. Gim chi ph thi gian pht trin phn mm khi tp trung pht trin chuyn mn trc ri mi pht trin ng dng bng cch ti s dng framework ch khng cn xy dng li t u. Cung cp cc tru tng hng mng mc cao gn vi yu cu ng dng cho vic pht trin h thng ri rc. Cung cp nhiu dch v pht trin, nh ng nhp v bo mt gip cho vic hot ng hiu qu trong mi trng mng.

5. Gii thiu b Globus toolkit 5.1 Gii thiu Globus toolkit l mt b toolkit m ngun m c s dng xy dng cc h thng v cc ng dng Grid. Globus toolkit hin ang c pht trin bi t chc Globus Alliance v nhiu t chc khp ni trn th gii. Globus Alliance l mt cng ng cc c nhn v t chc tham gia pht trin cc cng ngh nn tng cho Grid. Globus toolkit cho php thc hin ha cc tng, mc tiu ng sau khi nim grid. B toolkit bao gm : cc dch v v th vin phc v vic bo mt, h tng thng tin grid, qun l ti nguyn qun l d liu, lin lc, pht hin li, . . . . N c ng gi nh mt tp cc thnh phn c th s dng c lp hoc kt hp vi nhau. Mi t chc u c nhng hot ng, chnh sch khc nhau, vic kt hp, chia s ti nguyn t nhiu t chc b cn tr bi tnh khng tng thch gia cc ti nguyn. Globus toolkit c xy dng loi b nhng tr ngi ny, cc dch v, interface v protocol ca n cho php ngi dng truy cp n cc ti nguyn xa nh th n ang nm trong my tnh ca h trong khi vn cho php cc t chc thit lp cc chnh sch cc b ca mnh nh qun l vic ai c php dng ti nguyn v khi no. Mc d Globus c pht trin phc v cc d n v khoa hc v k thut, nhng hin nay Globus cng c p dng vo lnh vc thng mi. T nm 2000 cc cng ty hng u th gii trong lnh vc cng ngh thng tin nh : Avaki, Datasynapse, Entropia, HewlettPackerd, IBM, NEC, Oracle, Platform, Sun v United device, Microsoft bt u xy dng cc chin lc v Grid computing trn nn tng Globus.

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

7/31


GV: TS. Tn Hnh

5.2 Lch s pht trin Cui nm 1994 Rick Stevens (Argonne National Laboratory) v Tom DeFanti (Electronic Visualization Laboratory, University of Illinois, Chicago) ngh to mt ng kt ni tm thi gia 11 mng nguyn cu tc cao to ra mt Grid xuyn quc gia (I-WAY) trong 2 tun trc v trong hi ngh Supercomputing 95. Mt i ng pht trin nh ng u l tin s Lan Foster (Argonne National Laboratory) to nn cc protocol cho php ngi dng ca I-WAY chy cc ng dng trn my tnh nm ri rc khp nc M. Thnh cng ny c s ti tr ca t chc Defense Advance Research Projects Agency (DARPA) tip tc nguyn cu v pht trin. n nm 1997 phin bn u tin ca Globus toolkit ra i, ri tip theo l s pht hnh ca Globus toolkit Version 1.0 (GT1-1998), Globus toolkit Version 2.0 (GT2-2002), Globus toolkit Version 3.0 (GT3-2003) v hin nay l Globus toolkit Version 4.0 (GT4-2005). GT1 v GT2 l cc phin bn xy dng theo cc m hnh v giao thc c quyn ca t chc Globus, n GT3 v GT4 th chuyn sang xy dng cc Grid Service theo cc chun OGSA v OGSI.

5.3 Kin trc Globus toolkit

Hnh 5: Kin trc Globus toolkit B Globus Toolkit gii quyt cc vn ca cng ngh Grid Computing da trn 4 thnh phn chnh: 3 thnh phn l Resource Management, Information Service, Data Management lin kt hot ng trn nn tng bo mt chung, 1 thnh phn l Security Infrastructure. Ngoi ra Globus Toolkit cn cung cp mt b cc hm API v SDK nhm gip pht trin, xy dng cc ng dng Grid. Globus Toolkit 4 c thit k h tr hon ton OGSI v bao gm rt nhiu dch v, chng trnh, cng c, . . . . .Mt s trong chng c xy dng trn OGSI v c gi l

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

8/31


GV: TS. Tn Hnh

WS (Web Service) components, mt s khc khng da trn OGSI th c gi l pre-WS component. 5.4 Open Grid Service Architecture (OGSA)

Hnh 6 : Open Grid Service Architecture (OGSA)

a) OGSA l g?Open Grid Services Architecture (OGSA) c pht trin bi The Global Grid Forum vi mc ch a ra kin trc chung, chun v m cho cc ng dng tnh ton li. OGSA hng n vic chun ha cc service trong ng dng li bng cch a cc interface chun cho cc service ny. Hnh di cho thy m hnh ca OGSA

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

9/31


GV: TS. Tn Hnh

Hnh 7: M hnh OGSA OGSA gm 3 thnh phn chnh: Open Grid Services Infrastructure, OGSA services OGSA schemas OGSA c xy dng da trn Web services. OGSA c th c trin khai trn nhiu mi trng khc nhau, giao tip vi nhau thng qua cc giao thc (protocol). Ta s tm hiu chi tit hn cc thnh phn ny trong cc phn tip theo. Web services l cng c c s dng kh ph bin tuy nhin bn thn Web services vn cn mt s nhng hn ch nh: Khi to webservice Thi gian sng ca webservice Qun l li OGSA gii quyt cc vn trn v c hin thc lp c s hng tng (OGSI). Web services tun theo cc chun OGSI c gi l Grid Service. OGSI nh ngha cc chun ca giao tip v cc hnh vi phc v cho vic m t v tm kim dch v, khi tao instance, qun l thi gian sng, nhm service

b) Open Grid Services InfrastructureCc c tnh ca OGSI Grid service descriptions and instances Trong m hnh Web services chun, service c to ra cng nh b hy nm ngoi phm vi ca bn thn Web services. Tuy nhin trong thc t, ng dng thng xuyn khi to service mi v khi cc tc v hon tt th Web services b hy i. OGSI cung cp mt c ch phn bit gia phn m t v phn instance ca service. Phn m t nh ngha cc interface v hnh vi ca service. Cc service instance s hin thc cc hnh vi ny.

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

10/31


GV: TS. Tn Hnh

Service state, metadata, and introspection WSDL chun khng c khi nim trng thi ca service. V th OGSI a ra khi nim service data biu din siu d liu v cc trng thi. Cc thng tin ny c xem nh mt phn m t ca service v c th c truy xut t service instance. ng dng client c th yu cu service instance tr v cc thng tin ca chnh service . V d: cc interface, c t thng tin trng thi hin ti ca service, thi im kt thc ca service OGSI cung cp hai c ch truy xut trng thi ng dng: pull v push. Pull mode: OGSI cung cp tc v findServiceData kt hp vi service interface cho php client c th query thng tin trng thi ng dng. Push mode: client ng k cc vi service thng tin trng thi mnh mong mun thng qua cc interface NotificationSource, NotificationSubscription, v NotificationSink. Khi trng thi service thay i, service s thc hin hnh vi callback thng bo cho client bit.

ming v name resolution V Grid service c khi to ng v c trng thi nn cn phi c cch thc phn bit gia cc instance ca grid service. Do ta cn phng thc t tn cho cc instance ny. OGSI a ra c ch t tn hai mc. Mi grid instance s c gn mt Grid Service Handle(GSH) v c qun l bi HandleResolver. GSH l ton cc v duy nht tn ti trong sut thi gian sng ca instance. Client th giao tip vi service instance cng nh cc service instance vi nhau thng qua Grid Service Reference(GSR). Khng ging vi GSH, GSR c to ra, thay i, hy trong sut thi gian sng ca service instance. Hnh di minh ha c ch hot ng ca naming.

Hnh 8: C ch phn gii tn

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

11/31


GV: TS. Tn Hnh

Service life cycle Mt trong nhng im khc bit chnh gia grid service v Web service l Grid service c th transient(to v hy). OGSI cung cp c ch cho php cc instance khi to, hy cng nh qun l thi gian sng ca cc instance ny. Service instance c th quy nh thi gian sng bng cc phng thc sau: Khi to ban u: khi c yu cu khi to mi mt grid service, client gi km khong thi gian sng c th ca service instance. Kt thc tng minh(Explicit termination): client ch ng gi yu cu hy grid service instance. Yu cu iu chnh thi gian sng(Requesting a lifetime modification): client c th yu cu iu chnh thi gian sng ca service instance bng cch gi thng ip keepalive n server. OGSI nh ngha chun cc kiu chun cho tt c cc thng ip li c tr v bi Grid service. Service groups OGSI cung cp c ch t chc service instance theo nhm. OGSI nh ngha cc interface (WSDL portTypes). Mi loi portType a ra tp cc tc v v OGSI quy nh hnh vi c th cho cc tc v ny. Bng di lit k mt s cc portType PortType GridService HandleResolver NotificationSource NotificationSubscription NotificationSink M t Cung cp cc hnh vi chnh bao gm phn d liu v qun l thi gian sng ca service. nh x t GSH sang GSR Cho php client ng k cc thng ip notification Qun l thi gian sng v cc thuc tnh ca cc subscription. nh ngha tc v cho vic phn phi cc thng ip notification n service instance. Tc v chun to grid service instance Qun l nhm cc service instance Cho php thm hoc xa Grid service ra khi ServiceGroup

lt type

Factory ServiceGroup ServiceGroupRegistration

5.5 Cc Core Service ca OGSICore service cung cp cc dch v v phn gii tn, tm kim dch v, bo mt, chnh sch, v truyn thng ip. Cc dch v c bn: Name resolution and discovery Service domains Security Policy Messaging, queuing, and logging SV : o Anh V | | Trng Mc Cng

MSSV :

12/31

Tnh ton li: Grid Computing Management Events Metering and accounting 5.6 Data and Information Services 1. Data naming and access 2. Replication 3. Metadata and provenance

GV: TS. Tn Hnh

Resource and Service Management Provisioning and resource management Service orchestration Transactions Administration and deployment

5.8 Tng quan v WSRFOGSI cung cp mt c cu cho php pht trin, trin khai v qun l thi gian sng (lifetime management) cc dch v li. Tuy nhin, OGSI vn cn l nhiu im yu nh: Gii quyt qu nhiu vn trong cng mt bn c t. GWSDL khng theo chun ca Web service khin cc cng c c sn trong Web service khng s dng c. S nhp nhng gia Web service khng trng thi (stateless) v Web service c trng thi (stateful). WSRF trn c s nhm li cc tc v ca OGSI ng thi s dng cc chun mi hnh thnh ca kin trc Web services nh WS-Addressing, WS-Notification gii quyt cc nhc im ca OGSI. WSRF cha tt c cc chc nng ca OGSI v ci tin OGSI ba bc sau: Gii thiu khi nim WS-Resource Tch bit gia chc nng dch v v vic kch hot dch v Dch v notification theo chun WS-Notification ca Web services. WSRF nhm li cc chc nng ca OGSI thnh nm nhm chnh sau: WS-ResourceProperties: c t cc d liu ca ti nguyn, tng t nh Grid Data Elements ca OGSI, v cc c ch cho php truy cp, xa hoc thay i cc thng tin ny. WS-ResourceLifetime: c ch kt thc mt WS-Resource; cc c t v thng tin trao i gia ngi yu cu dch v v WS-Resource nhm kt thc dch v ngay lp tc hoc l mt thi im nh sn. WS-RenewableReferences: da trn chun WS-Addressing ca Web service cp nht cc thng tin mi v a ch dch v (endpoint references) khi cc thng tin hin ti tr thnh khng hp l. WS-ServiceGroup: c t giao tip cho php mt ti nguyn tham gia vo nhm; c t cc tc v cho php ly thng tin ti nguyn ca mt thnh vin ca nhm cng nh thng tin v cc nhm. Mt nhm l mt tp cc Web services v WS-Resources ca mt lnh vc c th (domain specific). WS-BaseFault: nh ngha cc kiu chun ca li v cch s dng chng trong WSDL. WSRF tch bit gia Web services (khng trng thi) v Resource (c trng thi) v nh ra mt c ch cho vic kt hp gia hai thnh phn ny li vi nhau. Hnh 11 a ra mt v d v hai thnh phn can bn nht ca WSRF: Web Service cung cp mt giao tip cho php truy cp vo cc ti nguyn (resources) c trng thi (cc file).

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

13/31


GV: TS. Tn Hnh

Hnh 9 : Mt Web service i din cho nhiu resources, mi resource l mt file WSRF s quy nh cch thc kt hp ngi dng t xa, thng qua giao tip Web service c th truy cp vo ti nguyn yu cu. Vic kt hp ny c m t trong Hnh.

Hnh 10 : Kt hp gia Web service v Resources trong WSRF

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

14/31

Tnh ton li: Grid Computing Management 5.9 Hin thc WSRF :

GV: TS. Tn Hnh

Hnh 11: Hin thc WSRF

6. Cc cng ngh6.1 Service Oriented Architeture (SOA)Phn ny gii thiu i nt v mt s khi nim v thnh phn c bn ca kin trc Service Oriented Architeture (SOA). SOA l kin trc ca Web Service v sau l Grid Service.

6.2 Gii thiu v SOA SOA l mt hng tip cn mi trong kin trc phn mm ng dng, trong mt ng dng c cu thnh t mt tp cc thnh phn c lp, phn tn, phi hp hot ng vi nhau c gi l service. Cc service c th c phn tn bt c ni no, c bn trong v bn ngoi t chc. hay ni mt cch khc cc thnh phn service c th tn ti

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

15/31


GV: TS. Tn Hnh

trn nhiu nn tng khc nhau v c th c ci t bi cc ngn ng lp trnh khc nhau. im mu cht ca SOA l cc chc nng ca service c cng b di dng mt giao din chun. Chi tit ci t c th cc chc nng c che du v ngi dng dch v cng khng cn quan tm n. ngi dng ch gi s dng cc chc nng ca service thng qua cc phng thc cng b trn giao din. C th thy tnh ng gi ny c k tha t phng php lp trnh hng i tng. Cng vi s h tr ca cc service c bn nh lp lch truy xut ti nguyn (scheduler service), ch mc (index service), tm kim ti nguyn (discovery service), . . . . . , ng dng c th xc nh thi gian thc thi cc service c chc nng ging nhau t nhiu ngun, t chn ra service tt nht s dng, p ng nhu cu ca ng dng.

6.3 Kin trc ca SOAGm cc thnh phn v cc thng ip hot ng trao i gia chng. o Cc thnh phn : SOA c 3 thnh phn c bn l : Service Provider, Service Requestor, Service Registry nh trong hnh

ServiceProvider : Chu trch nhim xy dng cc service, to cc bn m t cho chng, ng k bn m t cho cc dch v cho mt hoc nhiu ServiceRegistry, tip nhn, x l cc thng ip yu cu s dng service t cc ServiceRequestor. ServiceRequestor : L cc thc th s dng cc service cung cp bi ServiceProvider, ServiceRequestor tm kim cc bn t t service trong cc ServiceRegistry, la chn service cn thit v thch hp, ri sau kt ni n ServiceProvider v s dng service mong mun.

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

16/31


GV: TS. Tn Hnh

ServiceRegistry : Chu trch nhim qun b cc ServiceProvider ng k cho n v cho php cc dch v ServiceRequestor tm kim cc t t service trong danh sch ng k ca n.o Cc hot ng chnh :

SOA c 3 loi hot ng chnh gia cc thnh phn trn : Public, Find v Bind. Public : L hot ng gia ServiceProvider v ServiceRegistry, ServiceProvider thc hin ng k giao din service n cung cp cho ServiceRegistry thng qua phng thc public. Find : L hot ng gia ServiceRequestor v ServiceRegistry, ServiceRequestor s dng phng thc Find ly danh sch service v ServiceProvider tha mn cc yu cu ca n. C th c nhiu iu kin tm kim trong phng thc Find, ServiceRegistry s tm trong danh sch ServiceProvider ri tr v thng tin thch hp. Bind : L hot ng gia ServiceRequestor v ServiceProvider. N cho php ServiceRequestor thc hin kt ni n ServiceProvider trc khi thc hin cc li gi s dng dch v. Cho php ServiceRequestor khi to proxy pha client cho service cung cp bi ServiceProvider. Thao tc kt ni ny c th thc hin ng hay tnh. Trong trng hp kt ni ng, ServiceRequestor pht sinh proxy da trn cc thng tin ly c t ServiceRegistry, trong trng hp cn li, proxy c pht sinh trong lc pht trin ng dng. 7. Web Service Web Service l mt cng ngh c s dng rng ri trin khai m hnh SOA vo thc t, n a ra m hnh lin lc, trao i gia ng dng vi ng dng trn c s ngn ng c t XML. Web Service l nn tng ca Grid service.

Web Service s dng ngn ng Web Services Description Language (WSDL) m t ni dung v cch s dng service, s dng protocol SOA trao i cc thng ip gia cc Web Service, s dng ngn ng c t Universal Description, Discovery and Interation (UDDI) cho php cc nh cung cp web service ng k service ca mnh v cho php ngi s dng web service tm c nh cung cp tha iu kin mong mun. Ngoi ra cn mt s chun v nh ngha v trin khai cht lng dch v ca web service ang c xy dng nh SW-Security, WS-Repliable Messaging, WSCoordination v WS-Transsaction, . . . . . V bn cht, Web Service cng l mt cng ngh tnh ton phn tn nh cc cong ngh : CORBA, RMI, EJB, . . . Tuy nhin, Web Service c mt s li im m cc cng ngh khc khng c. Web Service c lp vi ngn ng lp trnh, c lp vi nn tng thc thi ng dng do c xy dng trn chun XML. y cng l l do chnh chn cng ngh Web Service lm nn tng cho Grid Service gii quyt thch thc ln nht ca cng ngh Grid Computing l qun l v s dng cc ti nguyn phn tn, a dng, phc tp, trn nhiu nn tng khc nhau. Hu ht cc Web Service u s dng protocol HTTP truyn thng ip (cc yu cu service v kt qu tr v t service), nn h tr xy dng cc ng dng tm c ton: o Anh V | | Trng Mc Cng

SV

MSSV :

17/31


GV: TS. Tn Hnh

cu qua nhiu site, nhiu vng bo mt, nhiu vng qun tr khc nhau trn nn tng internet, do cc lu thng dng HTTP thng khng b chn li khi gp firewall hoc proxy. Trong khi vic ttruyn thng ca cc cng ngh khc thng gp vn vi firewall. Mt s khc bit na l cccng ngh nh : CORBA v EJB hng n cc h thng phn tn c kt hp cao (highly coupled), trong client v server phi ph thuc cht ch vo nhau. Cng ngh ny thng l tng cho cc ng dng trong mng cc b. Cn vi cng ngh Web Service th ngc li hon ton, client khng cn bit thng tin v server v service cho n khi n thc s cn s dng service. Do cng ngh Web Service thng thch hp nht xy dng cc ng c phm vi rng trn internet, nh cc ng dng hng Grid. Cng ngh Web Service c th c s dng qun l ti nguyn thay i ng theo thi gian. 8. Ci t ng dngTrin khai dch v Grid s dng mi trng lp trnh tch hp Eclipse. Nn tng c chn l Windows

Bc 1 : Ci t cc gi phn mm Cc gi phn mm cn thit: Sun Java SDK V1.6.0_09 * Eclipse IDE V3.6.0 * Apache Jakarta Tomcat V6.0.29 * Sysdeo Eclipse Tomcat Launcher Plug-in V3.1 * Apache Ant 1.8.1 * GT4 WS Core 4.0.1 * globus-build-service 0.2.5 * Netbean Ci t v Cu hnh Java: 1. Ci t gi j2sdk vo 1 th mc (v d: C:\j2sdk1.4.2_11) 2. To bin mi trng JAVA_HOME= (vd: JAVA_HOME=C:\j2sdk1.4.2_11) Click chut phi ln biu tng "My Computer", chn "Properties", chn tab "Advanced", v nhn nt "Environment Variables ", cui cng thm bin JAVA_HOME v gi tr cho n. 3. Thm ng dn "%JAVA_HOMEBIN%" vo bin mi trng PATHCi t v Cu hnh Ant: 1. Ti gi apache-ant-1.8.1-bin.zip t http://ant.apache.org/bindownload.cgi 2. Bung gi apache-ant-1.8.1-bin.zip ny vo 1 th mc (vd: D:\Project\apache-ant-1.8.1) 3. To bin mi trng ANT_HOME= (vd: ANT_HOME= D:\Project\apache-ant-1.8.1) 4. Thm ng dn "%ANT_HOMEBIN%" vo bin mi trng PATH

Ci t v Cu hnh WS Core ca Globus Toolkit 4.0: 1. Ti gi ws-core-4.0.1-src.zip t http://www.globus.or...ownloads/4.0.1/ 2. Bung gi ws-core-4.0.1-src.zip ny vo 1 th mc (vd: D:\Project\ws-core-4.0.1) 3. To bin mi trng GLOBUS_LOCATION= (vd: GLOBUS_LOCATION=D:\Project\ws-core-4.0.1) 4. Chuyn ti th mc ws-core-4.0.1 va bung 5. Chy lnh:"ant all"Ci t globus-build-service: 1. Ti gi globus-build-service-gt4_0.2.5.tar.gz t http://gsbt.sourcefo...ent/view/28/46/ 2. Bung gi globus-build-service-gt4_0.2.5.tar.gz ny vo th mc "etc" trong GLOBUS_LOCATION (vd: D:\Project\ws-core-4.0.1\etc)

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

18/31


GV: TS. Tn Hnh

Ci t v Cu hnh Eclipse: 1. Ti gi eclipse-SDK-3.6.0-win32.zip t http://www.eclipse.org/downloads/ 2. Bung gi eclipse-SDK-3.6.0-win32.zip ny vo 1 th mc (vd: D:\Project\eclipse) 3. Chy file eclipse.exe trong th mc ny Ci t Sysdeo Eclipse Tomcat Launcher Plug-in V3.1: 1. Ti gi tomcatPluginV31.zip t http://www.sysdeo.co...se/tomcatplugin 2. Bung gi ny vo th mc "plugin" ca Eclipse(vd: D:\Project\eclipse\plugins) 3. Khi ng li Eclipse Ci t v Cu hnh Apache Tomcat 6.0.29 1. Ti gi apache-tomcat-6.0.29.exe t http://tomcat.apache...download-55.cgi 2. Chy file apache-tomcat-6.0.295.exe 3. Chn th mc cha Tomcat (c:\tomcat) 4. t mt khu cho ngi qun tr Tomcat Server: "admin" Bc 2.1 Thay th JRE bng JDK trong Eclipse (cn chy Tomcat) 1. Chy chng trnh Eclipse (trong D:\Project\eclipse) 2. Click Window/Preferences 3. Chn Java/Installed JREs 4. Click Add 5. Nhp vo "JRE Name" = "jdk1.5.0_06" 6. Nhp vo "JRE Home directory" = ng dn ti th mc cha " jdk1.6.0_11" (C:\Program Files\Java\jdk1.6.0_11) 7. Click OK, Chn check box = " jdk1.6.0_11", Click OK Bc 2.2 Cu hnh Tomcat trong Eclipse 1. Chy chng trnh Eclipse (trong D:\Project\eclipse) 2. Click Window/Preferences 3. Chn Tomcat 4. Chn "Tomcat version" = "Version 6.0" 5. Nhp vo "Tomcat Home" = ng dn ti th mc cha "Tomcat" (c:\tomcat) 6. Chn Tomcat/JVM Settings, Chn JRE= jdk1.6.0_06 7. Click OK

Bc 2 : Cu hnh Eclipse

9. Gii thiu chng trnh DemoTn ng dng File Sharing Management System: p dng cng ngh WSRF, gm 3 Component 2 Service Component: Service dng cng ngh Globus toolkit WSRF GridDatabaseService: service qun l ngi dng ProvisionDirService: service qun l chia s file vi my tnh t xa File Sharing Management System: window application, dng qun l vic chia s file vi my tnh khc thng qua vic gi service GridDatabaseService, ProvisionDirService

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

19/31


GV: TS. Tn Hnh

M hnh h thng File Sharing System 2 Services component: p dng cng ngh Grid WSRF

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

20/31


GV: TS. Tn Hnh

GridDatabaseService: Cung cp service v qun l user login Dng cng ngh Globus toolkit WSRF, gm cc chc nng: Checklogin: kim tra user ng nhp ListUsers: lit k danh sch user DeleteUser: xa user UpdateUser: cp nht user AddNewUser: thm mi user ChangeUserName: thay i username ChangePassword : thay i mt khu ProvisionDirService: service qun l chia s file vi my tnh t xa Dng cng ngh Globus toolkit WSRF gm cc chc nng: transfer: Gi 1 file n my tnh t xa getImage: Ly 1 file t my tnh t xa listDir: ly danh sch file v th mc t my tnh t xa listDirRoot: ly danh sch a my tnh t xa

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

21/31


GV: TS. Tn Hnh

File Sharing Management System: window application, dng qun l vic chia s file vi my tnh khc thng qua vic gi service GridDatabaseService, ProvisionDirService Mn hnh khi ng

Mn hnh ng nhp

Mn hnh thao tc chnh

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

22/31


GV: TS. Tn Hnh

Mn hnh chia s file vi my tnh t xa

Xem danh sch user

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

23/31


GV: TS. Tn Hnh

Thm, Cp nht, xa user

10. Kin trc chng trnh Services component: p dng cng ngh Grid WSRF buildservice.xml: y l file dng build Grid WSRF services package

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

24/31


GV: TS. Tn Hnh

buildservice.properties: y l file dng build ProvisionDirService service

buildserviceDB.properties: y l file dng build GridDatabaseService service

ProvisionDir.wsdl: y l file nh ngha hm, thuc tnh cho server, dng ngn ng WSDL

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

25/31


GV: TS. Tn Hnh

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

26/31


GV: TS. Tn Hnh

File deploy-jndi-config.xml l JNDI deploy file, file ny dng enables GT4 WSRF (ProvisionDirService service c mt file, GridDatabaseService service c mt file)

File deploy-server.wsdd l file WSDD configuration, n bo Web Service container (Tomcat) lm th no publish Web service (ProvisionDirService service c mt file, GridDatabaseService service c mt file)

File code ProvisionDirService.java (dng cho ProvisionDirService service) SV : o Anh V | | Trng Mc Cng

MSSV :

27/31


GV: TS. Tn Hnh

File ProvisionDirQNames.java nh ngha Resources (dng cho ProvisionDirService service)

File code GridDatabaseService.java (dng cho GridDatabaseService service)

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

28/31


GV: TS. Tn Hnh

File GridDatabaseQNames.java nh ngha Resources (dng cho GridDatabaseService service)

11. Ti liu tham kho[1.] Rajkumar Buyya, Steve Chapin, and David DiNucci, Architectural Models for Resource Management in the Grid, USA, 2000 [2.] Rajkumar Buyya, David Abramson, and Jonathan Giddy, An Economy Driven Resource Management Architecture for Global Computational Power Grids. [3.] Rajkumar Buyya, David Abramson, Jonathan Giddy, and Heinz Stockinger, Economic Models for Resource Management and Scheduling in Grid Computing. [4.] David Abramson, Rajkumar Buyya, Jon Giddy. School of Computer Science and Software Engineering. Monash University, Melbourne, Australia. Nimrod/G GRID Resource Broker and Computational Economy. SV : o Anh V | | Trng Mc Cng

MSSV :

29/31


GV: TS. Tn Hnh

[5.] Klaus Krauter1, Rajkumar Buyya and Muthucumaru Maheswaran. A taxonomy and survey of grid resource management systems for distributed computing.

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

30/31


GV: TS. Tn Hnh

SV

: o Anh V

| |

Trng Mc Cng

MSSV :

31/31

Detai Grid Computing

Documents

Transcript of Detai Grid Computing