7/24/2019 C ch qun l my ch o trong in ton m my
1/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/
I HC THI NGUYN
TRNG I HC CNG NGH THNG TIN V TRUYN THNG
LUN VN THC S KHOA HC MY TNH
Thi Nguyn2014
7/24/2019 C ch qun l my ch o trong in ton m my
2/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/
LI CM N
Trc ht, ti v cng bit n su sc n Thy gio
ngi thy trc tip dnh nhiu thi gian tn tnh hng dn, cung cp nhng
thng tin, ti liu qu bu gip ti hon thnh bn lun vn ny.
Ti xin chn thnh cm n Ban lnh o Trng i hc Cng ngh thng
tin v Truyn thng - i hc Thi Nguyn to nhiu iu kin gip ti hon
thnh lun vn ny.
Sau cng ti xin by t lng bit n n ngi thn, cng bn b, ng
nghip c quan, nhng ngi lun c v ng vin ti hon thnh bn lun vn tt
nghip Thc s ny.
Thi Nguyn, ngy 26 thng 08 nm 2014
HC VIN
7/24/2019 C ch qun l my ch o trong in ton m my
3/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/
MC LC
M U ..................................................................................................................... 1CHNG 1 ................................................................................................................ 5TNG QUAN V IN TON M MY V BI TONQUN L MY CH O ........................................................................................ 5
1.1 TNG QUAN V IN TON M MY................................................. 5
1.1.1 Khi nim v in ton m my................................................................ 5
....................................................................... 13
1.1.3 Khi nim v tng quan v o ha............................................................. 16
1.2 BI TON QUN L MY CH O........................................................ 24
1.2.1 Cc phng cch qun l my o trong in ton m my trn th gii .. 24
1.2.2 Vn la chn m hnh ph hp trin khai dch v in ton m myca cc nh cung cp ti Vit Nam........................................................................................... 30
CHNG 2 ................. 33........................................................................................ 33
2.1 CHIA S TI NGUYN MY O................................................................... 33
2.1.1 Thit lp mt mi trng ng dng o....................................................... 33
2.1.2 sp xp li phc tp ca cc vn ............................................... 33
2.1.3 Uc lng hiu sut ca mt ngun lc c cung cp.................... 34
2.1.4 Thut ton chia s ti nguyn...................................................................... 35
2.2 CN BNG TI................................................................................................... 37
2.2.1 K thut cn bng ti................................................................................... 37
2.2.2 Cc thut ton cn bng ti.......................................................................... 39
2.3 LP LCH CNG VIC...................................................................................... 50
2.3.1 Thut ton Lp lch da trn Cn bng ti............................................. 512.3.2 Thut ton Lp lch da trn thut ton Gii thut di truyn ci tin . 53
CHNG 3 ................................................................................... 573.1 T BI TON.................................................................................................... 57
3.2 PHN TCH NH GI LA CHN CNG C GII QUYT BI
TON .. .................................................................................................................................57
3.2.1 Thit k h thng......................................................................................... 57
3.2.2 Thit k mng........................................................................................... 57
7/24/2019 C ch qun l my ch o trong in ton m my
4/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/
3.2.3Ci t Eucalyptus................................................................................. 59
3.2.4 Ci t Hadoop......................................................................................... 59
3.2.5 S dng mt s gi m ngun m.............................................................. 62
3.2.6 S dng thut ton lp lch da trn cn bng ti gii quyt bi ton..... 67
3.3 MT S KT QU.............................................................................................. 68
KT LUN ............................................................................................................... 68TI LIU THAM KHO ........................................................................................ 73
7/24/2019 C ch qun l my ch o trong in ton m my
5/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/
DANH MC CC CH VIT TT
VM Virtual Machine My oCS Cloud Scheduler Lp biu m my
VMM Virtual machine monitor Mn hnh my oIaaS Infrastructure as a Service C s h tng l mt dch vSaaS Software as a service Phn mm l mt dch vPaaS Platform as a service Nn tng l mt dch vOS Operating System H iu hnhECP Elastic Computing Platform Nn tng in ton mm doCLC Cloud Controller B iu khin m my
NC Node Controller B iu khin nt
PM Physical machine My vt l
7/24/2019 C ch qun l my ch o trong in ton m my
6/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/
DANH MC CC HNH
S hiu hnh Tn hnh Trang
1.1 M hnh in ton m my 51.2 in ton m my di gc nhn 3D 6
1.3 Phn loi in ton m my da vo v tr 81.4 M hnh phn lp ca kin trc IaaS 10
1.5 S truy cp ti nguyn phn cng ca cc my o 14
1.6 161.7 - based 191.8 Kin trc Hypervisor-based 191.9 201.10 S truy cp ti nguyn phn cng ca cc my o 21
1.11 o trong TM 231.12 241.13 262.1 333.1 563.2 Cu hnh Hadoop gi phn tn 583.3 593.4 603.5 61
3.6 623.7 Kin trc ca EUCALYPTUS 633.8 Giao din chnh ca chng trnh th nghim 65
3.9 Khi to my ch o 66
3.10 Chn thng s my ch o 66
7/24/2019 C ch qun l my ch o trong in ton m my
7/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/1
M U1. t vn
Ti Vit Nam, in ton m my ang l ch cng ngh mang tnh thi s
v c phn kh mi m, s am hiu v in ton m my ni chung v vn qun
l my o trong in ton m my ni ring cn c phn hn ch.La chn m hnh hot ng theo c ch no trin khai dch v in ton
m my l mt bi ton quan trng i vi nh cung cp dch v.
V d, nu trin khai theo c ch thit lp mt mi trng ng dng o bng
cch s dng cc ng dng o nh mt c ch chia s ti nguyn, th bt c khi no
c yu cu cung cp nhiu ti nguyn hn, h thng t ng trin khai thm cc
ng dng o khc.Vi cch tip cn ny liu c gy lng ph cc ngun ti nguyn khng?
Trong ton b thi gian p ng yu cu ca ngi dng, khng phi tt c
cc ti nguyn cm u bn. Khi ngi dng cn x l cc ng dng d liu ln, h
li phi ch cho mt cng vic phi c hon thnh trc khi nhim v ca mnh
c th c x l, ngi dng nu khng th s dng tt c cc cm sn c s gy
lng ph ngun lc.
Ngoi ra cc my ch o cn cung cp mt lp cc phn mm to thnh mi
trng c bn nh th vin, d liu, nhng chng trnh m sn sng phc vngi dng ti bt k cm ti nguyn no.
V vy, cc nh cung cp dch v in ton m my cn phi c mt phng
php qun l cc my ch o.
ng thi, nh cung cp dch v cn chng mnh cho ngi s dng thy
rng, dch v in ton m my theo m hnh m mnh xy dng hon ton c
th p ng c cc tiu ch nh: hiu sut, tc cp pht b nh, hiu sut trao
i thng tin ca cc my o tng t nh cc my vt l.T nhng l do trn ti chn v nghin cu thc hin ti C ch qun l my
ch o trong in ton m mydi s hng dn ca thy TS. L Vn Phng.
2. i tng v phm vi nghin cu
i tng nghin cu ca lun vn l h thng my ch o trong in ton
m my. Phm vi nghin cu gi hp v c ch qun l my ch o ca h thng
qun l cm o thng qua vic xem xt cc kha cnh: Tnh linh ng, kh nng cn
bng ti. Kt qu phi hp gia nghin cu l thuyt v thao tc thc t dn n
7/24/2019 C ch qun l my ch o trong in ton m my
8/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/2
vic ci t cc h thng, p dng cc kch bn tnh ton phn tn vo cc cm o,
v d nh MapReduce framework cng nh cc nh gi v ci tin. t c
iu ny, cn phi nghin cu rt nhiu v li, m my, cng ngh o ha, cm
o, my ch h iu hnh Linux, v cc gi m ngun m nh Eucalyptus v
Hadoop, MapReduce.
3. Hng nghin cu ca ti:
Mc tiu chnh ca lun vn ny l nghin cu v c ch qun l my ch o
trong in ton m my. V vy, ni dung lun vn cn phi lm r cc nhim v
sau y:
- Th hin r bn cht ca EUCALYPTUS v Hadoop, Mapreduce.
- Chi tit ha cc c ch ca h thng qun l cm o v cc gi m ngun m.
- Ci t, cu hnh, nghin cu c ch qun l my ch o ca mt s h thng
in ton m my hin hnh.
- Ch ra u im, khuyt im ca cc c ch, h thng (bao gm c phn tch
v nh gi).
- xut ci tin v lm sng t tnh kh thi ca n.
4. Nhng ni dung nghin cu chnh
D kin lun vn gm: Phn m u, ba chng chnh, phn kt lun, ti liutham kho v ph lc c b cc nh sau:
Chng 1. Tng quan v in ton m myv bi ton qun l my ch o
Tm hiu tng quan v in ton m my, trnh by cc khi nim, cu trc,
o ha.
Chng 2. Mt s c ch qun l my ch o trong in ton m my
l my ch o trong in ton m my.
Chng 3. Th nghim
5. Phng php nghin cu
Thu thp, phn tch v tng hp cc thng tin, ti liu lin quan n ti
t tt c cc ngun.
Da theo kin chuyn gia, la chn v th hin gii quyt vn .
Phn tch thit k cc m phng ca chng trnh.
7/24/2019 C ch qun l my ch o trong in ton m my
9/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/3
Kim tra nh gi kt qu.
7/24/2019 C ch qun l my ch o trong in ton m my
10/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/4
6. ngha khoa hc ca ti
Lun vn nhm m rng tri thc v bo m khoa hc my tnh ni chung,
ng thi em n s hiu bit v c ch qun l my ch o trong in ton m
my ni ring.
ngha khoa hc ca ti th hin ch tng hp c tri thc qun l hiu
qu my ch o, cn bng ti, cc ph, chia s ti nguyn trong h thng qun l
cm o, t xut nhng phng php khoa hc bo m v nng cao c
c ch qun l cc my ch o nhm p ng nhanh nht, tt nhtyu cu ngi dng.
Kt qu cc th nghim da trn h thng c ci t s thuyt phc ngi
s dng dch v in ton m my, to ra cm gic an ton, tin tng i vi dch
v in ton m my.
7/24/2019 C ch qun l my ch o trong in ton m my
11/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/5
CHNG 1
TNG QUAN V IN TON M MYV BI TON
QUN L MY CH O
1.1 TNG QUAN V IN TON M MY
1.1.1
Khi nim v in ton m my
1.1.1.1 Cc quan im v in ton m my
in ton m my l m hnh in ton s dng cc cng ngh my
tnh v pht trin da vo mng Internet. Dch v in ton m my ha hn p
ng mnh m nhu cu in ton ca ngi dng.
Theo nh ngha ca SYS-CON Media Inc: in ton m my l mt h
thng bao gm nhiu my tnh sao cho cc ti nguyn gm: ngun in (power),
kh nng lu tr (storage), nn tng (platform) v cc dch v c tru tng ha,
o ha , c tnh co dn ng v qun l cung cp cho ngi dng qua Internet.
Theo nh ngha ca NIST: in ton m my l mt m hnh ph
bin, thun li, c kh nng truy cp Internet chia s cu hnh v ngun ti
nguyn mt cch nhanh chng v bt u vi mt chi ph ti thiu hoc
tng tc cc dch v c cung cp.
T phc v theo yu cu: Ngi s dng c th t ch trong qu trnhcung cp kh nng tnh ton m khng i hi c s tng tc gia con ngi vi
nh cung cp dch v.
co gin cao: Ngha l c kh nng thay i nhanh chng v quy m
ty thuc vo nhu cu c th ca ngi dng ti thi im khc nhau.
7/24/2019 C ch qun l my ch o trong in ton m my
12/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/6
7/24/2019 C ch qun l my ch o trong in ton m my
13/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/7
Theo nh ngha ca CISCO: "in ton m my l thng tin v ngun ti
nguyn v dch v c tru tng t c s h tng c bn, cung cp theo yu cu v
quy m trong mt mi ngi a ngi s dng".
Theo yu cu: Cc ngun ti nguyn c cp quyn ngay lp tc khi cnthit, bt u khi khng c yu cu v ch lp ha n khi c s dng.
Theo quy m: C
.
Theo mi trng a ngi s dng: Cc ngun ti nguyn cung cp cho
nhiu ngi s dng t mt hin thc n nht, tit kim c chi ph cho qu trnh
cung cp.
1.2in ton m my di gc nhn 3D
7/24/2019 C ch qun l my ch o trong in ton m my
14/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/8
1.1.1.2 S khc bit gia in ton m my v in ton truyn thng
a. T Sa Cha
Bt k ng dnghoc dch v no ang chy trong mt mi trng in
ton m my c mt tnh cht t sa cha. Trong trng hp ng dng tht bi,
lun lun c mt d phng tc thi ca ng dng sn sng cho cng vic khng
b gin on. C nhiu bn sao ca cng mtng dng - mi bn cp nht chnh n
thng xuyn v vy nhng lntht bi, c t nht mt bn sao ca ng dng c
th ly lnhot ng m thm ch khng cn thay i nh no trong trng thi chy
ca n.
b. Nhiu ngi s dng
Vi in ton m my, bt k ng dng no cng h tr a ngi dng-
l khi nim dng ch nhiu ngi s dng m my trong cng thi gian. H
thng cho php mt skhch hng chia s c s h tng c phn b cho h m
khng ai trong h nhn bitv s chia s ny. iuny c thc hin bi vic o
ha cc my ch trong mt di cc my tnh v sau cp pht cc my ch
nnhiu ngi s dng. iu ny c thc hin theo cch m trong s ring
t ca ngi s dngv bo mt ca d liu ca h khng b tn hi.
c. Kh nng m rng tuyn tnh
Dch v in ton m my c kh nng m rng tuyn tnh. H thng c
kh nngphn chia cc lung cng vic thnh phn nh v phc v n quac s h
tng. Mt tng chnh xc ca kh nng m rng tuyn tnh c th c ly
tthc t l nu mt my ch c th x l 1000giao dch trong mt giy, th hai
my ch c th x l 2.000 giao dch trong mt giy.
d. Hng dch v
H thng in ton m my l tt c cc dch v theo nh hng nhng
dch v nh vy c to ra t nhng dch v ri rc khc.Rt nhiu dch v ri rc
nh vy l s kt hp ca nhiu dch v c lp khc vi nhau to dch v ny.
iu ny cho php vic ti s dng cc dch v khc nhausn c v ang c to
ra. Bng vic s dng cc dch v c to ra trc , nhng dch v khc c
th c to ra t .
e. iu khin SLA(Service level agreement)
Thng thng cc doanh nghip c tha thun v s lng dch v. Kh
nng m rng v cc vn c sn c th lm cho cc tha thun ny b ph v.
7/24/2019 C ch qun l my ch o trong in ton m my
15/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/9
Tuy nhin, cc dch v in ton m my l hng SLA, nh vickhi h thng c
kinh nghim t nh ca ti, n s t ng iu chnhchnh n tun th cc tha
thun cp dch v.Cc dch v s to ra thm nhng thc th ca ng dng
trn nhiu server cho vic ti c th d dng qun l.
f. Kh nng o ha
Cc ng dng trong in ton m my hon ton tch ri khi
phn cng nm bn di. Mi trng in ton m my l mt mi trng o ha
y .
g. Linh hot
Mt tnh nng khc ca ccdch v in ton m my l chng linh hot.
Chng c th c dng phc v rt nhiu loi cng vic c khi lng khc
nhau t ti nh ca mt ng dng nh cho n ti rt nng ca mt ng dng
thng mi.
1.1.1.3 Phn loi in ton m my
Da votiu ch v tr ni cc cloud ng vai tr l my ch, in ton m
my c chia thnh 4 loi: Private Cloud (m my ring), Public Cloud (m
my cng cng), Hybrid cloud (m my lai) v Community Cloud (m
my truyn thng).
1.3
7/24/2019 C ch qun l my ch o trong in ton m my
16/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/10
a. Public Cloud (m my cng cng)
Public Cloud c nh ngha nh sau:
C s h tng tnh ton c lu ti nh cung cp dch v v c s
chia s c s h tng ny gia cc t chc vi nhau.
Ngi dng khng nhn thy c v tr t my ch trong c s h
tng in ton m my.
Cc nh cung cp dch v public cloud c th k ti l: Amazon,
Winsdow Azure, Google Apps
b. Private Cloud (m my ring)
Private Cloud c nh ngha nh sau:
C s h tng tnh ton c quyt nh bi khch hng. V vy, ngnhin khch hng s bit c v tr my ch t u v khng c s chia s gia
cc t chc vi nhau.
Do ch c mi khch hng s dng nn chi ph thng thng khch
hng b ra s tn hn nhiu v nng cao c tnh bo mt hn Public Cloud. in
hnh cho nh cung cp Private Cloud c th k ti l trang eBay.com.
c. Community Cloud (m my truyn thng)
Community Cloud c nh ngha nh sau:
C s h tng c chia s gia cc t chc c cng mt mi quan tm
chung vi nhau nh bo mt, thm quyn, chuyn mn
c qun l ni b bi nhng t chc trong nhm hoc giao cho bn
th ba (a third-party) ng tin cy qun l.
V tr t my ch c th trong hoc ngoi nhm.
Chi ph b ra ca nhng ngi s dng trong Community Cloudthng s t hn Public Cloud nhng s tn nhiu hn Private Cloud.
d. Hybrid Cloud (m my lai)
Hybrid Cloud c nh ngha nh sau:
y l s kt hp gia hai hay nhiu loi cloud k trn (Private
Cloud, Public Cloud, Community Cloud) hnh thnh nn mt Hybrid Cloud.
Do c s kt hp trn nn my ch c qun l ging nh Public
Cloud v cc ng dng lin quan n bo mt c qun l nh Private Cloud.
7/24/2019 C ch qun l my ch o trong in ton m my
17/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/11
Bng n in ton m my l thut ng dng xc nh mt h thng t chc s
dng c s h tng ring ca mnh cho vic s dng bnh thng, nhng li s dng
in ton m my trong gi cao im. Cc giai on pht trin ca cloud c th
c trnh by tm lc qua hnh 1.3 gm c 4 giai on t qu trnh lu tr d liu
t pht nhiu trung tm khc nhau cho n hnh thnh qu trnh s dng chung
cc ngun ng dng qua s kt hp ca nhiu loi cloud khc nhau.
1.4 M hnh phn lp ca kin trc IaaS
1.1.1.4 Phn tch u vnhc im ca in ton m my
a. u im
Khi s dng cc ng dng trn in ton m my, ngi dng s c nhng
u im sau:
Li ch v chi ph: Ngi dng ch cn tr cc chi ph lin quan ti vn
hnh h thng v chi ph s dng c ng dng. Ngha l ngi dng s dng bao
nhiu th ch cn tr chi ph cho mc ch m thi.
Tnh linh hot: Nhanh chng cung cp dung lng ph hp cho nhu
cu s dng, d dng thay i cc khi lng cng vic vi nhau.
Ci thin kh nng t ng ha: Cung cp cc dch v cn thit theo yu
cu ngi s dng.
7/24/2019 C ch qun l my ch o trong in ton m my
18/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/12
Tp trung vo kh nng ct li: Nghin cu cc li ch ca ngun ti
nguyn chung trong in ton m my cung cp cc dch v cn thit cho ngi s
dng di s iu tit v gim st ca c quan trc thuc chnh ph.
Tnh bn vng: in ton m my c nng lng tiu th t hn so vi
mt trung tm lu tr d liu thng thng trong cng phng din lu tr d liu.
b. Nhc im
Tuy nhin, trc nhng u im khi s dng ng dng trn in ton m
my, n cng c mt s nhc im:
Cn phi c ng truyn Internet tc cao thc hin ng dng.
p ng c yu cu v bo mt v cu hnh ca h thng.
Kh nng cng tc gia cc in ton m my ca nhiu t chc khc nhau.
V cng c rt nhiu cu hi cha vn ang ch cu tr li thuyt phc
nh, tnh ring t, cc thng tin ngi dng v d liu c cha trn in ton
m my c m bo c ring t, v liu cc thng tin c b s dng v mt
mc ch no khc khng, iu vn cha c cu tr li thuyt phc.
Tnh sn dng, liu cc dch v m my c b "treo" bt ng, khin cho
ngi dng khng th truy cp cc dch v v d liu ca mnh trong nhng khongthi gian no khin nh hng n cng vic?
Mt d liu, mt vi dch v lu tr d liu trc tuyn trn m my
bt ng ngng hot ng hoc khng tip tc cung cp dch v, khin cho ngi
dng phi sao lu d liu ca h t "m my" v my tnh c nhn. iu ny s
mt nhiu thi gian. Thm ch mt vi trng hp, v mt l do no , d liu ngi
dng b mt v khng th phc hi c.
Tnh di ng ca d liu v quyn s hu, mt cu hi t ra, liu
ngi dng c th chia s d liu t dch v m my ny sang dch v ca m my
khc? Hoc trong trng hp khng mun tip tc s dng dch v cung cp t m
my, liu ngi dng c th sao lu ton b d liu ca h t m my? V lm cch
no ngi dng c th chc chn rng cc dch v m my s khng hy ton b
d liu ca h trong trng hp dch v ngng hot ng.
Kh nng bo mt, vn tp trung d liu trn cc "m my" l cch
7/24/2019 C ch qun l my ch o trong in ton m my
19/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/13
thc hiu qu tng cng bo mt, nhng mt khc cng li chnh l mi lo ca
ngi s dng dch v ca in ton m my. Bi l mt khi cc m my b tn
cng hoct nhp, ton b d liu s b chim dng. Tuy nhin, y khng thc s
l vn ca ring "in ton m my", bi l tn cng nh cp d liu l vn
gp phi trn bt k mi trng no, ngay c trn cc my tnh c nhn.
1.1.2 C u trc in ton m my
1.1.2.1. Khi nim IaaS
IaaS l mt m hnh dch v m s cung cp cc thit b nhm htr hot ng h
thng cho khc hng. Cc thit b bao gm kho d liu, phn cng, my ch v
cc thnh phn networking. Nh cung cp s lm ch cc thit b v chu trch
nhim cho vic hot ng v bo tr h thng. Khch hng s tr tin cho cc hp ng
dch v .
Cc bn hp ng cc mc dch v khc nhau : i vi tng nhu cu
khc nhau m cc khch hng c th chn nhng dch v thch hp. ng vi cc
dch v s c nhng hp ng tng ng.
Khi s dng dch v IaaS th phi tr ph.
IaaS u da trn cc hot ng ca my o. C ch ca vic s dng cc
thit b o trong in ton m my th rt thch hp bi v n c nhiu li ch trongvic chia s, qun l ti nguyn.
IaaS tp trung ch yu vo vic cho thu cc thit b phn cng nh l
my ch (server) , k thut networking v khng gian lu tr hn l mua v ci t
n trong trung tm d liu ca ring bn. IaaS cn c internet. in ton m my lin
quan ti vic phn phi cc dch v my ch. Mt dch v cloud th c 3 im khc nhau
chnh so vi dch v hosting truyn thng trn internet. l : n c bn theo nhu
cu c tnh theo gi, kh nng cung cp v hn v linh ng theo nhu cu v dch v
hosting c qun l bi nh cung cp.
1.1.2.2. Cc c im chnh ca IaaS
Cc ti nguyn IaaS th c phn phi nh l dch v. Cc ti nguyn l:
cc my ch (server), thit b networking, b nh, CPU, khng gian vng nh, .v.v.
C s h tng thay i ng : bn c th iu chnh cc ti nguyn theo yu cu
s dng ca bn. IaaS trong cloud s p ng nhanh chng vic tng hay gim ti
7/24/2019 C ch qun l my ch o trong in ton m my
20/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/14
nguyn mt cch d dng. C chi ph bin i ngha l ty vo nhu cu s dng khc
nhau th cc khch hng s tr trn cc dch v . Khng c nh chi ph cho bt c
dch v no. IaaS thng c nhiu ngi thu. IaaS c nhng mc dch v khc nhau
p ng cho tt c nhu cu ca ngi dng.
1.1.2.3.
Kin trc v hot ng ca IaaS trong in ton m my
Khi thc thi mt yu cu t ngi s dng, cng vic c th thc hin song song
v chia s ti nguyn p ng yu cu cng nhanh cng tt.
Hoc l c th truy cp cc kho d liu khc nhau c th tha mn nhu cu ca
khch hng. IaaS trong m my phi m bo v s thc thi (performance) v
hiu qu chi ph trong khi bo tr cc iu khin trung tm v kh nng tng ti nguyn
bo m dch v khng b gin on.
7/24/2019 C ch qun l my ch o trong in ton m my
21/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/15
1.5 S truy cp ti nguyn phn cng ca cc my o
C 03 thnh phn chnh trong kin trc ca h thng cloud. l: cloud
manager, cluster manager v computer manager
Cloud manager l im truy cp vo cloud ni m cc nh thu bao ng
k ti khon, qun l cc ti nguyn m h thu t cloud v truy cp d liu. N thc
7/24/2019 C ch qun l my ch o trong in ton m my
22/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/16
hin vic truy cp ti nguyn mc u tin (top level). N quyt nh c ti
nguyn p ng yu cu khch hng hay khng v cluster manager s thc hin
yu cu. Cloud manager cng thc hin cc lut trn cloud i vi yu cu t khch
hng.
Cluster manager: Chu trch nhim vn hnh cc my thng qua
network. Cluster manager s nhn lnh / queries truy cp ti nguyn t cloud
manager v xc nh ti nguyn no c th p ng yu cu t ngi s dng . Sau
hin thc truy cp ti nguyn.
Computer manager: Hp tc vi hypervisor chy trn mi h thng my
tnh trong mt cluster. Trong vic p ng cc queries t Cluster manager. Cluster
manager tr v thng tin trng thi lin quan n ti nguyn c s dng v csn m c th c s dng.
1.1.3 Khi nim v tng quan v o ha
1.1.3.1. Khi nim o ha
o ho l cng ngh tin tin nht trong mt lot cc cuc cch mng cng
ngh nhm tng mc o ha h thng cho php tng hiu sut lm vic ca my tnh
ln mt cp cha tng c.
Cng ngh o ha cho php nhiu h iu hnh cng hot ng ng thitrn mt my vt l thng qua mn hnh my o (Virtual machine monitor - VMM
hoc hypervisors)
Hnh 1.6 minh ha mt cch tru tng v my o (Virtual Machine
Abstraction) khi thc hin ng dng, h iu hnh, ng b phn cng trn cc my
o khc nhau.
7/24/2019 C ch qun l my ch o trong in ton m my
23/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/17
1.6
o ha h thng my ch tc l ta tin hnh phn chia mt server thnh
nhiu server o hoc kt hp nhiu my ch vt l thnh mt my ch logic, i
vi ngis dng h nhn bit v s dng cc server o ging nh mt my vt l
c lp c cc ti nguyn cn thit (b vi x l, b nh, kt ni mng, ), trong
khi cc server o khng h c nhng ti nguyn c lp nh vy, n ch s dng ti
nguyn c gn t my ch vt l.
y, bn cht th nht l cc server o s dng ti nguyn ca my ch
vt l, bn cht th hai l cc server o c th hot ng nh mt server vt l c lp.
o ha tr thnh mt thnh phn khng th thiu trong mi m my datrn kh nng tru tng ha v bao ng. m my cn phi chy nhiu ng dng
ca ngi dng v tt c nhng ng dng hin th nh th chng ang c chy
ng thi v s dng tt c ti nguyn c sn ca cloud. o ha cung cp mc
tru tng cn thit nh cc ti nguyn tnh ton, lu tr, ti nguyn mng c
ng nht thnh pool hoc resource overlay. o ha cung cp tnh bao ng cho ng
dng c th c cu hnh, ci t, nng cp tng tnh bo mt v qun l tt hn.
7/24/2019 C ch qun l my ch o trong in ton m my
24/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/18
in ton m my hng n o ha trong hin thc v mt s l do sau:
Nhiu ng dng c th chy trn cng mt server, ti nguyn c th
c s dng hiu qu hn.
Kh nng cu hnh cao, nhiu ng dng yu cu ti nguyn khc nhau
nh s lng core, dung lng b nh. Vic cu hnh ny kh thc hin c mc
phn cng nhng l d dng trong o ha. V d: VMware.
Kh nng sn sng ca ng dng cao. o ha cung cp kh nng phc
hi nhanh sau nhng h hng cng nh kh nng nng cp m khng gy ngt
qung qu trnh s dng dch v ca ngi dng.
Kh nng p ng cao. o ha cung cp cc c ch theo di v bo tr
ti nguyn mt cch t ng, mt s ti nguyn thng thng c th c cache chovic dng li.
1.1.3.2. Li ch ca gii php o ha
Thng thng vic u t cho mt trung tm cng ngh thng tin l rt tn
km. Chi ph u t mua cc my ch cu hnh mnh v cc phn mm bn quyn
l rt t . Trong thi bui kinh t kh khn hin nay doanh nghip no cng
mun ct gim v hn ch ti a cc chi ph khng cn thit m vn p ng c
nng sut v tnh n nh ca h thng. Th nn vic ng dng o ha tr thnh nhu
cu cn thit ca bt k doanh nghip ln hay nh. Thay v mua mi my ch cho
mi ng dng th ch cn mua mt hoc hai my ch c h tr o ha th vn c
th chy tt mi ng dng trn. iu ny cho ta thy s khc bit gia h thng
o ha v khng o ha. Bn cnh vic ng dng o ha cn em li nhng li ch
sau y:
Qun l n gin
Trin khai nhanh
Phc hi v lu tr h thngnhanh
Cn bng ti v cung cp ti nguyn linh hot
Tit kim
o ha gp phn tngcng tnh lin tc
1.1.3.3. Kin trc o ha
Xt v kin trc h thng, cc kin trc o ha h thng my ch c th cc
7/24/2019 C ch qun l my ch o trong in ton m my
25/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/19
dng dng chnh l: Host-based, Hypervisor-based (cn gi l bare- metal
hypervisor, n c chia nh ra lm hai loi l Monothic Hypervisor v
Microkernel Hypervisor), Hybrid. Ngoi ra, ty theo tng sn phm o ha c
trin khai (nh VMWare, Microsoft HyperV, Citrix XEN Server) m mc o ha
c th s khc nhau.
Cc kin trc o ha my ch bao gm:
a. Kin trc Hosted-based:
Cn gi l hosted hypervisor, kin trc ny s dng mt lp hypervisor chy
trn nn tng h iu hnh, s dng cc dch v c h iu hnh cung cp phn
chia ti nguyn ti cc my o. Nu ta xem hypervisor ny l mt lp phn mm ring
bit, th cc h iu hnh khch ca my o s nm trn lp th 3 so vi phn cng
my ch.
Mt h thng o ha s dng M hnh Hosted-based c chia lm 4 lp hot
ng nh sau:
Nn tng phn cng
H iu hnh Host
H thng mn hnh my o - virtual machine monitor (hypervisor)
Cc ng dng my o: S dng ti nguyn do hypervisor qun l.
7/24/2019 C ch qun l my ch o trong in ton m my
26/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/20
1.7 ted - based
b. Hypervisor-based:
Cn gi l bare-metal hypervisor. Trong M hnh ny, lp phn mm
hypervisor chy trc tip trn nn tng phn cng ca my ch, khng thng qua
bt k mt h iu hnh hay mt nn tng no khc. Qua , cc hypervisor ny c kh
nng iu khin, kim sot phn cng ca my ch. ng thi, n cng c kh nng
qun l cc h iu hnh chy trn n. Ni cch khc, cc h iu hnh s chy trn
mt lp nm pha trn cc hypervisor dng baremetal.
7/24/2019 C ch qun l my ch o trong in ton m my
27/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/21
1.8Kin trc Hypervisor-based
Mt h thng o ha my ch s dng nn tng Baremeta l hypervisor bao
gm 3 lp chnh:
Nn tng phn cng:Bao gm cc thit b nhp xut, thit b lu tr (Hdd,
Ram), b vi x l CPU, v cc thit b khc (cc thit b mng, vi x l ha, mthanh )
Lp nn tng o ha Virtual Machine Monitor (cn gi l hypervisor),
thc hin vic lin lc trc tip vi nn tng phn cng pha di, qun l v cung
cp ti nguyn cho cc h iu hnh khc nm trn n.
Cc ng dng my o: Cc my o ny s ly ti nguyn t phn cng,
thng qua s cp pht v qun l ca hypervisor, khi mt h iu hnh thc hin
truy xut hoc tng tc ti nguyn phn cng trn h iu hnh ch.
c. Hybrid
Hybrid l mt kiu o ha mi hn v c nhiu u im. Trong lp o
ha hypervisor chy song song vi h iu hnh my ch . Tuy nhin trong cu trc
o ha ny cc my ch o vn phi i qua h iu hnh my ch truy cp phn
cng nhng khc bit ch c h iu hnh my ch v cc my ch ou chy
trong ch ht nhn. Khi mt trong h iu hnh my ch hocmt my ch o
cn x l tc v th CPU s phc v nhu cu cho h iu hnh my ch hoc my
7/24/2019 C ch qun l my ch o trong in ton m my
28/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/22
ch o tng ng. L do khin Hyrbird nhanh hn l lp o ha chy trong trong
ch ht nhn (chy song song vi h iu hnh) tri vi Virtual Machine
Monitor vi lp o ha chy trong trong ch ngi dng (chy nh mt ng
dng ci trn h iu hnh).
Phng php o ha Hybird c s dng trong hai sn phm o ha ph
bincal Microsoft Virtual PC 2007 v Microsoft Virtual Server 2005 R2.
1.9
1.1.3.4. Cng ngh my o (Virtual Machine)
My o l mt my tnh c ci trn mt h iu hnh khc hay mt my
tnh khc. Mt my o cng bao gm phn cng, cc ng dng phn mm v h iu
hnh. iu khc bit y l lp phn cng camy o khng phi l cc thit b
thng m ch l mt mi trng hay phn vng m n c cp pht mt s
ti nguyn nh l chu k CPU, b nh, a .
Cng ngh my o cho php ci v chy nhiu my o trn mt my tnh vt l.
7/24/2019 C ch qun l my ch o trong in ton m my
29/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/23
Mi my o c mth iu hnh my khch ring l v c phn b ti nguyn,
cng, card mng v cc ti nguyn phn cng khc mt cch hp l. Vic phn b
ti nguyn ny ph thuc vo nhu cu ca tng my o ng dng v cng ty
thuc vo phng php o ha c dng.
c bit khi my o cn truy xut ti nguyn phn cng th n hot ng
ging nh mt my tht hon chnh. V ch l mt tp tin c phn vng trn
a nn vic di chuyn cc my o t my ch ny sang my ch khc l rt d dng
v khng cn quan tm n vn tng thch phn cng hay nh hng ti my ch.
1.10 S truy cp ti nguyn phn cng ca cc my o
7/24/2019 C ch qun l my ch o trong in ton m my
30/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/24
Trong kin trc ca mt b x l o ha c chia thnh 4 lp:
Lp 0 l lp c quyn cao nht c th truy cp v can thip su nht n ti
nguyn phn cng. Lp 0 thng l cc h iu hnh ch c ci trn chnh my ch.
Lp 1 l lp o ha Hypervisor. Lp ny dng qun l v cung cp ti nguyn
n cc my o.
Lp 2 l cc h iu hnh khch chy trn cc my o. truy cp ti nguyn
phn cng n phi lin lc vi lp o ha v phi qua h iu hnh my ch.
Lp c quyn can thip thp nht n ti nguyn l lp 3. y l cc ng
dng hot ng trn cc my o. Trong cc h thng my tnh ln dng x l
cc ng dng thng mi v khoa hc (mainframe), h iu hnh chy trn phn
cng my thc ch u tin v ch c h iu hnh ch mi c php sa i
v can thip vo phn cng bn di n. Cn my o lm vic ch gii hn v
phn cng m n nhn thy ch lcc thit b o. Khi my o yu cu cc lnh hoc
tin trnh thng thng th h iu hnh ch s chuyn tip chng n b x l
thc thi trc tip, cn i vi cc lnh hoc cc tin trnh c bit nhy cm can thip
su n phn cng bn di s b chn li v c th lm nh hng ti h thng v
my o cn li. H iu hnh ch s thc thi lnh vi b x l trn my thc ri sau
m phng kt qu ri tr v cho my o. y l c ch nhm cch ly my o vimy thc m bo an ton h thng.
1.2 BI TON QUN L MY CH O
1.2.1 Cc phng cch qun l my o trong in ton m my trn th gii
Ti nguyn my o trong in ton m my c chia thnh 3 tng:
Tng Infrastructure (c s h tng): Dng qun l cc ti nguyn tnh
ton nh my tnh, RAM, ni lu tr d liu v h tng mng.
Tng Platform (nn tng):Bao gm i tng lu tr, tnh ng b, thi
gian thc, hng i v c s d liu.
Tng Application (ng dng): Bao gm cc ng dng nh ng dng
theo di, giao tip, truyn thng, ti chnh.
7/24/2019 C ch qun l my ch o trong in ton m my
31/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/25
Da trn vic qun l ti nguyn 3 tng trong in ton m my, cc ti
nguyn c phn thnh hai dng chnh:
Ti nguyn vt l (physical resources): My tnh, a lu tr, c s d
liu, h tng mng.
Ti nguyn lun l (logical resources): Cc ng dng dng thc thi,
v ng dng truyn thnggiao tip.
7/24/2019 C ch qun l my ch o trong in ton m my
32/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/26
Cc m hnh ca cc tng ti nguyn my o trong dch v in ton m my bao gm.
Infrastructure as a service (IaaS):y l m hnh dch v c bn nht cain ton m my, nh cung cp s cung cp my tnh c th l my vt l hoc
my o, ni lu tr, firewall, load balance v network. H scung cp theo nhng
ti nguyn d theo yu cu v thng thng n s c tch hp li trong mt trung
tm d liu v c truy xut thng qua a ch IP.
trin khai mt ng dng, ngi dng phi ci t h diu hnh thng qua cc
mn hnh o cng nhcc ng dng cn thit. Trong m hnh ny, ngi dng chu
trch nhim cho vic duy tr h iu hnh v phn mm ng dng. Nh cung cp stnh ph da trn cc ti nguyn c cp pht v tiu th.
Vi m hnh ny, cn phi qun l c ch chia s ti nguyn bao gm: Ti nguyn
phn cng, tng la bo v v mng.
Platform as a service (PaaS):Trong m hnh ny, nh cung cp s cung cp
nn tng in ton v gii php thc thi nhim v bao gm: H iu hnh, mi trng
thc thi ngn ng lp trnh, c s d liu v web server. Ngi pht trin ng dng
c th pht trin v chy cc gii php phn mm trn nn tng m my m khng
7/24/2019 C ch qun l my ch o trong in ton m my
33/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/27
quan tm n chi ph v phc tp ca vic mua bn, qun l phn cng v phn
mm. Vi mt s dch v cung cp, cc ti nguyn lu tr v tnh ton c th c
m rng mt cch t ng thng qua nhu cu ca ng dng, ngi dng khng phi
cp pht v qun l ti nguyn ny mt cch th cng.
Vi m hnh ny cn qun l c ch chia s ti nguyn nn tng t ng nh th
no cho hp l.
Software as a service (SaaS): Trong m hnh ny, nh cung cp s ci t,
thc thi cc ng dng trn m my v sau ngi dng truy xut nhng ng
dng t m my clients. Ngi dng khng bit cu hnh c s h tng m
my, cc phn mm hthng m ng dng thc thi trn . iu ny loi b i
vic ci t v chy ng dng trn my tnh ca ngi dng nhm n gin ha vic
bo tr.
c im ni bt lm cho ng dng m my khc bit nhng ng dng khc
chnh l tnh linh hot cao. Khnng ny cho php nhn bn cc cng vic thc
thi trn nhiu my o ti cng mt thi im.Vic iu phi c thc hin thng
qua load balancer. Qu trnh ny trong sut i vi ngi dng, h ch thy mt
im nhp duy nht. Chnh iu ny lm cho m my c kh nng phc v cho
nhiu ngi dng ti mt thi im thay v phi s dng hng i v phc v tun tnh li.
Vi m hnh ny cn c c ch iu phi cc ti nguyn my o nh th no cho
hp l.
C ch chia s ti nguyn o cho h thng gm hai cng vic chnh:
Lp lch hot ng cho cc my o.
Qun l cc my o.
C hai kiu lp lch cho cc my o.
Power aware scheduling: Cc cng vic c lp lch theo cch thc
gim thiu ti a lng nhit tng th trong cc trung tm d liu. Thay v gim nng
lng cho cc my ch, chin lc ny s lm gim nng lng phc v cho cc hot
ng lm mt trung tm d liu.
Themal aware scheduling: Cc cng vic c ln lch theo cch thc
nhm gim cng sut ca cc my ch v phn ln vic x l cc cng vic u din
7/24/2019 C ch qun l my ch o trong in ton m my
34/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/28
ra cc my ch.
Hnh 1.13
Qun l my o:Cng vic ny lin quan n qun l my o bng cch bt,
tt my o mt cch hp l. Vi mt chin lc hp l, nhng my khng s dng s
dng k thut tt my ng (dynamic shutdown techniques) tt v bt li khi cn
thit. C th dng Wake On LAN trong vic hin thc chin lc bt tt my o ny.
a.Lp qun l ti nguyn v qun l cng vic
B lp biu m my (CS) gim st cc cng vic v cc ngun ti nguyn
vi cc m my. Cc lp qun l m my bao gm cc lp ResourcePool, lp
nhm my o (Cluster classes), v cc lp my o (Virtual Machine classes).
ResourcePool l mt danh sch cc ti nguyn m my c c khi
khi to h thng, v c th cp nht theo thi gian thc.
Cluster class bao gm cc thng tin c nh miu t cc thuc tnh ca
mi m my v mt danh sch linh ng cc my o chy trn m my .
Virtual Machine classes bao gm cc thng tinv thuc tnh v tnh
7/24/2019 C ch qun l my ch o trong in ton m my
35/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/29
trng ca mt my o.
Lp qun l cng vic bao gm cc lp JobPool v cc lp cng vic (Job
Classes). Lp JobPool cha mt danh sch cc i tng cng vic c truy hi t b
lp trnh cng vic HTC Condor. Lp cng vic c thuc tnh ca cng vic t ngi
s dng yu cu.
b. Qun l my o
Khi b lp biu m my bt u khi ng v c cc file cu hnh m my.
Chui JobPoller duy tr trng thi v cc siu d liu ca cng vic
c a vo hng i v ang c chy trnB lp biu cng vic Condor v xp
cc hng i B lp trnh cng vic Condor vo JobPool.
Da trn cc thng tin Jobpool, b lp biu s kim sot cc my otheo cc yu cu cng vic.
Chui Cleanup dng cc my o khng cn c yu cu. N cng c
th cp nht li trng thi ca cng vic trong JobPool. Nu mt my o bt k b
ngt do xy ra mt li no , chui CleanUp s thay i trng thi cng vic trong
JobPool t c lp biu thnh hin trng mi, sau mt my o mi c th c
to rali cho cng vic .
Nu B lp biu m my b ngt, cc my o cng c th b ngt hocchng c th duy tr trng thi hin ti ca mnh. Do , cc my o c th tip tc
chy cc cng vic. Sau , B lp biu m my s ti li hin trng khi ckhi
ng li hoc khi phc li cc cng vic v cc ngun ti nguyn. Trong trng
hp ny, cc my o c cung cp cho tt c cc ngi dng vi cc cng vic
trong hng ch. Khi c yu cu mi t cc ngi dng khc, B lp biu m my
s lm cn bng li cc chia s ti nguyn my o bng cch ngt cc my o b qu
ti v khi ng cc my o cha qu ti.
c.Lp lch cng vic
B lp lch cng vic HTC Condor [7] c thit k qun l cc cng
vic u tin v lp k hoch. Nh cp, Cloud Scheduler c th nh hng
n vic lp k hoch cng vic ca Condor. V d, hy xem xt hai vic xp hng
i, cng vic trnh u tin i hi mt my o c kiu l VM-A, v mt cng
vic c yu cu th hai i hi mt my o c kiu l VM-B. NuCloud Scheduler
7/24/2019 C ch qun l my ch o trong in ton m my
36/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/30
bt u ln u tin vi VM-B (gi s cc ngun ti nguyn khi ng my o
VM-B c sn), sau cng vic VM-B s chy trc khi cng vic VM-A c
yu cu.
Cloud Scheduler c th c cu hnh a lm cho cc ti khon ngi
dng cn bng v ti nguyn v m bo tnh u tin s dng. Hin nay, Cloud
Scheduler s bt u vi nhiu my o cng vi cc ngun ti nguyn sn c trn h
thng. Cc my o c cung cp ng u n tt c ngi s dng vi cc cng vic
trong hng i.
Cloud Scheduler ti cn bng cung cp my o bng cch tt cc my o
c cung cp v khi ng cc my o khc c cp.
V d, mt ngi s dng s nhn c cp pht y ca my o My
Scheduler, nhng mt khi ngi dng th hai trnh cng vic, mt na s ngi s
dng my o u tin s c ng ca cc ngun ti nguyn min ph cho ngi
s dng th hai.
Cloud Scheduler c th ti cn bng cung cp my o bng cch tt my o
mt cch t t hoc bng cch ngay lp tc. Khi cu hnh tt my t t, Cloud
Scheduler chuyn tnh trng ca Condor sang cp pht chnh thc, v yu cu cc
my o trn phn b cho mt nhm khc. Khi Cloud Scheduler c cu hnh ttmy ngay lp tc, cc my o s tt my ngay lp tc m khng cn ch i cho cng
vic kt thc. Nu mt my o c tt trong khi cng vic ang chy, b lp trnh
cng vic HTC Condor s lp lch li cho cng vic v a n vo hng i ch
thc hin.
1.2.2 Vn la chn m hnh ph hp trin khai dch v in ton
m my ca cc nh cung cp ti Vit Nam
i vi Vit Nam, in ton m my ang l ch cng ngh nng hi v
c phn kh mi m, s am hiu v in ton m my ni chung v vn chia s
ti nguyn my o trong in ton m my ni ring cn cphn hn ch.
Mi m hnh dch v in ton m my c trin khai theo mt c ch khc
nhau. La chn m hnh hot ng theo c ch no trin khai dch v in ton
m my l mt bi ton quan trng i vi nh cung cp dch v.
C rt nhiu vn t ra lm sng t c bi ton nh:Dch v theo m hnh c phc tp trong vic trin khai khng?
7/24/2019 C ch qun l my ch o trong in ton m my
37/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/31
Nguyn l xy dng dch v theo m hnh ra sao?
M hnh c tiu tn ti nguyn khng?
Tc x l, hiu sut ca m hnh nh th no?C ging vi cc h
thng my thc vt l hay khng ?
Song song vi vic la chn m hnh dch v, nh cung cp dch v cn chng
mnh cho ngi s dng bit rng dch v o ha theo m hnh m mnh xy
dng hon ton c th p ng c cc tiu ch nh: Ngun ti nguyn dch v lun
sn sng p ng cng vic; M hnh ang trin khai hon ton ging vi h thng
my vy l tht nh trc y v tc ...
V d, nu trin khai theo c ch thit lp mt mi trng ng dng o bng
cch s dng cc ng dng o nh mt c ch chia s ti nguyn, th bt c khi noc yu cu cung cp nhiu ti nguyn hn, h thng t ng trin khai thm cc ng
dng o khc.Vi cch tip cn ny liu c gy lng ph cc ngun ti nguyn khng?
Trong in ton m my, cc nh cung cp dch v cho php khch hng
thu mt ngun ti nguyn o, trong h c th ty chnh li h iu hnh v mi
trng cho cc ng dng. Vic chia s ti nguyn gia cc cng vic l kh khn
bi v mi cng vic c yu cu ti nguyn khc nhau m khng th c tnh trc
mt cch chnh xc.Trong mt h thng cm o, khi ngi dng gi i mt yu cu, my o s p
ng thc hin cc nhim v. Nhng my o ny c iu khin bi mn hnh my
o. Bn cnh , cc mn hnh my o cqun l bi h thng qun l my o c
th cung cp ti nguyn cho cc trng hp my o ang chy trn cc cm vt l.
V mt l thuyt, s dng cng ngh my o lm tng s dng cm, v n ch
cung cp cho ngi s dng nhng ngun ti nguyn m h cn n. Cc my tnh
cho php hiu chnh li vic chia s ti nguyn trc tuyn c thc hin nh l mt
phn ca cc Mn hnh my o v h thng qun l my o. Tuy nhin, n rt phc
tp t c mc tiu bi v vn tn ti mt s tnh hung gi nh c th lm
gim hiu sut ca cc cm o. Cc gi nhbao gm:
CPU v b nh yu cu cho cc ng dng c th chy.
Mi cng vic yu cu ch c duy nht mt my o c thit lp.
Khi lng cng vic l c nh vi yu cu ngun ci nguyn khng i v
7/24/2019 C ch qun l my ch o trong in ton m my
38/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/32
khng c cng vic c nhp vo vo a ra khi h thng.
Cng ngh my o cho php chia s cc kh nng tnh ton ca mt my
ch lu tr trn CPU b rng buc .
Nhng thch thc ny c th lm tht bi ng dng chy trn m my.
Thng thng, cc thit b o c cu hnh li v sn sng chy my o cho cc
ng dng c th. gii quyt nhng vn trn y, cn nghin cu mt s c ch
chia s ti nguyn my o trong in ton m my, t xut ra mt c ch trin
khai th nghim dch v trn mt cm o, thc hin cc th nghim, a ra kt qu v
nhn xt nh gi, chng minh tnh kh thi ca n.
7/24/2019 C ch qun l my ch o trong in ton m my
39/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/33
CHNG 2
MT S
2.1 CHIA S TI NGUYN MY O
2.1.1 Thit lp mt mi trng ng dng o
H trin khai thit b o trn my vt l ring bit[1] cho cc ng dng c bit
v s dng mt b nh v ra quyt nh lp k hoch trn c s khi lng cng
vic c yu cu. Bt c khi no c yu cu cung cp nhiu ti nguyn hn, h
thng t ng trin khai thm cc ng dng o khc. Vi cch tip cn ny gy
lng ph cc ngun ti nguyn, bi v h cung cp cng mt lng ngun ti
nguyn thit b o mi cng c th hot ng ging nh cc thit b o khc ang
hot ng. Ngoi ra, s dng cc ng dng ang chy trong mi trng my o
c th theo di nhu cu ti nguyn ca h, v vic chia s ti nguyn c c linh
ng, mm do hn. N ngn chn rt tt cc xung t mt khi cc ng dng chia s
cc ngun ti nguyn cng chy.
2.1.2 sp xp li phc tp ca cc vn
H nh thc ha vn chia s ti nguyn ni chung da trn cc gi nh can. Sau , h sp xp li phc tp ca cc vn v xut cc thut ton
gii quyt vn .
H thng xem xt mt nhm cm my o ng nht da trn mt kt ni chuyn
mch, v c qun l bi mt h thng chia s ti nguyn. H thng p ng yu cu
ti nguyn ngi dng bng cch to ra mt nhm cc my o gi l "cm o", cng
vic s c gii quyt trn cm o.
Cc my o chy trn my ch vt l, v mi my o c kim sot bi mn
hnh my o. Mn hnh my o s yu cu ngun ti nguyn khc nhau cho mi my
o trn mi my ch vt l. Mn hnh my o hot ng di s qun l v iu hnh
ca h thng qun l cm my o hay gi l h thng qun l cm o. H thng qun
l cm o s xc nh v iu khin vic cp pht ti nguyn cho mi my o.
Ngoi ra, h thng qun l cm o cn c th iu khin vic di chuyn my o
gia cc my ch vt l, mi my ch vt l gi l mt nt, da trn tnh nng cnbng ti, vic iu khin di chuyn my o qua li gia cc my ch vt l vi mc
7/24/2019 C ch qun l my ch o trong in ton m my
40/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/34
ch s dng s lng t nht my ch vt l c th trong h thng cm o, nhng
vn p ng c yucu cng vic t ngi dng, gii phng cc my ch hot
ng vi cng sut thp. Do h thng qun l cm o s cung cp c ch phn b
ngun ti nguyn cho mi cng vic khi c yu cu.
Quyt nh chia s ti nguyn s c thc hin bi mt b cp pht ti nguyn
trong h thng cm o, quyt nh lin quan ti vic yu cu s b t chi hay chp
nhn khi ng ng mt my o no , lin quan ti vic di di my o t my ch
vt l sang my ch vt l khc, lin quan n t l tiu th ti nguyn b iu
chnh cc my o ca h thng. Mc tiu ca c ch l thit k mt thut ton phn
b ngun ti nguyn m thanh c thc hin ti trung tm ca cc cp pht ti nguyn.
2.1.3 Uc lng hiu sut ca mt ngun lc c cung cp
Trong c ch ny, tc gi trnh by mt kin trc c th c lng hiu sut
ca mt ngun lc c cung cp v tm mt gii php chia s ti nguyn ti u
trong khng gian tm kim vi quy m rt ln, l kin trc TARA
2.1Kin trc TARA
Cng c d bo c th vch ra c cc yu t chia s ngun ti nguyn theo
cc thng s s ph hp vi hm mc tiu. Sau cc ngun ti nguyn ny s c
7/24/2019 C ch qun l my ch o trong in ton m my
41/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/35
ch nh p dng vo cc yu cu cng vic c th. Trong h thng nguyn mu
ny, lp o ha v lp IaaS cng cungcp cc thng tin v ngun ti nguyn sn c
cho cng c d bo trc khi cng vic c ch nh ngun ti nguyn. Cu trc ny
gip nng cao kh nng chia s cc ngun ti nguyn vo cc nhm o. Mt cng vicno cn mt ngun ti nguyn s c cung cp y v hiu qu chy ng
dng mt cch hiu qu.2.1.4 Thut ton chia s ti nguyn
a) tng
Xy dng mt kin trc framework nhm mc ch qun l chia s ti
nguyn tnh ton trong in ton m my mt cch t ng, gim thiu vic tiu
th nng lng n mc c th km theo vic duy tr cht lng dch v mcchp nhn c. Mc tiu ca framework ny bao gm:
- a ra nhng chnh sch v c ch qun l ti nguyn mt cch t ng.
- Theo di v duy tr nhng mc tiu v hiu sut ca ng dng.
- Gim thiu ti a vic s dng nng lng khi chy cc dch v in ton
m my.
b) Thut ton
Input: Cc my ch o, ti nguyn my server vt l
Output: Server s p ng yu cu cho my o vi phng n ti u nht
7/24/2019 C ch qun l my ch o trong in ton m my
42/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/36
S khica thut ton:
Bt u
Theo di thng s vhiu sut ca my o
So snh vimc tiu
Tnh ton ti nguyntha yu cu rng buc
Chuyn yu cu vPhysical Machine
Manager
Kt thc
Thamn
khngtha mn
7/24/2019 C ch qun l my ch o trong in ton m my
43/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/37
c) Ci t
2.2 CN BNG TI
2.2.1 K thut cn bng ti
Nh chng ta bit, bcn bng ti c nhim vkt ni gia ngi dng v
server, do n c th hot ng nh mt proxy hoc gateway. Mt proxy c
nhim vlun chuyn yu cu v dliu p trgia ngi dng v server, trong
khi mt gateway chc nhim vto ra mt kt ni hai i tng ny v khng
lm g thm. C thsdng phn cng hoc phn mm c ci t trn mt front
server, hoc trn chnh web server [2]. Thm na, khi slng ngi dng tng ln,
trnh SPOF, cn thit phi ci t 2 bcn bng ti song song, hot ng theo c
chactive-active hoc active-backup.
Cc phn mm cn bng ti thng c ci t nh m t proxy. xy
dng mt b cn bng ti phn mm, cc k thut cn phi ch trng, l: kim
7/24/2019 C ch qun l my ch o trong in ton m my
44/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/38
tra trng thi server, la chn server tt nht gi yu cuv k thut duy tr kt
ni ca ngi dng.
2.2.1.1 Kim tra trng thi server
chn c server ph hp gi request, b cn bng ti cn phi bit
c server no ang c sn. V vy, n cn phi dng bin php no kim tra
trng thi ca server, chng hn nh gi lnh ping, cc yu cu, thkt ni hay bt
cphng php no m ngi qun trngh l dng c. K thut kim tra ny
thng c gi l health checks
Mt server bdown c thtrli lnh ping nhng khng thtrli cc kt ni
TCP, mt server btreo c khnng trli kt ni TCP nhng khng thtrli cc
yu cu HTTP. Khi mt ng dng web nhiu lp c kch hot, mt syu cu
HTTP c thtrli ngay lp tc trong khi skhc stht bi.
Chnh v th, vic chn mt phng php test ph hp c chp nhn bi
ng dng web v bcn bng ti l rt th v. Mt stest i khi phi cn truy xut
dliu database nhm m bo rng ton bqu trnh ca n l ng. Hn chln
nht l nhng phng php kim tra ny schim ti nguyn ca hthng nh l
CPU, threads
Do , cn bng thi gian kim tra chnh l vn kh nht trong kthut lachn server. Khong thi gian gia 2 ln test lin tip phi di khng tn qu
nhiu ti nguyn ca h thng v cng cn ngn nhanh chng pht hin ra
nhng server cht. V health checks l mt trong nhng kha cnh phc tp
nht ca kthut cn bng ti, nn thng sau mt vi kim tra, cc nh pht trin
ng dng sthc thi mt yu cu c bit dnh ring cho bcn bng ti, gip cho
n thc hin mt skim tra ni b.
Phn mm cn bng ti c khnng cung cp scripting, do n t c
linh hot rt cao. Thm na, nu nh mt bi kim tra no i hi phi chnh sa
code, n c ththc hin trong mt khong thi gian ngn.
2.2.1.2 La chn server tt nht
Vic la chn server tt nht chnh l phn chnh ca thut ton cn bng ti
c cp trong phn 2. Phng php dnht v thng c sdng nht trong
cc h thng nh l Round Robin, cc server c la chn quay vng, tuy nhinphng php ny c nhc im l 2 requests lin tc tmt ngi dng svo 2
7/24/2019 C ch qun l my ch o trong in ton m my
45/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/39
servers khc nhau, thng tin gia 2 yu cu lin tip sbmt, nh vy skhng th
ti u ha c sdng ti nguyn. c bit l khi cn phi ci t kt ni cho cc
phin chyv dnh SSL key negociation srt tn thi gian.
Mt cch khc phc nhc im ny l sdng mt hm bm theo a chIP,
nh vy requests tcng mt a chIP schvo mt server duy nht. Tuy vy
phng php ny i hi ngi dng phi c IP tnh. Vy th cch khc phc cho
nhng hn chtrn l g? chnh l cc kPersistence
2.2.1.3 Kthut Session Persistence
Nh cp trn, vn cn gii quyt chnh l lm sao gicho cc
yu cu ca mt ngi dng c gi vo mt my duy nht trong sut phin lm
vic ca ngi . Tt c cc yu cu ca ngi dng ny cn phi c chuyn
vo cng mt server. Nu server bcht, hoc ngng bo tr, cn phi c c ch
chuyn session ca ngi dng ny sang my server khc. chnh l kthut
Session Persistence.
C mt sgii php c a ra tip cn kthut ny, chng hn nh s
dng mt respone HTTP 302 hay to ra lin kt gia ngi dngserver. Tuy vy
2 phng php ny u c nhng hn ch, sdng HTTP 302 skhin ngi dng
lun lun tm cch kt ni vi mt server duy nht, kckhi server ny cht.Dng cch to lin kt i hi user phi c IP tnh trong sut phin lm vic.
Vy th cu trli cui cng l g? chnh l sdng cookie. Cookie l mt
i tng c iu khin bi Web Servers. Trong kt qutrvcho ngi dng
web servers s chn thm mt s thng tin. Nhng yu cu tip theo ca ngi
dng gi n server scha thm thng tin ca cookie ny, server sc cc cookie
v bit phi lm g vi cc yu cu ny.
2.2.2 Cc thut ton cn bng ti
2.2.2.1 Thut ton Round Robin (RR)
a) tng
RR l thut ton c dng thng xuyn nht trong cc h thng va v
nh, c t i hi vkhnng mrng. Mt kt ni mi sc gi n server k
tip trong cm server, v c quay vng nh vy. RR lm vic tt trong mi cu
hnh, nhng stt hn nu nh cc trang thit bang c cn bng ti khc nhauvtc xl, tt kt ni hoc bnh.
7/24/2019 C ch qun l my ch o trong in ton m my
46/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/40
Mt cch thc thi thut ton ny l s dng mt server_map. B cn bng
ti s c khai bo nh mt con tr proxy, n s c bin server_map l mt mng
cc server v bin srv_rr_idx ch nh server tip theo trong chu k round robin.
b) Thut ton
Input: hiu nng s dng ca my o, s my o trn mi server
Output: quyt nh di chuyn my o sang server mi
7/24/2019 C ch qun l my ch o trong in ton m my
47/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/41
S khi ca thut ton nh sau:
Bt u
Kim traserver_map
dn ghp my osang server mi
Kim traserver trng
Tt server
Kt thc
tha k
tha k
khng trng
7/24/2019 C ch qun l my ch o trong in ton m my
48/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/42
c) Ci t
/* Kim tra xem c server no sn c khng bng cch kim tra kch thcserver_map */
if(srv_map_size = 0)return NULL;if (srv_rr_idx > proxy->srv_map_size)
/* Nu n cui mng srv_map, update li gi trsrv_rr_idx */srv_rr_idx = 0;
int newidx = px->srv_rr_idx;
do {
srv = proxy ->srv_map[newidx++];
/* Trvserver v update li gi trsrv_rr_idx */
return srv;proxy->srv_rr_idx = newidx;
} while (newidx != px->srv_rr_idx)
/* Thc hin cho n khi ly c server tip theo */
RR hot ng tt khi cc server c khnng xl (cu hnh) tng tnhau,
tuy nhin sc hin tng mt cn bng khi cc server c cu hnh khc nhau, hoc
sau mt thi gian, skt ni ang hot ng mt server ang nhiu hn hn mt
server khc, nhng lng kt ni tip theo m cc server ny nhn c vn bng
nhau. Do mt sserver sphi xl nhiu hn hn cc server khc. Tuy vy, v
tnh n gin ca n, nn n hot ng rt hiu qu(khng phi mt thm thi gian
tnh ton cc thng skhc nn vic phn ti din ra rt nhanh). Nu cc server hot
ng bnh thng v khng xy ra scth sdng RR rt tt.
im yu ca RR l 2 yu cu lin tc t pha mt ngi dng c th s
c gi vo 2 server khc nhau. iu ny khng tt v khi ngi dng ang ckt ni vo mt server, thng tin m hcn ang server , nu kt ni tip theo
vn c server xl th sgp phn tng tc p ng cho ngi dng. Do
thut ton RR thng c ci t cng vi cc phng php duy tr session nh
sdng cookie.
2.2.2.2 Thut ton Weighted Round Robin (Ratio)
a) tng
7/24/2019 C ch qun l my ch o trong in ton m my
49/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/43
Nguyn l hot ng ca thut ton WRR cng ging nh thut ton RR, yu
cu tpha ngi dng sc bcn bng ti chuyn n cc server theo tht
xoay vng. Skhc bit duy nht y l thut ton WRR cn quan tm n kh
nng xl (cu hnh) ca cc server. Trong cng mt chu k, 1 server c khnng
xl gp i server khc snhn c gp i syu cu tpha bcn bng ti.
Gischng ta c 4 server A, B, C, D c cu hnh khc nhau, A v B c cu
hnh ging nhau, C v D c cu hnh mnh gp i A. Vy chng ta c thnh
trng scho A v B l 1, C v D l 2. Khi theo thut ton WRR, thtserver
nhn yu cu tpha bcn bng ti sl ABCDCD.
Thut ton ny c thc thc thi nh sau: Gischng ta mt hng i
cha cc server snhn request. Nu nh 1 server trng sn, trong hng i s
c n chmc (entry) ca cng 1 server ny, chng hn nh v dtrn, mi server
A, B sc 1 chmc, mi server C, D sc 2 chmc. Vi cch lu chmc nh
vy trong hng i, cc server trong WRR s c ly ra theo th t hon ton
ging nh RR.
Thut ton WRR hot ng tt hn RR khi cc server trong cluster c cu
hnh khc nhau. Tuy nhin s dng thut ton ny c th dn ti s mt cn bng ti
ng nu nh ti ca cc yu lin tc thay i trong mt khong rng (v d nhcc yu cu xem video hoc ti cc file c dung lng ln xen k vi cc yu cu
c thng tin...). Trong mt khong thi gian ngn, hon ton c kh nng phn ln
cc yu cu c ti cao s c chuyn hng n cng mt server.
b) Thut ton
Input: danh sch my o trn mi server, danh sch server
Output: khi to my o trn server c la chn
7/24/2019 C ch qun l my ch o trong in ton m my
50/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/44
S khi ca thut ton nh sau:
Bt u
Kim traserver_map
Khi to my o
Kim traserver trng
Kt thc
Gn ch s choserver
tha k
ng
sai
7/24/2019 C ch qun l my ch o trong in ton m my
51/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/45
c) Ci tGisnh chng ta c 3 server A, B, C vi trng sln lt l 1, 2, 3. Thut
ton s phn ti vo server theo th t ABBCCC. iu ny c ch nh trong
srv_map khi chng ta lu cp pht b nh cho mt server mi v lu n vosrv_map. Bin srv_rr_idx c dng chn server tip theo trong thut ton.
Thut ton RR c ci t nh sau: static inline struct server*get_server_rr_with_conns(struct proxy *px) {int newidx;/* Bin ny dng t gi trmi cho srv_rr_idx saukhi chn c server */struct server *srv;/*Kim tra nu kch thc ca srv_map bng khng, nghal khng tn ti server no ang hot ng, thut tontrvnull */
if (px->srv_map_sz == 0)return NULL;
/*Nu nh gi trca srv_rr_idx nhhn 0, hoc vtqu kch thc srv_map_sz, ngha l i n cuiserver map chng ta scp nhp gi trcho n bng 0*/if(px->srv_rr_idx < 0 || px->srv_rr_idx >= px->srv_map_sz)
px->srv_rr_idx = 0;/*Gn gi trca srv_rr_idx cho newidx */newidx = px->srv_rr_idx;
/*Thc hin vng lp cho n khi ly c server phhp lra y v newidx = pr->srv_rr_idx, chng ta sly c lun server tha mn, tuy nhin cn phi loitrtrng hp server y, hoc skt ni hinti ln hn skt ni cho php */
do {srv = px->srv_map[newidx++];if (!srv->maxconn || srv->cur_sess srv_rr_idx = newidx;
return srv;}if (newidx == px->srv_map_sz)
newidx = 0;} while (newidx != px->srv_rr_idx);
return NULL;
}
Thut ton WRR n gin v chy kh n nh trong phn mm Haproxy,
tuy nhin n cng c nhng nhc im m khng thkhc phc c.
7/24/2019 C ch qun l my ch o trong in ton m my
52/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/46
Thnht, v n phn phi ti theo hnh thc xoay vng, nn mt ngi dng
n vi website c thc y n cc server khc nhau, iu ny l khng nn
xy ra, v khi ngi dng c a vo mt server, ngha c thit lp kt
ni vi server , tip tc lm vic vi server ny cc yu cu tip theo sgip
ngi dng khng phi ti li mt scc i tng (chng hn nh c ti v
yu cu trc), hn na, sgip ngi dng khng phi thc hin li vic kt ni
server, iu ny c bit quan trng khi web-server c yu cu vbo mt, chng
hn nh kim tra SSL key. Nu yu cu ca mt ngi dng c a vo cc
server khc nhau, vic kim tra lin tc SSL key smt rt nhiu thi gian, lm tng
thi gian p ng ngi dng.
Chng ta c thkhc phc nhc im ny bng 2 cch. Cch thnht l s
dng cookie nh ni phn cookie ca chng 2. Cch th2 l sdng mt
hm bm theo a chIP ca ngi dng. Khi bcn bng ti nhn yu cu, n s
bm a chIP ca ngi dng. Cng mt gi trbm sc cho vo 1 server. Tuy
nhin phng php ny i hi ngi dng phi c IP tnh.
Nhc im th 2 l v phn phi theo kiu xoay vng, nn c th s xy ra
trng hp mt server phi phc v rt nhiu ngi dng, trong khi server khc li
nhn ri. iu ny c th khc phc bng cch s dng thut ton LeastConnections (LC)
2.2.2.3 Thut ton Least Connections (LC)
a) tng
Trong thut ton LC, yu cu tpha ngi dng sc chuyn vo serverc t kt ni nht trong hthng ti thi im . Thut ton ny c coi nh thutton ng, v n cn phi m skt ni "ang hot ng" ca cc server. Vi mt
hthng c cc server gn ging nhau vcu hnh, LC c khnng hot ng ttngay ckhi ti ca cc kt ni bin thin trong mt khong ln. Do sdng LC
skhc phc c nhc im ca RR.
Gi s chng ta c n server Si, i = 1, 2,...n. S lng connections ang hotng l Ci vi i = (1, 2,...,n). ALL_CONNECTIONS l tng Ci.
Yu cu tip theo s c chuyn n server j, trong :
Cj/ALL_CONNECTIONS = min {Ci/ALL_CONNECTIONS },
7/24/2019 C ch qun l my ch o trong in ton m my
53/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/47
i = (1, 2,...,n).
V gi tr ALL_CONNECTIONSl khng i ti thi im tnh nn chngta c th chn server Cj theo cng thc:
Cj = min {Ci}, i = (1, 2,...,n).
Nhn bn ngoi c v nh LC cng c kh nng hot ng tt khi cc server
c cu hnh bin thin khc nhau, trn thc t iu l khng ng. Vy th
nguyn nhn u? chnh l do trng thi TIME_WAIT ca TCP.
TIME_WAIT ny thng c t l 2 pht, trong 2 pht mt website "bn rn"
c th nhn ti hng chc ngn kt ni lin tc, gi s nh server A c kh nng x
l gp i server B, server A ang x l hng ngn yu cu v gi nhng yu cu
ny trong trng thi TIME_WAIT ca TCP, trong khi server cng phi x l
hng ngn yu cu nh server A, nhng v cu hnh server B yu hn nn s chm
chp hn rt nhiu. Nh vy, thut ton LC hot ng khng tt khi cc server c
cu hnh khc nhau.
b) Thut ton
Input: danh sch kt ni hin ti, danh sch cc server
Output: khi to my o trn server c la chn
7/24/2019 C ch qun l my ch o trong in ton m my
54/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/48
S khi cathut ton nh sau:
Bt u
Kim traserver_map
Khi to my o
Kim traserver trng
Kt thc
sp xp danh schserver theo ds kt ni
tha k
ng
sai
7/24/2019 C ch qun l my ch o trong in ton m my
55/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/49
c) Ci t
gis2 server A, B c trng sln lt l 1 v 2. Thut ton sm bo cho
ssession active B lun xp xgp i ssession active A, v chng ta ang so
snh ssession active/ trng sserver.
V vic kim tra s lng kt ni khng phi c thc hin ngay lp tc.
Trong mt hthng c ti cao, nu mt server l ang c t active session nht, n
snhn c yu cu, sau n snhn c lin tc yu cu, do slng active
session cha kp cp nhp. V vy, trong thut ton ny, chng ta cn trnh phn 2
yu cu lin tip vo cng mt server (chng ta ang xt vi bi ton khng c
cookie, ngha l 2 kt ni n t 2 clients khc nhau). Ngha l server va c
phn ti strthnh server cn trnh trong ln phn ti tip theo. y chng ta s
dng bin struct server *srvtoavoid.
if(srv != srvtoavoid){
}
Sau khi chn c server, chng ta s cp nhp li gi tr srvtoavoid bng
mt bin static
Static struct server *pre_server;
Pre_server = t;
Di y l hm thc thi thut ton least connections:
static inline struct server *get_server_lc(struct proxy
*px, struct server *srvtoavoid) {
int s; /*Sdng ly skt ni t nht ca mi
server da trn trng sca chng */
struct server *srv, *t;
/* Kim tra nu kch thc ca srv_map bng khng, ngha
l khng tn ti server no ang hot ng, thut ton trv
null */
if (px->srv_map_sz == 0)
return NULL;
7/24/2019 C ch qun l my ch o trong in ton m my
56/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/50
t = NULL;
s = 10000000;
/* Thc hin cho n khi tm c server ph hp, tng
gi tri v chn server no c t kt ni nht da trn bincur_sess v trng s*/
for(srv = px->srv; srv != NULL; srv = srv->next) {
if(srv != srvtoavoid) {
if (!srv->maxconn || srv->cur_sess (srv->cur_sess / srv-
>eweight ) || t==NULL) {
t = srv;
s = srv->cur_sess / srv-
>eweight;
}
}
}
}
pre_server = t;
return t;
}
2.3 LP LCH CNG VIC
B lp lch cng vic HTC Condor [7] c thit k qun l cc cng
vic u tin v lp k hoch. Nh cp, Cloud Scheduler c th nh hng
n vic lp k hoch cng vic ca Condor. V d, hy xem xt hai vic xp hngi, cng vic trnh u tin i hi mt my o c kiu l VM-A, v mt cng
vic c yu cu th hai i hi mt my o c kiu l VM-B. Nu Cloud Scheduler
bt u ln u tin vi VM-B (gi s cc ngun ti nguyn khi ng my o
VM-B c sn), sau cng vic VM-B s chy trc khi cng vic VM-A c
yu cu.
Cloud Scheduler c th c cu hnh a lm cho cc ti khon ngi
dng cn bng v ti nguyn v m bo tnh u tin s dng. Hin nay, Cloud
7/24/2019 C ch qun l my ch o trong in ton m my
57/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/51
Scheduler s bt u vi nhiu my o cng vi cc ngun ti nguyn sn c trn h
thng. Cc my o c cung cp ng u n tt c ngi s dng vi cc cng vic
trong hng i.
Cloud Scheduler ti cn bng cung cp my o bng cch tt cc my o
c cung cp v khi ng cc my o khc c cp.
V d, mt ngi s dng s nhn c cp pht y ca my o My
Scheduler, nhng mt khi ngi dng th hai trnh cng vic, mt na s ngi s
dng my o u tin s c ng ca cc ngun ti nguyn min ph cho ngi
s dng th hai.
Cloud Scheduler c th ti cn bng cung cp my o bng cch tt my o
mt cch t t hoc bng cch ngay lp tc. Khi cu hnh tt my t t, Cloud
Scheduler chuyn tnh trng ca Condor sang cp pht chnh thc, v yu cu cc
my o trn phn b cho mt nhm khc. Khi Cloud Scheduler c cu hnh tt
my ngay lp tc, cc my o s tt my ngay lp tc m khng cn ch i cho cng
vic kt thc. Nu mt my o c tt trong khi cng vic ang chy, b lp trnh
cng vic HTC Condor s lp lch li cho cng vic v a n vo hng i ch
thc hin.
2.3.1Thut ton Lp lch da trn Cn bng tia) tng
Ti ca my o c th hin qua thi gian thc thi d on ca nhim v
chy trn my o, gi l Vli. V ti ca host c biu din bi ti trung bnh ca my
o chy trn n, gi l HLi, ta c HLi=1
n
j
j
VL
n trong n l s my o chy trn
host.T HLi, gi tr ti trung bnh avgl v gi tr nh gi cn bng ti B ca mi
trng in ton m my c th nh ngha nh sau:
avgl= 1
m
i
HLi
m
B=
2
1
( )m
i
Li avgl
m
7/24/2019 C ch qun l my ch o trong in ton m my
58/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/52
Trong cc phng trnh trn, s host l m, gi tr B cng nh th cn bng ti
cng tt v gi tr B cng ln th cn bng ti km hn.
b) Thut ton
Input: ti nguyn host, cng sut x l ca host
Output: my o c ti nh nht
Cc bc thut ton:
Bc 1. Theo m hnh ti nguyn host, to tp ti nguyn host nh sau
H = {h0, h2, ... hm-1} v xp theo th t t di ln theo cng sut x l.
Bc 2. Theo m hnh nhim v, to tp nhim v H = {t0, t2, ... tm-1} Trong
qu trnh ny, b lp lch mc th nht to m t my o theo cc c tnh ca nhim
v, cung cp thng tin cu hnh cho vic gn ti nguyn v to my o.
Bc 3. Theo m t my o ca Nhim v t i T, chn mt ti nguyn host hj
c th t c ti nguyn yu cu v ti l nh nht. Nu host tn ti, to my o v
gn ti nguyn yu cu cho n, sau cp nht ti nguyn kh dng hFcap ca Host hj ,
nu khng nhim v tis xung cui hng i nhim v v ch lp lch tip theo.
Bc 4. Nu yu cu ti nguyn ca nhim v t igim i, th gii phng ti
nguyn tha m my o chim gi, v cp nht ti nguyn kh dng gi bi host.
Bc 5. Nu nhim v ti c hon thnh, th hu my o canhim v tiv gii phng ti nguyn c chim gi cho cc nhim v cha c thc thi khc.
Bc 6. Tnh gi tr nh gi cn bng ti B trong mi trng hin ti, nu B
ln hn ngng gi tr B0, iu ny ch ra trng thi cn bng ti km i, th chn mt
my o vi ti nh hn v chuyn n n host m c th t c yu cu ti nguyn
vi ti nh nht.
Bc 7. Lp li bc 3 n 6 cho n khi mi nhim v c hon thnh.
Trong thut ton trn, my o c lp lch cho host c ti nh nht trong mi
ln thc hin. u im l trnh qu ti cho host gi nhiu ti nguyn hn. Nu my
o hin thi c lp lch cho mt host, khi lng tnh ton tng ln, dn n ti ca
my o nng gy mt cn bng ti, th hot ng di chuyn ng c s dng,gi cn
bng ti trong mi trng hin ti.
c) Ci t
struct server {struct server *next;
7/24/2019 C ch qun l my ch o trong in ton m my
59/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/53
int state; /* server state (SRV_*) */
int cklen; /* the len of the cookie, to
speed up checks */
char *cookie; /* the id set in the cookie */
char *id; /* just for identification */
struct list pendconns; /* pending connections */
int nbpend, nbpend_max; /* number of pending
connections */
struct task *queue_mgt; /* the task associated
to the queue processing */
struct sockaddr_in addr; /* the address to
connect to */
struct sockaddr_in source_addr; /* the address to
which we want to bind for connect() */
short check_port; /* the port to use for the
health checks */
int health; /* 0->rise-1 = bad; rise->rise+fall-1 =
good */
int rise, fall; /* time in iterations */
int inter; /* time in milliseconds */
int result; /* 0 = connect OK, -1 = connect KO */
unsigned char uweight, eweight; /* user-specified
weight-1, and effective weight-1 */
unsigned int wscore; /* weight score, used during
srv map computation */
int cur_sess, cur_sess_max; /* number of currently
active sessions (including syn_sent) */
unsigned int cum_sess; /* cumulated number of
sessions really sent to this server */
unsigned int maxconn, minconn; /* max # of active
sessions (0 = unlimited), min# for dynamic limit. */
unsigned failed_checks, down_trans; /* failed checks
and up-down transitions */
unsigned failed_conns, failed_resp; /* failed
connect() and responses */
unsigned failed_secu; /* blocked responses because
of security concerns */
struct proxy *proxy; /* the proxy this server
belongs to */
};
2.3.2 Thut ton Lp lch da trn thut ton Gii thut di truyn ci tina) tng
7/24/2019 C ch qun l my ch o trong in ton m my
60/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/54
Phn ny s nghin cu thut ton lp lch GA ci tin, trong cc phng
php lp lch Min-Min v Max-Min c st nhp trong mt thut ton GA tiu chun.
Cc k thut Min-Min, Max-Min v Genetic c phn tch trong hiu nng cui cng
ca thut tonGA tiu chun v c s so snh vi GA ci tin.
b) Thut ton
Input: ti nguyn host, cng sut x l ca host
Output: my o c ti nh nht
To qun th vi ccphng n ngu nhin
Bt u
c lng miphng n
Chn b m
Phi hp lai cc ib m
nh gi ng vinmi
Chn c th cho th htip theo
Tha mniu kin
C
khng
7/24/2019 C ch qun l my ch o trong in ton m my
61/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/55
Thut ton di truyn ci tin
To qun th vi ktqu buc 2
Bt u
nh gi mi ngvin
Chn b m
Phi hp lai cc ib m
nh gi ng vinmi
Chn c th cho th htip theo
Kt thc
Tha mniu kin
C
khng
Tm phng thc biMin-Min v Max-Min
7/24/2019 C ch qun l my ch o trong in ton m my
62/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/56
c) Ci t
static inline struct server
*get_server_rr_with_conns(struct proxy *px) {
int newidx;
/* Bin ny dng t gi trmi cho srv_rr_idx sau
khi chn c server */struct server *srv;
/*Kim tra nu kch thc ca srv_map bng khng, ngha
l khng tn ti server no ang hot ng, thut ton
trvnull */
if (px->srv_map_sz == 0)
return NULL;
/*Nu nh gi trca srv_rr_idx nhhn 0, hoc vt
qu kch thc srv_map_sz, ngha l i n cui
server map chng ta scp nhp gi trcho n bng 0*/
if(px->srv_rr_idx < 0 || px->srv_rr_idx >= px-
>srv_map_sz)
px->srv_rr_idx = 0;
/*Gn gi trca srv_rr_idx cho newidx */
newidx = px->srv_rr_idx;
/*Thc hin vng lp cho n khi ly c server ph
hp lra y v newidx = pr->srv_rr_idx, chng ta sly c lun server tha mn, tuy nhin cn phi loi
trtrng hp server y, hoc skt ni hin
ti ln hn skt ni cho php */
do {
srv = px->srv_map[newidx++];
if (!srv->maxconn || srv->cur_sess srv_rr_idx = newidx;
return srv;}
if (newidx == px->srv_map_sz)
newidx = 0;
} while (newidx != px->srv_rr_idx);
return NULL;
}
7/24/2019 C ch qun l my ch o trong in ton m my
63/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/57
CHNG 3
3.1 T BI TON
Bi ton t ra l khi khch hng ng k lp hp ng thu 1 my ch vi
cu hnh theo yu cu, khch hng s t chn cu hnh trn website ca cng ty
cung cp dch v, sau h thng s t ng to my ch o tha mn yu cu cu
hnh ca khch hng yu cu.
Trong qu trnh khch hng s dng dch v, h thng tng tin hnh cn
bng ti, chia s ti nguyn my o , t ng lu tr, sao lu hay phc hi d liu
khi c s c ...3.2 PHN TCH NH GI LA CHN CNG C GII QUYT BI TON
3.2.1 Thit k h thng
S dng 2 trm lm vic thit lp nn mt m my vi My ch
Ubuntu 10.04. Ti s dng mt m ngun m l EUCALYPTUS framework
thit lp nn mt m my vi mt B iu khin m my (Cloud Controller -
CLC), mt B iu khin nhm (Cluster Controller - CC) v cc B iu
khin Nt (Node Controller - NC). Ti ci t b iu khin m my v b
iu khin nhm vo nt u, cui v ci t cc b iu khin nt trn mt my
tnh xch tay khc c ni vi mng ring ny. Ti s dng
EUCALYPTUS framework tora cc my o trn cc b iu khin nt. V
cui cng ca cng vic ci t th nghim, ti ci t Hadoop/MapReduce
framework nh gikt qu ca cc th nghim.
Vic thit k h thng bao gm thit k mng, ci t m ngun
Eucalyptus, cc gi software components, trin khai Hadoop/ MapReduce. Kt
qu t c ca thit k l mt h thng cm o hot ng theo c chCloud
Scheduler.
3.2.2 Thit k mng
Th nghim c trin khai trn mt my vi tnh bn v mt my tnh
sch tay nh hnh 3.1:
7/24/2019 C ch qun l my ch o trong in ton m my
64/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/58
\
3.1
7/24/2019 C ch qun l my ch o trong in ton m my
65/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/59
C hai my ch chy trn Ubuntu 10.04 servers OS. Trn my ch 1, ti ci
t b iu khin m my (Cloud Controller), b iu khin nhm
(Cluster Controller) v b iu khin Walrus (Walrus Controller). Trn mt my
ch khc, ti ci t b iu khin nt, my ny phi c tnh nng o ha trong
BIOS trc khi trin khai B iu khin nt Eucalyptus.
3.2.3 Ci t Eucalyptus
Chun b ci t Eucalyptus :
Trc tin, phi cp nht cc b m ngun bin dch bao gm:
C compilers
Java Developer Kit (SDK) phin bn 1.6 hoc cao hn
Apache phin bn 1.6.5 hoc phin bn cao hnlibc development files
pthreads development files
libvirt development files
Axis2C v rampart development files
Curl development files
openssl development files
u tin, cn ci t cc gi yu cu cn thit trc khi ci t
Ecalyptus: apt-get install bzr gcc make apache2-threaded-dev ant openjdk-6-
jdk libvirt-dev libcurl4-openssl-dev dhcp3-server vblade apache2 unzip curl
vlan bridge-utils libvirt-bin kvm vtun.
Sau thit lp mi trng cho Eucalyptus.
3.2.4 Ci t Hadoop
Nhu cu tm kim thng tin qu gi t khi lng ln dliu phi cu trcc to ra bi cc trang web, blog, mng truyn thng x hi.. l rt cao.
Chnh yu t dn lm tng s quan tm n cng ngh m ngun m Hadoop.
Phn mm m ngun m Hadoop, mt d n phn mm qun l d liu
Apache c 2 thnh phn ch yu l h thng file phn tn Hadoop (Hadoop
Distributed File System HDFS [4]) v MapReduce [8], c thit k h tr
cc ng dng s dng c s lng ln d liu cu trc v phi cu trc.
7/24/2019 C ch qun l my ch o trong in ton m my
66/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/60
3.2 Cu hnh Hadoop gi phn tn
Hadoop c th chy cc ng dng vi lng d liu ln mt cch nhanhchng, chnh xc, hiu qu cao bng cch lu v tnh ton d liu trn nhiu node
mt cch c lp, gip x l khi lng c terabyte v thm ch l
petabytes d liu phc tp tng i hiu qu vi chi ph thp hn
Khng ging nh cc h qun tr c s d liu truyn thng, Hadoop
c thit k lm vic vi nhiu loi d liu v d liu ngun. Cng ngh
HDFS ca Hadoop cho php khi lng ln cng vic c chia thnh cc khi
d liu nh hnc nhn rng v phn tn trn cc phn cng ca mt nhm
x l nhanh hn. Cng ngh ny c s dng rng ri bi mt s trang
web ln nht th gii, chng hn nh Facebook, eBay, Amazon, Baidu, v
Yahoo. Cc nh quan st nhn mnh rng Yahoo l mt trong nhng nh
ng gp ln nht i vi Hadoop.
7/24/2019 C ch qun l my ch o trong in ton m my
67/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/61
3.3
Nhn t bn ngoi, files lu trn HDFS cng ging nh lu trong
Windows hay Linux. C th To mi, xa, di chuyn, thay i tn Nhng trn
thc t, d liu c chia ra thnh cc block lu tr trn rt nhiu Node d liu(DataNode), mi block c nhiu bn sao, nhng thng thng, mc nh l 3,
lu trn nhiu DataNode khc nhau, phng khi mt DataNode no c s c th
h thng vn hot ng bnh thng. Ngoi ra cn c 1 (v ch 1) NameNode lm
nhim v qun l d liu v iu tit cc lnh i hi thao tc ng.
D liu u vo c phn chia thnh nhiu phn theo cch cho n c
th c phn phi trong mt cm cc my cho php x l song song. Theo cchnh vy, d liu trung gian to ra c x l song song [4], lm cho cch tip
cn ny l l tng i vi vic x l s lng d liu rt ln. Khi d liu u
vo c cung cp (vo trong h thng tp ca Hadoop [HDFS]), u tin n
c chia thnh cc phn v sau c phn phi ti cc nt [7] trong cm o
m my v c lu tr ti y.Cn MapReduce gip cho vic x l song
song c thun li, t nht gm 3 b phn: hm Map phn tch d liu
thnh cc cp (kha, gi tr); hm Reduce cn c vo cc kha gom tp
7/24/2019 C ch qun l my ch o trong in ton m my
68/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/62
hp cc cp nh vy li vi nhau v a ra kt qu; hm Main iu tit.
Mi mt thao tc Map hoc Reduce c gi l TaskTracker (theo di
nhim v). Thng thng TaskTrackers c chy trn DataNode (nt d
liu) gim ng truyn. Tasktrackers c JobTracker (theo di cng vic)cn c vo thng tin ca blocks khi to trn DataNode ph hp. JobTracker
khng nht thit chy trn cng my viNameNode.
3.2.5 S dng mt s gi m ngun m
a) OpenNebula
OpenNebula l mt ng dng m ngun m theo giy php ca Apache
c pht trin ti i hc Complutense de Madrid. Ngoi vic h tr xy
dng m my ring, OpenNebula ng h tng v cc cc m my lai[5].
m my lai cho php kt hp mt c s h tng m my ring t vi mt c s
h tng m my cng cng (nh Amazon) cho php cc mc m rng cao
hn.
3.4
7/24/2019 C ch qun l my ch o trong in ton m my
69/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/63
7/24/2019 C ch qun l my ch o trong in ton m my
70/79
7/24/2019 C ch qun l my ch o trong in ton m my
71/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/65
c) ECP
ECP (Elastic Computing Platform nn tng in ton linh hot) cung
cp mt giao din web ti libvirt, c cc c im ni bt nh kho cha nh v
hng dn ngi dng cng nh kh nng qun l mng rt tt. c im quantrng nht ca ECP l cc kho lu tr ca n v dng c to hnh nh cho my
o, n cho php mt ngi dng t xa truy cp qua din web m ngi dng
ny hon ton khng am hiu v k thut. Cc kh nng lu tr ca ECP hon
ton tha mn cho nhu cu thit k v kim tra cc chi tit ca my o. Tuy
nhin, bi v s gii hn v vic qun l mng ca n v qu trnh ci t yu
cu cn thm vo mt host trong mt cm my o, do ECP [8] vn cn
cha c nhiu ngi s dng ci t.
3.6
7/24/2019 C ch qun l my ch o trong in ton m my
72/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/66
d) Eucalyptus
Mt trong nhng gi m ngun m ph bin nht xy dng cc c s h
tng in ton m my l Eucalyptus (Elastic Utility Computing
Architecture for Linking Your Programs to Useful Systems - Kin trc inton tin ch linh hot lin kt cc chng trnh ca bn vi cc h thng c
ch) [3]. iu lm cho n c nht v nh l giao din ca n l tng thch vi
m my in ton linh hot Amazon - Amazon Elastic Compute Cloud
(Amazon EC2 giao din ca in ton m my ca Amazon). Ngoi ra,
Eucalyptus bao gm Walrus, l mt ng dng lu tr m my tng thch vi
Dch v lu tr n gin ca Amazon Amazon Simple Storage Service
(Amazon S3giao din lu tr m my ca Amazon).
Eucalyptus h tr KVM/Linux v Xen cho cc tng siu gim st v bao
gm vic trnh phn phi cm Rocks qun l phn cm. Kin trc ca h
thng EUCALYPTUS linh ng vi hai c im chnh: Kh nng m rng
v kh nng bo mt.
Kin trc ca EUCALYPTUS
Kin trc ca Eucalyptus c bn lp chnh.
7/24/2019 C ch qun l my ch o trong in ton m my
73/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/67
3.7Kin trc ca EUCALYPTUS
3.2.6 S dng thut ton lp lch da trn cn bng ti gii quyt bi ton
Trong qu trnh khch hng s dng dch v trn my ch o, chng trnh s
theo di v tin hnh lp lch hot ng cho cc my o m bo cho hiu qu hotng ca my o l tt nht.
struct server {
struct server *next;
int state; /* server state (SRV_*) */
int cklen; /* the len of the cookie, to
speed up checks */
char *cookie; /* the id set in the cookie */
char *id; /* just for identification */
struct list pendconns; /* pending connections */
int nbpend, nbpend_max; /* number of pending
connections */
struct task *queue_mgt; /* the task associated
to the queue processing */
struct sockaddr_in addr; /* the address to
connect to */
struct sockaddr_in source_addr; /* the address to
which we want to bind for connect() */short check_port; /* the port to use for the
health checks */
int health; /* 0->rise-1 = bad; rise->rise+fall-1 =
good */
int rise, fall; /* time in iterations */
int inter; /* time in milliseconds */
int result; /* 0 = connect OK, -1 = connect KO */
unsigned char uweight, eweight; /* user-specified
weight-1, and effective weight-1 */
unsigned int wscore; /* weight score, used during
srv map computation */
int cur_sess, cur_sess_max; /* number of currently
active sessions (including syn_sent) */
unsigned int cum_sess; /* cumulated number of
sessions really sent to this server */
unsigned int maxconn, minconn; /* max # of active
sessions (0 = unlimited), min# for dynamic limit. */
unsigned failed_checks, down_trans; /* failed checks
and up-down transitions */
7/24/2019 C ch qun l my ch o trong in ton m my
74/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/68
unsigned failed_conns, failed_resp; /* failed
connect() and responses */
unsigned failed_secu; /* blocked responses because
of security concerns */
struct proxy *proxy; /* the proxy this server
belongs to */
};
3.3 MTS KT QU
Giao din chnh ca chng trnh gm c 2 dch v l "Cloud computer"
dng thit lp cc my ch o, qun l thng tin, nng cp, bo tr bo dng
my ch o v dch v "Cloud monitoring" dng theo di gim st cc tintrnh hot ng ca cc my ch o
Hnh 3.8 Giao din chnh ca chng trnh th nghim
7/24/2019 C ch qun l my ch o trong in ton m my
75/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/69
Trc tin ngi dng tin hnh khi to my ch o, la chn mu h iu
hnh cho my ch o phc v cho qu trnh s dng sau ny.
Hnh 3.9 Khi to my ch o
Tip theo ngi dng tin hnh chn cc thng tin v phn cng my ch o
nh CPU, RAM, HDD ...
7/24/2019 C ch qun l my ch o trong in ton m my
76/79
7/24/2019 C ch qun l my ch o trong in ton m my
77/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/71
KT LUN
Trong qu trnh lm lun vn ti thu thp v tm hiu cc ti liu v
in ton m my v cc c ch qun l my ch o trong mi trng in ton
m my. Trong s cc c ch nhm qun l my ch o ti tp trung nghin cu
ba c ch l Chia s ti nguyn my o, Cn bng ti v Lp lch cng vic.
Sau khi hon thnh, lun vn t c mt s kt qu nh sau:
V mt lthuyt:
- Lun vn nu c tng quan m hnh in ton m my, hiu r hn
v ba m hnh dch v chnh trong in ton m my, l dch v Iaas, dch v
PaaS v dch v SaaS. Trong i su vo nghin cu dch v IaaS phc v
cho vic thit k mt h thng m phng, v ci t mt s th nghim kim
chng mc dch v IaaS chng ba.
- Tng hp ti liuv cng ngh o ha, cng ngh nn tng trong xy dng
dch v in ton m my.
- Trnh by c mt s kin thc mi v cc m ngun m Eucalyptus
framework v Hadoop/ Mapreduce, gip xy dng mt h thng m phng v
cm my o in ton m my.- Gip cho cc nh cung cp dch v in ton m my hiu r hn mt s
c ch chia s ti nguyn my o, cn bng ti,i su vo nghin cu c ch lp
lch, t quyt nh la chn m hnh dch v in ton m my theo c ch
ph hp.
V mt thc tin:
- thit k v xy dng mt h thng m my ring da trn m
ngun m Eucalyptus framework v Hadoop/ Mapreduce.
- Thc hin qu trnh p ng ca h thng khi c yu cu t pha ngi
dng bng vic s dng thut ton lp lch cng vic da trn c ch cn bng ti.
Tuy nhin, bn cnh nhng iu t c, lun vn vn cn mt s im
hn ch sau:
7/24/2019 C ch qun l my ch o trong in ton m my
78/79
S ha bi Trung tm Hc liu http://www.lrc-tnu.edu.vn/72
- V m hnh hot ng dch v in ton m my theo c ch chia s ti
nguyn my o, c th l c ch lp lch mi chdng li vic nghin cu
c ch, thit k h thng xy dng nn m hnh hot ng ca h thng cm
my o in ton m my, m cn cha i su vo chng minh tnh ti u ha
ca c ch.
xut nhng hng nghin cu v pht trin tip theo ca lun vn l:
Da trn c s t c, cn nghin cu cc phng php chng minh
tnh ti u ca c ch.
Nghin cu thm cc m ngun m khc xy dng cc h thng, t
c c s la chn ph hp hn cho vic pht trin dch v. Tch hp giao
din nn tng in ton m my Amazon EC2 m m ngun m Eucalyptus
h tr, thng qua EC2 API.
Trong cc nghin cu tip theo, c th ti s a ra c mt vi phng
php khc nhm ti u ha s chia s ti nguyn my o thc s cn thit
trong in ton m my.
7/24/2019 C ch qun l my ch o trong in ton m my
79/79
TI LIU THAM KHO
Ti liu ting Vit
[1] Nguyn Vit Hng, Trn L Vinh (2012), Tnh ton li- Qun l
ti nguyn trong in ton m my, Bo co SEMINAR, Trng i hc Bch
khoai hc Quc gia TP.HCM, TP.HCM.
[2] Hng Phc (2005), Ti u Ha Thc Thi Mng Vi Content Switching
Server, Firewall V Cn Bng Ti, NXB Thng k.
Ti liu ting anh
[3] Anat Batat and Dror G. Feitelson (1999), Gang scheduling with
memory considerations, International Parallel and Distributed Processing
Symposium, (14), pp. 109-114.
[4] Damien Cerbelaud, Shishir Garg, and Jeremy Huylebroeck,
(2009), Opening the clouds : qualitative overview of the state-of-the-art
open source VM-based cloud management platforms, ACM/IFIP/USENIX
International Conference on Middleware, (10) pp. 1-8.
[5] Daniel Nurmi, Rich Wolski, Chris Grzegorczyk, Graziano
Obertelli, Sunil Soman, Lamia Youseff, and Dmitrii Zagorodnov (2008),
Eucalyptus: A technical report on an elastic utility computing architecturelinking your programs to useful systems, Computer Science Department
University of California, Santa Barbara Santa Barbara, California.
[6] Dhruba Borthakur (2007), The Hadoop Distributed File System:
Architecture and Design. The Apache Software Foundation.
[7] Mohammad Farhan Husain, Pankil Doshi, Latifur Khan,
and Bhavani Thuraisingham (2009), Storage and Retrieval of Large RDF
Graph Using Hadoop and MapReduce, Martin G. Jaatun, Gansen Zhao, and
Chunming Rong, editors, Cloud Computing, (5931), pp. 680686.
Top Related