Decentralized Control of Cooperative Robotics System Using ...
DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基...
-
Upload
eunice-kennedy -
Category
Documents
-
view
233 -
download
8
Transcript of DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基...
![Page 1: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/1.jpg)
DONAR Decentralized Server Selection for Cloud Services
B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如
2011.06.21
![Page 2: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/2.jpg)
Introduction
The trend toward geographically-diverse server placement will only continue and increasingly include smaller enterprises, with the success of cloud-computing platforms like Amazon AWS .
These services all need an effective way to direct clients across the wide area to an appropriate service location (or “replica”).
![Page 3: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/3.jpg)
說文解字: Replica Selection
Geo-replicated services need an effective way to direct client requests to a particular location, based on performance, load, and cost.
![Page 4: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/4.jpg)
Replication Selection 兩大主流
central coordination distributed heuristics(DONAR)
優點(1) reliability(2) security
同時解決(1) client performance(2) server load
缺點
(1) single point of failure
(2) attractive target for attackers
(3) overhead
(4) less responsive to sudden changes
(5) scalability limitations
(1) nodes over-react based on their own local information
(2) the system does not balance replica load effectively
![Page 5: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/5.jpg)
Replica-Selection System 必備特質
[1] Expressive
Customers should have a sufficiently expressive interface to specify policies based on (some combination of) (1) performance, (2)replica load, and (3) server and bandwidth costs.
[2] ReliableThe system should offer reliable service to clients, as well as stable storage of customer policy and replica configuration data.
[3] AccurateClient requests should be directed to the service replicas as accurately as possible, based on the customer’s replica-selection policy.
[4] ResponsiveThe replica-selection system should respond quickly to changing client demands and customer policies without introducing instability.
[5] Flexible The nodes should support a variety of replica-selection mechanisms
[6] SecureOnly the customer, or another authorized party,should be able to create or change its selection policies.
![Page 6: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/6.jpg)
本篇主角: DONAR
This paper presents DONAR, a distributed system that can offload the burden of replica selection, while providing these services with a sufficiently expressive interface for specifying mapping policies.
![Page 7: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/7.jpg)
1.2 Decentralized Replica-Selection System
mapping node 的任務
(1) direct its clients
(2)adapt to changing conditions
![Page 8: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/8.jpg)
Roadmapsection
2Simple and expressive interface for customer policies
section 3
Stable, efficient, and accurate distributed replica-selection algorithm
section 4
Scalable, secure, reliable, and flexible prototype system
section 5
Experiments in Section 5 evaluate both our distributed algorithm operating at scale and a small-scale deployment of our prototype system
section 6
compares DONAR to related work
section 7
concludes
![Page 9: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/9.jpg)
2.1 Customer GoalsCustomers use DONAR to optimally pair clients with service replicas
minimize the network latency
balance load across all replicas
billing costs
![Page 10: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/10.jpg)
2.2 Application Programming Interface
create a DONAR services = create ()
add a replica instance i = add (s, repl, ttl) time-to-live period (ttl)
set split weight set (s, i, wi, εi)
set bandwidth cap set (s, i, Bi)
match a client-replica pairmatch (s, clnt, i)
prefer a particular replica preference (s, clnt, i)
remove a replica instanceremove (s, i)
![Page 11: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/11.jpg)
Roadmapsection
2Simple and expressive interface for customer policies
section 3
Stable, efficient, and accurate distributed replica-selection algorithm
section 4
Scalable, secure, reliable, and flexible prototype system
section 5
Experiments in Section 5 evaluate both our distributed algorithm operating at scale and a small-scale deployment of our prototype system
section 6
compares DONAR to related work
section 7
concludes
![Page 12: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/12.jpg)
3.1 Global Replica-Selection Problem
若想提高網路效能,就得以 accurate load distribution 為代價。
Our goal is to minimize this performance penalty
![Page 13: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/13.jpg)
3.2 Distributed Mapping Service
每個 mapping node 各有其負責的 clients
The node maps the client to a replica , and returns the result to that client.
![Page 14: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/14.jpg)
3.2 Distributed Mapping Service
所有 clients 的 traffic, node n 所佔的比例
mapping node n 所有的 traffic 中,從 client c 而來的比例
所有從 client c 而來,經過 mapping node n 的 traffic , 流入 replica i 的比例 , i.e., ∑i Rnci = 1
![Page 15: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/15.jpg)
3.3 Decentralized Selection Algorithm
optimization decomposition : 藉由 algorithmic iterations, 讓 local decisions converge to the global optimum.
global performance local client performance
![Page 16: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/16.jpg)
The optimization of local performance.
每一個 mapping node 以 client population & replica 上的 load term 來 optimizes local performance
the unit price of violating the constraint.
True proportion of requests directed to replica i
![Page 17: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/17.jpg)
local replica selection
某特定 mapping node n, 將其所負責之所有 clients 的 traffic 引到 replicas 所需的 performance penalty.
loadn = load, n∀;超出預期流量的罰款。
( 以一個 mapping node 的視野看世界 )
![Page 18: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/18.jpg)
The core components of the algorithm are the local updates by each mapping node, and the periodic updates of replica prices.
![Page 19: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/19.jpg)
overhead
centralized solution
distributed solution
Each node needs to share its mapping decisions of size and each replica’s price λi needs to be known by each node. This implies messages, each of size computational complexity is of size
每個 mapping node 會有 |N-1| 個 mapping node 的鄰居。他們會告訴此 mapping node 個與replica mapping 有關的消息。
個 replicas 會告訴每一個mapping node 他們的 price
![Page 20: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/20.jpg)
DONAR’s system design
![Page 21: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/21.jpg)
DONAR’s system design
![Page 22: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/22.jpg)
Distribution optimization---tracking requests geographically
A group of similarly
located end-hosts.
![Page 23: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/23.jpg)
Distributed Optimization--Tracking Requests Geographically
![Page 24: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/24.jpg)
Distributed Optimization--Exponentially weighted moving average
![Page 25: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/25.jpg)
Distributed Optimization--Known cost assumption
![Page 26: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/26.jpg)
DONAR’s System Design
![Page 27: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/27.jpg)
Decomposed Local ProblemFor Some Node (n*)
![Page 28: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/28.jpg)
DONAR Algorithm
![Page 29: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/29.jpg)
DONAR Algorithm
![Page 30: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/30.jpg)
DONAR Algorithm
![Page 31: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/31.jpg)
DONAR Algorithm
![Page 32: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/32.jpg)
DONAR Algorithm
![Page 33: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/33.jpg)
Better!
![Page 34: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/34.jpg)
DONAR’s System Design
![Page 35: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/35.jpg)
Protocol-level mechanisms forWide-area replica selection
![Page 36: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/36.jpg)
Data Retrieving Steps
![Page 37: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/37.jpg)
Data Retrieving Steps(cont.)
![Page 38: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/38.jpg)
DONAR’s System Design
![Page 39: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/39.jpg)
Secure Registration and Dynamic Updates
![Page 40: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/40.jpg)
DONAR’s System Design
![Page 41: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/41.jpg)
Distributed Data Storage
![Page 42: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/42.jpg)
CRAQ(Chain Replication with Apportioned Queries)
“while maintaining the strong consistency properties of chain replication, provides lower latency and higher throughput for read operations by supporting apportioned ( 分攤 ) queries: that is, dividing read operations over all nodes in a chain, as opposed to requiring that they all be handled by a single primary node.”
![Page 43: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/43.jpg)
DONAR’s System Design
![Page 44: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/44.jpg)
IP Anycast
![Page 45: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/45.jpg)
Software Architecture
![Page 46: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/46.jpg)
Results: DONAR Curbs Volatility
![Page 47: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/47.jpg)
Results: DONAR Minimizes Distance
![Page 48: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/48.jpg)
Conclusions
![Page 49: DONAR Decentralized Server Selection for Cloud Services B96B02016 生化科技四 張煥基 B97901184 電機三 姜慧如 2011.06.21.](https://reader036.fdocument.pub/reader036/viewer/2022062301/56649e9c5503460f94b9d226/html5/thumbnails/49.jpg)
Thank You