マイクロサービスを利用する側のパフォーマンス向上策 (PyCon JP 2016)
47
https://www.monotaro.com/
-
Upload
monotaro-it -
Category
Software
-
view
709 -
download
0
Transcript of マイクロサービスを利用する側のパフォーマンス向上策 (PyCon JP 2016)
https://www.monotaro.com/
https://www.monotaro.com/ 2
https://www.monotaro.com/ 3
https://www.monotaro.com/ 4
https://www.monotaro.com/ 5
•
•
•
•
•
•
https://www.monotaro.com/ 6
https://www.monotaro.com/
–
7
https://www.monotaro.com/
–
8
https://www.monotaro.com/ 9
MonotaRO http://www.slideshare.net/monotaro-itd-pr/monotaro-20150320-devlove
https://www.monotaro.com/ 10
https://www.monotaro.com/ 11
https://www.monotaro.com/ 12
https://www.monotaro.com/ 13
https://www.monotaro.com/ 14
12 API
https://www.monotaro.com/ 15
https://www.monotaro.com/ 16
APIAPIAPI API
AP Server
https://www.monotaro.com/ 17
APIAPIAPI API
AP Server
https://www.monotaro.com/ 18
https://www.monotaro.com/ 19
https://www.monotaro.com/ 20
https://www.monotaro.com/ 21
https://www.monotaro.com/ 22
Ordered by: cumulative time
ncalls tottime percall cumtime percall filename:lineno(function) 1 0.000 0.000 3.330 3.330 run_web.py:134(application) 1 0.000 0.000 3.330 3.330 (フレームワーク初期化) 1 0.000 0.000 3.249 3.249 (フレームワーク初期化) 1 0.000 0.000 3.180 3.180 (フレームワーク初期化) 1 0.000 0.000 3.180 3.180 (画面実装部分) 19 0.000 0.000 2.991 0.157 (画面実装部分) 19 0.000 0.000 2.920 0.154 (画面実装部分) 10 0.000 0.000 2.865 0.286 (画面実装部分) 7591 2.784 0.000 2.784 0.000 {method 'recv' of '_socket.socket' objects} 19 0.000 0.000 2.275 0.120 lib\urllib2.py:122(urlopen) 19 0.000 0.000 2.275 0.120 lib\urllib2.py:373(open) 19 0.000 0.000 2.274 0.120 lib\urllib2.py:401(_open) (略)
https://www.monotaro.com/ 23
https://www.monotaro.com/ 24
Boost application performance using asynchronous I/O http://www.ibm.com/developerworks/library/l-async/
https://www.monotaro.com/ 25
Boost application performance using asynchronous I/O http://www.ibm.com/developerworks/library/l-async/
https://www.monotaro.com/ 27
https://www.monotaro.com/ 28
# 標準ライブラリにモンキーパッチ # 必ず標準ライブラリの前に書くこと！ from gevent import monkeymonkey.patch_all()
# urllib2が非同期IO版に置換される import urllib2 import gevent
https://www.monotaro.com/ 29
def get_json(self, url, params): response = urllib2.urlopen(url).read() return json.loads(response)
# 変更前 (urlopenで待たされる) result = self.get_json(any_url, any_params)
https://www.monotaro.com/ 30
def get_json(self, url, params): response = urllib2.urlopen(url).read() return json.loads(response)
# get_jsonはすぐには実行しない future = gevent.spawn(self.get_json, any_url, any_params) (他の処理を実行できる)
# future.get()実行結果が来るまでブロック result = future.get()
https://www.monotaro.com/ 31
future1 = gevent.spawn(self.get_json, url1, param1) future2 = gevent.spawn(self.get_json, url2, param2) future3 = gevent.spawn(self.get_json, url3, param3) future4 = gevent.spawn(self.get_json, url4, param4) future5 = gevent.spawn(self.get_json, url5, param5) …
https://www.monotaro.com/ 32
from gevent.lock import Semaphore
# セマフォを用いて同時処理数を50に制限 semaphore = Semaphore(50)
def get_json(self, url, params): # このコンテキスト内には同時に最大50しか入れない with semaphore: response = urllib2.urlopen(url).read() return json.loads(response)
https://www.monotaro.com/ 33
from gevent.pywsgi import WSGIServer
http_server = WSGIServer(('', 5000), app)http_server.serve_forever()
https://www.monotaro.com/ 34
gevent.spawn
https://www.monotaro.com/ 35
APIAPIAPI API
AP Server
https://www.monotaro.com/
API
[ms]
https://www.monotaro.com/ 37
APIAPIAPI API
AP Server
https://www.monotaro.com/ 38
https://www.monotaro.com/
APIAPIAPI API
AP Server
39
https://www.monotaro.com/
40
APIAPIAPI API
AP Server
https://www.monotaro.com/ 41
https://www.monotaro.com/ 42
https://www.monotaro.com/ 43
https://www.monotaro.com/ 44
https://www.monotaro.com/ 45
https://www.monotaro.com/ 46
https://www.monotaro.com/ 47
