2018 LG전자 영업보고서 0325 - lge.co.kr · lg트윈타워 본사, 전사 경영전략 수립 등 서울특별시 영등포구 여의대로 128 lg서울역빌딩 한국영업본부
카카오 전사 모니터링/로깅/알람플랫폼 KEMI
Transcript of 카카오 전사 모니터링/로깅/알람플랫폼 KEMI
![Page 2: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/2.jpg)
Who�am�I?�
Issac(임성국)�
2007~2009:�Mobile�Health�Care�
2009~2010:�Open�API�서비스�플랫폼�
2010~2014:�KT�Open�API�플랫폼�
2014�~:�Kakao�Openstack,�CMDB,�Logging,�Monitoring,�…
![Page 3: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/3.jpg)
KEMI?�
(Kakao�Event�Metering�&�monItoring)�
카카오의�모든�리소스(baremetal,�private�cloud,�public�cloud,�container)에서�발생하는�데이터를�수집하고,�필요한�이벤트를�만들어�필요한�곳으로�전달하자!
![Page 4: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/4.jpg)
왜�KEMI를?�
구글�has�StackDriver�
Netflix�has�Genie�and�atlas�
kakao?
![Page 5: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/5.jpg)
왜�KEMI를?�
for�Production�Service�on�the�openstack�
KAKAO�infra(CMDB)와도�자동�연동된�모니터링/알람이�필수!
![Page 6: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/6.jpg)
Ceilometer,�monasca,�cacti,�nagios,�…��
CMDB기반으로�자동화된�툴을�만들어보자!
![Page 7: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/7.jpg)
KEMI는?
![Page 8: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/8.jpg)
수집�
조회/알람�
제어�
->�Realtime/Batch
![Page 9: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/9.jpg)
RealTime
![Page 10: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/10.jpg)
Batch
![Page 11: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/11.jpg)
Set�by�API�&�UI
![Page 12: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/12.jpg)
Log는?
![Page 13: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/13.jpg)
Realtime�&�Batch
![Page 14: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/14.jpg)
![Page 15: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/15.jpg)
Issue…
![Page 16: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/16.jpg)
save�&�query�large�time�series�data(more�than�year)�
-�slow�query�&�cluster�hang�
->�restructuring�
origin�hbase�key:�[salt]<metric_uid><timestamp><tagk1><tagv1>[…
<tagkN><tagvN>]�
->�
[salt]<resource_id><timestamp><metric_uid><metric�value1>[…<tagkN><tagvN>]
![Page 17: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/17.jpg)
Elasticsearch�Log�Indexing:��
no�replica,�more�shards,�ES�on�Hadoop�
kafka�Msg�Corruption:�
invalid�message�exception�handling
![Page 18: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/18.jpg)
Is�it�enough?
![Page 19: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/19.jpg)
Automatic�Resource�Mgmt�
Prediction�
More�features��
&�Open�source…
![Page 20: 카카오 전사 모니터링/로깅/알람플랫폼 KEMI](https://reader036.fdocument.pub/reader036/viewer/2022082217/58700c171a28ab427f8b7453/html5/thumbnails/20.jpg)
Thanks�
(@hardy,�@jenny,�@joanne,�@andrew�&�@@ccc)