Real User Monitoring at Scale @ Atmosphere Conference 2016
Transcript of Real User Monitoring at Scale @ Atmosphere Conference 2016
![Page 1: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/1.jpg)
Real User Monitoring at scaleJarosław Bloch Albert Łącki
![Page 2: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/2.jpg)
PL
SKHU
RS
CH
![Page 3: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/3.jpg)
![Page 4: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/4.jpg)
20 mln real users
7 mln requests every minute
150 mln PV daily
![Page 5: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/5.jpg)
3 data centers
3 000 servers and devices
130 Gbps traffic
![Page 6: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/6.jpg)
40 teams
> 250 deployments daily
300 specialists
![Page 7: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/7.jpg)
![Page 8: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/8.jpg)
Speed
search +0,4s PV/UU -0,5%
load +35% Revenue -5%
load +250ms PV/UU -1,8%
Revenue/UU -4,3%
![Page 9: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/9.jpg)
![Page 10: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/10.jpg)
Component monitoring
![Page 11: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/11.jpg)
Service monitoring
![Page 12: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/12.jpg)
User experience
Our responsibility
Under our control
![Page 13: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/13.jpg)
External monitoring
![Page 14: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/14.jpg)
![Page 15: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/15.jpg)
![Page 16: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/16.jpg)
Real User Monitoring
![Page 17: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/17.jpg)
?
![Page 18: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/18.jpg)
Real User Monitoring
?
? ?
collection
ingestion processing presentation
![Page 19: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/19.jpg)
Data collection
![Page 20: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/20.jpg)
<script> var data = collect(); data.send();</script>
Data collection
![Page 21: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/21.jpg)
Navigation Timing API
onLoadDOM
Processing
ResponseRequestTCP, DNSRedirects
navigationStart
fetchStart
requestStart
responseStart domLoading
responseEnd domInteractive
domComplete
![Page 22: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/22.jpg)
Resource Timing API
![Page 23: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/23.jpg)
JS Errors
try { …} catch (ex) { collect(ex);}
![Page 24: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/24.jpg)
Data collection
data
![Page 25: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/25.jpg)
DC-1
Accelerator
DC-2
GET
![Page 26: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/26.jpg)
HTTP 202
Data collection
data
![Page 27: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/27.jpg)
Script injection
![Page 28: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/28.jpg)
Script injection
<js>
![Page 29: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/29.jpg)
Data ingestion
5 min
![Page 30: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/30.jpg)
Data ingestion
![Page 31: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/31.jpg)
Kafka
Partition 1
Partition 2
Partition 3
![Page 32: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/32.jpg)
Data replication
DC-2 DC-1
![Page 33: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/33.jpg)
DATA
DATA EVERYWHERE
![Page 34: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/34.jpg)
METRICS
METRICS EVERYWHERE
![Page 35: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/35.jpg)
Storm
Topologymetrics
data
![Page 36: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/36.jpg)
Presentation
![Page 37: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/37.jpg)
Graphite
sum(metric1, metric2)highestMax(services.*, 10)…
![Page 38: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/38.jpg)
Graphite3 millions metrics
![Page 39: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/39.jpg)
Custom alerts
![Page 40: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/40.jpg)
![Page 41: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/41.jpg)
Druid
![Page 42: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/42.jpg)
Real User Monitoring
![Page 43: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/43.jpg)
Deployments
![Page 44: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/44.jpg)
Instant feedback
![Page 45: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/45.jpg)
![Page 46: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/46.jpg)
![Page 47: Real User Monitoring at Scale @ Atmosphere Conference 2016](https://reader031.fdocument.pub/reader031/viewer/2022030214/588aa25f1a28ab4c308b4a87/html5/thumbnails/47.jpg)
Thank you!