Netflow Analysis using Elastic Stack - 조인중

16
NetFlow Analysis with Elastic Stack Elasticsearch Seoul Meetup [email protected]

Transcript of Netflow Analysis using Elastic Stack - 조인중

Page 1: Netflow Analysis using Elastic Stack - 조인중

NetFlow Analysis with Elastic Stack

Elasticsearch Seoul Meetup

[email protected]

Page 2: Netflow Analysis using Elastic Stack - 조인중

Presenter

manager at SK broadband [email protected]

I don’t have any f**king Btv coupons!

Page 3: Netflow Analysis using Elastic Stack - 조인중

What is NetFlow?

• Cisco router feature that provides the ability to collect IP network traffic information on interfaces

• Main components – Flow Exporter

– Flow collector (logstash)

– Analysis application (elasticsearch)

– Visualization (kibana or whatever works)

Source: Wikipedia

Page 4: Netflow Analysis using Elastic Stack - 조인중

NetFlow Architecture

Source: Wikipedia

Page 5: Netflow Analysis using Elastic Stack - 조인중

NetFlow Protocol (v5 header)

Source: https://www.plixer.com/support/netflow_v5.html

Page 6: Netflow Analysis using Elastic Stack - 조인중

NetFlow Protocol (v5 record)

Source: https://www.plixer.com/support/netflow_v5.html

Page 7: Netflow Analysis using Elastic Stack - 조인중

What we can do with NetFlow

• Application usage analysis

• Troubleshoot network problem

• Track down bandwidth hogs

• Detect abnormal traffic usage

• Detect hosts infected by malwares

• …

Page 8: Netflow Analysis using Elastic Stack - 조인중

Elastic Stack - NetFlow

• Logstash: NetFlow collector

• Elasticsearch: NetFlow storage & analysis

• Kibana: Visualization

Page 9: Netflow Analysis using Elastic Stack - 조인중

System Architecture

이보다 더 간단할 수 없다.

Page 10: Netflow Analysis using Elastic Stack - 조인중

Logstash Configuration (input)

Page 11: Netflow Analysis using Elastic Stack - 조인중

Logstash Configuration (filter)

Enrichment with geolocation info

Calculate estimated traffic volume (need to consider sampling rate)

Page 12: Netflow Analysis using Elastic Stack - 조인중

Logstash Configuration (output)

Page 13: Netflow Analysis using Elastic Stack - 조인중

Template for NetFlow data

Page 14: Netflow Analysis using Elastic Stack - 조인중

Collected data sample

Page 15: Netflow Analysis using Elastic Stack - 조인중

Demo! Demo!! Demo!!!

Page 16: Netflow Analysis using Elastic Stack - 조인중

Thank you.