Elastic{ON} Tour 2018 Munich : Telekom

Elastic{ON} Tour Munich - February 1, 2018

Smart Tracing at Deutsche Telekom - Revealing the secrets behind modern networks with the Elastic Stack

Data drives our modern world but most data is never seen and yet its implications can be wide ranging. Using the Elastic Stack and its data analytics techniques, Smart Tracing works like an x-ray to reveal what sits behind modern networks based on network data. It uses the hidden data which network equipment and devices use to communicate with each other to create new insights into performance issues, security threats and network faults.

Alexander Sobania | Senior Expert Functional Strategy | Deutsche Telekom

Transcript

1. Alexander Sobania, Senior Expert Functional Strategy, Deutsche Telekom Smart Tracing at Deutsche Telekom - Revealing the secrets behind modern networks with the Elastic Stack
2. SMART Tracing Alexander Sobania
3. Data is the new oil Clive Humby 2006 Smart Tracing Introduction 3 What is the most valuable data we have in our Network? Alexander Sobania
4. 4 Tracing the Challenge Majority of the operational use cases could be fulfilled with captured data from the network but… Why don’t we leverage it today? ¡ Data silos ¡ Probe vendor “lock” the network data ¡ Vendor and product specific data ¡ Necessity to “normalize” the data ¡ “Data umbrella” over “data umbrella” ¡ Virtualization will bring new challenges Alexander Sobania
5. Accessibility How should we access it? ¡ Use open APIs to access the data Data Collection What data should we collect? ¡ De-facto standard - pcap Where to get it from? ¡ Legacy TAPs or Network Elements Usage How should we use the raw data? ¡ Apply probe visualization on top for call-flows ¡ Use scripts for automation ¡ Find new use cases (e.g. ML/AI) Data Storage What data should we store? ¡ Convert pcaps to human readable json Where should we store it? ¡ Use “Big Data” technologies to store the data ¡ Horizontally scalable and process can be parallelized 5 Smart Tracing Concept 1 2 3 4 Alexander Sobania
6. Live capture DNS analysis SMART Tracing Deployment Examples Data Collection Analytics Storage Conversion 6 Alexander Sobania EPC test automation VoLTE pcaps analysis Use Cases Wireshark/Tshark Polystar/Kibana/Gra fana
7. Capturing ¡ Copy the Network traffic ¡ Capture it with e.g. wireshark or tcpdump Converting ¡ Convert the pcap files to json with t-shark ¡ “Tshark -T ek” 7 Wireshar k pcap pcap pcap T-shark json json json json Uploading ¡ Upload json to elasticsearch ¡ Curl … /_bulk Analyze ¡ Use kibana dashboards & discovery https://www.elastic.co/blog/analyzing-network-packets-with-wireshark-elasticsearch-and-kibana SMART Tracing Detailed description Alexander Sobania
8. Vendor discussions Drive the Industry 8 Alexander Sobania NGMN White Paper ¡ DTAG in lead ¡ Orange ¡ BT ¡ Telcel ¡ Tele2 ¡ Telekom Austria https://www.ngmn.org/publications/all- downloads.html?tx_news_pi1%5Bnews%5D=675&cHash=ae863dc49952575ba259bcda76fe8b5 0
9. Pilot the concept ¡ First plan is for 2018 in a Mobile Network Make it public ¡ Communication on multiple channels started ¡ Liaison Statements are send out to 3GPP, ETSI and TM Forum Show that it is working ¡ Demos for multiple use cases are being prepared and will be shown internally and in public 9 SMART Tracing Next Steps Alexander Sobania Expand the Community