Global ONOS SDN-IP Deployment Ping-Chun Huang 

About Me NCTU SDN-IP Deployment 2 m 黃秉鈞 [email protected] l 交通大學資工所 系統實務組 (丁組) l 無線網際網路實驗室 (曾建超教授指導) 碩士班 l 開放原始碼專案貢獻 – ONOS ( ON.Lab SDN Controller ) – Mininet ( ON.Lab SDN Simulator ) – OpenNet ( D-Link NCTU SDWLAN Simulator ) – OpenvWRT ( OpenvSwitch + OpenWrt ) l ONOS Voting Community 2016 Team Member l SDNDS-TW Co-Founder l NCTU SDN-IP Project Tech Lead 

About SDN-IP m Allows an SDN to connect to external networks on the Internet using standard Border Gateway Protocol (BGP) m SDN-IP is just an ONOS application l Uses ONOS to install and update appropriate data forwarding rules Transit network 

Global ONOS SDN-IP Deployment Map NCTU SDN-IP Deployment 4 

Global SDN-IP Deployment Team Member NCTU SDN-IP Deployment 5 1. Internet2 l 40 OF switches around US, 5 sites connected 2. AmLight l 4 OF switches around South America and Miami 3. GEANT l Multiple end-points all around Europe 4. KREONET l 4 OF switches distributed in two cities in Korea 5. AARENT 6. NCTU l 4 OF switches in Taiwan 

ONOS SDN-IP Implementation at NCTU NCTU SDN-IP Deployment 6 m Goals and Motivations of SDN-IP m NCTU SDN-IP Implementation l NCTU SDN-IP Topology l Software Stack l Verification m SDN-IP Rack l Hardware Components l Open Source Projects m Live Demo in ONS 2016 m Future work 

Goals and Motivations of SDN-IP NCTU SDN-IP Deployment 7 m Goals l Create a global SDN network – via REN l Let entities communicate at L3 without legacy routers in the network core m Demonstrate that ONOS can work l In real network scenarios l Providing high performance, HA and scalability REN: Research & Education Network 

ONOS SDN-IP Implementation at NCTU NCTU SDN-IP Deployment 8 m Goals and Motivations of SDN-IP m NCTU SDN-IP Implementation l NCTU SDN-IP Network Topology l Software Stack l Verification m SDN-IP Rack l Hardware Components l Open Source Projects m Live Demo in ONS 2016 m Future work 

NCTU SDN-IP Network Topology NCTU SDN-IP Deployment 9 ONOS Cluster L2 ToR Switch OF1 OF4 OF2 OF3 via NCHC/PacificWave via NCHC/StarLight NCTU Test Net 2 Quagga1 Quagga2 NCTU Test Net 1 AmLight KREONET Control Link Data Link 

Flows of eBGP and iBGP NCTU SDN-IP Deployment 10 iBGP eBGP ONOS Cluster L2 ToR Switch OF1 OF4 OF2 OF3 via NCHC/PacificWave via NCHC/StarLight NCTU Test Net 2 Quagga1 Quagga2 NCTU Test Net 1 AmLight KREONET AS 65113 AS 65110 AS 65120 AS 65111 AS 20080 

Flows in Control Plane and Data Plane NCTU SDN-IP Deployment 11 ONOS Cluster L2 ToR Switch OF1 OF4 OF2 OF3 via NCHC/PacificWave via NCHC/StarLight NCTU Test Net 2 Quagga1 Quagga2 NCTU Test Net 1 AmLight KREONET Control Data 

NCTU SDN-IP L2 Connections NCTU SDN-IP Deployment 12 NCTU NCHC StarLight@CHI PacificWave@LA KREONET AmLight vlan 2016 vlan 3785 

Software Stack NCTU SDN-IP Deployment 13 Application Hardware Box Hypervisor Virtual Machine 

Configuration Verification NCTU SDN-IP Deployment 14 m Automatic configuration verification and management m Ansible l IaC (Infrastructure as Code) for automatically managing and provision through source code Ø Adopt Ansible to – Quickly verify network or machine status – Manage multiple machines through one simple command Server Command (via ssh) Control Machine 

Ansible Ad-Hoc Commands Use Case NCTU SDN-IP Deployment 15 1. Inventory configurable l Classifying operating systems – 14 instances, 7 group types 2. Use Ansible command to control systems l Show machine uptime ansible onos –m command –a “uptime” l Display Status # Ansible Inventory # Ubuntu [onos] onos1 onos2 onos3 # PicaOS [of_switch] nctu-of1 nctu-of2 nctu-of3 nctu-of4 

NCTU SDN-IP Implementation - SDN-IP Self-Verification at NCTU NCTU SDN-IP Deployment 16 m Verification environment set up l Two additional ASs l Stream server and stream client, respectively m BGP information exchanged between ASs m Stream traffic routed from AS 65110 to AS 65120 Internet Quagga OF4 L2 Switch perfSONAR 10.113.10.0/24 NCTU SDN-IP Quagga OF2 L2 Switch 10.113.20.0/24 AS 65113 AS 65120 AS 65110 Stream Server Stream Client 

Self-Verification Video Stream Demo NCTU SDN-IP Deployment 17 

ONOS SDN-IP Implementation at NCTU NCTU SDN-IP Deployment 18 m Goals and Motivations of SDN-IP m NCTU SDN-IP Implementation l NCTU SDN-IP Network Topology l Software Stack l Verification m SDN-IP Rack l Hardware Components l Open Source Projects m Live Demo in ONS 2016 m Future work 

SDN-IP Rack NCTU SDN-IP Deployment 19 42u Rack Cabinet NCTU-of1 Switch (10G) NCTU-of2 Switch (10G) NCTU-of3 Switch (10G) NCTU-of4 Switch (10G) ONOS cluster NCTU Quagga 2 (AS 65113) 40U 26U 30-27U 31U 32U 33U 34U 38-35U 39U 25U 24U L2 ToR Switch (1G) NCTU BGP 2 (AS 65120) 22U NCTU Quagga 1 (AS 65113) 23U NCTU BGP 1 (AS 65110) L2 ToR Switch (1G) 42, 41U 

Hardware Components NCTU SDN-IP Deployment 20 m ONOS Controller l Accton SAU5081I-AC m Quagga Router l White Box Server m OpenFlow switch (10G) l Data Plane l Edgecore AS5712-54X + Pica8 PicOS (OVS mode) m L2 ToR switch (1G) l Control Plane l Edgecore AS4610-54T + Pica8 PicOS (L2/L3 mode) 

Open Source Projects NCTU SDN-IP Deployment 21 m ONOS 1.5 (Falcon) m Quagga m Open vSwitch 2.3.0 m Ubuntu 14.04.4 LTS m Ansible 2.0 

Global SDN-IP Deployment Live Demo in ONS 2016 NCTU SDN-IP Deployment 22 m Live video stream 

Direct Streaming from NCTU to AmLight NCTU SDN-IP Deployment 23 

Redirect Streaming via KREONET NCTU SDN-IP Deployment 24 

Taiwan on ONOS NCTU SDN-IP Deployment 25 

SDN-IP Booth at ONS 2016 NCTU SDN-IP Deployment 26 T hi 

Future Work NCTU SDN-IP Deployment 27 m Bring more SDN R&E network operations in Taiwan l Scale-out scope l More opportunities for international exchange m For ON.Lab l Support multi-table pipeline switches 

Special Thanks NCTU SDN-IP Deployment 28 

Want to know more? NCTU SDN-IP Deployment 29 m SDN Project l sdnds-tw/SDN-IP-Example-VM l sdnds-tw/Ryu-SDN-IP m Youtube l Global R&E Deployment Powered by ONOS l ONOS Lightning Talk: Global SDN deployment powered by ONOS 

Join SDNDS-TW Community NCTU SDN-IP Deployment 30