R-CORD Overview - CORD Workshop, GNTC

D907136acebc72f1df878541b26f271a?s=47 Phil Huang
November 29, 2017

R-CORD Overview - CORD Workshop, GNTC

#onf #cord #gntc #edgecore

D907136acebc72f1df878541b26f271a?s=128

Phil Huang

November 29, 2017
Tweet

Transcript

  1. R-CORD Overview Phil Huang 黃秉鈞 Edgecore Networks Solution Engineer /

    phil_huang@edge-core.com ONF CORD Ambassador / phil@cord-ambassadors.org Global Network Technology Conference 2017, Beijing, China, Nov. 29, 2017
  2. 2 黃秉鈞 Phil Huang • Member of ONF Ambassador Steering

    Team • Edgecore Networks Solution Engineer • SDNDS-TW Co-Founder Ref: https://www.linkedin.com/in/phil-huang-09b09895/ ONF: Open Networking Foundation
  3. Telco Central Office (CO) Mobile Residential Enterprise Central Office Can

    be small or large and has different names in different contexts 3 • CO is a service provider’s gateway to its customers • There are 1000+ of COs • Per CO may support § 10K+ residential subscribers § 10K+ mobile subscribers § 1K+ enterprise customers • CO providers a great vantage point for service providers
  4. Residential Network 4 PC CPE ONU OLT BNG Internet Home

    Roadside CO
  5. Challenges • Source of high CAPEX and OPEX • Lack

    of programmability inhibits innovation • Limits ability to create new services and revenue ØHard to create innovative services 5
  6. What is CORD? 6 Central Office Re-architected as a Datacenter

    SDN + NFV + Cloud Open Source Software Commodity Hardware (Servers, White-Box Switches, I/O Blades) Large number of COs Evolved over 40-50 years 300+ Types of equipment Huge source of CAPEX/OPEX
  7. Traditional Service Provider Network 7 Aggregation Switch … OLT …

    ONU ONU Splitter Splitter … BNG Switch Internet Reliability ☹ Scalability ☹ Flexibility ☹ Cost
  8. Data Center Leaf-Spine Fabric 8 Reliability Scalability Flexibility Latency Cost

    Bandwidth Spine Leaf
  9. CORD: Software Stack 9 XOS ONOS Access- as-a-Service Subscriber- as-a-Service

    Internet- as-a-Service CDN OpenStack / Docker vSG ... vRout er ... Multicast Control Fabric Control VTN Ceilometer Monitoring- as-a-Service Scalable Services Run in OpenStack VMs and Docker Containers Control Applications Hosted by ONOS Multi-Tenant Services Assembled by XOS
  10. Trellis An Open-Source, White-Box, SDN Based Leaf-Spine Network Fabric 10

  11. Trellis Multi-purpose leaf-spine fabric designed for NFV White Box Hardware

    Open Source Software SDN Based
  12. Dual Homing Routing Bridging vRouter IPv6 VLAN L3 DHCP Relay

    and more… Trellis Features
  13. Trellis Data Plane Redundancy Spine Switch Spine Switch ECMP group

    ECMP group Leaf Switch Leaf Switch Leaf Switch Leaf Switch Access Equipment
  14. Underlay Fabric – Open Hardware 14 White Box SDN Switch

    Edgecore Switches Spine Switch 10G/40G/100G ports downlink to leaf switches GE mgmt. White Box SDN Switch Edgecore Switches Leaf Switch 10G/40G ports downlink to servers and vOLT 10G/40G/100G ports uplink to different spine switches ECMP across all uplink ports GE mgmt. OF-DPA Community or Commercial Support: - AS5712-54X (10G) - AS5812-54X (10G) - AS5912-54X (10G) - AS5916-54XM (10G) - AS6712-32X (40G) - AS7712-32X (100G)
  15. Underlay Fabric – Software Stacks 15 BRCM ASIC OF-DPA Indigo

    OF Agent OF-DPA API OpenFlow 1.3 Leaf/Spine Switch Software Stack OCP Software - ONL ONIE OCP Bare Metal Hardware BRCM SDK API ONOS OCP: Open Compute Project ONL: Open Network Linux ONIE: Open Network Install Environment BRCM: Broadcom Merchant Silicon ASICs OF-DPA: OpenFlow Datapath Abstraction Open Networking Linux Based on OF-DPA pipeline
  16. L2 Unicast 16 Leaf1 Leaf2 Spine1 Spine2 Host1 Host2 Host3

    OLT Upstream Router Quagga ONOS
  17. L2 Broadcast 17 Leaf1 Leaf2 Spine1 Spine2 Host1 Host2 Host3

    OLT Upstream Router Quagga ONOS
  18. L3 Unicast 18 Leaf1 Leaf2 Spine1 Spine2 Host1 Host2 Host3

    OLT Upstream Router Quagga ONOS
  19. L3 Multicast 19 Leaf1 Leaf2 Spine1 Spine2 Host1 Host2 Host3

    OLT Upstream Router Quagga ONOS
  20. vRouter Integration 20 Leaf1 Leaf2 Spine1 Spine2 Host1 Host2 Host3

    OLT Upstream Router Quagga ONOS BGP Data
  21. vSG Integration 21 Leaf1 Leaf2 Spine1 Spine2 Host1 Host2 Host3

    OLT Upstream Router Quagga ONOS Q-in-Q
  22. Put everything all together… 22 Leaf1 Leaf2 Spine1 Spine2 Host1

    Host2 Host3 OLT Upstream Router Quagga ONOS
  23. • Upcoming ONOS 1.12 release (Dec 2017) • Dual-homing (released

    1.11.1) fixes for known issues • Pseudowire support • Initial QoS support • IPv6 additional features • DHCPv6 relay additional features (contributed by Nokia) • IPv6 Multicast (contributed by Nokia) • IPv6 Router Advertisement app (contributed by Infosys) • Support for New ASICs & Bare-metal switches • Broadcom Qumran (QMX) • Cavium Xpliant • Quanta switches (QCT LY8) • Barefoot Tofino using P4 (not in 1.12 release) Trellis Roadmap
  24. • What is Trellis? • Multi-purpose leaf-spine fabric • Built

    with à bare-metal hardware + open-source software + SDN • Overlay + Underlay when used in CORD • Why Trellis? • Designed for SP use cases & NFV • SDN allows simpler, easier & more-optimized features • SDN + P4 = new features in hardware • Open-source gives SP’s ownership & full customizabilty • Trellis Roadmap • Different roadmaps for Trellis, and the use of Trellis in CORD Summary of Trellis
  25. Trellis Demo at CORD Build 2017, USA 25

  26. 26

  27. Virtual Optical Line Terminal Hardware Abstraction 27

  28. Disaggregated Optical Line Termination 28 GPON Chassis-Type OLT GPON Line

    Card GPON Line Card GPON Line Card Switching Board Control Board Backpalne Each GPON OLT IO Blade is connected to TOR switch with 40/100Gbps uplink port Disaggregated OLT GPON OLT IO Blade GPON OLT IO Blade GPON OLT IO Blade ToR Switch x86 Server vOLT Control App
  29. AT&T Open GPON Hardware Spec • 48 Port, 1RU, I/O

    Pizza box • GPON MAC • GPON protocol management • 802.1ad-compiant VLAN bridging • Ethernet MAC 29
  30. ToR ToR ToR Spine Spine Spine ToR ToR ToR ToR

    SDN Controller (ONOS Cluster) Fabric Control vOLT Control AAA Control DHCP Relay OpenFlow 1.3 vRouter Control … Bare-metal Open-source Leaf-Spine Fabric ToR NETCONF … CORD Controller (XOS) Maple QumranAX XGS-PON Whitebox OLT ASFvOLT16 Multi-vendor ONT/ONUs & RG VOLTHA VOLTHA CDN vSG CDN vSG Dataplane VNFs in Edge Compute Metro Routers Control Plane VNFs as SDN apps Service Creation and Orchestration 3rd Party Service VNFs Maple QumranAX Residential CORD
  31. Virtual OLT Hardware Abstraction (VOLTHA) 31 VOLTHA southbound adapters Tibit

    Tibit Micro-OLT Ciena Whitebox OLT (EdgeCore) Calix ASFvOLT16 Nokia Adtran Nokia OLT Adtran OLT Ciena OLT Calix OLT fluentd consul registrator adapter_agent config_proxy config_root grpc_server global_handler dispatcher kafka_client VOLTHA core Envoy (REST) OpenFlow Agent NetConf agent VOLTHA northbound VOLTHA hides PON-level details (T-CONT, GEM ports, OMCI etc.) from the SDN controller, and abstracts each PON as a pseudo-Ethernet switch easily programmed by the SDN controller Common control and management framework shared by all OLTs &ONUs
  32. What is vOLTHA? Layer of abstraction atop legacy and next

    generation netwrok equipment both PON and in the future xDSL, Docsis, G.Fast, Ethernet Key value add of vOLTHA: • Network as a Switch - access network abstracted as a programmable switch • Evolution to virtualization - legacy and virtualized devices. Runs on the device on general servers or in a DC • Unified OAM abstraction - provides unified, vendor/tech agnostic management interface • vOLTHA Confines the differences of access tech to the locality of access and hiding from the upper layers of the OSS stack 32
  33. Hardware vOLTHA AT&T Open GPON –Software Overview Ref: https://wiki.opencord.org/display/CORD/VOLTHA%3A+vOLT+Hardware+Abstraction 33

    OpenFlow Controller Configuration Controller Ref: https://wiki.opencord.org/display/CORD/CORD+Summit+--+July+29%2C+2016?preview=/1278537/1279415/Tom%20Anschutz%20R-CORD%20Breakout.pdf
  34. Edgecore ASFvOLT16 34 vOLTHA asfvolt16_olt adapter (Python) ASFvOLT16 OLT CPU

    BAL Objects/protos BAL Core/Utils Qumran API Maple SDK Qumran SDK BCM88470 Qumran (QAX) Ethernet PSU/FAN (FPGA) XFP/QSFP SyncE/IEEE 1588 Timing VPD (EEPROM) Board (Reset/WD) Uplink Ethernet Maple NNI PON Maple NNI PON Maple NNI PON Maple NNI PON Redfish Http(s) REST Board Config, optics supervision, TCA, Alarms gRPC client ONLP API Maple API bal_voltha_app (C) gRPC Client gRPC Server bal_cli gRPC server vOLTHA IAdapterInterface Flows, Intf, Stats, Ind, TCA OMCI ONU act/flow Maple stubs OpenNetworkLinux ONIE OpenNetworkLinux BRCM PON MAC/Switch Broadcom Proprietary Redfish HW REST API Adapter Board HW stat/ctrl ASFvOLT16 board HW Adapter PON elements OLT driver elements ASFvOLT16 vOLTHA adapter BRCM maybe required Maybe required Ref: https://wiki.opencord.org/display/CORD/VOLTHA+Adapter+for+Edgecore+ASFvOLT16+OLT Hardware & Firmware vOLTHA
  35. Whitebox ToR Fabric Switch CORD Head Node CORD Compute Node

    ONOS XOS OpenStack MAAS … VOLTHA vSG OvS EdgeCore 7712 (Tomahawk 32 x 100G) EdgeCore Whitebox OLT (ASFvOLT16) Nokia SD-OLT (LightSpan CF-24W) Residential Subscribers Central Office Nokia ONU BCM ONU R G R G BBWF R-CORD & VOLTHA Demo Internet
  36. Whitebox ToR Fabric Switch CORD Head Node CORD Compute Node

    ONOS XOS OpenStack Radius … VOLTHA vSG OvS EdgeCore 7712 (Tomahawk 32 x 100G) EdgeCore Whitebox OLT (ASFvOLT16) Nokia SD-OLT (LightSpan CF-24W) Residential Subscribers Central Office Nokia ONU BCM ONU R G R G 802.1x Subscriber Authentication Internet
  37. Whitebox ToR Fabric Switch CORD Head Node CORD Compute Node

    ONOS XOS OpenStack Radius … VOLTHA vSG OvS EdgeCore 7712 (Tomahawk 32 x 100G) EdgeCore Whitebox OLT (ASFvOLT16) Nokia SD-OLT (LightSpan CF-24W) Internet Residential Subscribers Central Office Nokia ONU BCM ONU R G R G Subscriber VLAN Provisioning
  38. Whitebox ToR Fabric Switch CORD Head Node CORD Compute Node

    ONOS XOS OpenStack Radius … VOLTHA vSG OvS EdgeCore 7712 (Tomahawk 32 x 100G) EdgeCore Whitebox OLT (ASFvOLT16) Nokia SD-OLT (LightSpan CF-24W) Residential Subscribers Central Office Nokia ONU BCM ONU R G R G Subscriber Data-plane Traffic Internet
  39. Internet Whitebox ToR Fabric Switch CORD Head Node CORD Compute

    Node ONOS XOS OpenStack Radius … VOLTHA vSG OvS EdgeCore 7712 (Tomahawk 32 x 100G) EdgeCore Whitebox OLT (ASFvOLT16) Nokia SD-OLT (LightSpan CF-24W) Residential Subscribers Central Office Nokia ONU BCM ONU R G R G CDN Video Source Subscriber view Operator view Subscriber Services
  40. BBWF Booth

  41. VOLTHA v1.0 (9/13/2017) Theme: Basic Management and Operations of vendor

    OLT solutions (XGS-PON) Features VOLTHA High Availability - w/ Docker Swarm - Database redundancy with Consul VOLTHA Remove Internet network access dependency for Install, Deploy and Runtime PON Management & Configuration - BBF WT-385 implementation - AutoDetect ONU - ONU Registration - Control Plane VOLTHA Backup /Restore VOLTHA Security - Local Access Control Least Privilege Access (Install, Instantiate, Maint) - No Open Ports VOLTHA Software Maintenance (patching documentation) Exploratory/Foundational Work: YANG Common Data Model - NETCONF/YANG G.Fast (DPU Driver) Harmonizing PM KPI’s K8s Container Management VOLTHA v2.0 (Q2 2018) Theme: Feature Enhancements Features Containerized Adapters NETCONF Support (NBI) (RFC 6241) - SSH and TLS support Standards-based Yang Model Support (BBF & IETF) PON & ONU Management Part II PON Config Part II G.Fast Support (DPU Driver/Adapter) Finalize Whitebox OLT Adapter (OCP) Alarms & PM Support VOLTHA Software Component Upgrade VOLTHA Stability Enhancements Migrating from Docker Swarm to Kubernetes Reference implementation of VOLTHA - CI/CD Traffic Management/QoS (upstream & downstream) VOLTHA PON Scalability 2 OLT; 64 ONU/OLT* Exploratory/Foundational Work: Deployment Automation OpenOMCI Stack IEEE 802.3 PON Examine all the existing GPBs in order to map to standard YANG models YANG aware transactional database support VOLTHA Roadmap Theme: Productization Features Netconf Call Home (RFC 8071) support YANG aware transactional database support VOLTHA Security - Encrypted Messaging - Global Access Control (e.g. CORD Platform) - Audit Logging Harmonizing Alarms and Events (YANG model?) Implementation of PM KPIs (based on harmonized work) OLT / ONT Interoperability OpenOMCI Stack ONT Adapter (OpenOMCI common adapter) Rogue ONU mitigation VANILLA Architecture Refactor TOSCA Support Ethernet PON Support Exploratory/Foundational Work (TBD): VOLTHA v3.0 (Q4 2018)
  42. VOLTHA v1.x & v2.0 Release Milestones

  43. Service Provider Traction North America • AT&T: R-CORD, M-CORD (Multi-Service

    Edge), vOLTHA • Verizon: M-CORD • Sprint: M-CORD • Comcast: R-CORD • CenturyLink: R-CORD • Google: Multi-access CORD Asia & Australia • China Unicom: M-CORD, E-CORD • China Mobile: M-CORD and E-CORD • NTT, NTT East: IP+Optical, R-CORD • SK Telecom: M-CORD • Telstra: M-CORD • Reliance Jio: M-CORD Europe • Deutsche Telekom: R+M-CORD (Hybrid CORD) • Telefonica: R-CORD, M-CORD • Telecom Italia: M-CORD • Colt: R-CORD • Turk Telekom/Netsia: M-CORD & ONOS SDN Control Interest continues to grow on a monthly basis. Many successful POCs and lab trials and a few field trials
  44. Check out Useful Information • VOLTHA Wiki Page: https://wiki.opencord.org/display/CORD/VOLTHA §

    VOLTHA 1.0 features and Release note can be found in VOLTHA Wiki • Join VOLTHA meetings - see CORD calendar for VOLTHA TST Meetings § A separate meeting schedule for ASFVOLT16 OLT adapter work • Welcome to join our effort to create an vendor & technology agnostic Access Network Architecture § More Questions: Contact Shawn Ying at sying1562@gmail.com 44
  45. Thank you! http://opencord.org