$30 off During Our Annual Pro Sale. View Details »

R-CORD Overview - CORD Workshop, GNTC

Phil Huang
November 29, 2017

R-CORD Overview - CORD Workshop, GNTC

#onf #cord #gntc #edgecore

Phil Huang

November 29, 2017
Tweet

More Decks by Phil Huang

Other Decks in Technology

Transcript

  1. R-CORD Overview
    Phil Huang 黃秉鈞
    Edgecore Networks Solution Engineer / [email protected]
    ONF CORD Ambassador / [email protected]
    Global Network Technology Conference 2017, Beijing, China, Nov. 29, 2017

    View Slide

  2. 2
    黃秉鈞 Phil Huang
    • Member of ONF Ambassador Steering Team
    • Edgecore Networks Solution Engineer
    • SDNDS-TW Co-Founder
    Ref: https://www.linkedin.com/in/phil-huang-09b09895/
    ONF: Open Networking Foundation

    View Slide

  3. Telco Central Office (CO)
    Mobile
    Residential
    Enterprise
    Central Office
    Can be small or large
    and has different names
    in different contexts
    3
    • CO is a service provider’s gateway to
    its customers
    • There are 1000+ of COs
    • Per CO may support
    § 10K+ residential subscribers
    § 10K+ mobile subscribers
    § 1K+ enterprise customers
    • CO providers a great vantage point
    for service providers

    View Slide

  4. Residential Network
    4
    PC CPE ONU OLT BNG Internet
    Home Roadside CO

    View Slide

  5. Challenges
    • Source of high CAPEX and OPEX
    • Lack of programmability inhibits innovation
    • Limits ability to create new services and revenue
    ØHard to create innovative services
    5

    View Slide

  6. What is CORD?
    6
    Central Office Re-architected as a Datacenter
    SDN + NFV + Cloud
    Open Source Software
    Commodity Hardware
    (Servers, White-Box Switches, I/O Blades)
    Large
    number of
    COs
    Evolved over
    40-50 years
    300+ Types
    of
    equipment
    Huge source
    of
    CAPEX/OPEX

    View Slide

  7. Traditional Service Provider Network
    7
    Aggregation
    Switch

    OLT

    ONU
    ONU
    Splitter
    Splitter

    BNG
    Switch
    Internet
    Reliability ☹
    Scalability ☹
    Flexibility ☹
    Cost

    View Slide

  8. Data Center Leaf-Spine Fabric
    8
    Reliability
    Scalability
    Flexibility
    Latency Cost
    Bandwidth
    Spine
    Leaf

    View Slide

  9. CORD: Software Stack
    9
    XOS
    ONOS
    Access-
    as-a-Service
    Subscriber-
    as-a-Service
    Internet-
    as-a-Service
    CDN
    OpenStack / Docker
    vSG ...
    vRout
    er
    ...
    Multicast
    Control
    Fabric
    Control
    VTN
    Ceilometer
    Monitoring-
    as-a-Service
    Scalable Services Run in
    OpenStack VMs and Docker Containers
    Control Applications
    Hosted by ONOS
    Multi-Tenant
    Services
    Assembled
    by XOS

    View Slide

  10. Trellis
    An Open-Source, White-Box, SDN Based Leaf-Spine Network Fabric
    10

    View Slide

  11. Trellis
    Multi-purpose leaf-spine
    fabric designed for NFV
    White Box
    Hardware
    Open
    Source
    Software
    SDN Based

    View Slide

  12. Dual
    Homing
    Routing
    Bridging
    vRouter IPv6
    VLAN
    L3 DHCP
    Relay
    and more…
    Trellis Features

    View Slide

  13. Trellis Data Plane Redundancy
    Spine Switch Spine Switch
    ECMP group ECMP group
    Leaf Switch Leaf Switch
    Leaf Switch
    Leaf Switch
    Access
    Equipment

    View Slide

  14. Underlay Fabric – Open Hardware
    14
    White Box SDN Switch
    Edgecore Switches
    Spine Switch
    10G/40G/100G ports downlink to leaf switches
    GE
    mgmt.
    White Box SDN Switch
    Edgecore Switches
    Leaf Switch
    10G/40G ports downlink to servers and vOLT
    10G/40G/100G ports uplink to different spine
    switches ECMP across all uplink ports
    GE
    mgmt.
    OF-DPA Community or Commercial Support:
    - AS5712-54X (10G)
    - AS5812-54X (10G)
    - AS5912-54X (10G)
    - AS5916-54XM (10G)
    - AS6712-32X (40G)
    - AS7712-32X (100G)

    View Slide

  15. Underlay Fabric – Software Stacks
    15
    BRCM ASIC
    OF-DPA
    Indigo OF Agent
    OF-DPA API
    OpenFlow 1.3
    Leaf/Spine Switch Software Stack
    OCP
    Software
    -
    ONL
    ONIE
    OCP Bare Metal Hardware
    BRCM SDK API
    ONOS
    OCP: Open Compute Project
    ONL: Open Network Linux
    ONIE: Open Network Install Environment
    BRCM: Broadcom Merchant Silicon ASICs
    OF-DPA: OpenFlow Datapath Abstraction
    Open Networking Linux Based on OF-DPA
    pipeline

    View Slide

  16. L2 Unicast
    16
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS

    View Slide

  17. L2 Broadcast
    17
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS

    View Slide

  18. L3 Unicast
    18
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS

    View Slide

  19. L3 Multicast
    19
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS

    View Slide

  20. vRouter Integration
    20
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS
    BGP
    Data

    View Slide

  21. vSG Integration
    21
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS
    Q-in-Q

    View Slide

  22. Put everything all together…
    22
    Leaf1 Leaf2
    Spine1 Spine2
    Host1 Host2 Host3
    OLT
    Upstream
    Router
    Quagga
    ONOS

    View Slide

  23. • Upcoming ONOS 1.12 release (Dec 2017)
    • Dual-homing (released 1.11.1) fixes for known issues
    • Pseudowire support
    • Initial QoS support
    • IPv6 additional features
    • DHCPv6 relay additional features (contributed by Nokia)
    • IPv6 Multicast (contributed by Nokia)
    • IPv6 Router Advertisement app (contributed by Infosys)
    • Support for New ASICs & Bare-metal switches
    • Broadcom Qumran (QMX)
    • Cavium Xpliant
    • Quanta switches (QCT LY8)
    • Barefoot Tofino using P4 (not in 1.12 release)
    Trellis Roadmap

    View Slide

  24. • What is Trellis?
    • Multi-purpose leaf-spine fabric
    • Built with à bare-metal hardware + open-source software + SDN
    • Overlay + Underlay when used in CORD
    • Why Trellis?
    • Designed for SP use cases & NFV
    • SDN allows simpler, easier & more-optimized features
    • SDN + P4 = new features in hardware
    • Open-source gives SP’s ownership & full customizabilty
    • Trellis Roadmap
    • Different roadmaps for Trellis, and the use of Trellis in CORD
    Summary of Trellis

    View Slide

  25. Trellis Demo at CORD Build 2017, USA
    25

    View Slide

  26. 26

    View Slide

  27. Virtual Optical Line Terminal
    Hardware Abstraction
    27

    View Slide

  28. Disaggregated Optical Line Termination
    28
    GPON Chassis-Type OLT
    GPON Line Card
    GPON Line Card
    GPON Line Card
    Switching Board
    Control Board
    Backpalne
    Each GPON OLT IO Blade is connected to
    TOR switch with 40/100Gbps uplink port
    Disaggregated OLT
    GPON OLT IO Blade
    GPON OLT IO Blade
    GPON OLT IO Blade
    ToR Switch
    x86 Server
    vOLT Control App

    View Slide

  29. AT&T Open GPON Hardware Spec
    • 48 Port, 1RU, I/O Pizza box
    • GPON MAC
    • GPON protocol management
    • 802.1ad-compiant VLAN bridging
    • Ethernet MAC
    29

    View Slide

  30. ToR ToR ToR
    Spine Spine Spine
    ToR ToR ToR ToR
    SDN Controller (ONOS Cluster)
    Fabric
    Control
    vOLT
    Control
    AAA
    Control
    DHCP
    Relay
    OpenFlow 1.3
    vRouter
    Control

    Bare-metal
    Open-source
    Leaf-Spine Fabric
    ToR
    NETCONF

    CORD Controller (XOS)
    Maple QumranAX
    XGS-PON Whitebox OLT
    ASFvOLT16
    Multi-vendor
    ONT/ONUs & RG
    VOLTHA
    VOLTHA
    CDN
    vSG
    CDN
    vSG
    Dataplane VNFs in
    Edge Compute
    Metro
    Routers
    Control Plane VNFs
    as SDN apps
    Service Creation
    and Orchestration
    3rd Party Service VNFs
    Maple QumranAX
    Residential CORD

    View Slide

  31. Virtual OLT Hardware Abstraction (VOLTHA)
    31
    VOLTHA
    southbound
    adapters
    Tibit
    Tibit
    Micro-OLT
    Ciena
    Whitebox OLT
    (EdgeCore)
    Calix ASFvOLT16 Nokia Adtran
    Nokia
    OLT
    Adtran
    OLT
    Ciena
    OLT
    Calix
    OLT
    fluentd consul registrator
    adapter_agent config_proxy
    config_root grpc_server
    global_handler dispatcher kafka_client
    VOLTHA
    core
    Envoy (REST) OpenFlow Agent NetConf agent
    VOLTHA
    northbound
    VOLTHA hides PON-level details (T-CONT, GEM ports, OMCI etc.) from the SDN controller,
    and abstracts each PON as a pseudo-Ethernet switch easily programmed by the SDN controller
    Common
    control and
    management
    framework
    shared by all
    OLTs &ONUs

    View Slide

  32. What is vOLTHA?
    Layer of abstraction atop legacy and next generation netwrok
    equipment both PON and in the future xDSL, Docsis, G.Fast, Ethernet
    Key value add of vOLTHA:
    • Network as a Switch - access network abstracted as a programmable switch
    • Evolution to virtualization - legacy and virtualized devices. Runs on the device on general
    servers or in a DC
    • Unified OAM abstraction - provides unified, vendor/tech agnostic management interface
    • vOLTHA Confines the differences of access tech to the locality of access and hiding from
    the upper layers of the OSS stack
    32

    View Slide

  33. Hardware
    vOLTHA
    AT&T Open GPON –Software Overview
    Ref: https://wiki.opencord.org/display/CORD/VOLTHA%3A+vOLT+Hardware+Abstraction 33
    OpenFlow
    Controller
    Configuration
    Controller
    Ref: https://wiki.opencord.org/display/CORD/CORD+Summit+--+July+29%2C+2016?preview=/1278537/1279415/Tom%20Anschutz%20R-CORD%20Breakout.pdf

    View Slide

  34. Edgecore ASFvOLT16
    34
    vOLTHA
    asfvolt16_olt adapter (Python)
    ASFvOLT16 OLT CPU
    BAL Objects/protos
    BAL Core/Utils
    Qumran API
    Maple SDK Qumran SDK
    BCM88470
    Qumran
    (QAX)
    Ethernet
    PSU/FAN
    (FPGA)
    XFP/QSFP
    SyncE/IEEE
    1588
    Timing
    VPD
    (EEPROM)
    Board
    (Reset/WD)
    Uplink
    Ethernet
    Maple NNI
    PON Maple NNI
    PON Maple NNI
    PON Maple NNI
    PON
    Redfish
    Http(s)
    REST
    Board Config, optics
    supervision, TCA,
    Alarms
    gRPC
    client
    ONLP API
    Maple API
    bal_voltha_app (C)
    gRPC Client
    gRPC Server
    bal_cli
    gRPC
    server
    vOLTHA IAdapterInterface
    Flows, Intf, Stats, Ind, TCA
    OMCI
    ONU
    act/flow
    Maple
    stubs
    OpenNetworkLinux
    ONIE
    OpenNetworkLinux
    BRCM PON MAC/Switch
    Broadcom Proprietary
    Redfish HW REST API
    Adapter Board HW stat/ctrl
    ASFvOLT16 board HW
    Adapter PON elements
    OLT driver elements
    ASFvOLT16 vOLTHA adapter
    BRCM maybe required
    Maybe required
    Ref: https://wiki.opencord.org/display/CORD/VOLTHA+Adapter+for+Edgecore+ASFvOLT16+OLT
    Hardware
    & Firmware
    vOLTHA

    View Slide

  35. Whitebox ToR Fabric Switch
    CORD Head Node
    CORD Compute Node
    ONOS XOS OpenStack MAAS

    VOLTHA vSG
    OvS
    EdgeCore 7712 (Tomahawk 32 x 100G)
    EdgeCore Whitebox OLT
    (ASFvOLT16)
    Nokia SD-OLT
    (LightSpan CF-24W)
    Residential
    Subscribers
    Central
    Office
    Nokia
    ONU
    BCM
    ONU
    R
    G
    R
    G
    BBWF R-CORD & VOLTHA Demo
    Internet

    View Slide

  36. Whitebox ToR Fabric Switch
    CORD Head Node
    CORD Compute Node
    ONOS XOS OpenStack Radius

    VOLTHA vSG
    OvS
    EdgeCore 7712 (Tomahawk 32 x 100G)
    EdgeCore Whitebox OLT
    (ASFvOLT16)
    Nokia SD-OLT
    (LightSpan CF-24W)
    Residential
    Subscribers
    Central
    Office
    Nokia
    ONU
    BCM
    ONU
    R
    G
    R
    G
    802.1x Subscriber Authentication
    Internet

    View Slide

  37. Whitebox ToR Fabric Switch
    CORD Head Node
    CORD Compute Node
    ONOS XOS OpenStack Radius

    VOLTHA vSG
    OvS
    EdgeCore 7712 (Tomahawk 32 x 100G)
    EdgeCore Whitebox OLT
    (ASFvOLT16)
    Nokia SD-OLT
    (LightSpan CF-24W)
    Internet
    Residential
    Subscribers
    Central
    Office
    Nokia
    ONU
    BCM
    ONU
    R
    G
    R
    G
    Subscriber VLAN Provisioning

    View Slide

  38. Whitebox ToR Fabric Switch
    CORD Head Node
    CORD Compute Node
    ONOS XOS OpenStack Radius

    VOLTHA vSG
    OvS
    EdgeCore 7712 (Tomahawk 32 x 100G)
    EdgeCore Whitebox OLT
    (ASFvOLT16)
    Nokia SD-OLT
    (LightSpan CF-24W)
    Residential
    Subscribers
    Central
    Office
    Nokia
    ONU
    BCM
    ONU
    R
    G
    R
    G
    Subscriber Data-plane Traffic
    Internet

    View Slide

  39. Internet
    Whitebox ToR Fabric Switch
    CORD Head Node
    CORD Compute Node
    ONOS XOS OpenStack Radius

    VOLTHA vSG
    OvS
    EdgeCore 7712 (Tomahawk 32 x 100G)
    EdgeCore Whitebox OLT
    (ASFvOLT16)
    Nokia SD-OLT
    (LightSpan CF-24W)
    Residential
    Subscribers
    Central
    Office
    Nokia
    ONU
    BCM
    ONU
    R
    G
    R
    G
    CDN
    Video
    Source
    Subscriber view
    Operator view
    Subscriber Services

    View Slide

  40. BBWF
    Booth

    View Slide

  41. VOLTHA v1.0 (9/13/2017)
    Theme:
    Basic Management and Operations of vendor OLT
    solutions (XGS-PON)
    Features
    VOLTHA High Availability
    - w/ Docker Swarm
    - Database redundancy with Consul
    VOLTHA Remove Internet network access dependency
    for Install, Deploy and Runtime
    PON Management & Configuration
    - BBF WT-385 implementation
    - AutoDetect ONU
    - ONU Registration
    - Control Plane
    VOLTHA Backup /Restore
    VOLTHA Security
    - Local Access Control Least Privilege Access (Install,
    Instantiate, Maint)
    - No Open Ports
    VOLTHA Software Maintenance (patching documentation)
    Exploratory/Foundational Work:
    YANG Common Data Model - NETCONF/YANG
    G.Fast (DPU Driver)
    Harmonizing PM KPI’s
    K8s Container Management
    VOLTHA v2.0 (Q2 2018)
    Theme:
    Feature Enhancements
    Features
    Containerized Adapters
    NETCONF Support (NBI) (RFC 6241)
    - SSH and TLS support
    Standards-based Yang Model Support (BBF & IETF)
    PON & ONU Management Part II
    PON Config Part II
    G.Fast Support (DPU Driver/Adapter)
    Finalize Whitebox OLT Adapter (OCP)
    Alarms & PM Support
    VOLTHA Software Component Upgrade
    VOLTHA Stability Enhancements
    Migrating from Docker Swarm to Kubernetes
    Reference implementation of VOLTHA - CI/CD
    Traffic Management/QoS (upstream & downstream)
    VOLTHA PON Scalability 2 OLT; 64 ONU/OLT*
    Exploratory/Foundational Work:
    Deployment Automation
    OpenOMCI Stack
    IEEE 802.3 PON
    Examine all the existing GPBs in order to map to standard
    YANG models
    YANG aware transactional database support
    VOLTHA Roadmap
    Theme:
    Productization
    Features
    Netconf Call Home (RFC 8071) support
    YANG aware transactional database support
    VOLTHA Security
    - Encrypted Messaging
    - Global Access Control (e.g. CORD Platform)
    - Audit Logging
    Harmonizing Alarms and Events (YANG model?)
    Implementation of PM KPIs (based on harmonized work)
    OLT / ONT Interoperability
    OpenOMCI Stack
    ONT Adapter (OpenOMCI common adapter)
    Rogue ONU mitigation
    VANILLA Architecture Refactor
    TOSCA Support
    Ethernet PON Support
    Exploratory/Foundational Work (TBD):
    VOLTHA v3.0 (Q4 2018)

    View Slide

  42. VOLTHA v1.x & v2.0 Release Milestones

    View Slide

  43. Service Provider Traction
    North America
    • AT&T: R-CORD, M-CORD (Multi-Service Edge), vOLTHA
    • Verizon: M-CORD
    • Sprint: M-CORD
    • Comcast: R-CORD
    • CenturyLink: R-CORD
    • Google: Multi-access CORD
    Asia & Australia
    • China Unicom: M-CORD, E-CORD
    • China Mobile: M-CORD and E-CORD
    • NTT, NTT East: IP+Optical, R-CORD
    • SK Telecom: M-CORD
    • Telstra: M-CORD
    • Reliance Jio: M-CORD
    Europe
    • Deutsche Telekom: R+M-CORD (Hybrid
    CORD)
    • Telefonica: R-CORD, M-CORD
    • Telecom Italia: M-CORD
    • Colt: R-CORD
    • Turk Telekom/Netsia: M-CORD & ONOS
    SDN Control
    Interest continues to grow on a
    monthly basis.
    Many successful POCs and lab trials
    and a few field trials

    View Slide

  44. Check out Useful Information
    • VOLTHA Wiki Page: https://wiki.opencord.org/display/CORD/VOLTHA
    § VOLTHA 1.0 features and Release note can be found in VOLTHA Wiki
    • Join VOLTHA meetings - see CORD calendar for VOLTHA TST Meetings
    § A separate meeting schedule for ASFVOLT16 OLT adapter work
    • Welcome to join our effort to create an vendor & technology agnostic Access
    Network Architecture
    § More Questions: Contact Shawn Ying at [email protected]
    44

    View Slide

  45. Thank you!
    http://opencord.org

    View Slide