Edgecore Networks Big Cloud Fabric Virtual Lab Phil Huang Open Networking Division 

Who am I? 2 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Phil Huang § Edgecore SDN Solution Engineer § Familiar with § Open Source / DevOps / NetOps § SDN Open Source Committer § ONOS / Mininet / ONIE § Project § Global ONOS SDN-IP Deployment, Taiwan § GitHub § pichuang 

Intra-Tenant/Inter-Tenant Routing Troubleshooting with Test Path Hands-On Lab Overview © 2016 Edgecore Networks. All rights reserved. Subject to errors and misprints. | www.edge-core.com Big Cloud Fabric Overview 01 04 05 02 Setting BCF Environment 03 

Hands-On Lab Overview Provide by Big Switch & Edgecore Networks © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 4 

BCF (P Edition) Hands-On Lab 5 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § The BCF architecture consists of a physical switching fabric § Based on Leaf-Spine Clos network architecture § Running Switch Light Operating System § You will experience both fabric and tenant provisioning via a centralized portal by accessing the BCF Controller (CLI or GUI) 

Logical Topology View 6 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

Login BSN Labs & Edgecore Networks 7 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com http://labs.bigswitch.com/edgecore Type information that you are given 

Launch Big Cloud Fabric (P Edition) Module 8 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com Press “LAUNCH” button Choose “Big Cloud Fabric” 

Access Hands-On Lab 9 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com Lab Topology & options to access the BCF Controller 

Lab Topology Overview 10 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

Introduction of Component 11 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com Spine S Leaf L Rack R Host H Router RTR Firewall FW BCF Controller * Control BCF P Switch Rack 1 Leaf-Group R2 Internet Spine 

Access Big Cloud Fabric Controller via GUI 12 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Action 1. Right click Big Cloud Fabric (BCF) Controller icon 2. Select the “Controller GUI” § Default controller username/password is “admin/bsn123” 

Access Big Cloud Fabric Controller via CLI 13 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Action 1. Right click Big Cloud Fabric (BCF) Controller icon 2. Select the “CLI Access” § Default controller username/password is “admin/bsn123” 

Command Usage 14 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Enter configure mode § Show all of runtime configuration 

Deploy Switch in BCF Ready to ship from Edgecore Networks © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 15 

Zero Touch Networking (ZTN) 16 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § BCF provides Zero Touch Networking (ZTN) for switches § Uses Open Network Install Environment (ONIE) boot loader to automate switch installation and configuration § BCF switches run the Switch Light OS § Bundled with BCF software ØThis lab will NOT cover the Controller and Switch installation process Network OS Open Networking Switch 

Configure BCF Switches for Spine and Leaf Roles The BEST recommend 40G/10G switches: AS6712-32X / AS5712-54X © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 17 

Configuring Switch Role 18 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Need MAC address for each switch to configure switch roles § Pre-configure the switch role before setting and booting up switch ØIn this lab, the switches are already configured with a role and leaf group assignment. MAC Address with Edgecore Networks switch 

Show Switch Status from CLI 19 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

Verify The State of The Switches 20 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Action 1. Navigate to Fabric -> Switches 2. Check the roles configuration of switches 

Show Link to Verify Topology 21 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Action 3. Click on to show detailed information 4. Check the link of the switch 3 

Configure Port Groups High Availability, More Stability © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 22 

Port Groups 23 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Support LAG links function in active-active mode § Port Groups in Big Cloud Fabric are configured to allow the aggregation of multiple links § Port Groups can be defined § Statically by assigning each link § Dynamically for hosts that support Link Layer Discovery Protocol (LLDP) Both links from the host bundled in Port Group 

Configuring Port Groups 24 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com port-group R1H1 member switch R1L1 interface R1L1-eth5 member switch R1L2 interface R1L2-eth5 port-group R1H2 member switch R1L1 interface R1L1-eth6 member switch R1L2 interface R1L2-eth6 port-group R2H1 member switch R2L1 interface R2L1-eth5 member switch R2L2 interface R2L2-eth5 port-group R2H2 member switch R2L1 interface R2L1-eth6 member switch R2L2 interface R2L2-eth6 port-group R3RTR1 member switch R3L1 interface R3L1-eth6 member switch R3L2 interface R3L2-eth6 port-group R3RTR2 member switch R3L1 interface R3L1-eth7 member switch R3L2 interface R3L2-eth7 port-group R3FW member switch R3L1 interface R3L1-eth5 member switch R3L2 interface R3L2-eth5 5 5 6 6 6 6 5 5 5 5 6 6 7 7 

Verify Port Groups 25 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

Configure Tenants and Segments Clear Tenant-Oriented Management © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 26 

Key Terminologies 27 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com Traditional Big Cloud Fabric vSphere OpenStack VRF Tenant vCenter Project Router (VRF) Logical Router Routing App. Router VLAN Segment Port Group Network 

Use Case Topology 28 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Goals § Configure two tenants § Green & Red § Create logical segments for tenants Web App QA 

Configuring Tenant and Logical Segment 29 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com tenant Green segment QA member port-group R2H2 vlan untagged tenant Red segment App member port-group R2H1 vlan untagged segment Web member port-group R1H1 vlan untagged member port-group R1H2 vlan untagged Tenant Red Segment Web Tenant Red Segment App Tenant Green Segment QA 

Verify Entire Configuration 30 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Action § Navigate to Fabric -> Segments 

Intra-Tenant Routing Communication with Difference Segments in Same Tenant © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 31 

Intra-Tenant Routing 32 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Tenant logical router provides distributed virtual routing functionality § Each leaf switch acts as a L3 segment gateway 

Configure Tenant Logical Router 33 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Configure L3 Interfaces for each of the tenant Red and Green § This provides intra-tenant routing for the two segments in the Red and Green tenants tenant Red logical-router interface segment App ip address 10.0.1.1/24 interface segment Web ip address 10.0.0.1/24 Red Tenant Logical Router Web 10.0.0.2/24 10.0.1.1/24 10.0.0.1/24 tenant Green logical-router interface segment QA ip address 10.0.2.1/24 Green Tenant Logical Router 10.0.2.1/24 App 10.1.1.2/24 QA 10.0.2.2/24 

Verify Intra-Tenant Routing 34 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Verify Intra-Tenant traffic between different segments § Action § Right click R1H1 host § Access the CLI Access § Ping App, Red tenant (10.0.1.2) from Web, Red tenant (10.0.0.2) 

Inter-Tenant Routing Communication with Difference Tenant in BCF © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 35 

Inter-Tenant Routing 36 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Communication with different tenant via System tenant router § System Tenant Router § BCF internal tenant § Enable routing between user-defined tenants (Ex: Green, Red tenants) 

Configuring System Tenant Router 37 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com tenant system logical-router interface tenant Green interface tenant Red tenant Green logical-router interface tenant system route 0.0.0.0/0 next-hop tenant system tenant Red logical-router interface tenant system route 0.0.0.0/0 next-hop tenant system Default static route 

Verify Inter-Tenant Routing 38 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Verify Inter-Tenant traffic between different tenants § Action § Right click R1H1 host § Access the CLI Access § Ping QA (10.0.2.2) of Green tenant 

External Network Connect to the Internet © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 39 

External Network 40 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Traffic want to route outside Big Cloud Fabric § Link External Tenant to External Router(s) § Can be configure ECMP group to load balance between two External Routers 

Configuring External Tenant 41 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com tenant External logical-router route 10.0.0.0/24 next-hop tenant system route 10.0.1.0/24 next-hop tenant system route 10.0.2.0/24 next-hop tenant system route 0.0.0.0/0 next-hop rtr next-hop-group rtr ip 10.0.3.2 ip 10.0.4.2 interface segment Ext-01 ip address 10.0.3.1/24 interface segment Ext-02 ip address 10.0.4.1/24 interface tenant system segment Ext-01 member port-group R3RTR1 vlan untagged segment Ext-02 member port-group R3RTR2 vlan untagged 10.0.3.2/24 10.0.4.2/24 System Tenant 10.0.0.0/24 10.0.1.0/24 10.0.2.0/24 ECMP Group Ext-01 10.0.3.1/24 Ext-02 10.0.3.1/24 Segment Ext-01 Segment Ext-02 

Complete Logical View of Topology 42 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

Verify Big Cloud Fabric Routing 43 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Verify Inter-Tenant traffic between different tenants § Action § Right click R1H1 host § Access the CLI Access § Ping Internet (20.20.20.20) ØUse Test Path with BCF Network Troubleshooting Solution Ping failure 

Test Path BCF Network Troubleshooting Visibility Solution © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 44 

Using Test Path 45 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Action 1. Navigate to Visibility -> Test Path 2. Select Segment Web from Source Endpoint list 3. Choose external IP address (20.20.20.20) in Destination Endpoint 4. Click Simulate icon 2 3 4 

Analyze Test Path Result 46 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com Routing missing in logical-router system for next hop 

Fix Missing Routing Problem 47 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com § Patch § The setting is effective immediately § Verify ping traffic again and check it successful tenant system logical-router route 0.0.0.0/0 next-hop tenant External interface tenant External Ping successful 

Show Test Path Result 48 © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

49 Open Networking from Freedom Control Innovation © 2016 Edgecore Networks. All rights reserved | www.edge-core.com 

© 2015 Edgecore Networks. All rights reserved. Subject to errors and misprints. | www.edge-core.com