Data Centre - Packet Pushers Future of Networking Summit - Interop Las Vegas 2016

Transcript

1. © 2015 Packet Pushers Interactive LLC Page Future of Networking Data Centre Interop Las Vegas 2016 1
2. © 2015 Packet Pushers Interactive LLC Page Presentation Style • My presentation style is …. different • Going to hit a bunch of big ideas • and leave lots of pieces on the ground for you to pickup 2
3. Hyper convergence
4. © 2015 Packet Pushers Interactive LLC Page Hyper-convergence • Use commodity x86 servers for everything • Focus on the software features • One more server adds storage and compute to a clusters • Rack scale - storage/compute/network • i.e. the network comes with the rack e.g. Dell, vBlock, 4
5. © 2015 Packet Pushers Interactive LLC Page Hyper-Hardware • Big Vendors love appliances • hardware = big money • hardware needs support contracts • Old Cisco loves selling hardware • Won’t control top-of-rack network hardware • Or the top-of-rack operating systems 5
6. © 2015 Packet Pushers Interactive LLC Page Compression • Technology Compression Hypothesis: • hardware gets smaller and cheaper over time • software gets larger and costs more over time 6
7. Whitebox and The Enterprise
8. © 2015 Packet Pushers Interactive LLC Page 8 Mass Storage Boot Flash 10G DRAM Serial Mgmt Eth. 10G 10G 10G 10G 10G 10G 10G Management Plane Data Plane Switching ASIC CPU System on Chip Control Plane © Greg Ferro 2016 FPGA
9. © 2015 Packet Pushers Interactive LLC Page Whitebox • Wireless • Campus • Data Centre • WAN Routing • Appliances/Middleboxes 9
10. © 2015 Packet Pushers Interactive LLC Page How Many Switches Do You Need ? • How much Ethernet do you really need ? • Campus is going wireless or 4G • Branch ??? • Data Centre is moving to Converged or Hyperconverged • Networking in the bundle 10
11. © 2015 Packet Pushers Interactive LLC Page 11 Merchant Silicon Standard Box Design Custom Silicon Standard Components Whitebox Hardware Available Factory Capacity = Standard Box Design Standard Components Made to Order Production Custom Device = Whitebox Hardware Commodity items are majority items of all network hardware © Greg Ferro 2015
12. © 2015 Packet Pushers Interactive LLC Page 12 Vendor Solution Whitebox Custom Device Vendor Operating System Open Operating System Support Mix “Full Responsibility” = = Whitebox Solution Whitebox = Whitebrand Vendor Operating System “Full Responsibility” Whitebox Branded Operating System Whitebox Solution Partial Responsibility © Greg Ferro 2015 Whitebox Combinations = Commodity items are majority items of all network hardware
13. © 2015 Packet Pushers Interactive LLC Page Whitebox Reliability - Good • Question relates to three areas • hardware, software and onsite • Whitebox is manufactured in the same factories as branded equipment • Using the same components • There are speakers here today who runs large numbers of Whitebox - ask them 13
14. © 2015 Packet Pushers Interactive LLC Page Whitebox - Bad • You can use low quality power supplies • Air flow / thermal problems show up • Work at first, problems over time ? • But cheap enough to throw away (consumables) 14
15. Programmable ASICS
16. © 2015 Packet Pushers Interactive LLC Page Silicon Pipelines - Static 16 Fabric ASIC Packet Processor & Forwarding Port Port Packet Processor & Forwarding Port Port © Greg Ferro 2014 EtherealMind.com
17. © 2015 Packet Pushers Interactive LLC Page Silicon Pipelines - Static 17 Packet Parser VLAN Processor MST Storage L2 Match/ Learning L2 CAM L3 Match/ Learning ACL Processing L3 CAM TCAM Input Counters Ingress Egress Output Counters Packet Rewrite QoS Policing/ Shaping PHY Crossbar PHY © Greg Ferro 2016 PacketPushers.net
18. © 2015 Packet Pushers Interactive LLC Page 18 • This is not possible in Broadcom silicon with static pipelines VXLAN Gateway Operation Extract VXLAN header Switch VXLAN to VLAN Route to Subnet on Next Hop VXLAN Packet Ethernet Frame IP Packet IP Packet Send to Output Port Ethernet Frame Egress to PHY Ingress From PHY VXLAN Packet Cannot process IP Packets After Ethernet © Greg Ferro 2014
19. © 2015 Packet Pushers Interactive LLC Page Silicon Pipelines - Dyamic 19 Packet Parser Pipeline TCAM Lookups Ingress Egress Packet Rewrite Packet Buffers PHY PHY Packet Replication Dynamic Packet Pipeline Action Action Action Action Action Action Configurable Counters © Greg Ferro 2014 • Might be something like this
20. © 2015 Packet Pushers Interactive LLC Page P4 • P4 programs specify how a switch processes packets. • P4 is suitable for describing everything from high- performance forwarding ASICs to software switches. 
 P4 allows network engineers to change the way their switches process packets after they are deployed. 20
21. © 2015 Packet Pushers Interactive LLC Page Use Cases • Write MPLS tags using your own northbound API • Write your own tunnelling formats • Add custom telemetry to headers • Faster Standards • e.g. VXLAN -> VXLAN-GPE 21 Label - 20bits BoS TTL EXP MPLS Label © Greg Ferro 2015 Device ID I/F Utilisation Timestamp Output Interface Telemetry Label © Greg Ferro 2015 Tenant ID Path Tags Timestamp Security Class Tenant Label © Greg Ferro 2015 IP Data TCP/ UDP IP Header Ethernet Payload Ethernet Header Use Case: Custom Encapsulation IP Tag © Greg Ferro 2015
22. The Multicast Problem
23. © 2015 Packet Pushers Interactive LLC Page Why is Multicast Broken ? • Two types of Multicast - Ethernet and IP • Flooding - one packet in, many packets out • How does this happen ? 23
24. © 2015 Packet Pushers Interactive LLC Page 24 Packet Replication In Hardware Why L2 Multicast is Not Reliable at High Speed Switching ASIC 10G 10G 10G 10G 10G 10G 10G 10G Packet Duplication 1 Multicast Packet Input 2 3 Packet Forwarded to Switching Engine 4 Packet Duplication Function Packets Disapatched to All Ports in VLAN © Greg Ferro 2014
25. © 2015 Packet Pushers Interactive LLC Page Multicast • Devices handle packet replication differently • Silicon varies widely • Some do local duplication on line cards • Unpredictable results 25
26. © 2015 Packet Pushers Interactive LLC Page 26
27. Data Centre - General
28. © 2015 Packet Pushers Interactive LLC Page Data Centre Interconnect • L2 in the overlay • Don’t do L2 in the underlay • blast radius 28
29. © 2015 Packet Pushers Interactive LLC Page Dark Fibre & DWDM • Instead of renting bandwidth • rent dark fibre, deploy your own WDM • Its not hard, its cost effective, ` 29
30. © 2015 Packet Pushers Interactive LLC Page The End of Chassis - 1 • First Gen Chassis • core silicon, blades with ports • Second Gen Chassis • local switch on blades, • 2-4 high speed backplane ports • low port count ASIC (<20) 30 Supervisor Switching ASIC Backplane Blade Blade Blade Port Port Port Port Port Port Port Port Port First Gen Chassis Block Diagram of Basic Chassis 2 High port count, low speed 1 1 2 xxxxxGBaseKR - Gigabit Ethernet Supervisor Standby Switching ASIC Backplane Blade Blade Blade Port Port Port Port Port Port Port Port Port Second Gen Chassis Block Diagram of Basic Chassis Low port count, high speed switching ASIC Switching ASIC Switching ASIC Switching ASIC Switching ASIC Supervisor Switching ASIC 1 1
31. © 2015 Packet Pushers Interactive LLC Page • Third Gen Chassis • Leaf Spine • Looks like any Leaf/Spine design 31 Backplane Blade Blade Blade Port Port Port Port Port Port Port Port Port Third Gen Chassis Block Diagram of Basic Chassis Leaf/Spine Architecture Switching ASIC Switching ASIC Switching ASIC Switching ASIC Supervisor Switching ASIC 1 2 Switching ASIC Switching ASIC Switching ASIC 1 High Density
32. © 2015 Packet Pushers Interactive LLC Page The End of Chassis - 2 • You don’t need a big-arse switch in the core • Leaf/Spine, ECMP 32
33. © 2015 Packet Pushers Interactive LLC Page Dumb LAN or Smart DC LAN • What sort of DC LAN do you want ? • Hardware heavy • complex operating systems | cost, bugs (fixing bugs) • silicon buffers for optimal performance • features in silicon | years to iterate/update • port to port (or socket to socket) • safe ? 33
34. © 2015 Packet Pushers Interactive LLC Page Dumb LAN or Smart DC LAN • What sort of DC LAN do you want ? • Software-centric • overlay networks • end to end network 34
35. © 2015 Packet Pushers Interactive LLC Page Dumb LAN or Smart DC LAN • How many 10G ports do you really need ? • 2 x 10G per physical server • 20-100 VMs per physical server • 48 ports per switch • …….. 35
36. © 2015 Packet Pushers Interactive LLC Page Hardware Centric • Hardware is still important but its not where the problem is • Hardware-Centric means replacing chips/box every time you want a new feature • That takes years and years 36
37. © 2015 Packet Pushers Interactive LLC Page Software Centric • Quicker product cycles • look at how quickly VMware NSX has implemented features • Safer operations (upgrade) • Huge Change in Design & Operation 37
38. © 2015 Packet Pushers Interactive LLC Page Cabling Tips 38 • Use coaxial copper in the rack • Use fibre optic for everything else • Use modular fibre optic cabling • with MPO connectors Reference : http://www.ethernetalliance.org/roadmap/
39. © 2015 Packet Pushers Interactive LLC Page Cabling tips • Don’t overspend on cabling • its going to change a lot • use modular cabling systems to grow cabling on demand • DO NOT: • install cabling as part of a rack deployment 39
40. © 2015 Packet Pushers Interactive LLC Page The End Thanks 40
41. © 2015 Packet Pushers Interactive LLC Page Newsletters 41 Deep Dive Podcasts Latest News http://packetpushers.net/podcasts/ http://packetpushers.net/the-network-break/ http://packetpushers.net/free-newsletter-magazine-subscriptions/