Upgrade to Pro — share decks privately, control downloads, hide ads and more …

SDN and Impact on Security

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Brent Salisbury Brent Salisbury
December 03, 2012
71

SDN and Impact on Security

Avatar for Brent Salisbury

Brent Salisbury

December 03, 2012

Transcript

  1. The Potential Impact of Software Defined Networking on Security Brent

    Salisbury Network Architect University of Kentucky [email protected]    
  2. •  We designed and build Service Provider, Data Center and

    Enterprise networks the same due to rigid constraints placed by Proprietary Hardware, Software and APIs. •  Leads to inflexible network architectures that do not meet the business needs. The Problem: Limited Choices/Flexibility •  Each market has very different problems, yet we try and solve the same way with today’s technology.  
  3. Change  is  Bad   •  We  are  opera9ng  far  to

     close  to  the  hardware.     o  Do  systems  administrators  configure  their  services  in  x86  Bios?  Guess  what?  We  do.   •  Generic  components  decomposed  into  resources  to   consume  anywhere,  any9me.   •  Abstrac9on  of  Forwarding,  State  and  Management.   o  Forwarding:  Networking  gear  with  flow  tables  and  firmware.   o  State:  Bag  of  protocols  destruc9on.   o  Management:  Orchestra9on,  CMDB  etc.  Join  the  rest  of  the  data  center  (and  world)   My Obligatory Rationalizing
  4. •  Security  Policy  at  the  Edge.   •  Mul9-­‐Tenancy  at

     the  Edge.   •  Traffic  Engineering  Classifica9on  at  the  edge.   •  Opera9onal  Complexity  at  the  Edge.   •  QOS  Policy  at  the  Edge.   •  Cost  at  the  Edge.   The Problem Has Always Been the Edge
  5. 1.  Commodity Hardware. Off the shelf “Merchant Silicon”. – If

    all vendors are using the same pieces and parts where is the value? Software becomes the differentiation. •  “We want to create a dynamic where we have a very good base set of vendor- agnostic instructions. On the other hand, we need to give room for switch/ chip vendors to differentiate.” -Nick McKeown •  “You don’t have to have an MBA to realize there is a problem. We are still ok but not for very long.” -Stuart Selby,Verizon •  When you run a large data center it is cheaper per unit to run a large thing rather than a small thing, unfortunately in networking that’s not really true. - Urs Hoezle, Google •  “Work with existing silicon today; tomorrow may bring dedicated OpenFlow silicon.” -David Erickson •  “The path to OpenFlow is not a four lane highway of joy and freedom with a six pack and a girl in the seat next to you, it’s a bit more complex and a little hard to say how it will work out, but I’d be backing OpenFlow in my view” – Greg Ferro Etherrealmind.com   What Changed? Why Now? #1 HW Commoditization
  6. Multi-­‐‑Tenancy  FlowVisor Openflow  Controller Physical  Network  Infrastructure Router,  Switches,  RIB,

     LIB,   TCAM,  Memory,  CPU,  ASIC. Virtualization HyperVisors,  Vmware,   Hyper-­‐‑V,  KVM,  Xen,  X86   Instruction  Set   Physical  Server  Infrastructure Servers,  CPU,  Memory,  Disk,   NIC,  Bus.   Physical  HW Slices SDN  Network VM  Farms  Today WindowS lice Windows Slices WindowS lice Windows Slices WindowS lice Windows Slices WindowS lice General Purpose Slice WindowS lice Research Slices WindowS lice Secure Network Slice Not New Ideas
  7. Southbound  API   (x86  ‘like’  or  a  HAL)   Northbound

        API   (POSIX,  REST,  JSON)   Applica9ons/   Policy   Controllers/   Slicing   Hardware/Firmware/   vSwitch   SDN  Stack   Opera9ng  System     Abstrac9on  Layers   Applica9ons   Kernel/OS/   Hypervisor   Memory   Device   CPU   Firmware      Abstraction Mainframe   Abacus   x86   Win32  
  8. port6   -Firewall *   Switch   Port   MAC

      src   MAC   dst   Eth   type   VLAN   ID   IP   Src   IP   Dst   IP   Prot   TCP   sport   TCP   dport   Ac9on   *   *   *   *   *   *   *   *   22   drop   -Routing *   Switch   Port   MAC   src   MAC   dst   Eth   type   VLAN   ID   IP   Src   IP   Dst   IP   Prot   TCP   sport   TCP   dport   Ac9on   *   *   *   *   *   5.6.7.8  *   *   *   port6   *   Switch   Port   MAC   src   MAC   dst   Eth   type   VLAN   ID   IP   Src   IP   Dst   IP   Prot   TCP   sport   TCP   dport   Ac9on   *   *   vlan1   *   *   *   *   *   00:1f..   Conceptually Simple, Yet Powerful -Flow Switching port3   Switch   Port   MAC   src   MAC   dst   Eth   type   VLAN   ID   IP   Src   IP   Dst   IP   Prot   TCP   sport   TCP   dport   Ac9on   00:20.   00:1f..  0800   vlan1   1.2.3.4   5.6.7.8   4   17264   80   port6,     port7,   port9   -VLAN Switching
  9. Ingress  Port  Ethec  Src    Ether  Dst    Ether  Type

     Vlan  ID   IP  Dst   IP  Src   TCP  Dst  TCP  Src  IP  Proto   Port  0/1   *   *   *   *   *   *   80   *   *   *   *   *   *   *   192.168.1.0/20   *   *   *   *   *   *   *   *   *   192.168.1.0/24   *   25   *   *   Port  0/3   *   *   *   *   192.168.1.1/32   *   *   *   *   Port  0/3   *   *   *   *   192.168.1.1/32   *   *   *   *   0/5   *   *   *   *   172.24.16.5/32   *   80   *   *   Packet-­‐in  with  match  in  TCAM  –  Ac9on  is  forward  to  port  0/2   Packet-­‐in  with  NO  match  in  TCAM  –  Ac9on  is  Punt  to  Controller   Ac9on  Bucket   Send  Packet     to  Controller   Send  Packet   to  Port  0/2   In  (n)RAM   Ac9on  Bucket   TCAM  Lookup   TCAM  Lookup   Open vSwitch – Scale HW vs. SW •  VM  rack  density  East-­‐West   traffic  could  be  problema9c  for   general  purpose  top  of  rack.   •  100K+  entries  in  a  rack  is   unrealis9c  in  HW  today.  
  10. What Changed? Why Now? #2 The Data Center   • 

    “The  network  is  in  my  way”  -­‐James  Hamilton,  Amazon     •  Networking  is  complex  because  the  appropriate  abstrac9ons  have  not  yet   been  defined.”  –A  Case  for  Expanding  OpenFlow/SDN  Deployments  On   University  Campuses   •  “If  you  look  at  the  way  things  are  done  today,  it  makes  it  impossible  to  build   an  efficient  cloud.  If  you  think  about  the  physical  network  because  of  things   like  VLAN  placements,  you  are  limited  on  where  you  can  place  workloads.  So   even  without  thinking  about  the  applica9on  at  all,  there  are  limits  on  where   you  can  place  a  VM  because  of  capacity  issues  or  because  of  VLAN  placement   issues.”  –  Mar9n  Casado     •  The  tools  we  have  today  for  automa9on:  snmp,  netconf,   subprocess.Popen(Python),  Net::Telnet(Perl),#!/bin/bash,  autoexpect,  etc.    
  11. Evolution or Re-Invention? ? 3-­‐Tier     North-­‐South  90/10  

    2-­‐Tier  Flat  TRILL/SPB/MPLS   North-­‐South  75/25   Sorware  Defined  
  12. What Changed? #2 The Data Center     •  Public

     Cloud  Scale   •  VID  Limita9ons  -­‐  ~4094  Tags   •  ¼  of  Servers  are  Virtualized   •  Customers  want  flat  networks  but   they  do  not  scale.   •  Complexity  in  the  network  substrate   to  support  bad  applica9on  design.   •  Required-­‐  Flexible  &  Open  APIs  to   consume  Network  Resources.   •  East-­‐West  policy  applica9on.   •  East-­‐West  BW  Consump9on.   •  L2  Mul9-­‐Tenancy.   •  Hypervisor  Agnos9c.   •  VM  port  characteris9c  mobility.   •  Traffic  Trombone  for  Policy.   VM1   Port1   VM4   Port4   VM3   Port3   VM2   Port2   Physical     x86  Hardware   VM  Farm   Physical   Network   Policy   The  Edge  Needs  to  Be  Smarter  but     also  manageable:  Below  is  neither  
  13. Virtual Switching (Example: Open vSwitch) VM1   Port1   VM4

      Port4   VM3   Port3   VM2   Port2   %  ovs-­‐appctl  fdb/show  br0    port    VLAN    MAC                                Age          0          0    00:0f:cc:e3:0d:d8        6          1          0    00:50:56:25:21:68        1          2          0    10:40:f3:94:e0:82        1          3          10  10:40:f3:94:e0:82      1          4          10    00:0f:cc:e3:0d:d8      1   Physical     x86  Hardware   Open  vSwitch  &  Hypervisor   •  Security-Vlan Layer2 isolation, Traffic filtering •  QOS-Traffic queuing and shaping •  Monitoring- Netflow, sFlow, SPAN, RSPAN •  Control- OpenFlow or NextGen •  Features: Bonding, GRE, VXLan, Capwap, STT, Ipsec. •  Hypervisor Support: KVM, XEN, Xenserv, Vbox. •  Orchestrator Support: OpenStack, CloudStack. •  License: Apache2 and GPL (upstream kernel mod) •  **Point being, switch SW is a Switch minus hardware.** Physical   Network  
  14. Open vSwitch Forwarding •  First  Packet  in  the  flow  goes

     to  the  OVS  controller  (slowpath)   •   Subsequent  are  forwarded  by  the  OVS  data  path  (fastpath)   •  When  axached  to  a  controller  datapaths  are  determined  by   the  OpenFlow  Controller.   •  Ac9ons:  Forward,  Drop,  encapsulate  (packet-­‐in)  and  send   to  controller.   Open  vSwitch  Data  Path   Open  vSwitch  Controller   or  Controller  (x)   First  Packet  in  a  Flow   Subsequent  Packets     VM  1   Physical  Hardware/Hypervisor   VM  2    
  15. Native Network Resources Consumption (Storage, Network, Compute) Either Local or

    Hybrid Private/Public Cloud. Visibility, OAM, Dynamic Provisioning, Brokerage and Analytics. Tenancy X Tenancy Y Tenancy Z SDN Overlays (GRE, STT, VXLan) Traditional and SDN Network Substrates Creating Dynamic Network Resource Pools Data Center Overlays •  Early SDN adoptions are happening today in Data Centers. decouple the virtual from the physical discreetly. Where do we terminate Tunnel endpoints? HW or SW for De-Encap?
  16. Leveraging  Overlays  With   VXLAN/(NV)GRE/CAPWAP   Create  one  Flat  Network

      Layer  3  Network   e.g.  Carrier  MPLS/VPN,  Internet,     L3  Segmented  Data  Center   Data  Center   West  Segment   Data  Center   East  Segment   Disaster  Recovery   Warm/Hot  Site   Cloud  Provided   Elas9c  Compute   Tenancy  X   Tenancy  Y   Tenancy  Z   Does This Make Sense?
  17. •  Policy Applied at the Edge Removing Hairpin •  OpenStack

    is Doing this Today. VM  to  VM(East-­‐West)   Traffic  is  Filtered  by   the  OVS  Libvirt  Plugin   Tenancy  X  =  Vlan1   Tenancy  Y  =  Vlan2   Tenancy  Z  =  Vlan3   Vnet0   Vnet1   Vnet2   Network   Gateway   Network East - West Traffic
  18. Pushing Policy to the Edge •  Self-provisioning of network security

    or template based policy. •  Auditing becomes significantly easier. •  East-West traffic policy application constraints are relaxed.
  19. Hybrid Cloud Look Internets   Public  and  Private   IP

     addr  on  one  NIC   Public  Cloud  Spoke   Controller   Dnsmasquerading   &  IPTables   Aka,  Router,     Switch  and  Firewall   Internets   VM  Instance   VM  Instance   How  Public  Cloud  Feels   VM  Networks   How  it  Really  is:  
  20. VM  to  VM(East-­‐West)  Traffic   is  Filtered  by  the  

    OpenvSwitch  Libvirt  Plugin   Tenancy  X  =  Vlan1  or  GRE1   Tenancy  Y  =  Vlan2  or  GRE2   Tenancy  Z  =  Vlan3  or  GRE3   Eth1=br-­‐int(OVS)            FIXED_RANGE       Vnet0   Vnet1   Vnet2   Overlays  Between  Physicals  Host  HyperVisors   NETWORK_GATEWAY   172.24.17.1   Data Center Orchestration Stacks– A Quick Look Eth1=br-­‐int(OVS)            FIXED_RANGE       Vnet0   Vnet1   Vnet2   NETWORK_GATEWAY   172.24.17.1  
  21. Hybrid Cloud - IMO Not as Bad as It Looks,

    this exists today in most DCs Public  and  Private   On  one  Nic   Spoke   Spoke   Private  Cloud   On  Your  Network   Hub  Gateway   Spoke   Spoke   Internet  
  22. Creates  One  Network   and  Hybrid  Cloud   Internets  

    Private  Cloud   On  Your  Network   Public  Cloud  Spoke   Encapsulated  Tunnels   Network  is     Unaware  of   Underlying  Substrate   An  x86  Node  Can   Aggregate  the  Tunnel     Endpoints.  Hub  and   Spoke.  The  Alterna9ve   would  be  a  Full  Mesh.   Policy  could  centrally  be   applied  there.   Hub  Gateway   Spoke   Spoke   Tunneling & Hybrid Cloud
  23. Internets   Private  Cloud   On  Your  Network   Public

     Cloud  Spoke   Hub  Gateway   Spoke   Spoke   De-Duping Policy is the best Reason for Tunnels •  Leverage  exis9ng   centralized  policy   Applica9on  and   Orchestra9on.     •  However,  sending  the   client  directly  to  a  cloud   provider  outside  of  a   tunnel  via  the  Internet   is  by  far  the  easiest  and   most  scalable  solu9on.   Crypto,  IDS/IPS,   Firewall  etc.  
  24. Leverage  Regional  &  Super-­‐Regional  Statewide  Networks   and  Open  Peerings

     to  Cloud  Providers.  xAAS  driven  as  a   commodi9es  market  through  Emerging  Open  API   Standards.  Programmability  Should  Enable  Efficiency  in   Usage  and  Allow  for  Time  Sharing  via  Orchestra9on.   OpenStack  Resources  Either  Local  w/the  ability  to  leverage  Hybrid  Private/Public  Cloud  offerings  based  on   the  best  market  price  that  year,  month  maybe  even  day  depending  on  the  elas9city  and  flexibility  to   move  workloads.  Also  balancing  workloads  amongst  each  other  through  scheduling  and  predic9ve   analysis  and  magic.  Tenants  would  be  any  community  anchor,  state,  city,  educa9on  non-­‐profit  etc.   Op#on  3:  Internet2,   Ideally  begin  leveraging   their  peering  and  Colos   globally  for  a  broader   net  to  capture   compe99vely  priced   resources   Op#on  2:  Dedicated  peerings  to   any  node  from  tenant  to  colo  into   the  super-­‐regional  anyone  selling   resource  pools  with  open  APIs.   Rackspace,  HP,  Dell,  Piston  Cloud.   Companies  whose  end  game  is  not   100%  cloud.   Op#on  1:General  Internet1  best  effort   connec9vity  through  commodity  I1   drains  like  a  Cogent  for  example  at  ~ ¢25-­‐¢50  cents  per/mb.  Capture  that  as   service  level  as  a  lower  9er  SLA  but   priced  significantly  lower.     Primary  op9on.     Public Cloud: The Internet will be the new LAN
  25. •  Policy classification and management. •  Regulatory implications from cost

    to OpEx. •  Identity Management (AAA) •  BYOD, BYOD, BYOD, BYOD Enterprise Problems
  26. NAC •  Why do the overwhelming majority of NAC deployments

    never make it past an “fail open” policy? •  Relying on SNMP, DHCP or any distributed “OS” Embedded in the Network Device. Dirty Vlan/VRF Dirty Vlan/VRF AAA/NAC SNMP
  27. Distribu9on   Campus     Core   Distribu9on   Distribu9on

      Wireless   Controllers   Apply  Policy   Centrally   Access  Points   Enterprise Wireless Today – Already Doing SDN
  28. Distribu9on   Campus     Core   Distribu9on   Distribu9on

      Enterprise Wireless at Larger Scale Today Distributed     Controllers   In  the  same     Administra9ve    Domain  
  29. Distribu9on   Campus     Core   Distribu9on   Distribu9on

      SDN/OF  x86   Controllers   Apply  Policy   Centrally   Edge  Switches   Decoupled Control Plane (NOS)
  30. Policy Application in Wired Networks •  Decoupling the Control Plane

    ! = mean distributed systems in networks go away. •  The problem is a distributed systems theory problem managed in software independent of hardware. •  We centralize the control plane in traditional hierarchical campus architectures today in big expensive chassis. Distributed     SDN/OF   Controllers  
  31. Distribu9on   Campus     Core   Distribu9on   Distribu9on

      •  The Alternative to apply policy is Business as usual. Un- Scalable and cost prohibitive bumps in the wire •  NAC and BYOD at w/ low Cap and OpEx is even more Mythical than and SDN. Edge  Switches   The Alternative is More of the Same
  32. SDN Enabled Switch A Insert Expensive Proprietary Magic Security Analytics

    Engine Example Security Use Case #1 •  Monitoring either particular data sets or entire links often requires expensive, purpose built hardware. SDN Enabled Switch B
  33. SDN  Enabled   Switch  A   SDN  Enabled   Switch

     B   *   Switch   Port   MAC   src   MAC   dst   Eth   type   VLAN   ID   IP   Src   IP   Dst   IP   Prot   TCP   sport   TCP   dport   Ac9on   *   *   *   *   192.1.1.0/24   *   *   *   port6,     port7   *   Match: IP_DST 192.168.1.0/24 Instruction: Forward to Port6 AND Port7 Corporate Financials 192.168.1.0/24 Port-­‐6   Port-­‐7   SDN   Controller   Example Security Use Case #1 Security Analytics Engine
  34. Security Use Case #2 – Operational Sanity and Cost Control

    Ships in the Night. •  We virtualize networks at varying degrees of scale today. •  Operational overhead, provisioning and cost of hardware is a barrier in many cases PCI   Financials   HIPPA  
  35. •  Centralize Operational Management by Decoupling Virtual from the Physical.

    Backbone   DMZ   ERP   PCI   Security Use Case #2 – Operational Sanity and Cost Control
  36. •  Extracting Applications and Features from Hardware Allows for Programmatic

    Operations and Proper Abstractions to Facilitate IT Objectives. •  Exposes Data to Analytics. Security Use Case #2 – Operational Sanity and Cost Control
  37. •  These are “Big Data” problems. •  Extract, snapshot, replay

    a “global view” of the network during attacks. •  Feed network data into predictive analysis engines. •  All Flow Data is exposed. Today’s Network Data resides in /dev/null
  38. Security Use Case #3 Names (Shameless Plug) erp.domain.com  -­‐  (Business

     Cri9cal)   pci.domain.com  -­‐  (Compliance  Cri9cal)   *.*.*.*/*  -­‐  (Everything  Else)   2  Separate  Physical    or  Logical  Paths.   SDN  Enabled   Switch  A   SDN  Enabled   Switch  B   Example  Scenario:  Classify  Traffic  Based  on  DNS  Values  and  Select  the  path  Based  on  Policy   Proac9vely  or  Reac9vely  Residing  on  the  SDN  Controller.  It  does  not  have  to  be  just  the   path.  There  are  many  powerful  headers  between  Layer2-­‐4  for  starters.   Simple  use  Case:  Name  Based  Path  Selec9on   Easy as Calling a Method -IPv4.fromIPv4Address(match.getNetworkDestination())
  39. Security Use Case #3 Names (Shameless Plug) Provider  Core  

    host1.erp.foo.org  (Gold  Path  Priority  #1)   host2.foo.org  (Silver  Path  Priority  #2)     Extracting packet-in payload is as easy as calling a method: (Match) …Recieve OFPacketIn pi = (OFPacketIn) msg; OFMatch match = new OFMatch(); IPv4.fromIPv4Address (match.getNetworkDestination());   (AcGon)  …   (String name, OFFlowMod fm, String swDpid) …Continue
  40. Ez Deployment Scenario New Flow Processing -- struct ofp_packet_in (POX

    L2 LearningAlgorthym) 1. Update Source Address in (T)CAM or SW tables. 2. Is destination address a Ethertpe LLDP or Bridge Filtered MAC, or is? Drop or FWD to Controller or even hand off to STP. LLDP may be used to build a topology (important for future). 3. Is Multicast? Yes Flood. 4. Is the destination address in port mac address table. If no Flood. 5. Is output port the same as input port? Drop to prevent loops. 6. Install flow and forward buffered and subsequent packets. Tradi9onal     Network   OF  and/or  SDN  Enabled     Switch  (Seman9cs)   POX,  FloodLight/Beacon   etc.  Controller   Tradi9onal     Layer  3  Gateway   Redistribu9on.   Legacy  Vlan/20   10.200.1.0/24   802.1q  Trunk   or  (M)LAG  group   Access  Port   to  Controllers   Vlan  1   Port  24   1   11   10    SDN  -­‐  Vlan/10   10.100.1.0/24   Simple  Hybrid  Deployment  Layer2  Path  Isola9on   between  SDN  and  Na9ve  networks  leveraging  Vlans    
  41. DNS   Analy9cs/   Topology   Firewall     Policy

      Inspec9on   Policy   HA/Load     Balancing   Directory/AAA   Services   Forwarding   Network   Opera9ng  System   Applica9ons   Not If But When?
  42. Brent’s Bookmarks •  hxp://ioshints.info   •  hxp://etherealmind.com   •  hxp://nerdtwilight.wordpress.com/

        •  hxp://networkheresy.com/     •  hxp://floodlight.openflowhub.org  (Floodlight  OF  Controller)   •  hxp://openvswitch.org  (Open  vSwitch)   •  hxp://www.noxrepo.org/  (POX)   •  First  10  minutes  of  McKeown’s  presenta9on  for  anyone  with  manager  in  9tle  not  to  men9on  brings  tears  to  my  eyes.   •  hxp://www.youtube.com/watch?v=W734gLC9-­‐dw  (McKeown)   •  An attempt to motivate and clarify Software-Defined Networking (SDN) -Scott Shenker •  hxp://www.youtube.com/watch?v=WVs7Pc99S7w     •  hxp://packetpushers.net   •  hxp://www.rackspace.com  (Rackspace  OpenStack  Private  Cloud  build)   •  hxp://www.networkworld.com/community/fewell   •  hxp://sdncentral.com   •  hxp://www.networkworld.com/Home/jduffy.html   •  hxp://networksta9c.net/  My  Ramblings   •  irc.freenode.net  #openflow  #openvswitch  #openstack