Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Bootstrapping DCs at the Edge and Enterprise (CIDC) - Oct 2019

Bootstrapping DCs at the Edge and Enterprise (CIDC) - Oct 2019

Introduction to RackN Digital Rebar Platform discussing how we are changing the operational pattern of data centers using Continuous Integration and IaC to deliver multi-site distributed management.

Video giving this presentation: https://youtu.be/wHtTycR-rPY
Demo Video: https://youtu.be/4yINEqYTiWg
Setup for Demo Video https://youtu.be/7gYeyEAASrk

Rob Hirschfeld

October 27, 2019
Tweet

More Decks by Rob Hirschfeld

Other Decks in Technology

Transcript

  1. Bootstrapping Data Centers
    at the Edge and Enterprise
    RackN Digital Rebar Platform v4

    View Slide

  2. RackN
    Physical Layer Automation
    “The Forgotten Layer”
    Data centers have become too
    fragile and hard to manage.

    View Slide

  3. RackN
    Stop fixing in silos with duct tape!
    We redesigned DC Ops to be
    Integrated, fast, and flexible.
    Physical Layer Automation
    Redesigned DC Ops
    from the Bare Metal up

    View Slide

  4. RackN
    Uniquely Integrated
    Vendor Neutral
    Multi-Site Automation
    RackN is physical layer automation
    for legacy & new multi-vendor
    hardware.
    We control from zero to full cluster
    plus Day 2 compliance & upgrades.
    This is proven software running
    customers data centers.

    View Slide

  5. Edge
    Initially, Enterprise and Edge appear different
    But the storage, compute and networking components for each are the same
    Enterprise
    Many Sites
    Few Servers
    Few Sites
    Many Servers
    Data
    Center
    Edge
    Edge
    Data
    Center
    Edge
    Edge
    Edge
    Edge
    Edge
    Edge

    View Slide

  6. Edge
    Edge
    Data
    Center
    Edge
    Edge
    Data
    Center
    Edge
    Edge
    Edge
    Edge Edge
    Edge
    In practice, Enterprise and Edge have same requirements
    But, Critical Features Overlap In Practice
    Security
    Zero Touch
    Application Mix
    Commodity H/W
    Enterprise = Edge

    View Slide

  7. Shared Infrastructure and Dedicated Infrastructure
    Distributed Multi-Infrastructure mixes shared, dedicated, and edge locations
    Shared
    Infrastructure Dedicated
    Infrastructure
    Dedicated
    Infrastructure
    Edge
    Site
    Edge
    Site
    Edge
    Site
    Edge
    Site
    Edge
    Site Edge
    Site
    Edge
    Site

    View Slide

  8. RackN Opportunity Is Enormous
    Universal Control Plane for Operator Managed Infrastructure
    Shared
    Infrastructure Dedicated
    Infrastructure
    Dedicated
    Infrastructure
    Edge
    Site
    Edge
    Site
    Edge
    Site
    Edge
    Site Edge
    Site
    Edge
    Site

    View Slide

  9. RackN is NOT Targeting Hybrid or Multi-Cloud
    Cloud-like Multi-Site Management, but NOT Multi-Cloud Management
    Shared
    Infrastructure Dedicated
    Infrastructure
    Dedicated
    Infrastructure
    Edge
    Site
    Edge
    Site
    Edge
    Site
    Edge
    Site Edge
    Site
    Edge
    Site

    View Slide

  10. And Enabling Hybrid Tooling
    For example, RackN allows Terraform to treat bare metal like a cloud
    Shared
    Infrastructure Dedicated
    Infrastructure
    Dedicated
    Infrastructure
    Edge
    Site
    Edge
    Site
    Edge
    Site
    Edge
    Site Edge
    Site
    Edge
    Site

    View Slide

  11. RackN is Customer Managed (No SaaS or MSP)
    Runs behind their firewall without any RackN supervision or connection.
    Dedicated
    Infrastructure
    Dedicated
    Infrastructure
    Edge
    Site
    Edge
    Site
    Edge
    Site
    Edge
    Site Edge
    Site
    Edge
    Site

    View Slide

  12. RackN
    Business Outcome:
    Regain IT Control
    Critical Needs
    1. Compliance & Visibility
    2. Multi-Vendor
    3. Agile Security
    4. Zero Touch Automation
    5. Integration to SoR

    View Slide

  13. Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Conform Configure Orchestrate
    Zero to Cluster in Minutes: any vendor hardware
    Time
    Zero
    Bare Metal
    Discover
    5 mins

    View Slide

  14. Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Zero to Cluster in Minutes: verified and updated
    Verify Configure Orchestrate
    Bare Metal
    Inventory
    Firmware
    Discover Conform
    Time
    Zero 10 mins

    View Slide

  15. Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Verify Configure Orchestrate
    Zero to Cluster in Minutes: Windows, Linux, ESXi ...
    Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Discover Deploy
    Conform
    Time
    Zero 15 mins

    View Slide

  16. Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Verify Configure Orchestrate
    Zero to Cluster in Minutes: integrated to SoR
    Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Discover Deploy
    Conform Configure
    Time
    Zero 20 mins

    View Slide

  17. Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Verify Configure Orchestrate
    Zero to Cluster in Minutes: fully operational
    Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Conform Configure Orchestrate
    Time
    Zero 30 mins

    View Slide

  18. Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Verify Configure Orchestrate
    Time to Value in Minutes instead of Weeks
    Bare Metal
    Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Build
    Cluster
    Discover Deploy
    Conform Configure Orchestrate
    RackN Platform: End-to-End Automation
    Time
    Zero

    View Slide

  19. Inventory
    Firmware
    O/S & Net
    Application
    Integrate
    System
    Cluster
    Cluster
    Bare Metal
    Cluster
    Cluster
    Build
    Cluster
    Customer Study: Zero Touch ESXi Deployment
    Unconfigured HPE, Dell and Lenovo servers
    Cluster
    Cluster
    vCenter
    Cluster
    150
    Machines
    Time
    Zero 60 mins
    No Manual Steps
    Rack
    Delivered

    View Slide

  20. “CIDC”
    CIDC captures both the full
    integration and Day 2 ops that we
    believe is essential.
    Related terms focus too narrowly:
    ● SDx - APIs for hardware
    ● IaC - Configuration focus
    ● SDDC - VM centered
    ● HCI - Storage appliances
    ● HDIM* - Single pane of glass
    * Hybrid Digital Infrastructure Management (Gartner 2019)
    Introducing the
    Continuously Integrated
    Data Center

    View Slide

  21. RackN
    Technical Overview
    Our Unique Modular Platform
    For Multi-Vendor Infrastructure
    Enables API-driven automation
    Scaling from Edge to Enterprise

    View Slide

  22. Continuously Integrated Data Center Components
    CI/CD Pipeline
    IaC
    Artifact
    Intent
    Platform
    Infrastructure

    View Slide

  23. RackN Bootstraps the Data Center
    CI/CD Pipeline
    IaC
    Artifact
    Intent
    Platform
    Infrastructure
    DRP

    View Slide

  24. And RackN Enables Continuous Integration
    CI/CD Pipeline
    IaC
    Artifact
    Intent
    Platform
    Infrastructure
    Ongoing Integration
    DRP

    View Slide

  25. Key Attributes
    1. Single, Tiny Golang binary
    2. REST API & WSS Events
    3. “Air gap” capable
    4. Field Extensible
    5. Integrated IaC
    RackN
    Technical Overview
    Digital Rebar Platform

    View Slide

  26. Orchestration of Complex Provisioning APIs
    DHCP
    Netboot (PXE, iPXE, …)
    Agent (Linux, Win, ESX, … )
    Network Switch / ToR
    REST API & UX
    DRP
    OOB / BMC (iLo, DRAC, Redfish, ...)

    View Slide

  27. Orchestration of Many Different APIs
    DHCP
    Netboot (PXE, iPXE, …)
    Agent (Linux, Win, ESX, … )
    Network Switch / ToR
    REST API & UX
    Systems of Record
    Configuration Mgmt DB
    Monitoring Systems
    DRP
    OOB / BMC (iLo, DRAC, Redfish, ...)
    CI/CD Pipeline

    View Slide

  28. Integrated Workflow Is Critical
    DHCP
    Netboot (PXE, iPXE, …)
    Agent (Linux, Win, ESX, … )
    Network Switch / ToR
    REST API & UX
    Systems of Record
    Configuration Mgmt DB
    Monitoring Systems
    DRP
    OOB / BMC (iLo, DRAC, Redfish, ...)
    CI/CD Pipeline

    View Slide

  29. Key Attributes
    1. Source Code Managed
    2. Modular Components
    3. Dependency Graphs
    4. IaC Catalog
    5. Open, Closed & Customer
    RackN
    Technical Overview
    Part 1 of 2
    CIDC in Practice

    View Slide

  30. CIDC Enables Shared Operational Practices
    IaC
    DRP
    Master
    Catalog
    IaC
    IaC

    View Slide

  31. RackN Includes Deep Integration Catalog
    IaC
    DRP
    Hardware
    Master
    Catalog
    IaC
    IaC
    O/S
    Platform
    Zero
    Touch
    Clusters

    View Slide

  32. Automatically Repurpose Infrastructure
    IaC
    DRP
    Hardware
    Master
    Catalog
    IaC
    IaC
    O/S
    Platform
    Fully
    Integrated
    Clusters
    Rebuilds In Minutes
    Zero Touch

    View Slide

  33. Workflows Must Include All Integrations
    IaC
    DRP
    Hardware
    IaC
    IaC
    O/S
    Platform
    Fully
    Integrated
    Clusters
    Systems of Record
    Configuration Mgmt DB
    Monitoring Systems
    Wide Area Networking

    View Slide

  34. Zero Touch Requires Eliminating Silos
    IaC
    DRP
    Hardware
    IaC
    IaC
    O/S
    Platform
    Fully
    Integrated
    Clusters
    Systems of Record
    Configuration Mgmt DB
    Monitoring Systems
    Wide Area Networking

    View Slide

  35. RackN
    Technical Overview
    Part 2 of 2
    Distributed Data Center
    Multi-Site Manager
    Key Attributes
    1. Uses Same Core Platform
    2. Managers Use Same APIs
    3. Federated (not Hierarchical)
    4. Sites remain autonomous
    5. Distributes Integrated IaC

    View Slide

  36. Globally Distributed Data Centers
    DRP
    Distributed
    DC US-1
    DRP
    Distributed
    DC EU-2
    DRP
    Distributed
    DC AR-3

    View Slide

  37. v1
    v2 v1
    v2
    v1
    v2 v1
    v2
    v1
    v2 v1
    v2
    Multi-Site Manager Controls Local Catalogs
    DRP
    Master
    Catalog
    v1
    v2
    DRP
    v1
    v2
    DRP
    v1
    v2
    Version Sets
    Distributed
    DC US-1
    Distributed
    DC EU-2
    Distributed
    DC AR-3

    View Slide

  38. Local Sites Must Maintain Autonomy
    DRP
    DRP
    DRP
    Local
    Control
    Local
    Control
    Local
    Control
    Distributed
    DC US-1
    Distributed
    DC EU-2
    Distributed
    DC AR-3

    View Slide

  39. Design Enables Distributed Shared Control
    DRP
    DRP
    DRP
    Local
    Control
    DRP
    Regional
    Control Distributed
    DC US-1
    Distributed
    DC EU-2
    Distributed
    DC AR-3

    View Slide

  40. Data Aggregation Creates a Single Pane of Glass
    DRP
    DRP
    DRP
    Global
    Control
    DRP
    Local
    Control
    DRP
    Regional
    Control
    Live Single
    Pane of Glass
    Distributed
    DC US-1
    Distributed
    DC EU-2
    Distributed
    DC AR-3

    View Slide

  41. Customer Study: Global ESXi Deployment
    Global
    Config
    DRP
    DRP
    DRP
    DRP
    v2
    v2
    v2

    View Slide

  42. RackN
    Digital Rebar Platform
    Commercial Model
    RackN is Enterprise Software
    Licensed Annually per Machine
    Proprietary Platform (Digital Rebar)
    Plus an Open Ecosystem (APLv2)

    View Slide

  43. Platform
    Ecosystem
    Open Source
    Catalog
    CLI
    Sledgehammer
    Digital Rebar API v3
    Agents (Runner)
    Operating System Install Templates
    Foundational Utilities
    Advanced Operations Practices
    Platforms, Apps, Configuration Management
    Digital Rebar Implementation
    Enterprise Extensions (Multi-Site, SSO, RBAC)
    Commercial Support
    Digital Rebar Platform and Ecosystem

    View Slide

  44. Self-Service Sales Pipeline
    Digital Rebar Implementation
    Enterprise Extensions (Multi-Site, SSO, RBAC)
    Commercial Support
    Freemium
    Base
    $80 per m/c
    Annual
    Pro
    $120 per m/c
    Annual
    Enterprise
    $150 per m/c
    Annual
    Full Catalog
    Up to 20 m/c
    Provision Only
    Full Catalog
    Limited Sites
    Multi-Tenant
    RBAC, SSO,
    On-Prem UX

    View Slide

  45. H/W Vendor BMC:
    Dell OpenManage
    Cisco UCS Director
    Silos of Competition
    Cluster Building
    Configuration Management
    Digital Rebar Implementation
    Enterprise Extensions (Multi-Site, SSO, RBAC)
    Commercial Support
    Provisioners:
    Cobbler
    Foreman
    Canonical MaaS
    OpenStack Ironic
    IaC Toolkits:
    Terraform
    Ansible
    Hardware Configuration
    Bare Metal Life Cycle
    Operating System Installation
    Bare Metal Bootstrap

    View Slide

  46. RackN
    Zero Touch CIDC

    View Slide

  47. Zero Touch CIDC
    + Multi-Site Federation
    RackN
    DRP
    DRP

    View Slide

  48. RackN
    Zero Touch CIDC
    + Multi-Site Federation
    + Robust IaC Catalog
    DRP
    DRP
    IaC
    Catalog

    View Slide

  49. RackN
    Zero Touch CIDC
    + Multi-Site Federation
    + Robust IaC Catalog
    = Unique Combination
    DRP
    DRP
    IaC
    Catalog

    View Slide

  50. RackN
    Uniquely Integrated
    Vendor Neutral
    Multi-Site Automation Rethinking Data Centers by
    Building on Strong Foundations

    View Slide