Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Project Updates Keynote - KubeCon 2017, Austin

Project Updates Keynote - KubeCon 2017, Austin

Michelle Noorali

December 12, 2017
Tweet

More Decks by Michelle Noorali

Other Decks in Technology

Transcript

  1. Project Updates
    Michelle Noorali
    Sr. Software Engineer, Microsoft

    View full-size slide

  2. Hello World
    • Sessions
    • Special Interest Groups
    • SIG Updates
    • SIG Deep Dives
    • Technical Salons
    • Meet project contributors
    • Get your hands dirty
    • Hallway Track
    • Booths and swag

    View full-size slide

  3. CNCF Projects at a high level slide

    View full-size slide

  4. Where did this all even come from?
    • The rise of microservices
    • The rise of the cloud

    View full-size slide

  5. Portability
    Using the same software in different
    environments

    View full-size slide

  6. Kubernetes 1.9
    • Coming soon to a GitHub near you
    • Workloads API will be stable (apps/v1)
    • DaemonSet, Deployment, ReplicaSet, StatefulSet
    • Windows Server Containers support is beta
    • Container Storage Interface (CSI) support is alpha

    View full-size slide

  7. CoreDNS
    • Service discovery for the cloud and more
    • CoreDNS 1.0 released!
    • Available as replacement for kube-dns in Kubernetes 1.9
    • CoreDNS salon today 3:40-5:00pm
    • Meeting Room 10C, Level 3

    View full-size slide

  8. Containerd
    • Industry standard container runtime
    • OCI (Open Container Initiative) compliant
    • Designed to be embedded in larger systems
    • Based on Docker Engine’s core container runtime
    • Cri-containerd project for Kubernetes integration

    View full-size slide

  9. Containerd 1.0.0
    • Containerd is 1.0.0!
    • Complete storage and distribution system that supports both OCI and
    Docker image formats
    • Robust events system
    • Improvements to manage container file systems
    • Performance improvements

    View full-size slide

  10. rkt & rktlet
    • Security-minded, standards based application container runtime
    • rktlet
    • A Kubernetes Container Runtime Interface (CRI) implementation using
    rkt as the main container runtime
    • Improving CRI (Container Runtime Interface in Kubernetes) compliancy
    • Over 180 contributors

    View full-size slide

  11. CNI: Container Networking Interface
    • Spec + Libraries for writing plugins to configure network
    interfaces in Linux containers
    • Along with supported plugins
    • Makes the network layer pluggable

    View full-size slide

  12. CNI Updates
    • Plugins and Spec now have full IPv6 support
    • Core library builds on Windows
    • Microsoft contributing Windows plugins
    • Approaching 1.0
    • Maintainers looking for feedback on what you’d like to see in 1.0

    View full-size slide

  13. Observability
    Monitoring tracing, log aggregation and
    analytics

    View full-size slide

  14. Tom Wilkie, Prometheus Developer

    View full-size slide

  15. Open source monitoring system,
    for dynamic environments.
    Powerful, concise query language.
    Simple operational model.
    Efficient local storage.
    Prometheus

    View full-size slide

  16. Prometheus 2.0

    View full-size slide

  17. • Optimized for Kubernetes
    • Brand new storage engine
    • Significantly improved performance
    • Aimed at highly dynamic environments, CI/CD.
    Big thanks for Fabian Reinartz, Brian Brazil and Goutham
    Veeramachaneni for making this happen.
    Prometheus 2.0

    View full-size slide

  18. Prometheus 2.0
    ~3x reduction in CPU usage
    ~2x reduction in disk space
    ~100x reduction in IO

    View full-size slide

  19. 220 attendees - 2.7x bigger than 2016
    Community

    View full-size slide

  20. CloudNativeCon Austin
    11:10am Prometheus Salon
    2:45pm The RED Method: How To Instrument Your Services
    3:30pm Meet the Maintainers
    4:25pm A Practical Guide to Prometheus for App Developers
    4:25pm Regain Control Thanks to Prometheus
    8:00pm Prometheus Happy Hour
    https://prometheus.io/blog/

    View full-size slide

  21. Eduardo Silva, SW Engineer at Treasure Data

    View full-size slide

  22. Logging
    • Why ?
    • Analyze your Application Behavior

    View full-size slide

  23. What’s new ?

    View full-size slide

  24. What’s new ?
    • Highlights
    • Multi Process Workers
    • Sub-second Time Resolution
    • Native TLS/SSL Support
    • Optimized buffers for Data Management
    • New Fluentd Forward Protocol v1

    View full-size slide

  25. What’s new ?
    • Connecting the dots: Data Streaming

    View full-size slide

  26. What’s new ?
    • Monitoring

    View full-size slide

  27. What’s new ?
    • Improved Windows Support

    View full-size slide

  28. Community Stats
    • Some numbers
    • 700 plugins available
    • 50k pulls a day
    • 130 contributors to the core
    • 500 contributors to the plugins ecosystem

    View full-size slide

  29. Production Grade
    Fluentd became the
    Industry Standard for Logging

    View full-size slide

  30. Industry Standard

    View full-size slide

  31. Logging Everywhere
    Fluentd is more than a project…
    ...It’s a full Ecosystem

    View full-size slide

  32. Ecosystem
    • Always Looking Forward:
    • Performance ?
    • Lightweight ?
    • Scalable ?

    View full-size slide

  33. fluent/fluent-bit

    View full-size slide

  34. Fluent Bit
    • Highlights
    • Written in C language
    • Pluggable Architecture (more than 35 plugins available!)
    • Event Driven / Async Networking I/O
    • Built-in TLS/SSL Support
    • Small Memory Footprint

    View full-size slide

  35. Fluent Bit
    • Cloud Native Logging

    View full-size slide

  36. Fluent Bit
    • Fluent Bit Roadmap
    • v0.13: December 2017! (Prometheus, Apache Kafka + others)
    • v0.14
    • new buffering mechanism
    • advanced filtering for routing (re-tagging)

    View full-size slide

  37. Fluentd at KubeCon
    • Join the Fluentd Team at KubeCon!

    Fluentd Salon / Wednesday 2pm

    Fluentd and Distributed Logging / Wednesday 3:40pm

    Cloud Native Logging 101 / Wednesday 4:25pm
    • Everywhere!

    View full-size slide

  38. OpenTracing Updates
    • Four major language API updates
    • C++, PHP, Java and Python
    • Envoy, Istio, NGINX, and Linkerd Integration
    • 140 project integrations with a combined 15,000 stargazers on
    GitHub

    View full-size slide

  39. Jaeger Updates
    • UI performance and usability improvements to view large traces
    • New C++ client library in addition to Go, Java, Python, Node.js
    • Integration with other CNCF projects
    • Kubernetes, Prometheus, Envoy
    • Jaegar technical salon today Friday at 2pm

    View full-size slide

  40. Reliability
    Managing, controlling, and monitoring
    service to service communication

    View full-size slide

  41. Oliver Gould, CTO at Buoyant

    View full-size slide

  42. Vote for your favorite emoji
    http://emoji.voto/

    View full-size slide

  43. Linkerd since KubeCon EU
    • 12 releases of Linkerd (current 1.3.3 on 12/1)
    • 3000+ GitHub stars, 1400+ Slack users, 1M+ Docker Hub pulls
    • Improved stability and performance
    • Over 100B+ requests served PER MONTH
    • New users like Salesforce, FOX, CreditKarma, and PayPal
    • Adoption has grown to ~50 production users

    View full-size slide

  44. What if we could build the ideal service
    mesh based on everything we’ve learned?

    View full-size slide

  45. Conduit
    The ideal service mesh should be
    • Fast
    • Efficient
    • Safe
    • Understable

    View full-size slide

  46. Conduit
    • Ultralight and blazing fast
    • Powerful and useful instrumentation
    • Conceptually lightweight
    • Built specifically for Kubernetes
    • v0.1 only for gRPC
    • much more coming soon! conduit.io

    View full-size slide

  47. Envoy
    • Edge and service proxy
    • Makes network transparent to applications
    • Originally built at Lyft

    View full-size slide

  48. Envoy Today
    • Updates
    • 1.5.0 released
    • gRPC v2 API now production ready
    • SNI now supported
    • Experimental LuaJIT scripting engine
    • Sharded Redis support
    • Envoy Salon today 3:40-5:00pm
    • Meeting Room 4A, Level 3

    View full-size slide

  49. gRPC
    • A remote procedure call (RPC) framework that can run
    anywhere
    • Makes it easier to build connected systems

    View full-size slide

  50. • Updates
    • Improve connectivity between clients and servers and through proxies
    • Improved Performance in several languages
    • Roadmap
    • Upcoming language support for JavaScript, Dart, Swift Node JS
    • Managing client configurations through service config, Retries, Interceptors,
    better integrations with load balancing, stats/tracing solutions.
    gRPC Updates

    View full-size slide

  51. Security
    Don’t lie to me.

    View full-size slide

  52. TUF: Software Update Spec
    • Attacks are an expectation
    • Secure key revocation embedded in design
    • Being used more and more in automotive and IoT space
    • Working on minor extensions with the community
    • Key rotation
    • Support multiple repositories
    • Additional security features

    View full-size slide

  53. Notary Updates
    • Add to any digital distribution system to secure download of
    packages
    • 0.6.0 release
    • Bugfixes
    • CLI options to support external CAs for root keys
    • Subcommand to diff 2 versions of a repo
    • PKCS#8 for private key storage

    View full-size slide

  54. End of Project Updates!

    View full-size slide