Project Updates Keynote - KubeCon 2017, Austin

Transcript

1. Project Updates Michelle Noorali Sr. Software Engineer, Microsoft
2. Hello World • Sessions • Special Interest Groups • SIG Updates • SIG Deep Dives • Technical Salons • Meet project contributors • Get your hands dirty • Hallway Track • Booths and swag
4. CNCF Projects at a high level slide
5. Where did this all even come from? • The rise of microservices • The rise of the cloud
7. Portability Using the same software in different environments
9. Kubernetes 1.9 • Coming soon to a GitHub near you • Workloads API will be stable (apps/v1) • DaemonSet, Deployment, ReplicaSet, StatefulSet • Windows Server Containers support is beta • Container Storage Interface (CSI) support is alpha
11. CoreDNS • Service discovery for the cloud and more • CoreDNS 1.0 released! • Available as replacement for kube-dns in Kubernetes 1.9 • CoreDNS salon today 3:40-5:00pm • Meeting Room 10C, Level 3
13. Containerd • Industry standard container runtime • OCI (Open Container Initiative) compliant • Designed to be embedded in larger systems • Based on Docker Engine’s core container runtime • Cri-containerd project for Kubernetes integration
14. Containerd 1.0.0 • Containerd is 1.0.0! • Complete storage and distribution system that supports both OCI and Docker image formats • Robust events system • Improvements to manage container file systems • Performance improvements
16. rkt & rktlet • Security-minded, standards based application container runtime • rktlet • A Kubernetes Container Runtime Interface (CRI) implementation using rkt as the main container runtime • Improving CRI (Container Runtime Interface in Kubernetes) compliancy • Over 180 contributors
18. CNI: Container Networking Interface • Spec + Libraries for writing plugins to configure network interfaces in Linux containers • Along with supported plugins • Makes the network layer pluggable
19. CNI Updates • Plugins and Spec now have full IPv6 support • Core library builds on Windows • Microsoft contributing Windows plugins • Approaching 1.0 • Maintainers looking for feedback on what you’d like to see in 1.0
21. Observability Monitoring tracing, log aggregation and analytics
22. Tom Wilkie, Prometheus Developer
23. Open source monitoring system, for dynamic environments. Powerful, concise query language. Simple operational model. Efficient local storage. Prometheus
24. Prometheus 2.0
25. • Optimized for Kubernetes • Brand new storage engine • Significantly improved performance • Aimed at highly dynamic environments, CI/CD. Big thanks for Fabian Reinartz, Brian Brazil and Goutham Veeramachaneni for making this happen. Prometheus 2.0
26. Prometheus 2.0 ~3x reduction in CPU usage ~2x reduction in disk space ~100x reduction in IO
27. Community
28. Community
29. Community
30. 220 attendees - 2.7x bigger than 2016 Community
31. CloudNativeCon Austin 11:10am Prometheus Salon 2:45pm The RED Method: How To Instrument Your Services 3:30pm Meet the Maintainers 4:25pm A Practical Guide to Prometheus for App Developers 4:25pm Regain Control Thanks to Prometheus 8:00pm Prometheus Happy Hour https://prometheus.io/blog/
32. Eduardo Silva, SW Engineer at Treasure Data
33. Logging • Why ? • Analyze your Application Behavior
34. Logging
35. Logging
36. Logging
37. Logging
38. Logging
39. What’s new ?
41. What’s new ? • Highlights • Multi Process Workers • Sub-second Time Resolution • Native TLS/SSL Support • Optimized buffers for Data Management • New Fluentd Forward Protocol v1
42. What’s new ? • Connecting the dots: Data Streaming
43. What’s new ? • Monitoring
44. What’s new ? • Improved Windows Support
45. Community Stats • Some numbers • 700 plugins available • 50k pulls a day • 130 contributors to the core • 500 contributors to the plugins ecosystem
46. Production Grade Fluentd became the Industry Standard for Logging
47. Industry Standard
48. Logging Everywhere Fluentd is more than a project… ...It’s a full Ecosystem
49. Ecosystem • Always Looking Forward: • Performance ? • Lightweight ? • Scalable ?
50. fluent/fluent-bit
52. Fluent Bit • Highlights • Written in C language • Pluggable Architecture (more than 35 plugins available!) • Event Driven / Async Networking I/O • Built-in TLS/SSL Support • Small Memory Footprint
53. Fluent Bit • Cloud Native Logging
54. Fluent Bit • Fluent Bit Roadmap • v0.13: December 2017! (Prometheus, Apache Kafka + others) • v0.14 • new buffering mechanism • advanced filtering for routing (re-tagging)
55. Fluentd at KubeCon • Join the Fluentd Team at KubeCon! • Fluentd Salon / Wednesday 2pm • Fluentd and Distributed Logging / Wednesday 3:40pm • Cloud Native Logging 101 / Wednesday 4:25pm • Everywhere!
57. OpenTracing Updates • Four major language API updates • C++, PHP, Java and Python • Envoy, Istio, NGINX, and Linkerd Integration • 140 project integrations with a combined 15,000 stargazers on GitHub
59. Jaeger Updates • UI performance and usability improvements to view large traces • New C++ client library in addition to Go, Java, Python, Node.js • Integration with other CNCF projects • Kubernetes, Prometheus, Envoy • Jaegar technical salon today Friday at 2pm
61. Reliability Managing, controlling, and monitoring service to service communication
62. Oliver Gould, CTO at Buoyant
63. Vote for your favorite emoji http://emoji.voto/
64. Linkerd since KubeCon EU • 12 releases of Linkerd (current 1.3.3 on 12/1) • 3000+ GitHub stars, 1400+ Slack users, 1M+ Docker Hub pulls • Improved stability and performance • Over 100B+ requests served PER MONTH • New users like Salesforce, FOX, CreditKarma, and PayPal • Adoption has grown to ~50 production users
65. What if we could build the ideal service mesh based on everything we’ve learned?
66. Conduit The ideal service mesh should be • Fast • Efficient • Safe • Understable
67. Demo
68. Conduit • Ultralight and blazing fast • Powerful and useful instrumentation • Conceptually lightweight • Built specifically for Kubernetes • v0.1 only for gRPC • much more coming soon! conduit.io
70. Envoy • Edge and service proxy • Makes network transparent to applications • Originally built at Lyft
71. Envoy Today • Updates • 1.5.0 released • gRPC v2 API now production ready • SNI now supported • Experimental LuaJIT scripting engine • Sharded Redis support • Envoy Salon today 3:40-5:00pm • Meeting Room 4A, Level 3
73. gRPC • A remote procedure call (RPC) framework that can run anywhere • Makes it easier to build connected systems
74. • Updates • Improve connectivity between clients and servers and through proxies • Improved Performance in several languages • Roadmap • Upcoming language support for JavaScript, Dart, Swift Node JS • Managing client configurations through service config, Retries, Interceptors, better integrations with load balancing, stats/tracing solutions. gRPC Updates
76. Security Don’t lie to me.
77. TUF: Software Update Spec • Attacks are an expectation • Secure key revocation embedded in design • Being used more and more in automotive and IoT space • Working on minor extensions with the community • Key rotation • Support multiple repositories • Additional security features
79. Notary Updates • Add to any digital distribution system to secure download of packages • 0.6.0 release • Bugfixes • CLI options to support external CAs for root keys • Subcommand to diff 2 versions of a repo • PKCS#8 for private key storage
81. End of Project Updates!