Project Updates Keynote - KubeCon 2017, Austin

Slide 1

Slide 1 text

Project Updates Michelle Noorali Sr. Software Engineer, Microsoft

Slide 2

Slide 2 text

Hello World • Sessions • Special Interest Groups • SIG Updates • SIG Deep Dives • Technical Salons • Meet project contributors • Get your hands dirty • Hallway Track • Booths and swag

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

CNCF Projects at a high level slide

Slide 5

Slide 5 text

Where did this all even come from? • The rise of microservices • The rise of the cloud

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

Portability Using the same software in different environments

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

Kubernetes 1.9 • Coming soon to a GitHub near you • Workloads API will be stable (apps/v1) • DaemonSet, Deployment, ReplicaSet, StatefulSet • Windows Server Containers support is beta • Container Storage Interface (CSI) support is alpha

Slide 10

Slide 10 text

No content

Slide 11

Slide 11 text

CoreDNS • Service discovery for the cloud and more • CoreDNS 1.0 released! • Available as replacement for kube-dns in Kubernetes 1.9 • CoreDNS salon today 3:40-5:00pm • Meeting Room 10C, Level 3

Slide 12

Slide 12 text

No content

Slide 13

Slide 13 text

Containerd • Industry standard container runtime • OCI (Open Container Initiative) compliant • Designed to be embedded in larger systems • Based on Docker Engine’s core container runtime • Cri-containerd project for Kubernetes integration

Slide 14

Slide 14 text

Containerd 1.0.0 • Containerd is 1.0.0! • Complete storage and distribution system that supports both OCI and Docker image formats • Robust events system • Improvements to manage container file systems • Performance improvements

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

rkt & rktlet • Security-minded, standards based application container runtime • rktlet • A Kubernetes Container Runtime Interface (CRI) implementation using rkt as the main container runtime • Improving CRI (Container Runtime Interface in Kubernetes) compliancy • Over 180 contributors

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

CNI: Container Networking Interface • Spec + Libraries for writing plugins to configure network interfaces in Linux containers • Along with supported plugins • Makes the network layer pluggable

Slide 19

Slide 19 text

CNI Updates • Plugins and Spec now have full IPv6 support • Core library builds on Windows • Microsoft contributing Windows plugins • Approaching 1.0 • Maintainers looking for feedback on what you’d like to see in 1.0

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

Observability Monitoring tracing, log aggregation and analytics

Slide 22

Slide 22 text

Tom Wilkie, Prometheus Developer

Slide 23

Slide 23 text

Open source monitoring system, for dynamic environments. Powerful, concise query language. Simple operational model. Efficient local storage. Prometheus

Slide 24

Slide 24 text

Prometheus 2.0

Slide 25

Slide 25 text

• Optimized for Kubernetes • Brand new storage engine • Significantly improved performance • Aimed at highly dynamic environments, CI/CD. Big thanks for Fabian Reinartz, Brian Brazil and Goutham Veeramachaneni for making this happen. Prometheus 2.0

Slide 26

Slide 26 text

Prometheus 2.0 ~3x reduction in CPU usage ~2x reduction in disk space ~100x reduction in IO

Slide 27

Slide 27 text

Community

Slide 28

Slide 28 text

Community

Slide 29

Slide 29 text

Community

Slide 30

Slide 30 text

220 attendees - 2.7x bigger than 2016 Community

Slide 31

Slide 31 text

CloudNativeCon Austin 11:10am Prometheus Salon 2:45pm The RED Method: How To Instrument Your Services 3:30pm Meet the Maintainers 4:25pm A Practical Guide to Prometheus for App Developers 4:25pm Regain Control Thanks to Prometheus 8:00pm Prometheus Happy Hour https://prometheus.io/blog/

Slide 32

Slide 32 text

Eduardo Silva, SW Engineer at Treasure Data

Slide 33

Slide 33 text

Logging • Why ? • Analyze your Application Behavior

Slide 34

Slide 34 text

Logging

Slide 35

Slide 35 text

Logging

Slide 36

Slide 36 text

Logging

Slide 37

Slide 37 text

Logging

Slide 38

Slide 38 text

Logging

Slide 39

Slide 39 text

What’s new ?

Slide 40

Slide 40 text

No content

Slide 41

Slide 41 text

What’s new ? • Highlights • Multi Process Workers • Sub-second Time Resolution • Native TLS/SSL Support • Optimized buffers for Data Management • New Fluentd Forward Protocol v1

Slide 42

Slide 42 text

What’s new ? • Connecting the dots: Data Streaming

Slide 43

Slide 43 text

What’s new ? • Monitoring

Slide 44

Slide 44 text

What’s new ? • Improved Windows Support

Slide 45

Slide 45 text

Community Stats • Some numbers • 700 plugins available • 50k pulls a day • 130 contributors to the core • 500 contributors to the plugins ecosystem

Slide 46

Slide 46 text

Production Grade Fluentd became the Industry Standard for Logging

Slide 47

Slide 47 text

Industry Standard

Slide 48

Slide 48 text

Logging Everywhere Fluentd is more than a project… ...It’s a full Ecosystem

Slide 49

Slide 49 text

Ecosystem • Always Looking Forward: • Performance ? • Lightweight ? • Scalable ?

Slide 50

Slide 50 text

fluent/fluent-bit

Slide 51

Slide 51 text

No content

Slide 52

Slide 52 text

Fluent Bit • Highlights • Written in C language • Pluggable Architecture (more than 35 plugins available!) • Event Driven / Async Networking I/O • Built-in TLS/SSL Support • Small Memory Footprint

Slide 53

Slide 53 text

Fluent Bit • Cloud Native Logging

Slide 54

Slide 54 text

Fluent Bit • Fluent Bit Roadmap • v0.13: December 2017! (Prometheus, Apache Kafka + others) • v0.14 • new buffering mechanism • advanced filtering for routing (re-tagging)

Slide 55

Slide 55 text

Fluentd at KubeCon • Join the Fluentd Team at KubeCon! • Fluentd Salon / Wednesday 2pm • Fluentd and Distributed Logging / Wednesday 3:40pm • Cloud Native Logging 101 / Wednesday 4:25pm • Everywhere!

Slide 56

Slide 56 text

No content

Slide 57

Slide 57 text

OpenTracing Updates • Four major language API updates • C++, PHP, Java and Python • Envoy, Istio, NGINX, and Linkerd Integration • 140 project integrations with a combined 15,000 stargazers on GitHub

Slide 58

Slide 58 text

No content

Slide 59

Slide 59 text

Jaeger Updates • UI performance and usability improvements to view large traces • New C++ client library in addition to Go, Java, Python, Node.js • Integration with other CNCF projects • Kubernetes, Prometheus, Envoy • Jaegar technical salon today Friday at 2pm

Slide 60

Slide 60 text

No content

Slide 61

Slide 61 text

Reliability Managing, controlling, and monitoring service to service communication

Slide 62

Slide 62 text

Oliver Gould, CTO at Buoyant

Slide 63

Slide 63 text

Vote for your favorite emoji http://emoji.voto/

Slide 64

Slide 64 text

Linkerd since KubeCon EU • 12 releases of Linkerd (current 1.3.3 on 12/1) • 3000+ GitHub stars, 1400+ Slack users, 1M+ Docker Hub pulls • Improved stability and performance • Over 100B+ requests served PER MONTH • New users like Salesforce, FOX, CreditKarma, and PayPal • Adoption has grown to ~50 production users

Slide 65

Slide 65 text

What if we could build the ideal service mesh based on everything we’ve learned?

Slide 66

Slide 66 text

Conduit The ideal service mesh should be • Fast • Efficient • Safe • Understable

Slide 67

Slide 67 text

Demo

Slide 68

Slide 68 text

Conduit • Ultralight and blazing fast • Powerful and useful instrumentation • Conceptually lightweight • Built specifically for Kubernetes • v0.1 only for gRPC • much more coming soon! conduit.io

Slide 69

Slide 69 text

No content

Slide 70

Slide 70 text

Envoy • Edge and service proxy • Makes network transparent to applications • Originally built at Lyft

Slide 71

Slide 71 text

Envoy Today • Updates • 1.5.0 released • gRPC v2 API now production ready • SNI now supported • Experimental LuaJIT scripting engine • Sharded Redis support • Envoy Salon today 3:40-5:00pm • Meeting Room 4A, Level 3

Slide 72

Slide 72 text

No content

Slide 73

Slide 73 text

gRPC • A remote procedure call (RPC) framework that can run anywhere • Makes it easier to build connected systems

Slide 74

Slide 74 text

• Updates • Improve connectivity between clients and servers and through proxies • Improved Performance in several languages • Roadmap • Upcoming language support for JavaScript, Dart, Swift Node JS • Managing client configurations through service config, Retries, Interceptors, better integrations with load balancing, stats/tracing solutions. gRPC Updates

Slide 75

Slide 75 text

No content

Slide 76

Slide 76 text

Security Don’t lie to me.

Slide 77

Slide 77 text

TUF: Software Update Spec • Attacks are an expectation • Secure key revocation embedded in design • Being used more and more in automotive and IoT space • Working on minor extensions with the community • Key rotation • Support multiple repositories • Additional security features

Slide 78

Slide 78 text

No content

Slide 79

Slide 79 text

Notary Updates • Add to any digital distribution system to secure download of packages • 0.6.0 release • Bugfixes • CLI options to support external CAs for root keys • Subcommand to diff 2 versions of a repo • PKCS#8 for private key storage