The future of Linux distros in the cloud​

(As presented at All Things Open! 2019 in Raleigh, NC)

Linux is everywhere today, thanks in no small part to its ability to change as computing evolves. There are new applications, new architectural patterns, new ways of distributing software and an unprecedented scale at which systems engineers work with Linux today. In this talk, Jose Miguel points to some of the trends to watch for as we prepare for the future of Linux in a cloud world.

Transcript

1. The future of Linux distros in the cloud José Miguel Parrella (@bureado)
3. What's changing with Linux distros in a cloud world? WHY AND WHERE WE RUN THEM WHERE THE BITS COME FROM HOW WE PUT THEM TOGETHER HOW WE SERVICE THEM HOW WE OBSERVE THEM
5. dataintensive.net Twitter: @martinkl
6. Catch up with PostgreSQL Bruce Momjian's PostgreSQL Intro and Concepts Dimitri Fontaine's The Art of PostgreSQL Book Dmitry Dolgov's PostgreSQL at low level talk Anything from Peter Zaitsev (stay for the next talk!) Subscribe to Citus Data blog Not interested in Postgres or databases? Check out Rook.io to learn how storage changes Linux
7. Where the bits come from is changing Ecosystem Debian Upstream Coverage Ruby 1100 9300 11.83% Perl 3700 31000 11.94% Python 3700 118000 3.14% Node.js 1300 350000 0.37% All-up libs 30K 2.8M 1.07% Docker Hub ? 2.3M N/A Helm Charts CNAB Bundles Portable Services ... ~0 ? ~0 Sources: libraries.io, APT lists, Docker Hub (2018)
8. Case Study: Debian at Microsoft APT is (possibly) the most prevalent package manager in the Microsoftecosystem Microsoft distributes software for Debian Microsoft runs Debian for top-of-rack networking in all datacenters Microsoft runs Debian (on Azure) for all the Skype relays Microsoft builds a minimal set of Debian packages for reproducibility
10. • systemd upstream NEWS • List branches in Lennart's fork • Read systemd for administrators • Or Understanding systemd
13. •Monitoring and Observability (blog post) •Observability — A 3-Year Retrospective (blog post) •Distributed Systems Observability (book) "[…] I tried all of these tools and more, and none of them helped resolve system performance and reliability. Let me repeat: none of them did what they claimed to do. This isn’t because they lied or misrepresented themselves, it’s because the kinds of systems we were building were fundamentally different than the systems those tools were developed to understand. Parse was an early adopter of a lot of trends which are still relatively cutting edge, and more and more people are now experiencing the consternation and frustration that I did during that time. These older tools, once revolutionary, simply no longer work for our current systems." - Charity Majors
14. PSI ◦ Quantifies lost wall clock time due to resource contention ◦ Exported via /proc ◦ Works with cgroup2 ◦ In kernel 4.20 and newer ◦ Full introduction of PSI in the kernel mailing lists
15. https://sysdig.com/blog/friends- dont-let-friends-curl-bash/
16. What's changing with Linux systems in a cloud world? WHY AND WHERE WE RUN THEM WHERE THE BITS COME FROM HOW WE PUT THEM TOGETHER HOW WE SERVICE THEM HOW WE OBSERVE THEM
17. Jose Miguel Parrella speakerdeck.com/bureado twitter.com/bureado https://jmp.soy Come to the Microsoft booth! (#20)