Voxoz — Erlang Platform Done Right

Presented on Erlang Factory SF Bay Area 2014

Transcript

1. VOXOZ Vladimir Kirillov @darkproger
2. ops
4. E2MPLATFORMS
5. let’s reimagine
6. Hack Deploy Scale
7. Hack Deploy Scale life’s too short to spend time on the environment
8. Hack quickly
9. Hack reproducibly
10. Hack no frictions
11. Hack no “works on my machine” excuses
12. your epoll into my kqueue
13. your inotify into my fsevents
14. Y UR CentOS runs R14B03?
15. so I compiled this port and copied it to your Linux box and it doesn’t run ;(
16. ! Deploy
17. ! Deploy no moving parts
18. Moving parts 3rd-party software: OS runtime/VM libraries
19. 3-rd party software using = being a maintainer
20. 3-rd party software isolate breakage as much as possible
21. state
22. ! Deploy = mutating state
23. Linux too many abstractions
24. Linux users ACLs SELinux networking stack package managers filesystems
25. erts-5.9.1/bin/escript: /lib/libc.so.6: version GLIBC_2.14 not found
26. Problems half-deploys speed rollbacks chef / puppet
27. # apt-get install linux-image-3.2.0-4-amd64 ... Setting up linux-image-3.2.0-4-amd64 (3.2.51-1) ... Running depmod. cp: cannot stat `/boot/initrd.img-3.2.0-4-amd64': No such file or directory Failed to copy /boot/initrd.img-3.2.0-4-amd64 to /initrd.img . dpkg: error processing linux-image-3.2.0-4-amd64 (--configure): subprocess installed post-installation script returned error exit status 1 Errors were encountered while processing: linux-image-3.2.0-4-amd64 E: Sub-process /usr/bin/dpkg returned an error code (1)
28. Breaking abstractions zerocopy userspace
29. netmap /dev/blk paravirt Breaking abstractions
30. Scaling
31. spawn X instances of $that Scaling
32. spawn X instances of $that ! doesn’t always work Scaling
33. riak_core rafter OTP-like for cloud ops Scaling
34. instances =~ processes OTP for cloud
35. solution: spawn X instances of $that ! … and pray Scaling
36. topology awareness hot migration instant bursting Want
37. are two nodes sharing one disk? ! are two nodes hogging the same CPU cache? topology awareness
38. aka double buffering or RCU hot migration
39. instance_supervisor :create_child instant bursting
40. query cache database b-tree VFS cache filesystem b-tree block cache VM
41. OS kernel query cache database b-tree VFS cache filesystem b-tree block cache VM
42. query cache database b-tree VFS cache filesystem b-tree block cache VM xxx
43. query cache database b-tree VM
44. Erlang on Xen
45. Erlang on Xen wow
46. Erlang on Xen wow much bare vm so 30 ms boot such fast lol no OS very not SMP nice elastic
49. ling build.erlangonxen.org xlates beam modules to ling yields a kernel binary
50. ling mostly R16 actively developed issues.erlangonxen.org
51. ling 9p for external filesystems lwIP for networking GooFS for persistence no NIFs no net_kernel (yet) no SSL (WIP) no erlang:trace
52. ling {build_config, debug} ling:trace ling:profile
53. … or not
54. ports Elixir (x.erlangonxen.org) ejabberd LINC (in progress) riak_core / riak_pipe 1.4 * n2o
55. voxoz & ling xen 4.[1-3] ! xapi (too enterprise) too much sh ! libxl (fast) gator
56. plugs OpenMirage 9p ipc with unix rump
57. Containers
58. Containers LXC / Docker Zones / Jails NixOS
59. Containers code vs data instant deploys no configuration
60. ZFS copy-on-write snapshots cheap volumes
62. lambda-ops
63. single-image deploys
64. app defines resources
65. copy-update-switch (double buffering thing)
66. code is configuration
67. distributed by default
68. instrumented by default
69. Tools
71. github.com/voxoz
72. 5HT/n2o synrc/kvs synrc/mqs synrc/skyline proger/active proger/erlfsmon proger/erldocker proger/eflame proger/erlsh
73. make software, not war. stay tuned ! @darkproger voxoz.com kirillov.im
75. this slide is intentionally left almost blank
76. this slide is intentionally left almost blank
77. some images in this document are copyrighted by their respective owners ! http://captainvendetta.deviantart.com/art/Gir-DUTY- MODE-188982723