etcd @ Go PDX

**Resources**

etcd:
- https://github.com/coreos/etcd
- https://github.com/coreos/etcdctl
- https://github.com/coreos/go-etcd
- Test cluster script: https://github.com/coreos/etcd/blob/master/scripts/test-cluster

Raft:
- http://blog.gopheracademy.com/writing-a-distributed-system-library
- http://thesecretlivesofdata.com/raft/

Transcript

1. etcd
2. Linux for Massive Server Deployments
3. @BrandonPhilips github.com/philips
4. secure the internet Why?
5. manual updates
6. automatic updates
7. automatic updates
8. rpm replace files restart processes edit configs
9. apt replace files restart processes edit configs
10. chef replace files restart processes edit configs
11. puppet replace files restart processes edit configs
12. kernel systemd ssh docker python java nginx mysql openssl app distro distro distro distro distro distro dist
13. kernel systemd ssh docker python java nginx mysql openssl app distro distro distro distro distro distro dist
14. The Linux Kernel does not break userspace.
15. WE DO NOT BREAK USERSPACE! Seriously. How hard is this rule to understand? We particularly don't break user space with TOTAL CRAP. - Linus Torvalds
18. etcd
19. /etc distributed
20. A highly-available key value store for shared configuration and service discovery.
21. A highly-available key value store for shared configuration and service discovery.
22. Available 3 1 2 5 4
23. Available 3 1 5 4
24. Available 3 1 4
25. Unavailable 3 1
26. A highly-available key value store for shared configuration and service discovery.
27. $ mkdir services! ! $ set services/db0 10.0.0.8! $ set services/db1 10.0.0.10! ! $ set services/db-master db0 etcdctl
28. GET /services/db0 “10.0.0.8”
29. A highly-available key value store for shared configuration and service discovery.
30. { "password": "cleartext", "user": "root" }
31. A highly-available key value store for shared configuration and service discovery.
32. A highly-available key value store for shared configuration and service discovery & locking.
33. App etcd DB?
34. App etcd No DB
35. App etcd I will watch and wait
36. App etcd master exists
37. App etcd DB Master?
38. App etcd No DB Master. You’re it. DB Master appeared
39. App etcd Heartbeat Watch SELECT * from Awesome
40. App etcd Heartbeat DB Master? Watch
41. App etcd Heartbeat Master exists. Watch
42. App etcd Heartbeat Heartbeat Watch
43. App etcd You’re master now New DB
44. App etcd Watch Heartbeat DROP *
45. App etcd Watch Heartbeat DB Master?
46. App etcd master exists Heartbeat Watch
47. $ set services/db-master db0! ! $ set --swap-with-value "db1" \! services/db-master db0! ! Compare failed ([db1 != db0]! etcdctl
48. how does the db know
 how to talk to etcd?
49. buddy etcd { host: “db1”, port: 4349 }
50. buddy etcd heartbeat
51. etcd
52. etcd from go
53. go-etcd etcd from go
54. etcd.NewClient(! [“127.0.0.1:4001”])
55. c.Create(“PDX”, “beer”)! ! c.Update(“PDX”, “bikes”)! ! c.Get(“PDX”)! ! c.Delete(“PDX”) // Never!
56. c.SetConsistency(! STRONG_CONSISTENCY)!
57. 0 1 1 0 1
58. c.SyncCluster()!
59. goraft
60. command.Apply() state is changed by raft.Command
61. server.Do() commands are replicated by the raft.Server
62. consensus across machines x = blue x = cow x = 1
63. raftd a simple k/v store on goraft >1000 LOC
64. Cmd + Tab Raft Visualization
65. Demo: etcd cluster
66. we’re hiring, you?
67. @coreoslinux github.com/coreos/etcd coreos.com Stay in Touch
68. Credits: Browser Icons: https://www.iconfinder.com/ Thanks!