Growing Distributed Systems: Abril Pro Ruby

The Abril Pro Ruby version of my Growing Distributed Systems talk.

Transcript

1. Growing Distributed Systems
2. Hello Bryce Kerley @bonzoesc basho
9. Distributed Systems What even are they?
10. Distributed Systems
11. Distributed Systems Always Broken
12. Distributed Systems Light Cones
13. Mutual visibility Soldier Fires Sniper Fires
14. Distributed Systems A distributed system is one in which the failure of a computer you didn’t even know existed can render your own computer unusable. Lamport, 1987
15. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
16. Byzantine Generals Two armies One town
17. Byzantine Generals Horse messengers
18. Byzantine Generals Consensus on when to attack
19. Byzantine Generals No Right Answer
20. Criticality •Amazon S3, July 2008 •GitHub, Dec. 2012 •Northeast US, 2003
21. Murphy’s Law at Scale •Backblaze •Gears of War 2
22. CAP Theorem Consistency Availability Partition tolerance
23. Rules, Theory, and Practice Compromise
24. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
25. CAP Theorem lose Consistency or Availability during Partitions
26. Partitions
27. Partitions
28. CP Systems Zookeeper
29. Unavailability Don’t fill requests
30. Unavailability oonbeamlabs
31. AP Systems Riak
32. Inconsistency Accept writes Perform reads
33. Inconsistency
34. Hybrid Multiple Stores
35. Hybrid Where It Counts
36. Hybrid Riak 2 Strong Consistency
37. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
38. Distributed Rails You’re Already Distributed
39. Distributed Rails Rails
40. Distributed Rails Rails Web DB
41. Distributed Rails SQL Rules
42. Distributed Rails NoSQL No Rules
43. Distributed Rails Temptation
44. Temptation “We’ll put everything in Rails models.”
46. Distributed Rails Service Oriented Architecture
47. Service Oriented Extract Parts
48. Service Oriented Documented Protocols
49. Service Oriented Smaller Deployments
50. Service Oriented Simpler Organization
51. Service Oriented Break Coupling
52. Service Oriented Flexible Implementation
53. Testing Unit Tests
54. Testing Service Tests
55. Testing Acceptance Tests
56. Testing Refactoring [GitHub] with Science Wynn Netherland, Big Ruby, Feb. 2014
57. Offline Apps Latency Garbage Collection Packet loss Airplane rides Local internet
58. Offline Apps Smarter clients
59. Offline Apps You’re Already Doing It
60. Offline Strategies Conflicts
61. Offline Strategies Operational Transform
62. Offline Strategies Git
63. Offline Strategies Vesper
64. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
65. Ruby Works
66. Make Something Awesome
67. Grow When You Need To
68. Thanks Bryce Kerley @bonzoesc bkerley@brycekerley.net http://bitly.com/aprb-dist
69. Bonus Slides
70. Consensus Algorithm Paxos 1989
73. Consensus Algorithm Raft 2013
74. Harvest & Yield Harvest: fraction of data Yield: probability of success
76. NoSQL and Rails SQL ACID
77. NoSQL and Rails Atomicity Consistency Isolation Durability
78. NoSQL and Rails NoSQL BASE
79. NoSQL and Rails Basically Available Soft-state Eventually consistent
80. Offline Libraries Breeze PouchDB Lawnchair
81. Must Watch Jeff Hodges “Practicalities of Productionizing Distributed Systems” youtu.be/BKqgGpAOv1w