Growing Distributed Systems

Ruby on Ales, Mar. 7 2014

Transcript

1. Growing Distributed Systems
5. Hello Bryce Kerley @bonzoesc basho
6. Distributed Systems What even are they?
7. Distributed Systems
8. Distributed Systems Always Broken
10. Distributed Systems Light Cones
11. Mutual visibility Soldier Fires Sniper Fires
12. Distributed Systems A distributed system is one in which the failure of a computer you didn’t even know existed can render your own computer unusable. Lamport, 1987
13. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
14. Byzantine Generals No Right Answer
15. Criticality •Amazon S3, July 2008 •GitHub, Dec. 2012 •Northeast US, 2003
16. Murphy’s Law at Scale •Backblaze •Gears of War 2
17. CAP Theorem Consistency Availability Partition tolerance
18. Rules, Theory, and Practice Compromise
19. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
20. CAP Theorem lose Consistency or Availability during Partitions
21. CP Systems Zookeeper
22. Unavailability Don’t fill requests
23. Unavailability
24. AP Systems Riak
25. Inconsistency Accept writes Perform reads
26. Inconsistency
27. Hybrid Multiple Stores
28. Hybrid Where It Counts
29. Hybrid Riak 2 Strong Consistency
30. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
31. Distributed Rails You’re Already Distributed
32. Distributed Rails Rails
33. Distributed Rails Rails Web DB
34. Distributed Rails SQL Rules
35. Distributed Rails NoSQL No Rules
36. Distributed Rails Temptation
38. Distributed Rails Service Oriented Architecture
39. Service Oriented Extract Parts
40. Service Oriented Documented Protocols
41. Service Oriented Smaller Deployments
42. Testing Unit Tests
43. Testing Service Tests
44. Testing Acceptance Tests
45. Testing Refactoring [GitHub] with Science Wynn Netherland, Big Ruby, Feb. 2014
46. Offline Apps Latency Garbage Collection Packet loss Airplane rides Local internet
47. Offline Apps Smarter clients
48. Offline Apps You’re Already Doing It
49. Offline Strategies Conflicts
50. Offline Strategies Operational Transform
51. Offline Strategies Git
52. Offline Strategies Vesper
53. Distributed Systems •Rules and Theory •Inconsistency and Unavailability •Distributed Rails
54. Ruby Works
55. Make Something Awesome
56. Grow When You Need To
57. Thanks Bryce Kerley @bonzoesc bryce@basho.com http://bitly.com/roa-dist
58. Bonus Slides
59. Harvest & Yield Harvest: fraction of data Yield: probability of success
61. NoSQL and Rails SQL ACID
62. NoSQL and Rails Atomicity Consistency Isolation Durability
63. NoSQL and Rails NoSQL BASE
64. NoSQL and Rails Basically Available Soft-state Eventually consistent
65. Why Extract? Break coupling Easier deploys Simpler responsibility Forced abstraction Prevent introspection Standardization Flexible backends
66. Offline Libraries Breeze PouchDB Lawnchair
67. Must Watch Jeff Hodges “Practicalities of Productionizing Distributed Systems” youtu.be/BKqgGpAOv1w