Scaling Silos: Distributed Knowledge

Presented at ScaleConf 2019

Transcript

1. SCALING SILOS DISTRIBUTED KNOWLEDGE @GREYSCHALE SCALECONF 2019
2. http://www.npr.org/player/embed/404548309/404548333
3. https://twitter.com/htde/status/590995577090875393
4. https://twitter.com/Scambl/status/590881078740672512
6. OBSERVATION: I use Stack Overflow.
 A lot. QUESTION: How will my coding habits change if I give it up for 30 days? @GREYSCHALE
7. HYPOTHESIS: I don't need Stack Overflow that much. PREDICTION: I'll be able to come up with different ways to write the same code. @GREYSCHALE
8. TEST: 1. Route stackoverflow.com in /etc/hosts to 127.0.0.1 2. Code. 3. Keep daily journal of observations. 4. ??? 5. ...Profit?! @GREYSCHALE
9. DAY 1: - Already am struggling. Help. How to PostGIS in Rails without gem. - Postgres documentation ain't so bad...I guess... - Only last two results of this search are not SO.... @GREYSCHALE
10. DAY 2: "Are you on W3Schools because you can't use StackOverflow?" (shockingly...no) @GREYSCHALE
11. DAY 14: - F*CKING FACEBOOK API WTF TOKEN AM I SUPPOSED TO F*CKING USE. - It's not cheating if you make somebody else use StackOverflow on their computer, right....? @GREYSCHALE
12. DAY 15: - TFW SO result is before the official RSpec docs. - Is it cheating to use WebArchive to SO? @GREYSCHALE
13. DAY 19: - SQL JOINs are hard. - Fixed a ticket with just Rails docs and status code searches. \o/ @GREYSCHALE
14. DAY 22: - Already knew this search query would be all SO results. @GREYSCHALE
15. DAY 26: ¯\_(ツ)_/¯ @GREYSCHALE
16. DAY 27: - Github issue ends with, "I posted the solution on StackOverflow." (ノಠ益ಠ)ノኯ┻━┻ @GREYSCHALE
18. CONCLUSIONS: 1. ??? 2. ??? 3. ??? 4. ??? 5. ???
19. FAULT TOLERANCE
21. https://xkcd.com/979/
22. http://forums.xkcd.com/viewtopic.php?f=7&t=76560#p2816635
24. (BUS) FACTORISATION: @GREYSCHALE
25. (BUS) FACTORISATION: - Do you have a "go-to" person on your team? @GREYSCHALE
26. (BUS) FACTORISATION: - Do you have a "go-to" person on your team? - Do other people realise this or acknowledge it? @GREYSCHALE
27. (BUS) FACTORISATION: - Do you have a plan for if this person suddenly disappeared? @GREYSCHALE
28. (BUS) FACTORISATION: - Is it the tool itself?! @GREYSCHALE
29. CAP-ish Theorem: @GREYSCHALE
30. CAP-ish Theorem: - Partition Tolerance @GREYSCHALE
31. CAP-ish Theorem: - Partition Tolerance - Availability @GREYSCHALE
32. CAP-ish Theorem: - Partition Tolerance - Availability - Consistency @GREYSCHALE
33. CAP-ish Theorem: - Partition Tolerance - Availability - Consistency @GREYSCHALE
34. 3-2-1 Rule: @GREYSCHALE
35. 3-2-1 Rule: 3 Copies 2 Formats 1 Off-site @GREYSCHALE
36. 3-2-1 Rule: 3 Teams 2 Documents 1 Source Control @GREYSCHALE
37. 3-2-1 Rule: 3 People 2 Formats 1 Truth @GREYSCHALE
38. RESOURCE SHARING
39. https://xkcd.com/627/
40. https://xkcd.com/627/
43. @GREYSCHALE
44. @GREYSCHALE
45. @GREYSCHALE
46. @GREYSCHALE
47. @GREYSCHALE
48. HOW DO WE SHARE KNOWLEDGE? @GREYSCHALE
49. HOW DO WE SHARE KNOWLEDGE? - Brain dumps? @GREYSCHALE
50. HOW DO WE SHARE KNOWLEDGE? - Brain dumps? - Interrupts? @GREYSCHALE
51. HOW DO WE SHARE KNOWLEDGE? - Brain dumps? - Interrupts? - Discovery? @GREYSCHALE
52. SHARING == <3 @GREYSCHALE
53. SHARING == <3 - Independent @GREYSCHALE
54. SHARING == <3 - Independent - Memetic/epidemic @GREYSCHALE
55. SHARING == <3 - Independent - Memetic/epidemic - Codified @GREYSCHALE
56. CODIFY IT?! @GREYSCHALE
57. CODIFY IT?! - Expectations @GREYSCHALE
58. CODIFY IT?! - Expectations - Modernity @GREYSCHALE
59. CODIFY IT?! - Expectations - Modernity - Update rate @GREYSCHALE
61. CARGO CULTS: @GREYSCHALE @GREYSCHALE
63. CARGO CULTS: - Make it so they don't need it @GREYSCHALE @GREYSCHALE
64. CARGO CULTS: - Make it so they don't need it - Remove pressures @GREYSCHALE
65. https://images-na.ssl-images-amazon.com/images/I/8143BTFiw8L._SL1488_.jpg
66. @GREYSCHALE CARGO CULTS: - Make it so they don't need it - Remove pressures - Attribute everything
67. https://twitter.com/kellabyte/status/1100457037882810370
68. https://twitter.com/iamdevloper/status/1100350155658678274
69. SCALABILITY
70. SCALABILITY?
71. KNOWLEDGE ROADMAPS FOR: - The next month - The next quarter - The next decade?! @GREYSCHALE
72. @GREYSCHALE team size knowledge
73. CONCLUSIONS: @GREYSCHALE
74. CONCLUSIONS: 1. Knowledge IS a distributed system. @GREYSCHALE
75. CONCLUSIONS: 1. Knowledge IS a distributed system. 2. The weakest link weakens the system. @GREYSCHALE
76. CONCLUSIONS: 1. Knowledge IS a distributed system. 2. The weakest link weakens the system. 3. Not all sharing is alike. @GREYSCHALE
77. CONCLUSIONS: 4. I still use Stack Overflow. A lot. @GREYSCHALE
78. CONCLUSIONS: 4. I still use Stack Overflow. A lot. 5. But try to share what I learn more often. @GREYSCHALE
79. CONCLUSIONS: 4. I still use Stack Overflow. A lot. 5. But try to share what I learn more often. <3 @GREYSCHALE
80. https://xkcd.com/1053/
81. THE END
82. THE END?
83. THE PERFECT DISTRIBUTED SYSTEM: @GREYSCHALE
84. THE PERFECT DISTRIBUTED SYSTEM: Never mind, figured it out. @GREYSCHALE posted 08-03-2003
85. THANK YOU QUESTIONS? @GREYSCHALE SCALECONF 2019