Upgrade to Pro — share decks privately, control downloads, hide ads and more …

On Distributed Systems and Distributed Teams at Elastic

On Distributed Systems and Distributed Teams at Elastic

A wall clock that ran backward and a skull and crossbones flag. Fictional parliamentary systems of ancient civilizations. @all threads that run into the several hundred replies. All are interesting stories and illustrate concepts that make Elastic...elastic?

The distributed systems movement, and open source more broadly, is fueled by solving a series of complex problems: consensus, leader election, failure semantics, among others. Our reasoning about distributed concepts influences system design and implementation. Our understanding impacts that which we build...particularly when we build distributed companies. How does a distributed team building distributed systems, at Elastic, function?

Tyler Hannan l Director, Product Marketing l Elastic

Dd9d954997353b37b4c2684f478192d3?s=128

Elastic Co

March 07, 2017
Tweet

Transcript

  1. Elastic 07/03/2017 @tylerhannan On Distributed Systems and Distributed Teams Tyler

    Hannan, Director Product & Technical Marketing
  2. whoami?

  3. 463

  4. 32

  5. 19

  6. 30

  7. distributed systems and distributed teams

  8. None
  9. and

  10. None
  11. an expression whose meaning refers to a figurative meaning

  12. known through common use (i.e. kick the bucket)

  13. None
  14. ‘We compare apples and oranges all the time!

  15. We compare them by price,

  16. by how much we like the taste,

  17. by the likely sweetness and ripeness,

  18. by how well they'll go in a tasty fruit cocktail

    and so on.
  19. In fact, every time we go to the store and

    buy
  20. apples rather than oranges -- or vice versa --

  21. we are necessarily

  22. (if implicitly)

  23. comparing apples and oranges.'

  24. ‘apples and democracy’

  25. ‘oranges and the multiplication table’

  26. distributed by design

  27. 'A distributed system is a software system in which components

    located on network computers communicate and coordinate their actions by passing messages.
  28. The components interact with each other in order to achieve

    a common goal.' Wikipedia
  29. 'A distributed system is one which the failure of a

    computer you didn't even know existed can render your own computer unusable' Leslie Lamport
  30. 'In pioneer days, they used oxen for heavy pulling, and

    when one ox couldn't budge a log, they didn't try to grow a bigger ox.' Grace Hopper
  31. 299,792,458

  32. None
  33. None
  34. 225,308,160

  35. latency

  36. ~10ms

  37. 1%

  38. 1906 London

  39. None
  40. villagers,

  41. farmers,

  42. ranchers,

  43. doctors,

  44. men,

  45. women,

  46. children,

  47. professionals,

  48. laborers,

  49. 787 guesses

  50. 1,197 pounds

  51. weight for it…

  52. 1,198 pounds.

  53. 'The results seem more creditable to the trustworthiness of a

    democratic judgment...'
  54. collective intelligence

  55. ‘group think’

  56. Client Proposer Acceptor Learner | | | | | |

    | --- First Request --- X-------->| | | | | | Request | X--------->|->|->| | | Prepare(N) | |<---------X--X--X | | Promise(N,I,{Va,Vb,Vc}) | X--------->|->|->| | | Accept!(N,I,Vm) | |<---------X--X--X------>|->| Accepted(N,I,Vm) |<---------------------------------X--X Response | | | | | | |
  57. the part time parliament

  58. None
  59. Paxos

  60. 'Writing about a lost civilization allowed me to eliminate uninteresting

    details and indicate generalizations by saying that some details of the parliamentary protocol had been lost.
  61. To carry the image further, I gave a few lectures

    in the persona of an Indiana-Jones- style archaeologist, replete with Stetson hat and hip flask.
  62. My attempt at inserting some humor into the subject was

    a dismal failure.’
  63. Client Proposer Acceptor Learner | | | | | |

    | --- First Request --- X-------->| | | | | | Request | X--------->|->|->| | | Prepare(N) | |<---------X--X--X | | Promise(N,I,{Va,Vb,Vc}) | X--------->|->|->| | | Accept!(N,I,Vm) | |<---------X--X--X------>|->| Accepted(N,I,Vm) |<---------------------------------X--X Response | | | | | | |
  64. consensus

  65. message was lost in the medium

  66. the delivery clouded the applicability

  67. distributed by design

  68. partial failure

  69. distributed teams by design

  70. 463

  71. 32

  72. 19

  73. 30

  74. or, perhaps,

  75. 463 employees

  76. 32 countries

  77. at least 19 timezones

  78. 30+ spoken languages

  79. we aren’t remote.

  80. we are distributed.

  81. it requires intent

  82. electronic communications lose nonverbal cues

  83. active, focused, and truly invested

  84. some all@ emails

  85. become t-shirts

  86. tiij ji je

  87. UzzrzOu))6,)6.32!&)8&&&

  88. None
  89. None
  90. None
  91. some all@ emails

  92. become public statements

  93. None
  94. ‘a more diverse company will make for

  95. a better company,’

  96. and we should continuously strive for it.

  97. distributed availability

  98. None
  99. None
  100. ‘your location is

  101. a descriptor

  102. not a defining attribute.’

  103. elastic heart

  104. None
  105. None
  106. None
  107. software is all about

  108. ‘what does your company do?’

  109. ‘why do you live in amsterdam?’

  110. ‘what tools do you use?’

  111. wrong question.

  112. in my life

  113. there are humans.

  114. humans i work for.

  115. humans i work with.

  116. humans who work for me.

  117. humans i raise.

  118. None
  119. None
  120. there is a reason

  121. there is a reason

  122. there is a reason

  123. software is all about humans

  124. ‘The most important thing I've accomplished, other than building the

    compiler, is training young people.
  125. They come to me, you know, and say, 'Do you

    think we can do this?' I say, "Try it."
  126. And I back 'em up. They need that.

  127. I keep track of them as they get older and

    I stir 'em up at intervals so they don't forget to take chances.’
  128. Grace Hopper

  129. written while listening to: 22, a million - Bon Iver

    Christine and Queens Here Their Dreams - Bombazine Black
  130. this presentation

  131. None
  132. None
  133. #133

  134. www.elastic.co

  135. Except where otherwise noted, this work is licensed under http://creativecommons.org/licenses/by-nd/4.0/

    Creative Commons and the double C in a circle are registered trademarks of Creative Commons in the United States and other countries. Third party marks and brands are the property of their respective holders. 135 Please attribute Elastic with a link to elastic.co