Build a System that Never Stops #FS16NY

B5b0f56c5edce4c54f1fea72e31d8378?s=47 Nic Benders
August 09, 2016
210

Build a System that Never Stops #FS16NY

An updated version of my Building a System talk, as presented at FutureStack 16 New York.

B5b0f56c5edce4c54f1fea72e31d8378?s=128

Nic Benders

August 09, 2016
Tweet

Transcript

  1. BUILDING A SYSTEM THAT NEVER STOPS Nic Benders Chief Architect,

    New Relic
  2. BUILDING A SYSTEM THAT NEVER STOPS GROWING

  3. BUILDING A SYSTEM THAT NEVER STOPS LEARNING

  4. BUILDING A SYSTEM THAT NEVER STOPS CHANGING

  5. ©2008-16 New Relic, Inc. All rights reserved. @nicbenders http://nicbenders.com/presentations/scaling-a-system/

  6. ©2008-16 New Relic, Inc. All rights reserved. Safe Harbor This

    document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission. Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,” “expects” or words of similar import. Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at ir.newrelic.com or the SEC’s website at www.sec.gov. New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided
  7. None
  8. IN 1 MINUTE requests accepts
 over 21M stores
 over analytic


    events 200M aggregates
 over 800M metrics 50B queries
 over data
 points ▪
  9. different
 services contains
 over 250 maintained/
 built by 25+ engineering


    teams ▪ 4.3 more
 than SSD
 storage PETABYTES
  10. ©2008-16 New Relic, Inc. All rights reserved. 8 LESSONS FROM

    OUR DATA PIPELINE
  11. ©2008-16 New Relic, Inc. All rights reserved. Collector New Relic

    App Agents
  12. Confidential ©2008-15 New Relic, Inc. All rights reserved. ▪ Double-click

    to edit
  13. ©2008-16 New Relic, Inc. All rights reserved. Collector New Relic

    App Agents
  14. ©2008-16 New Relic, Inc. All rights reserved. Collector New Relic

    App Agents Browser R.U.M.
 Beacon New Relic Browser Agents
  15. ©2008-16 New Relic, Inc. All rights reserved. Collector New Relic

    App Agents Browser R.U.M.
 Beacon New Relic Browser Agents Mobile Proxy New Relic Mobile Agents
  16. ©2008-16 New Relic, Inc. All rights reserved. New Relic App

    Agents New Relic Browser Agents New Relic Mobile Agents Zzz Collector Browser R.U.M.
 Beacon Mobile Proxy
  17. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  18. ©2008-16 New Relic, Inc. All rights reserved. NOTHING Lasts Forever

    Lesson 1
  19. ©2008-16 New Relic, Inc. All rights reserved. Lesson 2 Create

    a culture where CHANGE IS OK
  20. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  21. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  22. ©2008-16 New Relic, Inc. All rights reserved. EXPERIMENTS Don’t always

    work Lesson 3
  23. ©2008-16 New Relic, Inc. All rights reserved. Lesson 4 SYNCHRONOUS

    is going to be a problem
  24. ©2008-16 New Relic, Inc. All rights reserved. Kafka Kafka Browser

    Data Consumer Browser Data Router New Relic App Agents New Relic Browser Agents Collector
  25. ©2008-16 New Relic, Inc. All rights reserved. Kafka Kafka Browser

    Data Consumer New Relic App Agents Collector Zzz Browser Data Router New Relic Browser Agents
  26. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  27. ©2008-16 New Relic, Inc. All rights reserved. Lesson 5 Master

    the ROLLOUT
  28. ©2008-16 New Relic, Inc. All rights reserved. Rollout
 Techniques Kafka

    Load Balancer Cluster Kafka Browser Data Consumer Browser Data Router Browser Data
 Consumer V2 Browser R.U.M.
 Beacon %- %+ New Relic Browser Agents Collector Old New
  29. ©2008-16 New Relic, Inc. All rights reserved. Lesson 6 It’s

    the OPERATIONS
 stupid
  30. Confidential ©2008-15 New Relic, Inc. All rights reserved. Monitoring Tooling

    Operations Runbooks
  31. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  32. ©2008-16 New Relic, Inc. All rights reserved. Lesson 7 Use

    the right WORKLOAD DISTRIBUTION
  33. ©2008-16 New Relic, Inc. All rights reserved. Workload Distribution D

    D D D D C B B B B A A A A A C B D A B D D D Active Management Random C B B B D D A A D C B B D B C A A D D C C A B
  34. ©2008-16 New Relic, Inc. All rights reserved. D D D

    D D C B B B B A A A A A C B D A B D D D C B B B D D A A D C B B D B C A A D D C C A B Active Management Random Use Both!
  35. ©2008-16 New Relic, Inc. All rights reserved. Lesson 8 Technology

    enables CULTURE
  36. Thanks for the pic! https://www.flickr.com/photos/stephenyeargin/7466608166

  37. Thanks for the pic! https://www.flickr.com/photos/stephenyeargin/7466608166 �����

  38. 35

  39. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  40. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  41. Confidential ©2008-15 New Relic, Inc. All rights reserved.

  42. Confidential ©2008-15 New Relic, Inc. All rights reserved. @nicbenders http://nicbenders.com/presentations/scaling-a-system/