Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Life's Too Short for Cloud without Analytics

Life's Too Short for Cloud without Analytics

Webinar - Monitoring the dynamic nature of cloud computing.

Lee Atchison

April 21, 2016
Tweet

More Decks by Lee Atchison

Other Decks in Technology

Transcript

  1. Life’s Too Short… ... for Cloud without Analytics Monitoring the

    Dynamic Nature of Cloud Computing Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc. Confidential ©2008-16 New Relic, Inc. All rights reserved. @leeatchison leeatchison
  2. ▪ Today’s webinar is being recorded. A link to the

    recording will be emailed to all registrants shortly after. ▪ Please be sure to ask any questions via the “questions panel” ▪ There is a brief survey after the webinar for any additional questions or feedback. 2 Housekeeping Confidential ©2008-15 New Relic, Inc. All rights reserved.
  3. Who am I? Specialize in: Cloud computing Services & Microservices

    Scalability, Availability 28 years in industry 7 in Amazon Retail & AWS (Built SW/VG AppStore, AWS Elastic Beanstalk) 4 in New Relic (Architecture Lead, Cloud, Service Migration) Confidential ©2008-16 New Relic, Inc. All rights reserved. 3 @leeatchison leeatchison
  4. We want better apps faster Dynamic Environment Better Data Center

    How do we use the cloud to accomplish this? Confidential ©2008-16 New Relic, Inc. All rights reserved. 4
  5. Cloud as a “Better Data Center” Resources are allocated to

    uses, just like in a data center Confidential ©2008-16 New Relic, Inc. All rights reserved. 6
  6. Cloud as a “Better Data Center” Resources are allocated to

    uses, just like in a data center Provisioning process is faster Confidential ©2008-16 New Relic, Inc. All rights reserved. 7
  7. Cloud as a “Better Data Center” Resources are allocated to

    uses, just like in a data center Lifetime of components is relatively long Provisioning process is faster Confidential ©2008-16 New Relic, Inc. All rights reserved. 8
  8. Cloud as a “Better Data Center” Resources are allocated to

    uses, just like in a data center Lifetime of components is relatively long Provisioning process is faster Capacity planning is still important and still applies Confidential ©2008-16 New Relic, Inc. All rights reserved. 9
  9. Why use a “Better Data Center”? Add new Capacity (faster)

    Confidential ©2008-16 New Relic, Inc. All rights reserved. 11
  10. Why use a “Better Data Center”? Improve Application Availability (redundancy)

    Add new Capacity (faster) Confidential ©2008-16 New Relic, Inc. All rights reserved. 12
  11. Why use a “Better Data Center”? Compliance Improve Application Availability

    (redundancy) Add new Capacity (faster) Confidential ©2008-16 New Relic, Inc. All rights reserved. 13
  12. Who is impacted? Better Data Center Can I scale my

    server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Development Confidential ©2008-16 New Relic, Inc. All rights reserved. 15
  13. Who is impacted? Better Data Center Can I scale my

    server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Confidential ©2008-16 New Relic, Inc. All rights reserved. 16
  14. Who is impacted? Better Data Center Faster Application Launch /

    Deploy = Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Confidential ©2008-16 New Relic, Inc. All rights reserved. 17
  15. How do I monitor it? Similar to monitoring any other

    data center… Confidential ©2008-16 New Relic, Inc. All rights reserved. 18
  16. Monitoring an application Typical Server / EC2 Instance • Application

    & Application Microservices • Server OS • Hardware (virtual) EC2 Instance Application & Application Microservices Server OS Server (Virtual) Hardware Confidential ©2008-16 New Relic, Inc. All rights reserved. 19
  17. AWS Monitoring CloudWatch • Monitors: – EC2 instance – Virtualization

    – Hardware – [CPU / Disk / Networking] • Doesn’t know about: – Server OS – Memory / Filesystem – Processes – Application • Latency • Error rates • Internal insights EC2 Instance Application & Application Microservices Server OS Server (Virtual) Hardware CloudWatch AWS CONSOLE Confidential ©2008-16 New Relic, Inc. All rights reserved. 20
  18. New Relic Monitoring New Relic • Monitors (Server): – How

    O.S. is performing – Processes – Hardware • Monitors (Application): – App health – App performance – Microservices • Doesn’t know – Virtualization EC2 Instance Application & Application Microservices New Relic Application Monitoring Server OS Server (Virtual) Hardware New Relic Server Monitoring CloudWatch DASHBOARDS Confidential ©2008-16 New Relic, Inc. All rights reserved. 21 AWS CONSOLE
  19. AWS çè New Relic work together AWS / CloudWatch •

    Visibility into virtualization • CPU / Disk / Networking New Relic • CPU / Disk / Networking • Memory / Filesystem • Processes • Infrastructure components • Application / Microservices: – Latency – Error rates – App insights EC2 Instance Application & Application Microservices New Relic Application Monitoring Server OS Server (Virtual) Hardware New Relic Server Monitoring CloudWatch DASHBOARDS CloudWatch monitors New Relic monitors Confidential ©2008-16 New Relic, Inc. All rights reserved. 22 AWS CONSOLE
  20. Cloud as a “Dynamic Tool for Dynamic Apps” Use only

    the resources you need Confidential ©2008-16 New Relic, Inc. All rights reserved. 24
  21. Cloud as a “Dynamic Tool for Dynamic Apps” Use only

    the resources you need Allocate / de-allocate resources on the fly Confidential ©2008-16 New Relic, Inc. All rights reserved. 25
  22. Cloud as a “Dynamic Tool for Dynamic Apps” Use only

    the resources you need Resource allocation is an integral part of your application architecture Allocate / de-allocate resources on the fly Confidential ©2008-16 New Relic, Inc. All rights reserved. 26
  23. Dynamic Cloud Resources are: Application is aware of and is

    controlling traditional OPs resources De-allocated Consumed Allocated Auto Scale Confidential ©2008-16 New Relic, Inc. All rights reserved. 27
  24. Dynamic Cloud Docker containers: • Quicker / cheaper startup /

    shutdown than EC2 instances • Easy to consume Docker containers much like you do “processes” • Perform jobs: – In a script – Off of some queue of job requests Confidential ©2008-16 New Relic, Inc. All rights reserved. 28
  25. Dynamic Cloud 100 10K 1M 3.7 M 83 days 333

    days Docker Container Age (Count vs. Hours) Confidential ©2008-16 New Relic, Inc. All rights reserved. 29
  26. Dynamic Cloud 950,000 11% under one minute Docker Container Age

    (by Minute Under and Hour) Confidential ©2008-16 New Relic, Inc. All rights reserved. 30
  27. EC2 Auto Scaling Dynamic Cloud Technologies Mobile / IoT Dynamic

    routing Load balancing Data transport Queues and notifications Docker Dynamic Cloud is about scaling Confidential ©2008-16 New Relic, Inc. All rights reserved. 31
  28. How do I monitor the Dynamic Cloud? Dynamic Cloud has

    unique monitoring requirements… Confidential ©2008-16 New Relic, Inc. All rights reserved. 32
  29. Responsibility (Dynamic Cloud) Server OS Server (Virtual) Hardware Application &

    Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Responsible for the parts you care about • Application & Application Microservices Let cloud manage rest • Infrastructure • Allocation/Provisioning • Scaling Confidential ©2008-16 New Relic, Inc. All rights reserved. 33
  30. AWS Infrastructure çè New Relic work together Server OS Server

    (Virtual) Hardware CloudWatch DASHBOARDS Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Confidential ©2008-16 New Relic, Inc. All rights reserved. 34 AWS CONSOLE
  31. AWS Infrastructure çè New Relic work together Server OS Server

    (Virtual) Hardware CloudWatch DASHBOARDS Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Confidential ©2008-16 New Relic, Inc. All rights reserved. 35 AWS CONSOLE
  32. AWS Infrastructure çè New Relic work together Server OS Server

    (Virtual) Hardware CloudWatch DASHBOARDS Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning CloudWatch & AWS monitoring New Relic monitors Confidential ©2008-16 New Relic, Inc. All rights reserved. 36 AWS CONSOLE
  33. How do you monitor this? Server OS Server (Virtual) Hardware

    Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Confidential ©2008-16 New Relic, Inc. All rights reserved. 37 ? How do you monitor this?
  34. Where did it go? It was just here!!! Confidential ©2008-16

    New Relic, Inc. All rights reserved. 38 ? The thing you monitored 10 minutes ago… ...doesn’t exist anymore!
  35. Dynamic Cloud 950,000 11% under one minute Docker Container Age

    (by Minute Under and Hour) Confidential ©2008-16 New Relic, Inc. All rights reserved. 39
  36. Monitoring the Dynamic Cloud Very different than monitoring traditional Data

    Center components Monitor the Cloud Components themselves Monitor the lifecycle of the Cloud Components Confidential ©2008-16 New Relic, Inc. All rights reserved. 40
  37. Who is impacted by Dynamic Cloud? Better Data Center Can

    I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. 41
  38. Who is impacted by Dynamic Cloud? Better Data Center Can

    I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Dynamic Cloud What is a container? Why do I care?? It was just here, where did it go??? Confidential ©2008-16 New Relic, Inc. All rights reserved. 42
  39. Who is impacted by Dynamic Cloud? Better Data Center Can

    I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Dynamic Cloud What is a container? Why do I care?? It was just here, where did it go??? Cloud architecture is integral to the application architecture Developers deeply involved in cloud activities Confidential ©2008-16 New Relic, Inc. All rights reserved. 43
  40. Change is speeding up Traditional Data Center Cloud Data Center

    Dynamic Cloud Dynamic Cloud enables better applications faster. Good Better Best Confidential ©2008-16 New Relic, Inc. All rights reserved. 44 The way you’ve done things in the past won’t work in the future.
  41. Dynamic Cloud EC2 Server running application / processes Docker container

    Process running a command Confidential ©2008-16 New Relic, Inc. All rights reserved. 45 This is hard Things happen faster because of…
  42. Dynamic Cloud EC2 Server running application / processes Docker container

    Process running a command Lambda Function performing a task or operation Confidential ©2008-16 New Relic, Inc. All rights reserved. 46
  43. Microcomputing & AWS Lambda • Newest entrance to the “dynamic

    cloud” • Provides event driven compute capabilities Confidential ©2008-16 New Relic, Inc. All rights reserved. 48
  44. Microcomputing & AWS Lambda • No infrastructure to provision •

    Massively shared infrastructure Confidential ©2008-16 New Relic, Inc. All rights reserved. 49
  45. Why use Lambda? Lambda scripts Run in response to a

    state change or action in the cloud Stateless, “filters” Perform quick actions Virtually no startup/shutdown cost Confidential ©2008-16 New Relic, Inc. All rights reserved. 50
  46. AWS Lambda S3 Bucket Dynamo DB API Gateway SQS RESOURCES

    SOME • Takes an event from an AWS resource (A Trigger) Confidential ©2008-16 New Relic, Inc. All rights reserved. 51
  47. AWS Lambda S3 Bucket Dynamo DB API Gateway SQS RESOURCES

    SOME Lambda Script • Takes an event from an AWS resource (A Trigger) • Creates an instance to execute Lambda Instance Confidential ©2008-16 New Relic, Inc. All rights reserved. 52
  48. AWS Lambda S3 Bucket Dynamo DB API Gateway SQS RESOURCES

    SOME S3 Bucket API Gateway SQS RESOURCES SOME Lambda Script • Takes an event from an AWS resource (A Trigger) • Creates an instance to execute • Can impact original or different AWS Resource Lambda Instance Confidential ©2008-16 New Relic, Inc. All rights reserved. 53
  49. AWS Lambda S3 Bucket Dynamo DB API Gateway SQS RESOURCES

    SOME S3 Bucket API Gateway SQS RESOURCES SOME Lambda Script Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance • Takes an event from an AWS resource (A Trigger) • Creates an instance to execute • Can impact original or different AWS Resource • Any number of instances can run at a time Confidential ©2008-16 New Relic, Inc. All rights reserved. 54
  50. Photo management application User Upload File S3 Bucket Image Import

    • Photos uploaded to S3 Confidential ©2008-16 New Relic, Inc. All rights reserved. 56
  51. Photo management application User Upload File S3 Bucket Image Import

    S3 Bucket Image Thumbnails View Thumbnail Lambda Script • Photos uploaded to S3 • Lambda script creates thumbnails Confidential ©2008-16 New Relic, Inc. All rights reserved. 57
  52. Photo management application User Image Database Upload File S3 Bucket

    Image Import S3 Bucket Image Thumbnails Lambda Script View Thumbnail Lambda Script • Photos uploaded to S3 • Lambda script creates thumbnails • Lambda script updates metadata in database Confidential ©2008-16 New Relic, Inc. All rights reserved. 58
  53. Photo management application User Image Database Application Upload File S3

    Bucket Image Import S3 Bucket Image Thumbnails Lambda Script App Interactions View Thumbnail Lambda Script • Photos uploaded to S3 • Lambda script creates thumbnails • Lambda script updates metadata in database • Application only has to deal with metadata editing, not photo / file management Confidential ©2008-16 New Relic, Inc. All rights reserved. 59
  54. Mobile game platform API Gateway Lambda Script Lambda Script Lambda

    Script Mobile Phone Application Users Database • Cloud platform hosts an API for mobile app – API Gateway • Lambda scripts implement the API • Lambda scripts manipulate database • Extremely high scale possible – No infrastructure Confidential ©2008-16 New Relic, Inc. All rights reserved. 61
  55. Monitoring Lambda Scripts Less like server monitoring / More like

    web application monitoring We Care About We Don’t Care About • Run time (average, extremes – TP90/TP99) • Statistical metrics • Error rates and other deviations from norm • “Drill down” into individual “runs” • Details about all ”runs” • Server / infrastructure metrics Confidential ©2008-16 New Relic, Inc. All rights reserved. 62
  56. Monitoring Lambda More like application performance monitoring than infrastructure monitoring

    Confidential ©2008-16 New Relic, Inc. All rights reserved. 63
  57. Monitoring Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved.

    64 More like application performance monitoring than infrastructure monitoring
  58. Change is speeding up Traditional Data Center Cloud Data Center

    Dynamic Cloud Dynamic Cloud enables better applications faster. The rate of change is increasing… Good Better Best Confidential ©2008-16 New Relic, Inc. All rights reserved. 65 The way you’ve done things in the past won’t work in the future.
  59. Monitoring just the server EC2 Instance Application & Application Microservices

    Server OS Server (Virtual) Hardware CloudWatch Confidential ©2008-16 New Relic, Inc. All rights reserved. 66 Worked when rate of change was low… AWS CONSOLE
  60. Monitoring just the server Server OS Server (Virtual) Hardware Application

    & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Insufficient in the cloud: • Rate of change is faster • Problems come up quicker • “Server” isn’t a server anymore • “Provisioning” isn’t provisioning anymore You need top to bottom monitoring… You need full stack accountability...
  61. 68 New Relic enables accountability between your code & AWS

    Confidential ©2008-16 New Relic, Inc. All rights reserved. Customers Mobile / Apps / Browser On-Premises On Premises Relational Data EC2 AWS Container Service AWS RDS Synthetic Customers S3 NoSQL AWS Storage Services Your Responsibilities § Application code & 3rd party services § App architecture § Customer experience § On-Premises components NoSQL AWS Responsibility: § Service Availability & Performance § Provisioning & operation of DC § Isolation & security of resources § Service maintenance & innovation
  62. Architecting for Scale By: Lee Atchison Published by: O’Reilly Media,

    Available: June 2016 www.architectingforscale.com Want to Learn More?
  63. ©2008-15 New Relic, Inc. All rights reserved. Thank you. Lee

    Atchison Principal Cloud Architect and Advocate at New Relic, Inc. Architecting for Scale Published by: O’Reilly Media, Available: June 2016 www.architectingforscale.com @leeatchison leeatchison
  64. 71 Safe Harbor Confidential ©2008-16 New Relic, Inc. All rights

    reserved. This document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission. Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import. Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the SEC’s website at www.sec.gov. New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respectto the information provided.