Cloud Expo: Static vs Dynamic Cloud

Life’s Too Short...for Cloud without Analytics. Monitoring the Dynamic Nature of Cloud Computing.

Transcript

1. Life’s Too Short… ... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc. Confidential ©2008-16 New Relic, Inc. All rights reserved. @leeatchison leeatchison
2. 2 Safe Harbor Confidential ©2008-16 New Relic, Inc. All rights reserved. This document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promiseor obligation on behalfof New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not bereplicated or disclosed without New Relic’s express written permission. Such information may contain forward-looking statements within themeaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, futureplans, objectives, estimates, goals, or other characterizations of future events is a forward- looking statement. These forward-looking statements can often be identified as such because the context ofthestatement will includewords such as “believes,” “anticipates,”, “expects” or words ofsimilar import. Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in thefilings wemake with theSEC from timeto time. Copies of thesedocuments may be obtained by visiting New Relic’s Investor Relations websiteat http://ir.newrelic.comor theSEC’s websiteat www.sec.gov. New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this documentor otherwise, with respect to theinformation provided.
3. 3 Who am I? Confidential ©2008-16 New Relic, Inc. All rights reserved. Specialize in: Cloud computing Services & Microservices Scalability, Availability 28 years in industry 7 in Amazon Retail & AWS (Built SW/VG AppStore, AWS Elastic Beanstalk) 4 in New Relic (Architecture Lead, Cloud, Service Migration) @leeatchison leeatchison
4. 4 We want better apps faster Confidential ©2008-16 New Relic, Inc. All rights reserved. Dynamic Environment Better Data Center How do we use the cloud to accomplish this?
5. Cloud as a Better Data Center
6. 6 Cloud as a “Better Data Center” Confidential ©2008-16 New Relic, Inc. All rights reserved. Resources are allocated to uses, just like in a data center
7. 7 Cloud as a “Better Data Center” Confidential ©2008-16 New Relic, Inc. All rights reserved. Resources are allocated to uses, just like in a data center Provisioning process is faster
8. 8 Cloud as a “Better Data Center” Confidential ©2008-16 New Relic, Inc. All rights reserved. Resources are allocated to uses, just like in a data center Lifetime of components is relatively long Provisioning process is faster
9. 9 Cloud as a “Better Data Center” Confidential ©2008-16 New Relic, Inc. All rights reserved. Resources are allocated to uses, just like in a data center Lifetime of components is relatively long Provisioning process is faster Capacity planning is still important and still applies
10. 10 Why use a “Better Data Center”? Confidential ©2008-16 New Relic, Inc. All rights reserved.
11. 11 Why use a “Better Data Center”? Confidential ©2008-16 New Relic, Inc. All rights reserved. Add new Capacity (faster)
12. 12 Why use a “Better Data Center”? Confidential ©2008-16 New Relic, Inc. All rights reserved. Improve Application Availability (redundancy) Add new Capacity (faster)
13. 13 Why use a “Better Data Center”? Confidential ©2008-16 New Relic, Inc. All rights reserved. Compliance Improve Application Availability (redundancy) Add new Capacity (faster)
14. 14 Who is impacted? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Operations Development
15. 15 Who is impacted? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Development
16. 16 Who is impacted? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development
17. 17 Who is impacted? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Faster Application Launch / Deploy = Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development
18. 18 How do I monitor it? Confidential ©2008-16 New Relic, Inc. All rights reserved. Similar to monitoring any other data center…
19. 19 Monitoring an application Confidential ©2008-16 New Relic, Inc. All rights reserved. Typical Server / EC2 Instance • Application & Application Microservices • Server OS • Hardware (virtual) EC2 Instance Application & Application Microservices Server OS Server (Virtual) Hardware
20. 20 AWS Monitoring Confidential ©2008-16 New Relic, Inc. All rights reserved. CloudWatch • Monitors: – EC2 instance – Virtualization – Hardware – [CPU / Disk / Networking] • Doesn’t know about: – Server OS – Memory / Filesystem – Processes – Application • Latency • Error rates • Internal insights EC2 Instance Application & Application Microservices Server OS Server (Virtual) Hardware CloudWatch AWS CONSOLE
21. 21 New Relic Monitoring Confidential ©2008-16 New Relic, Inc. All rights reserved. New Relic • Monitors (Server): – How O.S. is performing – Processes – Hardware • Monitors (Application): – App health – App performance – Microservices • Doesn’t know – Virtualization EC2 Instance Application & Application Microservices New Relic Application Monitoring Server OS Server (Virtual) Hardware New Relic Server Monitoring CloudWatch DASHBOARDS AWS CONSOLE
22. 22 AWS çèNew Relic work together Confidential ©2008-16 New Relic, Inc. All rights reserved. AWS / CloudWatch • Visibility into virtualization • CPU / Disk / Networking New Relic • CPU / Disk / Networking • Memory / Filesystem • Processes • Infrastructure components • Application / Microservices: – Latency – Error rates – App insights EC2 Instance Application & Application Microservices New Relic Application Monitoring Server OS Server (Virtual) Hardware New Relic Server Monitoring CloudWatch DASHBOARDS CloudWatch monitors New Relic monitors AWS CONSOLE
23. Cloud as a Dynamic Tool
24. 24 Cloud as a “Dynamic Tool for Dynamic Apps” Confidential ©2008-16 New Relic, Inc. All rights reserved. Use only the resources you need
25. 25 Cloud as a “Dynamic Tool for Dynamic Apps” Confidential ©2008-16 New Relic, Inc. All rights reserved. Use only the resources you need Allocate / de-allocate resources on the fly
26. 26 Cloud as a “Dynamic Tool for Dynamic Apps” Confidential ©2008-16 New Relic, Inc. All rights reserved. Use only the resources you need Resource allocation is an integral part of your application architecture Allocate / de-allocate resources on the fly
27. 27 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. Resources are: Application is aware of and is controlling traditional OPs resources De-allocated Consumed Allocated Auto Scale
28. 28 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. Docker containers: • Quicker / cheaper startup / shutdown than EC2 instances • Easy to consume Docker containers much like you do “processes” • Perform jobs: – In a script – Off of some queue of job requests
29. 29 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. 100 10K 1M 3.7 M 83 days 333 days Docker Container Age (Count vs. Hours)
30. 30 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. 950,000 11% under one minute Docker Container Age (by Minute Under and Hour)
31. EC2 Auto Scaling 31 Dynamic Cloud Technologies Confidential ©2008-16 New Relic, Inc. All rights reserved. Mobile / IoT Dynamic routing Load balancing Data transport Queues and notifications Docker Dynamic Cloud is about scaling
32. 32 How do I monitor the Dynamic Cloud? Confidential ©2008-16 New Relic, Inc. All rights reserved. Dynamic Cloud has unique monitoring requirements…
33. 33 Responsibility (Dynamic Cloud) Confidential ©2008-16 New Relic, Inc. All rights reserved. Server OS Server (Virtual) Hardware Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Responsible for the parts you care about • Application & Application Microservices Let cloud manage rest • Infrastructure • Allocation/Provisioning • Scaling
34. 34 AWS Infrastructure çè New Relic work together Confidential ©2008-16 New Relic, Inc. All rights reserved. Server OS Server (Virtual) Hardware CloudWatch DASHBOARDS Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning AWS CONSOLE
35. 35 AWS Infrastructure çè New Relic work together Confidential ©2008-16 New Relic, Inc. All rights reserved. Server OS Server (Virtual) Hardware CloudWatch DASHBOARDS Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning AWS CONSOLE
36. 36 AWS Infrastructure çè New Relic work together Confidential ©2008-16 New Relic, Inc. All rights reserved. Server OS Server (Virtual) Hardware CloudWatch DASHBOARDS Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning CloudWatch & AWS monitoring New Relic monitors AWS CONSOLE
37. 37 How do you monitor this? Confidential ©2008-16 New Relic, Inc. All rights reserved. Server OS Server (Virtual) Hardware Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning ? How do you monitor this?
38. 38 Where did it go? It was just here!!! Confidential ©2008-16 New Relic, Inc. All rights reserved. ? The thing you monitored 10 minutes ago… ...doesn’t exist anymore!
39. 39 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. 950,000 11% under one minute Docker Container Age (by Minute Under and Hour)
40. 40 Monitoring the Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. Very different than monitoring traditional Data Center components Monitor the Cloud Components themselves Monitor the lifecycle of the Cloud Components
41. 41 Who is impacted by Dynamic Cloud? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Dynamic Cloud
42. 42 Who is impacted by Dynamic Cloud? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Dynamic Cloud What is a container? Why do I care?? It was just here, where did it go???
43. 43 Who is impacted by Dynamic Cloud? Confidential ©2008-16 New Relic, Inc. All rights reserved. Better Data Center Can I scale my server fleet? Can apps run anywhere? How do they perform in the cloud? Operations Data center is a data center… Development Dynamic Cloud What is a container? Why do I care?? It was just here, where did it go??? Cloud architecture is integral to the application architecture Developers deeply involved in cloud activities
44. 44 Change is speeding up Confidential ©2008-16 New Relic, Inc. All rights reserved. Traditional Data Center Cloud Data Center Dynamic Cloud Dynamic Cloud enables better applications faster. Good Better Best The way you’ve done things in the past won’t work in the future.
45. 45 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. EC2 Server running application / processes Docker container Process running a command This is hard Things happen faster because of…
46. 46 Dynamic Cloud Confidential ©2008-16 New Relic, Inc. All rights reserved. EC2 Server running application / processes Docker container Process running a command Lambda Function performing a task or operation
47. The Future with Lambda
48. 48 Microcomputing & AWS Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. • Newest entrance to the “dynamic cloud” • Provides event driven compute capabilities
49. 49 Microcomputing & AWS Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. • No infrastructure to provision • Massively shared infrastructure
50. 50 Why use Lambda? Confidential ©2008-16 New Relic, Inc. All rights reserved. Lambda scripts Run in response to a state change or action in the cloud Stateless, “filters” Perform quick actions Virtually no startup/shutdown cost
51. 51 AWS Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. S3 Bucket Dynamo DB API Gateway SQS RESOURCES SOME • Takes an event from an AWS resource (A Trigger)
52. 52 AWS Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. S3 Bucket Dynamo DB API Gateway SQS RESOURCES SOME Lambda Script • Takes an event from an AWS resource (A Trigger) • Creates an instance to execute Lambda Instance
53. 53 AWS Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. S3 Bucket Dynamo DB API Gateway SQS RESOURCES SOME S3 Bucket API Gateway SQS RESOURCES SOME Lambda Script • Takes an event from an AWS resource (A Trigger) • Creates an instance to execute • Can impact original or different AWS Resource Lambda Instance
54. 54 AWS Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. S3 Bucket Dynamo DB API Gateway SQS RESOURCES SOME S3 Bucket API Gateway SQS RESOURCES SOME Lambda Script Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance Lambda Instance • Takes an event from an AWS resource (A Trigger) • Creates an instance to execute • Can impact original or different AWS Resource • Any number of instances can run at a time
55. 55 Monitoring Lambda Scripts Confidential ©2008-16 New Relic, Inc. All rights reserved. Less like server monitoring / More like web application monitoring We Care About We Don’t Care About • Run time (average, extremes – TP90/TP99) • Statistical metrics • Error rates and other deviations from norm • “Drill down” into individual “runs” • Details about all ”runs” • Server / infrastructure metrics
56. 56 Monitoring Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. More like application performance monitoring than infrastructure monitoring
57. 57 Monitoring Lambda Confidential ©2008-16 New Relic, Inc. All rights reserved. More like application performance monitoring than infrastructure monitoring
58. 58 Change is speeding up Confidential ©2008-16 New Relic, Inc. All rights reserved. Traditional Data Center Cloud Data Center Dynamic Cloud Dynamic Cloud enables better applications faster. The rate of change is increasing… Good Better Best The way you’ve done things in the past won’t work in the future.
59. 59 Monitoring just the server Confidential ©2008-16 New Relic, Inc. All rights reserved. EC2 Instance Application & Application Microservices Server OS Server (Virtual) Hardware CloudWatch Worked when rate of change was low… AWS CONSOLE
60. Monitoring just the server Server OS Server (Virtual) Hardware Application & Application Microservices Application & Application Microservices Application & Application Microservices Provisioning Insufficient in the cloud: • Rate of change is faster • Problems come up quicker • “Server” isn’t a server anymore • “Provisioning” isn’t provisioning anymore You need top to bottom monitoring… You need full stack accountability...
61. 61 New Relic enables accountability between your code & AWS Confidential ©2008-16 New Relic, Inc. All rights reserved. Customers Mobile / Apps / Browser On-Premises On Premises Relational Data EC2 AWS Container Service AWS RDS Synthetic Customers S3 NoSQL AWS Storage Services Your Responsibilities § Application code & 3rd party services § App architecture § Customer experience § On-Premises components NoSQL AWS Responsibility: § Service Availability & Performance § Provisioning & operation of DC § Isolation & security of resources § Service maintenance & innovation
62. Architecting for Scale By: Lee Atchison Published by: O’Reilly Media, Available: June 2016 www.architectingforscale.com Want to Learn More?
63. “Fly Two Mistakes High” A Guide to Not Crashing 5:40pm today –Hot Track 1 | Cloud (Room 1A04) Keeping High Availability
64. ©2008-15 New Relic, Inc. All rights reserved. Thank you. Lee Atchison Principal Cloud Architect and Advocate at New Relic, Inc. Architecting for Scale Published by: O’Reilly Media, Available: June 2016 www.architectingforscale.com @leeatchison leeatchison