How does a PaaS actually work?

Talk from BrisTech 2016

Transcript

1. > “How does a PaaS actually work?” @alexevade BrisTech 2016
2. Alex Ley Product Manager Pivotal Cloud Foundry @alexevade > Introductions
3. > Agenda - What is a PaaS? - Cloud Foundry? - Application Lifecycle in a Cloud!
4. > What is a PaaS? “Computing platform that provides everything (OS + runtime environment + services) that is required for an web app to run on a computer and be accessed via the internet”
5. Infrastructure as a Service
6. Infrastructure as a Service
7. Infrastructure as a Service
8. Infrastructure as a Service Minutes not weeks!
9. Infrastructure as a Service Minutes not weeks!
10. Infrastructure as a Service Minutes not weeks! Still weeks to deploy my code
11. Infrastructure as a Service Platform as a Service
12. Infrastructure as a Service Platform as a Service Think of all the apps I can run!
13. Infrastructure as a Service Platform as a Service Software as a Service
14. Developers App Web User Platform
16. > What is Cloud Foundry? Cloud Foundry is a Computing Platform It is a large piece of software that provides the functionality of Cloud Computing Platform aka PaaS
19. > What does it do for me?
20. App Storage & Execution App Lifecycle
21. Messaging App Storage & Execution App Lifecycle Routing
22. Messaging App Storage & Execution App Lifecycle Routing Authentication
23. Messaging App Storage & Execution App Lifecycle Routing Authentication Services
24. Messaging App Storage & Execution App Lifecycle Routing Authentication Services Metrics & Logging
25. Messaging App Storage & Execution App Lifecycle Routing Cloud Controller nsync Diego Brain Cell Reps Blob Store App Execution (Diego Cell) Garden (Container) TCP Router HTTP Router BBS Consul NATS Message Bus Authentication OAuth2 Sever (UAA) Login Server Services Service Brokers Metrics & Logging App Log Aggregation Metrics Collection
27. > Lets run an app with CF!
28. > cf login -a https://api.run.pivotal.io … API endpoint: https://api.run.pivotal.io (API version: 2.54.0) User: jules@verne.io Org: pivot-jules Space: development …
29. Command Line Interface (CLI) • Primary way to interface with Cloud Foundry • Commands for both users and administrators • Plugin architecture to extend functionality
30. User Account and Authentication (UAA) • Multi tenant identity management service • OAuth2 provider issuing tokens for CF client applications • Integrates with LDAP, SCIM, OpenID
31. Authentication
32. login request Authentication
33. login request UAA endpoint Authentication
34. Authentication Request login request UAA endpoint Authentication
35. Access Token Authentication Request login request UAA endpoint Authentication
36. > cd /path/to/my/app > tree . ├── README.md ├── app.groovy ├── application.properties ├── manifest.yml
37. > cat manifest.yml --- applications: - name: cf-spring memory: 512M instances: 3 random-route: true
38. > cf push my-app Using manifest file /Users/verney/workspace/cf-sample-app- spring/manifest.yml Creating app cf-spring in org pivot-jules / space test as jules@verne.io... OK
39. • Entry point into Cloud Foundry via RESTFUL API’s • Interacts with other core components to orchestrate workflows • Specifies Service Broker API for integrating service gateways Cloud Controller
40. ...Creating route cf-spring-radishlike-audiphone.cfapps.io... OK
41. • Supports HTTP(S) and TCP routes • Experimental RESTFUL Routing API to replace NATS • Emitters to register CF apps with routers Routing NATS
42. • Communicates via NATS messages • Routes must be re-registered periodically • gorouter will prune routes that it considers to be stale • Uses simple round-robin load balancing for scaled apps Routing NATS
43. • Bound apps are given a reserved port and route on shared domain • Uses HAProxy tcp router implementation • Subscribes to events from the routing api • Follows router-group model Routing NATS
44. • RESTful interface for registering and deregistering routes • Routing API depends on a clustered etcd data store • A CLI client called rtr simplifies interactions • https://github.com/cloudfoundry-incubator/routing-ap Routing NATS
45. Uploading cf-spring... Uploading app files from: /Users/vereny/workspace/cf- sample-app-spring Uploading 1M, 44 files Done uploading OK
46. • The Cloud Controller (CC) manages a blob store for: • Resources - files that are uploaded to CC with unique SHA • App packages - unstaged files that represent an app • Droplets - the result of taking an app package and staging Blobstore
47. Uploading the app
48. Resource match Uploading the app
49. Matches Resource match Uploading the app
50. Matches Resource match Changed / new files Uploading the app
51. Matches Resource match Changed / new files Uploads Uploading the app
52. Starting app cf-spring in org pivot-jules / space test as jules@verne.io... Downloading ruby_buildpack... Downloading go_buildpack... Downloading nodejs_buildpack... Downloading java_buildpack... Downloaded java_buildpack Downloaded staticfile_buildpack Downloaded ruby_buildpack Downloaded nodejs_buildpack Downloaded go_buildpack
53. • Provide framework and runtime support for your apps • Examine app to determine dependencies to download • Know how to configure apps to talk to bound services /bin/detect /bin/compile /bin/release Buildpacks
54. Creating container Successfully created container Downloading app package... Downloaded app package (1.2M) Staging... -----> Java Buildpack Version: v3.7 (offline) -----> Downloading Open Jdk JRE 1.8.0_91 jdk-1.8.0_91.tar.gz (found in cache) Expanding Open Jdk JRE to .java-buildpack/open_jdk_jre (1.0s) -----> Downloading Open JDK Like Memory Calculator 2.0.2_RELEASE -----> Downloading Spring Boot CLI 1.3.3_RELEASE Expanding Spring Boot CLI to .java-buildpack/spring_boot_cli (0.0s) Exit status 0 Staging complete
55. 1. Staging
56. 1. Staging App Source Code
57. 1. Staging App Source Code Buildpack
58. 1. Staging App Source Code Buildpack File System (‘Stack’)
59. 1. Staging Staging Container App Source Code Buildpack File System (‘Stack’)
60. 1. Staging Staging Container App Source Code Buildpack File System (‘Stack’) Droplet
61. Droplet 2. Running
62. Runtime Container Droplet 2. Running File System (‘Stack’)
63. Runtime Container 2. Running File System (‘Stack’)
64. > cf scale my-app -i 8
65. Scaling
66. Runtime Container File System (‘Stack’) Scaling Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’)
67. Runtime Container File System (‘Stack’) Scaling Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’) Runtime Container File System (‘Stack’)
68. Diego • Provides Staging and Runtime support for Cloud Foundry • Schedules and runs Tasks and LRPs (Long-Running Process) • Optimally distributes Tasks and LRPs to Cells via auction
69. Diego Task • Guaranteed to be run at most once • E.g. Staging requests and one-off database migrations
70. Diego LRP • Long-Running Process • E.g. Application processes • Distributed across cells • Automatically restarted if they crash or disappear
71. Staging in Diego
72. Staging in Diego
73. Staging in Diego
74. Staging in Diego
75. Staging in Diego
76. Staging in Diego
77. Staging in Diego
78. Staging in Diego
79. Staging in Diego
80. Staging in Diego
81. Staging in Diego
82. Uploading droplet, build artifacts cache... Uploading build artifacts cache... Uploading droplet... Uploaded build artifacts cache (109B) Uploaded droplet (53.6M) Uploading complete
83. Running in Diego
84. Running in Diego
85. Running in Diego
86. Running in Diego
87. Running in Diego
88. Running in Diego
89. Running in Diego
90. Running in Diego
91. Running in Diego
92. 0 of 3 instances running, 3 starting 1 of 3 instances running, 2 starting 2 of 3 instances running, 1 starting 3 of 3 instances running App started OK
93. Garden • Cloud Foundry’s container technology • Allows build pack based applications as well as docker images • Multiple, pluggable backends each implementing the garden API
94. Garden
95. Garden
96. Garden
97. Garden
98. Garden • Based on standards set by the Open Container Project • Same codebase as docker (v 1.11+) • Soon to replace garden-linux
99. Accessing the app
100. https://myapp.cfapps.io Accessing the app
101. https://myapp.cfapps.io where to find the app Accessing the app
102. https://myapp.cfapps.io where to find the app Accessing the app
103. https://myapp.cfapps.io where to find the app Accessing the app
104. cf logs cf-spring Connected, tailing logs for app cf-spring in org pivot-jules / space development as jules...
105. Loggregator • Sources - logging agents on the components • Metron Agents - collect & forward logs to doppler • Doppler - Gather logs, metrics, events & forward • Traffic Controller - Collate & provide firehose • Nozzles - Stream firehose the select, buffer, and transform data
106. Collecting the logs
107. App Logs Metrics Collecting the logs
108. App Logs Metrics Collecting the logs
109. App Logs Metrics Firehose Collecting the logs
110. Seeing the logs
111. request for app details Seeing the logs
112. request for app details app details Seeing the logs
113. request for app details app details Web socket connect /tail/?app=…. Seeing the logs
114. request for app details app details App logs Web socket connect /tail/?app=…. Seeing the logs
115. Messaging App Storage & Execution App Lifecycle Routing Authentication Services Metrics & Logging
116. Messaging App Storage & Execution App Lifecycle Routing Cloud Controller nsync Diego Brain Cell Reps Blob Store App Execution (Diego Cell) Garden (Container) TCP Router HTTP Router BBS Consul NATS Message Bus Authentication OAuth2 Sever (UAA) Login Server Services Service Brokers Metrics & Logging App Log Aggregation Metrics Collection
117. > Recap - We know what a PaaS is - Cloud Foundry is awesome - PaaS is far more than containers - App lifecycle in the Cloud
118. Cloud Foundry: The Cloud Native Platform by Duncan Winn https://pivotal.io/cloud-foundry-the- cloud-native-platform Free O’Reilly eBook
119. Cloud Foundry: The Cloud Native Platform by Duncan Winn https://pivotal.io/cloud-foundry-the- cloud-native-platform Free O’Reilly eBook
120. > Questions? @alexevade BrisTech 2016