Orchestration in 2014 - WindyCityRails

Engineers are expensive and our greatest value is to focus on business solutions; not yak shave another custom web app deployment.

This slide deck introduces the requirements for an across-organization Platform (PaaS) providing orchestration services for all our apps and workloads.

It leads to an introduction to Pivotal Web Services & Heroku; and then Cloud Foundry for private installations.

Transcript

1. ORCHESTRATION IN 2014 Dr Nic Williams starkandwayne.com @drnic
2. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 In the beginning, there was a real-world problem
3. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Unique business problems don't require unique deployment solutions
4. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 orchestration? • Costs of software systems • What we really need? • What exists today? • What's still missing?
5. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 @drnic • Previously at Engine Yard • Lots and lots of Ruby projects • 2 yrs consulting around Cloud Foundry • Investigates all the things
6. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Stark & wayne • 8 staff • Cloud Foundry training, installations, managed service • Consultancy for nextgen Platforms • blog.starkandwayne.com
7. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014
8. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 COST OF SOFTWARE SYSTEMS
9. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 your business sales $$$$ profit $$$$
10. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 sales $$$$ your business profit $$$$ cost of sales -$
11. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 sales $$$$ your business profit $$$$ cost of sales -$ R&D -$
12. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 sales $$$$ your business profit $$$$ cost of sales -$ R&D -$ operations -$
13. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 cost of iT r&d • Avg salary in SF $150k ($200k total) • Costs explode with bespoke software • Risks of failure • Increases in operational costs
14. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 sales $$$$ your business loss $$ cost of sales -$ R&D -$$$ operations -$$ DIY software can dramatically change P&L
15. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 sales 0 your business losses $$$$$ cost of sales 0 R&D -$$$ operations -$$ Outages dramatically change everything
16. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 You are expensive :)
17. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 value • Amount of value from R&D? • Time until value? • Guarantee of value?
18. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Buy this today http://bit.ly/phoenixproject
19. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 We are in IT
20. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Embedded in conference
21. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Shortest name
22. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 WHAT WE REALLY NEED?
23. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 CIOs: next 10 yrs • Goal: reduce time to value • Goal: unify access to all data • Goal: mobile access
24. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Goal: reduce time to value • Goal: unify access to all data • Goal: mobile access • Solution: Orchestration • Solution: API everything
25. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014
26. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 YOUR ORG
27. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 orchestration goals for engineering http://12factor.net/
28. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 goals for orchestration • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery • . . .
29. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 goals for orchestration • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery • Packaging assurance/version control • Reproduce production for debugging • Auditing who/what did what change • Access controls; Share platform across organization(s) • Proportional billing to internal organizations
30. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 goals for orchestration • Let you focus on engineering • Let you focus on being valuable
31. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 WHAT EXISTS TODAY? Orchestration
32. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Guide to total value Every solution costs
33. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Use these until someone says you can't...
34. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Use these until someone says you can't... • $10.80/mth/512Mb • No free containers • Flexible container sizes • Portable to own infrastructure • $33.60/mth/512Mb • First container free • 512M, 1G, 6G container sizes • No portal/private option
35. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery yes yes Heroku buildpacks yes yes yes yes yes yes yes yes yes yes
36. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Packaging assurance/version control • Reproduce production for debugging • Auditing who/what did what change • Access controls; Share platform across organization(s) • Proportional billing to internal organizations • Portable platform - AWS, GCE, OpenStack, etc no yes yes no yes yes yes yes yes no Heroku buildpacks
37. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 We want our own orchestration
38. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 sales $$$$ your business loss $$ cost of sales -$ R&D -$$$ operations -$$ Beware DIY Orchestration
39. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 no unix app for all this • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery • Packaging assurance/version control • Reproduce production for debugging • Auditing who/what did what change • Access controls; Share platform across organization(s) • Proportional billing to internal organizations • Portable platform - AWS, GCE, OpenStack, etc
40. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Orchestration is a system not an app
41. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Double check why you can't just use these... before proceeding...
42. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 What about Docker?
43. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 docker is delightful • packaging • containers • process monitoring (v1.2) • port & data binding to host machine • big community of example Dockerfiles • demos really well!
44. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 1. 2. 3. Local Docker
45. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery yes no yes yes yes yes yes cluster of docker containers... on single docker server
46. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery yes no yes no no no yes cluster of docker containers... across cluster of servers that come & go
47. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Packaging assurance/version control • Reproduce production for debugging • Auditing who/what did what change • Access controls; Share platform across organization(s) • Proportional billing to internal organizations • Portable platform - AWS, GCE, OpenStack, etc yes no no no yes yes cluster of docker containers... across cluster of servers that come & go
48. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Docker is a unit to be orchestrated
49. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Need system-wide orchestration
50. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Projects orchestrating docker • Cloud Foundry • Mesos • Deis • Flynn • Flocker • Open Shift
51. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 trycf.starkandwayne.com
52. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 demo
53. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 running orchestration in production • Cloud Foundry - BOSH • Mesos - DIY • Deis - DIY • Flynn - DIY • Flocker - DIY • Open Shift - DIY
54. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014
55. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery • . . . http://docs.cloudfoundry.org/concepts/architecture/
56. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 BOSH also resurrects all servers No single points of failure
57. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 BOSH also scales servers up and out BOSH upgrades across versions v179 v180
58. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Why BOSH? > Platform operators deserve nice things too
59. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 goals for orchestration • Deploy quickly - apps/dependencies • Deploy language/framework of choice • HTTP routing to web processes • Integrate DBs/services/APIs • Streaming logs, including platform components • Simple, fast scaling • Automatic health recovery • Packaging assurance/version control • Reproduce production for debugging • Auditing who/what did what change • Access controls; Share platform across organization(s) • Proportional billing to internal organizations • Portable platform - AWS, GCE, OpenStack, etc
60. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 suggestions • Avoid DIY • Try CF - trycf.starkandwayne.com • full lifecycle orchestration ‣ Cloud Foundry for running Apps ‣ BOSH for running Cloud Foundry
61. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014
62. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 WHAT'S STILL MISSING?
63. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Orchestrating data services is hard
64. STARK & WAYNE | DR NIC | ORCHESTRATION IN 2014 | WINDY CITY RAILS 2014 Buy this today http://bit.ly/phoenixproject