Heroku 102

Transcript

1. rhys@heroku.com 102 @rhyselsmore
2. @rhyselsmore >>> import rhyselsmore Platform Security Engineer at Heroku. I focus on Anti-Abuse Systems. I develop using a mixture of Python/Go.
3. @rhyselsmore Heroku is a Platform as a Service
4. @rhyselsmore You build your application, not infrastructure
5. @rhyselsmore Deploying is as easy as ‘git push’
6. @rhyselsmore Scaling and upgrading is simple
7. @rhyselsmore tl;dr: Spend time on your application’s code
8. @rhyselsmore 3,000,000+ apps created. 130+ add-ons services. 90,000+ requests per second. 500,000+ log entries per second.
9. @rhyselsmore Run anything* on Heroku
10. @rhyselsmore Python & Ruby & PHP & Java & NodeJS
11. @rhyselsmore Play & Scala & Clojure & Gradle & Grails & C & Common Lisp & Dart & Elixir & Erlang & Go & Haskell & JRuby & Lua & Perl & Rust & …
12. @rhyselsmore
13. @rhyselsmore The Twelve-Factor App 12factor.net
14. @rhyselsmore The Twelve-Factor Flask App 12factor.net
15. @rhyselsmore Lets assume that You want to learn about Heroku
 You know (a bit) of Python
 You have Python, pip, and can create a virtualenv
16. @rhyselsmore Lets assume that You want to learn about Heroku
 You know (a bit) of Python
 You have Python, pip, and can create a virtualenv install.python-guide.org
17. @rhyselsmore Get an account at heroku.com
18. @rhyselsmore Install the Heroku Toolbelt toolbelt.heroku.com
19. @rhyselsmore $ heroku login Login
20. @rhyselsmore The Twelve-Factor App 12factor.net
21. @rhyselsmore $ mkdir heroku101
 $ cd heroku101
 $ git init
22. @rhyselsmore $ heroku create Creating myapp... done, stack is cedar http://myapp.herokuapp.com/ | git@heroku.com:myapp.git Git remote heroku added
23. @rhyselsmore $ cat .git/config [core] repositoryformatversion = 0 filemode = true bare = false logallrefupdates = true ignorecase = true precomposeunicode = true [remote "heroku"] url = git@heroku.com:myapp.git fetch = +refs/heads/*:refs/remotes/heroku/*
24. @rhyselsmore $ virtualenv venv $ pip install flask gunicorn $ pip freeze > requirements.txt
25. @rhyselsmore $ cat requirements.txt Flask==0.10.1 Jinja2==2.7.3 MarkupSafe==0.23 Werkzeug==0.9.6 gunicorn==19.0.0 itsdangerous==0.24 wsgiref==0.1.2
26. @rhyselsmore import os! from flask import Flask! ! app = Flask(__name__)! ! @app.route('/')! def index():! return "Hello, World!" heroku101.py
27. @rhyselsmore web: gunicorn heroku101:app Procfile
28. @rhyselsmore $ foreman start
 21:51:53 web.1 | started with pid 20276 Launch your application locally
29. @rhyselsmore Visit http://localhost:5000/ in your browser.
30. @rhyselsmore venv *.pyc .gitignore
31. @rhyselsmore $ git add .
 $ git commit -m ‘initial commit’ Store our changes in git
32. @rhyselsmore Now, lets send it up to Heroku
33. @rhyselsmore $ git push heroku master ! -----> Python app detected -----> Preparing Python runtime (python-2.7.7) -----> Installing Setuptools (3.6) -----> Installing Pip (1.5.6) ! …. ! -----> Discovering process types Procfile declares types -> web ! -----> Compressing... done, 31.6MB -----> Launching... done, v3 http://myapp.herokuapp.com/ deployed to Heroku ! To git@heroku.com:myapp.git * [new branch] master -> master
34. @rhyselsmore $ heroku open Check out our new application
35. @rhyselsmore Codebase Recap Dependencies Dev/Prod Parity Port Binding Processes
36. @rhyselsmore Codebase Recap Dependencies Dev/Prod Parity Port Binding Processes
37. @rhyselsmore I. Codebase One codebase tracked in revision control, many deploys
38. @rhyselsmore Codebase Recap Dependencies Dev/Prod Parity Port Binding Processes
39. @rhyselsmore II. Dependencies Explicitly declare and isolate dependencies
40. @rhyselsmore Codebase Recap Dependencies Dev/Prod Parity Port Binding Processes
41. @rhyselsmore X. Dev/Prod Parity Keep development, staging, and production as similar as possible
42. @rhyselsmore Codebase Recap Dependencies Dev/Prod Parity Port Binding Processes
43. @rhyselsmore VII. Port Binding Export services via port binding
44. @rhyselsmore Codebase Recap Dependencies Dev/Prod Parity Port Binding Processes
45. @rhyselsmore VI. Processes Execute the app as one or more stateless processes
46. @rhyselsmore Runs processes concurrently locally via a Procfile Foreman Exposes a configuration to our processes Creates parity between production and development
47. @rhyselsmore web: gunicorn heroku101:app Procfile
48. @rhyselsmore web: gunicorn heroku101:app
 worker: bin/celeryd worker
 clock: bin/clock
 monitor: bin/monitor Procfile
49. @rhyselsmore Runs processes concurrently locally via a Procfile Foreman Exposes a configuration to our processes Creates parity between production and development
50. @rhyselsmore VIII. Concurrency Scale out via the process model
51. @rhyselsmore web
52. @rhyselsmore $ heroku ps:scale web=6
53. @rhyselsmore web web web web web web
54. @rhyselsmore web: gunicorn heroku101:app
 worker: bin/celeryd worker
 clock: bin/clock
 monitor: bin/monitor Procfile
55. @rhyselsmore $ heroku ps:scale clock=1 monitor=1 worker=6
56. @rhyselsmore web web web web web worker worker worker worker worker clock monitor web worker
57. @rhyselsmore $ heroku ps:scale monitor=1:2X
58. @rhyselsmore web web web web web worker worker worker worker worker clock ! monitor web worker
59. @rhyselsmore $ heroku ps:scale worker=1:PX
60. @rhyselsmore web web web web web clock ! monitor web ! ! ! ! ! worker ! ! ! !
61. @rhyselsmore $ heroku ps:scale clock=0
62. @rhyselsmore web web web web web ! monitor web ! ! ! ! ! worker ! ! ! !
63. @rhyselsmore Runs processes concurrently locally via a Procfile Foreman Exposes a configuration to our processes Creates parity between production and development
64. @rhyselsmore III. Config Store config in the environment
65. @rhyselsmore import os! from flask import Flask! ! app = Flask(__name__)! ! @app.route('/')! def index():! name = os.environ.get('PAGE_NAME', 'Rhys')! return "Hello, {0}!".format(name)! heroku101.py
66. @rhyselsmore PAGE_NAME=‘Heroku User’ .env (Be sure to add ‘.env’ to .gitignore)
67. @rhyselsmore $ foreman start
 21:51:53 web.1 | started with pid 20276 Launch your application locally. Did it work?
68. @rhyselsmore $ git add heroku101.py
 $ git commit -m ‘loading name from configuration’
 $ git push heroku master … $ heroku open Commit our changes, and push to Heroku
69. @rhyselsmore Now, lets set our configuration on Heroku.
70. @rhyselsmore $ heroku config:set PAGE_NAME=‘App User’
 $ heroku open Launch your application locally. Did it work?
71. @rhyselsmore V. Build, Release, Run Strictly separate build and run stages
72. @rhyselsmore $ heroku releases
 === myapp v5 Set PAGE_NAME config vars rhys@heroku.com 2014/06/17 22:49:44 v4 Deploy 0b7df5b rhys@heroku.com 2014/06/17 22:49:33 v3 Deploy f6fc054 rhys@heroku.com 2014/06/17 22:00:32 v2 Enable Logplex rhys@heroku.com 2014/06/17 21:10:58 v1 Initial release rhys@heroku.com 2014/06/17 21:10:57 Viewing your Releases
73. @rhyselsmore $ heroku rollback v4
 Rolling back myapp... done, v4 ! Warning: rollback affects code and config vars; it doesn't add or remove addons. To undo, run: heroku rollback v5 Rolling back to another Release
74. @rhyselsmore IV. Backing Services Treat backing services as attached resources
75. @rhyselsmore ! app ! postgres ! redis ! s3 ! outbound mail
76. @rhyselsmore ! app ! redis Dev ! app ! redis Prod redis://my.production.redis redis://localhost
77. @rhyselsmore X. Dev/Prod Parity Keep development, staging, and production as similar as possible
78. @rhyselsmore ! app ! sqlite Dev ! app ! postgres Prod
79. @rhyselsmore CREATE TABLE ips ( id serial primary key, ip inet not null …
80. @rhyselsmore CREATE TABLE ips ( id serial primary key, ip inet not null …
81. @rhyselsmore ! app ! postgres Dev ! app ! postgres Prod
82. @rhyselsmore Homebrew (http://brew.sh) Vagrant (http://vagantup.com) Docker (http://docker.io) Some Solutions Postgres.app (http://postgresapp.com)
83. @rhyselsmore
84. @rhyselsmore $ pip install redis $ pip freeze > requirements.txt
85. @rhyselsmore import os! from flask import Flask! import redis! ! app = Flask(__name__)! db = redis.from_url(os.environ.get('REDISCLOUD_URL'))! ! ! @app.route('/name/<name>')! def setname(name):! db.set('PAGE_NAME', name)! return "Name successfully updated"! ! ! @app.route('/')! def index():! name = db.get('PAGE_NAME') or "Rhys"! return "Hello, {0}!".format(name)! heroku101.py
86. @rhyselsmore $heroku addons:add rediscloud Adding rediscloud on myapp... done, v7 (free) Use `heroku addons:docs rediscloud` to view documentation. Add RedisCloud
87. @rhyselsmore $ heroku config REDISCLOUD_URL=xxxxxxx PAGE_NAME=Rhys Addons are exposed to your application as config vars
88. @rhyselsmore $ git add heroku101.py requirements.txt
 $ git commit -m ‘using redis as our db store’
 $ git push heroku master … $ heroku open Commit our changes, and push to Heroku
89. @rhyselsmore XI. Logs Treat logs as event streams
90. @rhyselsmore $ heroku logs —tail
91. @rhyselsmore 2014-06-17T16:03:07.702584+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=7be32154-cbca-4e9c-b235-2a86a204f32d fwd="50.31.252.204" dyno=web.1 connect=1ms service=3ms status=200 bytes=172 2014-06-17T16:03:21.624306+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=180ee5c1-5c7e-4370-925c-4532bab44bb1 fwd="50.31.252.204" dyno=web.1 connect=1ms service=7ms status=200 bytes=172 2014-06-17T16:03:26.160610+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=71337d5d-ca00-49ed-98f6-e007123142de fwd="50.31.252.204" dyno=web.1 connect=0ms service=2ms status=200 bytes=172 2014-06-17T16:03:31.690643+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=b156826f-6db3-480d-bcc0-34239b2ad5a2 fwd="50.31.252.204" dyno=web.1 connect=1ms service=3ms status=200 bytes=172 2014-06-17T16:03:33.123754+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=a3768595-4fa5-41b7-aa2b-24ac4fa81880 fwd="50.31.252.204" dyno=web.1 connect=1ms service=3ms status=200 bytes=172 2014-06-17T16:03:34.186475+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=2e02b838-bdd6-47b2-b9c9-cd4d999ef1bc fwd="50.31.252.204" dyno=web.1 connect=0ms service=30ms status=200 bytes=172 2014-06-17T16:03:38.245823+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=c50b652a-1632-4727-b27a-03b0e89cdc4f fwd="50.31.252.204" dyno=web.1 connect=8ms service=30ms status=200 bytes=172 2014-06-17T16:03:48.101998+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.herokuapp.com request_id=94bd1cb4-446e-4309-9a67-94b210cdc3b2 fwd="50.31.252.204" dyno=web.1 connect=1ms service=2ms status=200 bytes=172 2014-06-17T16:03:49.663855+00:00 heroku[router]: at=info method=GET path="/" host=whispering-lake-5026.he
92. @rhyselsmore XI. Logs Treat logs as event streams
93. @rhyselsmore $ heroku labs:enable log-runtime-metrics Enabling log-runtime-metrics for myapp... done log-runtime-metrics
94. @rhyselsmore log2viz.herokuapp.com
95. @rhyselsmore $ heroku addons:add librato $ heroku addons:open librato Librato
96. @rhyselsmore
97. @rhyselsmore $ pip install log-metrics $ pip freeze > requirements.txt
98. @rhyselsmore import os! from flask import Flask! import log_metrics, random, time! ! app = Flask(__name__)! ! ! @app.route('/')! def index():! with log_metrics.timer('timed-function'):! time.sleep(random.uniform(0.5, 1.5))! log_metrics.increment('requests')! return "Hello, Librato!"! heroku101.py
99. @rhyselsmore 00:18:20 web.1 | measure#timed-function.ms=1261.87 00:18:20 web.1 | count#requests=1 00:18:24 web.1 | measure#timed-function.ms=925.83 00:18:24 web.1 | count#requests=1
100. @rhyselsmore
101. @rhyselsmore $ heroku addons:add papertrail $ heroku addons:add loggly Log Retention
102. @rhyselsmore $ heroku drains:add https://my-drain-app.com Log Drains
103. @rhyselsmore $ heroku domains:add mycustomdomain.com Custom Domains
104. @rhyselsmore The Heroku Platform API
105. @rhyselsmore >>> import requests! >>> import json! ! >>> heroku = requests.session()! >>> heroku.auth = ('', '<my API token>')! >>> heroku.headers.update({! "Accept": "application/vnd.heroku+json; version=3",! "Content-Type": "application/json"! })! ! >>> heroku.get('/apps').json()! {! "id":49939049,! "name":"my-app-1",! "dynos":0,! "workers":0,! "repo_size":null,! "slug_size":null,! "stack":"cedar",! "requested_stack":null,
106. @rhyselsmore >>> heroku.get('/apps/myapp/config-vars').json()! {! "NAME": "My App",! "SECRET_KEY": "hunter2"! } >>> heroku.patch(‘/apps/myapp/config-vars’, json.dumps({! ! "NAME": "My Apps new config var",! }))
107. @rhyselsmore Thanks!
108. @rhyselsmore Further Questions… ! SSL Endpoints? File Storage? Multiple Languages? Free Limits? Does an add-on for $task exist? EU vs US region? Show us how to…