Moby & The Beanstalk - Speaker Deck

Slide 1

Slide 1 text

Moby And The Beanstalk Sebastian Vetter @elbaschid

Slide 2

Slide 2 text

About Me » Back-End Engineer @ Mobify ! » Django developer since 2011 » Docker enthusiast " » elbaschid on the interwebz

Slide 3

Slide 3 text

This talk is about

Slide 4

Slide 4 text

our legacy Django app

Slide 5

Slide 5 text

porting it to Docker

Slide 6

Slide 6 text

& hosting it on Amazon Beanstalk.

Slide 7

Slide 7 text

What is Docker?

Slide 8

Slide 8 text

Docker

Slide 9

Slide 9 text

What is Beanstalk?

Slide 10

Slide 10 text

Beanstalk » Amazon PaaS Offering » Originally, Heroku-style deploys » Supports running Docker containers

Slide 11

Slide 11 text

Back To Our App

Slide 12

Slide 12 text

Our Old Stack

Slide 13

Slide 13 text

Our Problems » Fragile replication & sync » Error-prone deployments » Labour intensive maintenance

Slide 14

Slide 14 text

There Must Be A Better Way

Slide 15

Slide 15 text

Our New Stack

Slide 16

Slide 16 text

Let's Look Closer

Slide 17

Slide 17 text

Deployment

Slide 18

Slide 18 text

Automated Deployment

Slide 19

Slide 19 text

Django & Docker

Slide 20

Slide 20 text

Conﬁguration

Slide 21

Slide 21 text

Twelve-factor App » Ephemeral systems » Conﬁguration through environment » Explained in 12factor.net/conﬁg

Slide 22

Slide 22 text

12-factor on Beanstalk

Slide 23

Slide 23 text

Basic 12-Factor conﬁg # settings.py import os SECRET_KEY = os.getenv('SECRET_KEY') DATABASES = { 'default': { 'NAME': os.getenv('DB_NAME'), 'HOST': os.getenv('DB_HOST'), 'USER': os.getenv('DB_USER'), 'PASSWORD': os.getenv('DB_PASSWORD'), } }

Slide 24

Slide 24 text

There Is A Better Way

Slide 25

Slide 25 text

Using django-conﬁgurations » Class-based setup » Handling & validation of env vars » Variable namespace DJANGO_

Slide 26

Slide 26 text

Example Settings from configurations import values from configurations import Configuration class Production(Configuration): SECRET_KEY = values.SecretValue() DATABASES = values.DatabaseURLValue() # shell export DJANGO_SECRET_KEY='the django pony is awesome' export DJANGO_DATABASE_URL='postgres://myuser@localhost/mydb'

Slide 27

Slide 27 text

Serving Files

Slide 28

Slide 28 text

Ephermal Systems » No persistent storage » Use cloud storage solutions » Easy to set up with Django apps

Slide 29

Slide 29 text

For File Uploads » We use S3 for storage » Django app: django-storages » Uses boto under the hood

Slide 30

Slide 30 text

Easy To Conﬁgure # settings.py INSTALLED_APPS += ['storages'] DEFAULT_FILE_STORAGE = 'storages.backends.s3boto.S3BotoStorage' AWS_ACCESS_KEY_ID = 'xxxxxxxx' AWS_SECRET_ACCESS_KEY = 'xxxxxxxx' AWS_STORAGE_BUCKET_NAME = 'mybucket'

Slide 31

Slide 31 text

For Static Files » With django-storages » As easy as adding a setting # settings.py STATICFILES_STORAGE = 'storages.backends.s3boto.S3BotoStorage'

Slide 32

Slide 32 text

There Is A "Better" Way

Slide 33

Slide 33 text

The Way We Do It » Bake static ﬁles into images » Mount to the EC2 host » Update ﬁles on container startup » Serve via nginx

Slide 34

Slide 34 text

Challenges

Slide 35

Slide 35 text

Logging » Log ﬁles stored on EC2 » Aggregated on request (manually) » No syslog support Solution » Forward to central log server » Use gliderlabs/logspout

Slide 36

Slide 36 text

Monitoring » Limited info available » Separated by environment » No customization Solution » Use external service (e.g. DataDog) » Run DataDog/docker-dd-agent

Slide 37

Slide 37 text

DB Schema Changes » Unsolved Problem (for us) » Automatically migrating is problematic » Requires development strategy Recommended Read The Path To Smoother Migrations Nathan Duthoit

Slide 38

Slide 38 text

Beneﬁts

Slide 39

Slide 39 text

Dev-Prod Parity

Slide 40

Slide 40 text

Easy Rollbacks

Slide 41

Slide 41 text

Faster Deploys

Slide 42

Slide 42 text

Final Thoughts » Great improvement for us » Still issues with Beanstalk » Docker is extremely young