Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Digging Into Django's Migrations
Andrew Godwin
September 03, 2014
Programming
3
530
Digging Into Django's Migrations
My keynote from DjangoCon US 2014
Andrew Godwin
September 03, 2014
Tweet
Share
More Decks by Andrew Godwin
See All by Andrew Godwin
Writing Maintainable Software At Scale
andrewgodwin
0
190
A Newcomer's Guide To Airflow's Architecture
andrewgodwin
0
150
Async, Python, and the Future
andrewgodwin
2
440
How To Break Django: With Async
andrewgodwin
1
420
Taking Django's ORM Async
andrewgodwin
0
410
The Long Road To Asynchrony
andrewgodwin
0
420
The Scientist & The Engineer
andrewgodwin
1
450
Pioneering Real-Time
andrewgodwin
0
200
Just Add Await: Retrofitting Async Into Django
andrewgodwin
2
1.2k
Other Decks in Programming
See All in Programming
domain層のモジュール化 / MoT TechTalk #15
mot_techtalk
0
120
レガシーフレームワークからの移行
ug
0
120
Most Valuable Bug(?) ~インシデント未遂から得た学び~
tatsumiakahori
0
150
Prácticas de Seguridad en Kubernetes
pablokbs
0
130
TypeScript 4.9のas const satisfiesが便利
tonkotsuboy_com
9
2.3k
Gradle build: The time is now
nonews
1
480
CDKでValidationする本当の方法 / cdk-validation
gotok365
1
210
ちょうぜつ改め21世紀ふつうのソフトウェア設計
tanakahisateru
7
6.5k
Hono v3 - Do Everything, Run Anywhere, But Small, And Faster
yusukebe
4
130
フロントエンドで学んだことをデータ分析で使ってみた話
daichi_igarashi
0
180
Azure Functionsをサクッと開発、サクッとデプロイ/vscodeconf2023-baba
nina01
1
340
Swift Expression Macros: a practical introduction
kishikawakatsumi
2
730
Featured
See All Featured
How New CSS Is Changing Everything About Graphic Design on the Web
jensimmons
214
12k
Teambox: Starting and Learning
jrom
124
7.9k
Statistics for Hackers
jakevdp
785
210k
The Web Native Designer (August 2011)
paulrobertlloyd
76
2.2k
Stop Working from a Prison Cell
hatefulcrawdad
263
18k
Writing Fast Ruby
sferik
613
58k
Bash Introduction
62gerente
601
210k
The Cult of Friendly URLs
andyhume
69
5.1k
Git: the NoSQL Database
bkeepers
PRO
419
60k
What’s in a name? Adding method to the madness
productmarketing
12
1.9k
Docker and Python
trallard
30
1.9k
Testing 201, or: Great Expectations
jmmastey
25
5.7k
Transcript
's migrations digging into
Andrew Godwin Author of South migrations library Hi, I'm Author
of 1.7 Django migrations Senior Software Engineer at
south migrations for django south.aeracode.org DjangoCon 2008 https://speakerdeck.com/andrewgodwin/south-migrations-for-django
Migrations: They're pretty good.
South 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 1.0
Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
The Early Years 0.1 0.2 0.3 0.4 0.5 0.6 0.7
0.8 1.0 Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
Approaching Stability 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8
1.0 Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014 Well, in the short term, South 1.0 will be released. “ “ June 2010
The Long Gap & Kickstarter 0.1 0.2 0.3 0.4 0.5
0.6 0.7 0.8 1.0 Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
Today 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 1.0
Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
For at least a year now, people have been suggesting
to me that South should be in Django core. “ “ June 2010
The Initial Plan Django Schema backend ORM Hooks South 2
Migration handling User interface
The Revised Plan Django Schema backend ORM Hooks South 2
Migration handling User interface Backport for 1.4 - 1.6
The Revised Revised Plan Django Schema backend ORM Hooks Migration
handling User interface
Moving South into Django instead, "Adding migrations to Django"
Logically Separate SchemaEditor Schema Migrations field.deconstruct() ModelOptions.apps Operations Loader /
Graph Executor Autodetector Optimiser State
Operations & State
Operations are a declarative representation of model changes State is
an in-memory representation of entire project state
State State Operation AddModel No Models 1 Model
State State Operation State Operation State Operation State Operation Migration
1 Migration 2
AddModel DeleteModel RenameModel AddField DeleteField AlterModelOptions RenameField AlterModelTable AlterField AlterUniqueTogether
AlterIndexTogether RunSQL RunPython
SchemaEditor
connection.schema_editor() Abstraction over database DDL Takes Django models and fields
with connection.schema_editor() as ed: ed.create_model(Author) ed.add_field( Book, "author", models.ForeignKey(Author), )
Field Deconstruction
Every field has deconstruct() Returns arguments passed to __init__ to
duplicate itself
>>> field = CharField(max_length=255) >>> field.deconstruct() ( None, 'django.db.models.CharField', [],
{'max_length': 255} )
The Graph
Represents migrations and dependencies as directed graph Loop detection, leaf/root
selection
myapp/0001 myapp/0002 otherapp/0001 contenttypes/0001 appthree/0001 myapp/0003 otherapp/0002
The Autodetector
Compares two States and outputs a set of operations to
perform Operations have own dependencies and resolver
Model A Model A w/FK, Model B diff AddModel(B) AddField(A,
"b", FK(B)) dependency sort AddModel(B) AddField(A, "b", FK(B)) BEFORE AFTER
The Optimiser
Takes one set of Operations and outputs another with the
same effect Steps over pairs and checks if they combine and what they pass over
can't reduce reduce possible check conflicts reduced, reset
A New Format More concise Declarative Introspectable
Migration actions Frozen ORM
None
makemigrations field.deconstruct() Loader / Graph Autodetector Optimiser State Writer 1
2 State 3 5 4
migrate SchemaEditor ModelOptions.apps Operations Loader / Graph Executor State 1
2 Recorder 3
In-memory running Creates models from migration sets Autodetector diffs created
from on-disk Used to feed SchemaEditor / ORM
State State Operation State Operation State Operation State Operation Migration
1 Migration 2 Models Models Render Render
But what went wrong?
Swappable Models
Your migration dependencies myapp/0001 myapp/0002 otherapp/0001 auth/0001 contenttypes/0001
myapp/0001 myapp/0002 otherapp/0001 auth/0001 contenttypes/0001 thirdapp/0001 Your migration dependencies on
swappable models
what? Your migration dependencies on swappable models myapp/0001 myapp/0002 otherapp/0001
auth/0001 contenttypes/0001 thirdapp/0001 ???
what? Your migration dependencies on swappable models myapp/0001 myapp/0002 otherapp/0001
auth/0001 contenttypes/0001 thirdapp/0001 ???
Unmigrated Apps
Test persistence
Test persistence on MySQL
Random Meta options order_with_respect_to? Really?
Proxy Models
But we're there! Django 1.7, out now!
Thanks! Andrew Godwin
[email protected]