Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Digging Into Django's Migrations
Search
Andrew Godwin
September 03, 2014
Programming
3
580
Digging Into Django's Migrations
My keynote from DjangoCon US 2014
Andrew Godwin
September 03, 2014
Tweet
Share
More Decks by Andrew Godwin
See All by Andrew Godwin
Reconciling Everything
andrewgodwin
1
320
Django Through The Years
andrewgodwin
0
210
Writing Maintainable Software At Scale
andrewgodwin
0
440
A Newcomer's Guide To Airflow's Architecture
andrewgodwin
0
360
Async, Python, and the Future
andrewgodwin
2
670
How To Break Django: With Async
andrewgodwin
1
730
Taking Django's ORM Async
andrewgodwin
0
730
The Long Road To Asynchrony
andrewgodwin
0
660
The Scientist & The Engineer
andrewgodwin
1
770
Other Decks in Programming
See All in Programming
PHPUnitの限界をPlaywrightで補完するテストアプローチ
yuzneri
0
380
DatadogのArchived LogsをSnowflakeで高速に検索する方法(Archive Searchでオワコンにならないことを祈って) / How to search Datadog Archived Logs quickly with Snowflake (hoping Datadog Archive Search doesn’t make this obsolete)
civitaspo
0
110
大規模FlutterプロジェクトのCI実行時間を約8割削減した話
teamlab
PRO
0
450
AIコーディングエージェント全社導入とセキュリティ対策
hikaruegashira
16
9.5k
ZeroETLで始めるDynamoDBとS3の連携
afooooil
0
150
「次に何を学べばいいか分からない」あなたへ──若手エンジニアのための学習地図
panda_program
3
720
階層化自動テストで開発に機動力を
ickx
1
480
SwiftでMCPサーバーを作ろう!
giginet
PRO
2
230
No Install CMS戦略 〜 5年先を見据えたフロントエンド開発を考える / no_install_cms
rdlabo
0
460
Vibe Codingの幻想を超えて-生成AIを現場で使えるようにするまでの泥臭い話.ai
fumiyakume
21
10k
#QiitaBash TDDで(自分の)開発がどう変わったか
ryosukedtomita
1
350
あなたとJIT, 今すぐアセンブ ル
sisshiki1969
0
410
Featured
See All Featured
Music & Morning Musume
bryan
46
6.7k
Documentation Writing (for coders)
carmenintech
73
5k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
18
1k
Code Reviewing Like a Champion
maltzj
524
40k
Measuring & Analyzing Core Web Vitals
bluesmoon
8
540
4 Signs Your Business is Dying
shpigford
184
22k
Producing Creativity
orderedlist
PRO
347
40k
Speed Design
sergeychernyshev
32
1.1k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Six Lessons from altMBA
skipperchong
28
3.9k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.4k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.4k
Transcript
's migrations digging into
Andrew Godwin Author of South migrations library Hi, I'm Author
of 1.7 Django migrations Senior Software Engineer at
south migrations for django south.aeracode.org DjangoCon 2008 https://speakerdeck.com/andrewgodwin/south-migrations-for-django
Migrations: They're pretty good.
South 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 1.0
Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
The Early Years 0.1 0.2 0.3 0.4 0.5 0.6 0.7
0.8 1.0 Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
Approaching Stability 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8
1.0 Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014 Well, in the short term, South 1.0 will be released. “ “ June 2010
The Long Gap & Kickstarter 0.1 0.2 0.3 0.4 0.5
0.6 0.7 0.8 1.0 Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
Today 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 1.0
Aug 2008 Aug 2008 Sep 2008 Jan 2009 Apr 2009 Jun 2009 Mar 2010 May 2013 Jul 2014
For at least a year now, people have been suggesting
to me that South should be in Django core. “ “ June 2010
The Initial Plan Django Schema backend ORM Hooks South 2
Migration handling User interface
The Revised Plan Django Schema backend ORM Hooks South 2
Migration handling User interface Backport for 1.4 - 1.6
The Revised Revised Plan Django Schema backend ORM Hooks Migration
handling User interface
Moving South into Django instead, "Adding migrations to Django"
Logically Separate SchemaEditor Schema Migrations field.deconstruct() ModelOptions.apps Operations Loader /
Graph Executor Autodetector Optimiser State
Operations & State
Operations are a declarative representation of model changes State is
an in-memory representation of entire project state
State State Operation AddModel No Models 1 Model
State State Operation State Operation State Operation State Operation Migration
1 Migration 2
AddModel DeleteModel RenameModel AddField DeleteField AlterModelOptions RenameField AlterModelTable AlterField AlterUniqueTogether
AlterIndexTogether RunSQL RunPython
SchemaEditor
connection.schema_editor() Abstraction over database DDL Takes Django models and fields
with connection.schema_editor() as ed: ed.create_model(Author) ed.add_field( Book, "author", models.ForeignKey(Author), )
Field Deconstruction
Every field has deconstruct() Returns arguments passed to __init__ to
duplicate itself
>>> field = CharField(max_length=255) >>> field.deconstruct() ( None, 'django.db.models.CharField', [],
{'max_length': 255} )
The Graph
Represents migrations and dependencies as directed graph Loop detection, leaf/root
selection
myapp/0001 myapp/0002 otherapp/0001 contenttypes/0001 appthree/0001 myapp/0003 otherapp/0002
The Autodetector
Compares two States and outputs a set of operations to
perform Operations have own dependencies and resolver
Model A Model A w/FK, Model B diff AddModel(B) AddField(A,
"b", FK(B)) dependency sort AddModel(B) AddField(A, "b", FK(B)) BEFORE AFTER
The Optimiser
Takes one set of Operations and outputs another with the
same effect Steps over pairs and checks if they combine and what they pass over
can't reduce reduce possible check conflicts reduced, reset
A New Format More concise Declarative Introspectable
Migration actions Frozen ORM
None
makemigrations field.deconstruct() Loader / Graph Autodetector Optimiser State Writer 1
2 State 3 5 4
migrate SchemaEditor ModelOptions.apps Operations Loader / Graph Executor State 1
2 Recorder 3
In-memory running Creates models from migration sets Autodetector diffs created
from on-disk Used to feed SchemaEditor / ORM
State State Operation State Operation State Operation State Operation Migration
1 Migration 2 Models Models Render Render
But what went wrong?
Swappable Models
Your migration dependencies myapp/0001 myapp/0002 otherapp/0001 auth/0001 contenttypes/0001
myapp/0001 myapp/0002 otherapp/0001 auth/0001 contenttypes/0001 thirdapp/0001 Your migration dependencies on
swappable models
what? Your migration dependencies on swappable models myapp/0001 myapp/0002 otherapp/0001
auth/0001 contenttypes/0001 thirdapp/0001 ???
what? Your migration dependencies on swappable models myapp/0001 myapp/0002 otherapp/0001
auth/0001 contenttypes/0001 thirdapp/0001 ???
Unmigrated Apps
Test persistence
Test persistence on MySQL
Random Meta options order_with_respect_to? Really?
Proxy Models
But we're there! Django 1.7, out now!
Thanks! Andrew Godwin
[email protected]