Saying No to NoSQL

Migrating a production system from Mongo to Postgres Without losing your mind or your data.

Transcript

1. Saying No to NoSQL Migrating a production system from Mongo to Postgres Without losing your mind or your data Jonathan Neddenriep
2. The Application Appstack Fast growing production System handling significant $$
3. The Motivation
4. Create a Schema From a big pile'o'data
5. Massage Data into Schema The hard part
6. account_id = ? mongo_account_id = 4cc67093475061e3d95369d account_id = 4cc67093475061e3d95369d_placeholder mongo_account_id = 4cc67093475061e3d95369d account_id = 125612 mongo_account_id = 4cc67093475061e3d95369d
7. { ... 4cc67093475061e3d95369d => 125612 ... } { ... 4cc67093475061e3d95369d => [358, 8256] ... } [ ... 358 => "insert into..." ... ]
8. Code Conversion The tedious part
9. Code Conversion Find all instances of things like .gte, .lt, .eq, .ne, .any, .only Replace relationships like embeds_many with has_many • •
10. Three Problems
11. Three Problems # clean up any apostrophes val = val.gsub(/'/, "") unless val.nil? || !val.is_a? (String)
12. Three Problems Timezones Duplicate primary ids • •
13. The Results
14. What to Learn
15. Questions? Jonathan Neddenriep river1@gmail.com http://github.com/neddenriep