67-311 Data import presentation

How to import data after a database transition. Case Study: Schedule+

Transcript

1. 67-311 Database Design and Implementation Adam Weis 11/11/12 Wednesday, November 28, 12
2. Database Redesign Case study: Wednesday, November 28, 12
3. Database Redesign Case study: Wednesday, November 28, 12
4. Fall 2011 Wednesday, November 28, 12
5. Fall 2011 Wednesday, November 28, 12
6. Wednesday, November 28, 12
7. Spring 2013 Wednesday, November 28, 12
8. Spring 2013 Wednesday, November 28, 12
9. Wednesday, November 28, 12
10. Wednesday, November 28, 12
11. Wednesday, November 28, 12
12. Wednesday, November 28, 12
13. ERD - Fall 2011 Wednesday, November 28, 12
14. ERD - Spring 2013 Wednesday, November 28, 12
15. Overview Wednesday, November 28, 12
16. Overview How to upgrade database design? Wednesday, November 28, 12
17. Overview How to upgrade database design? How to import old data? Wednesday, November 28, 12
18. What changed? Wednesday, November 28, 12
19. What changed? A lot. Wednesday, November 28, 12
20. What changed? A lot. Instructors are now a table, not a row in Courses Wednesday, November 28, 12
21. What changed? A lot. Instructors are now a table, not a row in Courses Completely new relationships with “Group” join table Wednesday, November 28, 12
22. What changed? A lot. Instructors are now a table, not a row in Courses Completely new relationships with “Group” join table etc. Wednesday, November 28, 12
23. Migrations Wednesday, November 28, 12
24. Migrations Awesome for database manipulation Wednesday, November 28, 12
25. Migrations Awesome for database manipulation Bad with legacy data Wednesday, November 28, 12
26. Solution Wednesday, November 28, 12
27. Solution Write a database importer script! Wednesday, November 28, 12
28. Solution Write a database importer script! Query both databases simultaneously to import legacy data into new schema! Wednesday, November 28, 12
29. Database importer Wednesday, November 28, 12
30. Database importer ingredients Wednesday, November 28, 12
31. Database importer ingredients Establish a new ActiveRecord connection with old database Wednesday, November 28, 12
32. Database importer ingredients Establish a new ActiveRecord connection with old database Recreate all legacy model relationships Wednesday, November 28, 12
33. Database importer ingredients Establish a new ActiveRecord connection with old database Recreate all legacy model relationships Create the to_model methods Wednesday, November 28, 12
34. Database importer ingredients Establish a new ActiveRecord connection with old database Recreate all legacy model relationships Create the to_model methods Write the driver Wednesday, November 28, 12
35. Example Wednesday, November 28, 12
36. Citations Wednesday, November 28, 12
37. Citations Vincent Siao (SCS & HCI 2014) Wednesday, November 28, 12
38. Citations Vincent Siao (SCS & HCI 2014) Jason MacDonald (SCS 2013) Wednesday, November 28, 12
39. Citations Vincent Siao (SCS & HCI 2014) Jason MacDonald (SCS 2013) Steven Fackler (SCS 2013) Wednesday, November 28, 12
40. Citations Vincent Siao (SCS & HCI 2014) Jason MacDonald (SCS 2013) Steven Fackler (SCS 2013) Tim Riley: http://openmonkey.com/blog/2009/05/02/ importing-legacy-data-in-rails/ Wednesday, November 28, 12
41. Citations Vincent Siao (SCS & HCI 2014) Jason MacDonald (SCS 2013) Steven Fackler (SCS 2013) Tim Riley: http://openmonkey.com/blog/2009/05/02/ importing-legacy-data-in-rails/ https://github.com/aweis/rails_importer/blob/master/ S13importer.rb Wednesday, November 28, 12