Migration, everything I don't know about Migration but probably should

Transcript

1. Migration Everything I don't know about Migration but probably should*

   0

2. Who? Name - Mike Bell Twitter - Drupal.org - Github

   - Where - CTI Digital - Drupal Technical Architect @mikebell_ mikebell_ mikebell

3. In the beginning Migration options were pretty slim Hand crafted

   sql scripts Some bash thrown in for good measure

4. Then came the light Migrate Module Drupal 6 & 7

   Staple for Drupal to Drupal ... and everything else Good foundation to start with

5. Migrate Features in D7/6 Migration framework - Source and Destination

   Plugins - Nice UI

6. Migrate D2D Contrib module Drupal to Drupal Common field destinations

   for contrib modules Provides a lot of the heavy lifting for you

7. A small (/big) Caveat All subject to change A small

   Apology I'm not an expert on D8 Migrate Plenty of Drupal 7 migrations though ... which helps a lot.

8. Say hello to Migrate in Drupal 8 Core D6 to

   D8 already done D7 to D8 on it's way Base sources are in, MySQL, CSV etc

9. Why include Migrate in core? The New Upgrade Path -

   Reliable and easy way of updating - A major selling point - A new skill set for developers

10. Why Migrate instead of Updating(.php)? No hit or miss update.php

    runs Did I mention it's repeatable? It's repeatable Easier to test by taking smaller chunks first (and the above bit)

11. How will it help upgrading? End Users - not much

    - yet... - Migrate UI? Hopefully in contrib Developers - xYES - Re-usable components - Predefined destinations and sources

12. How will it help companies? Easily port third party cmss

    to Drupal Creates a skill set pool - The more people the better - Major selling point in the commercial process

13. How will it help you? Migration is cool and/or fun

    May cause insanity

14. Migrate 8 vs 7 Plugins/Yaml everywhere! D8 architecture Builds on

    existing proven features of Migrate 7

15. What you get Migrate - core files, general api, plugin

    manager Migrate Drupal - d2d, generic migrations for D6 (soon D7)

16. Down to the details Migration is split into: - Source

    - Process - Destination

17. Things you need to know PSR4 Yaml

18. PSR4 Is here to stay Bye bye PSR-0 It just

    makes sense PSR-4 example -

19. Fully Qualified Class Name Namespace Prefix Base Directory Resulting File

    Path \Acme\Log\Writer\File_Writer Acme\Log\Writer ./acme- log- writer/src/ ./acme-log- writer/src/File_Writer.ph

20. No More ./lib/src/Vendor/Badger/ClassName/Lib/Vendor/BadgerClass* *May not be PSR-0

21. Config Files Much of the configuration has been moved into

    yaml files Easier to edit and read Harder to debug, spelling mistakes can be a pain

22. Yaml and You What is it? - Data orientated -

    Human readable Why do you need it? - Drupal 8 config is Yaml - Widely adopted across many different languages

23. Source Plugins Defines source rows Migrate Drupal comes with D6

    SQL sources Lots of common one

24. Process Plugins Uses plugins Different functionality via small utilities

25. Destination Plugins Entities - User - Nodes

26. More on Migrate Process Plugins Additional helpers to process data

    before importing Some useful examples: - concat - concatination plugin - dedupe_entity - de-duplicates entities

27. Useful Process Examples Getting/Setting nested Values Setting default values Extracting

    values from multilevel arrays

28. Process: Setting/Getting Nested Values If you want to set $destination['display_settings']['label']['format']

    or read from $source['display_settings']['label']['format'] you need to use display_settings:label:format. Example: p r o c e s s : s o u r c e : ' d i s p l a y _ s e t t i n g s : l a b e l : f o r m a t '

29. Process: Setting default_value p r o c e s s

    : u i d : - p l u g i n : m i g r a t i o n i d : u s e r s s o u r c e : a u t h o r - p l u g i n : d e f a u l t _ v a l u e d e f a u l t _ v a l u e : 4 4

30. Process: Extracting values p r o c e s s

    : n e w _ t e x t _ f i e l d : p l u g i n : e x t r a c t s o u r c e : s o m e _ t e x t _ f i e l d i n d e x : - u n d - 0 - v a l u e $destination['new_text_field'] = $source['some_text_field']['und'][0]['value']

31. User Migration Example Pt1 i d : m i g

    r a t e _ e x a m p l e _ p e o p l e s o u r c e : p l u g i n : c u s t o m _ u s e r d e s t i n a t i o n : p l u g i n : e n t i t y : u s e r m d 5 _ p a s s w o r d s : t r u e

32. User Migration Example Pt2 p r o c e s

    s : n a m e : - p l u g i n : c o n c a t d e l i m i t e r : . s o u r c e : - f i r s t _ n a m e - l a s t _ n a m e - p l u g i n : c a l l b a c k c a l l a b l e : - ' \ D r u p a l \ C o m p o n e n t \ U t i l i t y \ U n i c o d e ' - s t r t o l o w e r

33. User Migration Example Pt3 - p l u g i

    n : c a l l b a c k c a l l a b l e : t r i m - p l u g i n : d e d u p e _ e n t i t y e n t i t y _ t y p e : u s e r f i e l d : n a m e m a i l : e m a i l p a s s : p a s s r o l e s : - p l u g i n : e x p l o d e d e l i m i t e r : ' ; ' s o u r c e : g r o u p s

34. Defining the source Pt1 / * * * D r

    u p a l 6 u s e r s o u r c e f r o m d a t a b a s e . * * @ M i g r a t e S o u r c e ( * i d = " c u s t o m _ u s e r " * ) * / c l a s s U s e r e x t e n d s D r u p a l S q l B a s e i m p l e m e n t s S o u r c e E n t i t y I n t e r f a c e { p u b l i c f u n c t i o n g e t I d s ( ) { r e t u r n a r r a y ( ' i d ' = > a r r a y ( ' t y p e ' = > ' i n t e g e r ' ) ) ; }

35. Defining the source Pt2 p u b l i c

    f u n c t i o n f i e l d s ( ) { r e t u r n a r r a y ( ' i d ' = > $ t h i s - > t ( ' U s e r I D ' ) , ' f i r s t _ n a m e ' = > $ t h i s - > t ( ' F i r s t n a m e ' ) , ' l a s t _ n a m e ' = > $ t h i s - > t ( ' L a s t n a m e ' ) , ' e m a i l ' = > $ t h i s - > t ( ' E - m a i l ' ) , ' p a s s ' = > $ t h i s - > t ( ' M D 5 h a s h e d p a s s w o r d ' ) , ' g r o u p s ' = > $ t h i s - > t ( ' U s e r g r o u p s ' ) , ) ; }

36. Defining the source Pt3 p u b l i c

    f u n c t i o n q u e r y ( ) { r e t u r n $ t h i s - > s e l e c t ( ' m i g r a t e _ e x a m p l e _ p e o p l e ' , ' p ' ) - > f i e l d s ( ' p ' , a r r a y ( ' i d ' , ' f i r s t _ n a m e ' , ' l a s t _ n a m e ' , ' e m a i l ' , ' p a s s ' , ' g r o u p s ' ) ) ; }

37. Executing your migration Drush is the only way at the

    moment Requires a manifest file It's yaml (no surprise!)

38. Example Manifest File - d 6 _ u s e

    r - d 6 _ u s e r _ r o l e

39. Running it through drush d r u s h m

    i g r a t e - m a n i f e s t m a n i f e s t - n a m e - - d b - u r l = m y s q l : / / r o o t : p a s s @ 1 2 7 . 0 . 0 . 1 / d b

40. Any Questions?

41. Resources Pedro Cambra - @pcambra webikon.com - http://webikon.com/cases/migrating-to-drupal-8 The IMP

    Team Migrate API Documentation - https://drupal.org/node/2127611 *Thanks to Mark Jones for the title!