InspiringFlow13: Scalable Deployment Architectures with TYPO3 Surf, Git and Jenkins

License: CC BY-SA

When developing and administrating large-scale distributed applications, deployment and change management becomes a new challenge. Modern version control systems like Git and Continuous Integration platforms like Jenkins or Hudson help automating this process, thus making it more efficient and less error-prone.

This talk aims at presenting how these tools can be used to coordinate deployment processes among large teams in distributed, mission-critical infrastructure systems, and how this process can be supported using build tools (like Apache Ant) and test automation. A special focus of the talk will be on possibilities to integrate the deployment software TYPO3 Surf into Git/Jenkins architectures.

Transcript

1. Scalable

   View Slide

2. YOUR SPEAKER
   Martin

   View Slide

3. LAST

   View Slide

4. Software

   View Slide

5. Manual

   View Slide

6. COMMON

   View Slide

7. martin@mybox:~ > ssh myserver.de
   martin@myserver:~ > cd my_app
   martin@myserver:~/my_app > git fetch origin
   martin@myserver:~/my_app > git reset --hard origin/master
   martin@myserver:~/my_app > git submodule update --init
   martin@myserver:~/my_app > ./flow doctrine:migrate
   martin@myserver:~/my_app > ./flow cache:flush
   Manual

   View Slide

8. martin@mybox:~ > ssh myserver.de
   martin@myserver:~ > cd my_app
   martin@myserver:~/my_app > git fetch origin
   martin@myserver:~/my_app > git reset --hard origin/master
   martin@myserver:~/my_app > git submodule update --init
   martin@myserver:~/my_app > ./flow doctrine:migrate
   martin@myserver:~/my_app > ./flow cache:flush
   VERSION

   View Slide

9. HERE:

   View Slide

10. HERE:

    View Slide

11. TYPO3

    View Slide

12. TYPO3

    View Slide

13. ├── cache
    │ └── localgitclone
    ├── releases
    │ ├── 20130324175345
    │ └── current -> ./20130324175345
    └── shared
    BEFORE
    ├── cache
    │ └── localgitclone
    ├── releases
    │ ├── 20130324175345
    │ ├── 20130329184503
    │ ├── previous -> ./20130324175345
    │ └── current -> ./20130329184503
    └── shared
    AFTER
    TYPO3

    View Slide

14. TYPO3

    View Slide

15. Install

    View Slide

16. INITIALIZE
    UPDATE
    MIGRATE
    FINALIZE
    TEST
    SWITCH
    CLEANUP
    SURF

    View Slide

17. Use

    View Slide

18. JENKINS Main
    Build
    Deployment
    Build
    Auxiliary
    Build
    TYPO3

    View Slide

19. Use

    View Slide

20. INITIALIZE

    View Slide

21. N2 N3 N4
    N1
    N2
    N3
    N4
    INIT

    View Slide

22. Execute

    View Slide

23. View Slide

24. View Slide

25. /** @var $deployment \TYPO3\Surf\Domain\Model\Deployment */
    $workflow = new TYPO3\Surf\Domain\Model\SimpleWorkflow();
    $application = new TYPO3\Surf\Application\BaseApplication('MyApplication');
    // ...
    $deployment->setWorkflow($workflow);
    $deployment->addApplication($application);
    if (getenv('BUILD_TARGET') !== FALSE) {
    $node = new TYPO3\Surf\Domain\Model\Node('node-' . getenv('BUILD_TARGET'));
    $node->setHostname(getenv('BUILD_TARGET'));
    $node->setOptions(array(
    'username' => 'surf'
    ));
    $application->addNode($node);
    } else {
    foreach (array('www01','www02','www03') as $node) {
    $node = new TYPO3\Surf\Domain\Model\Node('node-' . $node);
    $node->setHostname($node);
    $node->setOptions(array(
    'username' => 'surf'
    ));
    $application->addNode($node);
    }
    }
    

    View Slide

26. /** @var $deployment \TYPO3\Surf\Domain\Model\Deployment */
    $workflow = new TYPO3\Surf\Domain\Model\SimpleWorkflow();
    $application = new TYPO3\Surf\Application\BaseApplication('MyApplication');
    // ...
    $deployment->setWorkflow($workflow);
    $deployment->addApplication($application);
    if (getenv('BUILD_TARGET') !== FALSE) {
    $node = new TYPO3\Surf\Domain\Model\Node('node-' . getenv('BUILD_TARGET'));
    $node->setHostname(getenv('BUILD_TARGET'));
    $node->setOptions(array(
    'username' => 'surf'
    ));
    $application->addNode($node);
    } else {
    foreach (array('www01','www02','www03') as $node) {
    $node = new TYPO3\Surf\Domain\Model\Node('node-' . $node);
    $node->setHostname($node);
    $node->setOptions(array(
    'username' => 'surf'
    ));
    $application->addNode($node);
    }
    }
    

    View Slide

27. /** @var $deployment \TYPO3\Surf\Domain\Model\Deployment */
    $workflow = new TYPO3\Surf\Domain\Model\SimpleWorkflow();
    $application = new TYPO3\Surf\Application\BaseApplication('MyApplication');
    // ...
    $deployment->setWorkflow($workflow);
    $deployment->addApplication($application);
    if (getenv('BUILD_TARGET') !== FALSE) {
    $node = new TYPO3\Surf\Domain\Model\Node('node-' . getenv('BUILD_TARGET'));
    $node->setHostname(getenv('BUILD_TARGET'));
    $node->setOptions(array(
    'username' => 'surf'
    ));
    $application->addNode($node);
    } else {
    foreach (array('www01','www02','www03') as $node) {
    $node = new TYPO3\Surf\Domain\Model\Node('node-' . $node);
    $node->setHostname($node);
    $node->setOptions(array(
    'username' => 'surf'
    ));
    $application->addNode($node);
    }
    }
    

    View Slide

28. Deployment
    Build
    Deploy

    View Slide

29. Deployment
    Build
    Deploy

    View Slide

30. „Update“
    Build
    N1
    N2
    N3
    N4
    ON

    View Slide

31. Use

    View Slide

32. Use

    View Slide

33. Use

    View Slide

34. GIT
    PRIMARY
    GIT
    2NDARY
    GERRIT
    JENKINS
    MASTER-1
    JENKINS
    MASTER-2
    BUILD
    NODES
    BUILD
    NODES
    DEV
    DEV
    INT
    DEV
    DEV
    QA
    DEV
    DEV
    LIVE
    TYPO3
    SURF
    TYPO3
    SURF
    Deployment

    View Slide

35. TYPO3

    View Slide

36. TYPO3

    View Slide

37. TYPO3

    View Slide

38. USEFUL

    View Slide

39. •http://jenkins-ci.org
    •http://forge.typo3.org/projects/package-typo3-surf
    •http://git-scm.org
    •https://github.com/martin-helmich/ant-typo3flow
    •https://github.com/martin-helmich/jenkins-typo3surf-
    plugin
    •http://etobi.de/blog/2012/05/deployment-setup-typo3-surf/
    •http://de.slideshare.net/etobide/t3con12-flow-and-typo3-
    deployment-with-surf
    •https://git.typo3.org/FLOW3/Packages/TYPO3.Surf.git/blob/
    master:/Documentation/Guide/Index.rst
    •Duvall,

    View Slide

40. Questions
    ?
    

    View Slide

41. Image

    View Slide

42. Image

    View Slide