Automatisation in development and testing - within budget [DrupalCamp Bratislava 2016-05]

Working on client projects with very strict budget and resource restrictions, tight deadlines and pressure, many times does not allow for full blown Test Driven Development, Continuous Delivery and other software engineering goodness we would love to have. We will show you easily accessible and quickly implementable options, that allow you to automate your development and testing process, or at least the most painful parts, without blowing the budget. Finally you can relax during deployments of the code to production! :-)

Transcript

1. Automatisation Automatisation In Development and Quality Process (Within budget) David Lukac Senior Technical Consultant @ Inviqa Ltd. UK @davidlukac https://legacy.joind.in/18271 1
2. 2 . 1
3. 2 . 2
4. 2 . 3
5. https://inviqa.com 3 . 1
6. Software Engineer @ Siemens Software Engineer @ Siemens Java Consultant @ T-Mobile Austria Java Consultant @ T-Mobile Austria CTO @ Mogdesign.eu CTO @ Mogdesign.eu Head of Project Operations @ iKOS Ltd. Head of Project Operations @ iKOS Ltd. Senior Technical Consultant @ Inviqa Senior Technical Consultant @ Inviqa 3 . 2
7. 3 . 3
8. Questions Questions 1. F 2. G/V 3. DR/DC 4. AQA 5. C* 4 . 1
9. 4 . 2
10. Why automate? Why automate? Saves time Streamline the process Efficiency Quality / Error rate 5 . 1
11. 5 . 2
12. Why CI/CD? Why CI/CD? 6 . 1
13. Why CI/CD? Why CI/CD? What? Merging Immediate testing & reporting G: Feedback ... ... Defects identified and corrected ASAP 6 . 2
14. Why CI/CD? Why CI/CD? What? Short cycles Releasebility G: Build, test, release ... ... fast, frequently 6 . 3
15. Why CI/CD? Why CI/CD? Business critical functionality Regression DRY Ease of mind Confidence Trust 6 . 4
16. But how!? ... budget?! But how!? ... budget?! Credit: http://www.dailymail.co.uk/news/article-2103067/Duck-cover--Astonishing-video-shows-U-S-ground-grunt-guinea-pigs-taking-atomic- bomb-tests-1950s--trenches-protect-radiation.html 7 . 1
17. Preparation: Preparation: Unified environment Unified environment Drush aliases 7 . 2
18. Preparation: Preparation: Unified environment Unified environment Drush aliases $ <project root>/drush/mysite.aliases.drushrc.php <?php $aliases['mysite.local'] = array( .... ); $aliases['mysite.stage'] = array( .... ); $aliases['mysite.uat'] = array( .... ); $aliases['mysite.prod'] = array( .... ); ... $ ln -s ${DIR}/mysite.aliases.drushrc.php ~/.drush/mysite.aliases.drushrc.php 7 . 3
19. Preparation: Preparation: Unified environment Unified environment Drush aliases Stack DevDesktop 7 . 4
20. Preparation: Preparation: Unified environment Unified environment Drush aliases Stack DevDesktop Drupal-VM 7 . 5
21. Preparation: Preparation: Unified environment Unified environment Drush aliases Stack DevDesktop Drupal-VM Docker (Drude) 7 . 6
22. Credit: http://joefleming.net/posts/git-flow/ 7 . 7
23. Local tasks Local tasks Shell Shell >_ >_ 8 . 1
24. Shell scripts Shell scripts #!/usr/bin/env bash # Basic deployment tasks. drush @mysite.${1} cc all drush @mysite.${1} updatedb -y drush @mysite.${1} cron 8 . 2
25. Shell scripts Shell scripts #!/usr/bin/env bash # Basic deployment tasks. drush @mysite.${1} cc all drush @mysite.${1} updatedb -y drush @mysite.${1} cron # Purge Varnish curl -X PURGE -H "X-Acquia-Purge:[mysite.com]" -H "Accept-Encoding: gzip" https://mysite.com/about 8 . 3
26. Shell scripts Shell scripts #!/usr/bin/env bash # Basic deployment tasks. drush @mysite.${1} cc all drush @mysite.${1} updatedb -y drush @mysite.${1} cron # Purge Varnish curl -X PURGE -H "X-Acquia-Purge:[mysite.com]" -H "Accept-Encoding: gzip" https://mysite.com/about # Features # Hidden bonus(?!) drush @mysite.${1} fra -y 8 . 4
27. Shell scripts Shell scripts #!/usr/bin/env bash # Basic deployment tasks. drush @mysite.${1} cc all drush @mysite.${1} updatedb -y drush @mysite.${1} cron # Purge Varnish curl -X PURGE -H "X-Acquia-Purge:[mysite.com]" -H "Accept-Encoding: gzip" https://mysite.com/about # Features # Hidden bonus(?!) drush @mysite.${1} fra -y # Pull everything drush rsync ${source}:%files/ ${target}:%files/ --mode=ahkvz --progress -y drush sql-sync ${source} ${target} -y 8 . 5
28. Shell scripts Shell scripts #!/usr/bin/env bash # Basic deployment tasks. drush @mysite.${1} cc all drush @mysite.${1} updatedb -y drush @mysite.${1} cron # Purge Varnish curl -X PURGE -H "X-Acquia-Purge:[mysite.com]" -H "Accept-Encoding: gzip" https://mysite.com/about # Features # Hidden bonus(?!) drush @mysite.${1} fra -y # Pull everything drush rsync ${source}:%files/ ${target}:%files/ --mode=ahkvz --progress -y drush sql-sync ${source} ${target} -y # Tests cd behat bin/behat features/ 8 . 6
29. Shell scripts Shell scripts #!/usr/bin/env bash # Migration drush @mysite.${1} en menu_migrate -y drush @mysite.${1} mi Menu --feedback="100 items" 8 . 7
30. Shell scripts Shell scripts #!/usr/bin/env bash # Migration drush @mysite.${1} en menu_migrate -y drush @mysite.${1} mi Menu --feedback="100 items" # Solr drush @mysite.${1} solr-delete-index drush @mysite.${1} solr-index 8 . 8
31. Shell scripts Shell scripts #!/usr/bin/env bash # Deployment script drush @mysite.$1 fr feature_article -y drush @mysite.$1 vset my_custom_var 1 8 . 9
32. Shell scripts Shell scripts #!/usr/bin/env bash # Deployment script drush @mysite.$1 fr feature_article -y drush @mysite.$1 vset my_custom_var 1 drush @mysite.$1 cc css-js drush @mysite.$1 cron 8 . 10
33. Other Other Env. setup Dep. management npm, bundle Toggle Changelog Build 8 . 11
34. Local tasks Local tasks Gulp Gulp 9 . 1
35. Gulp tasks Gulp tasks watch compile copy serve 9 . 2
37. Laravel Envoy Laravel Envoy Server side, ssh Shell 11 . 1
38. Laravel Envoy Laravel Envoy Server side, ssh Shell Easy to setup Works with WebSupport $ composer global require "laravel/envoy=~1.0" $ envoy init user@192.168.1.1 11 . 2
39. Laravel Envoy Laravel Envoy Server side, ssh Shell Variables Servers Tasks Macros Setup 11 . 3
40. Envoy Envoy Envoy.blade.php --------------- @servers(['s1' => 'usr1@myserver.com -p 12345']) @setup $now = new DateTime(); $environment = isset($env) ? $env : "testing"; @endsetup @task('deploy-prod', ['on' => 's1']) cd /var/www echo {{ $now }}; echo {{ $environment }} drush @mysite.prod sql-dump --result-file --gzip git checkout master git pull drush @mysite.prod updb drush @mysite.prod cc all drush @mysite.prod cron @endtask @macro('deploy') deploy-prod clean-up @endmacro 11 . 4
41. Envoy Envoy Envoy.blade.php --------------- @servers(['s1' => 'usr1@myserver.com -p 12345']) @task('deploy-prod', ['on' => 's1']) cd /var/www drush @mysite.prod sql-dump --result-file --gzip git checkout master git pull drush @mysite.prod updb drush @mysite.prod cc all drush @mysite.prod cron @endtask ... $ envoy run deploy-prod 11 . 5
42. Capistrano Capistrano 12 . 1
43. Capistrano Capistrano Remote server Ruby Role, tasks, stages ... 12 . 2
44. Tools Tools Credit: http://galilsoftware.com/our-2015-ci-survey-the-results/ 13 . 1
45. Tools Tools Credit: http://galilsoftware.com/our-2015-ci-survey-the-results/ github.com/ripienaar/free-for-dev github.com/ripienaar/free-for-dev 13 . 2
46. QA Automation QA Automation 14 . 1
47. 14 . 2
48. QA Automation QA Automation TTD Unit Tests ... 14 . 3
49. QA Automation QA Automation TTD Unit Tests ... pricy? time consuming? ROI? 14 . 4
50. 14 . 5
51. 15 . 1
52. Behat Behat Behavioural testing Gather & test requirements User stories Gherkin 15 . 2
53. Behat Behat Behavioural testing Gather & test requirements User stories Gherkin Critical functionality Login Purchase Post ... 15 . 3
54. Behat Behat Behavioural testing Gather & test requirements User stories Gherkin Drupal support 15 . 4
55. Behat Behat default: suites: default: contexts: - FeatureContext - Drupal\DrupalExtension\Context\DrupalContext - Drupal\DrupalExtension\Context\MessageContext extensions: Behat\MinkExtension: selenium2: ~ base_url: http://mysite.local Drupal\DrupalExtension: blackbox: ~ api_driver: 'drupal' drupal: drupal_root: '/var/www' text: log_out: "Log out" log_in: "Log in" password_field: "Password" username_field: "Username" selectors: message_selector: '.messages' error_message_selector: '.messages.error' success_message_selector: '.messages.status' warning_message_selector: '.messages.warning' region_map: header_search: ".search-toggle" 15 . 5
56. Behat Behat DrupalContext custom context <?php class FeatureContext extends RawDrupalContext implements SnippetAcceptingContext { ... /** * @Then I should see the subheading */ public function iShouldSeeSubHeading() { $this->countElements('.taxonomy-term.vocabulary-sections .field-name-field-body .field-item', 1, 'Homepage subheading'); } ... 15 . 6
57. Behat Behat Feature: Homepage I want to see a home page As a user So I can see the latest featured content on the site. Background: Given I am not logged in When I visit "/" Scenario: User can see Main header Then I should see the text "welcome to our site" And I should see the subheading Scenario: User can see Latest Articles Then I should see 11 latest homepage articles 15 . 7
58. Behat Behat Scenario: User can add the content administration Given I am logged in as a user with the "Content Editor" role When I go to "node/add/article" Then I should not see "Page not found" When I fill in "title" with "Behat testing article" And I fill in "media[field_listing_image_und_0]" with "314631" And I press the 'edit-submit' button Then I should see the following success messages: | success messages | | Article Behat testing article has been created. | And I should be able to register my article with title "Behat testing article" for cleanup 15 . 8
59. Behat Behat Credit: http://erikaybar.name/building-and-testing-a-restful-api-using-behat-phpunit-and-laravel-part-1/ 15 . 9
60. Ghost Inspector Ghost Inspector 16 . 1
61. Ghost Inspector Ghost Inspector Automated UI testing Automated UI monitoring 16 . 2
62. Ghost Inspector Ghost Inspector Automated UI testing Automated monitoring Screenshots Comparison 16 . 3
63. Ghost Inspector Ghost Inspector 16 . 4
64. Ghost Inspector Ghost Inspector Credit: http://www.hung-truong.com/blog/ 16 . 5
65. Ghost Inspector Ghost Inspector Automated UI testing Automated monitoring Screenshots Comparison Step-by-step Selectors Recorder API 16 . 6
66. Ghost Inspector Ghost Inspector Credit: http://www.hung-truong.com/blog/ 16 . 7
67. Ghost Inspector Ghost Inspector API $ curl https://api.ghostinspector.com/v1/ suites/jabsdf7283947298374sdf/execute/ ?apiKey=aodjshfas72834970128347ijshdfg 16 . 8
68. Ghost Inspector Ghost Inspector 16 . 9
69. Effectiveness + Quality Confidence + Trust Unified environment Automated Tasks Automated QA Time for coffee + $$$ Recap Recap 17
70. Q & D Q & D https://legacy.joind.in/18271 @davidlukac 18