Shipping Faster With Storyplayer

Avoid costly rework and angry customers by validating your solution as you develop it.

This talk was given at PHP London on Thursday 5th May 2016.

Transcript

1. A presentation by @stuherbert
 for @GanbaroDigital With Storyplayer Shipping Faster
2. @GanbaroDigital This is a war story.
3. @GanbaroDigital Our Cast Of Characters
4. @GanbaroDigital https://flic.kr/p/h9ddL5
5. @GanbaroDigital https://flic.kr/p/cwK7UN
6. @GanbaroDigital composer require-dev datasift/storyplayer
7. @GanbaroDigital https://flic.kr/p/62n3eY
8. @GanbaroDigital Why is time always the real enemy?
9. @GanbaroDigital https://flic.kr/p/5Cv6jU
10. @GanbaroDigital The time it takes to design and deliver working software is our biggest cost today
11. @GanbaroDigital Our Quest What We Needed To Do To Win
12. @GanbaroDigital Payment Service Public
 Service Payment Providers
13. @GanbaroDigital Payment Service Public
 Service Payment Providers
14. @GanbaroDigital Payment Service Public
 Service Payment Providers Banks
15. @GanbaroDigital Payment Service Public
 Service Payment Providers Banks
16. @GanbaroDigital Payment Service Public
 Service Payment Providers Status Checks Status Notifications Banks
17. @GanbaroDigital Our Battlefield The Payment Service
18. @GanbaroDigital Payment Service MySQL API Client Payment Providers
19. @GanbaroDigital Payment Service MySQL Queue Workers Payment Providers Outbound Proxy API Client
20. @GanbaroDigital Payment Service MySQL Selenium Grid Firefox Queue Workers Payment Providers Outbound Proxy API Client
21. @GanbaroDigital Payment Service MySQL Selenium Grid Firefox Queue Workers Payment Providers Outbound Proxy API Client
22. @GanbaroDigital v2 v1 Live In Dev
23. @GanbaroDigital Integrate here v2 v1 Live In Dev
24. @GanbaroDigital https://flic.kr/p/96VRju
25. @GanbaroDigital Getting Started Establishing A Beach-Head
26. @GanbaroDigital First step: authenticate all the things
27. @GanbaroDigital as a scheme user - using a HTTP request - I can generate a new auth token for the Notifications API
28. @GanbaroDigital compose require-dev datasift/storyplayer
29. @GanbaroDigital $story = newStory("API Server") ->inGroup("Authentication") ->called("Can generate auth token"); $story->requiresStoryplayerVersion(2);
30. @GanbaroDigital as a scheme user - using a HTTP request - I can generate a new auth token for the Notifications API
31. @GanbaroDigital $story->addTestSetup(function() { });
32. @GanbaroDigital $story->addTestSetup(function() { $user = fromUsers() ->getUser('scheme_user'); if (isset($user->access_token)) { unset($user->access_token); } if (isset($user->token_expires)) { unset($user->token_expires); } });
33. @GanbaroDigital $story->addTestSetup(function() { $user = fromUsers() ->getUser('scheme_user'); if (isset($user->access_token)) { unset($user->access_token); } if (isset($user->token_expires)) { unset($user->token_expires); } });
34. @GanbaroDigital $story->addTestSetup(function() { $user = fromUsers() ->getUser('scheme_user'); if (isset($user->access_token)) { unset($user->access_token); } if (isset($user->token_expires)) { unset($user->token_expires); } });
35. @GanbaroDigital as a scheme user - using a HTTP request - I can generate a new auth token for the Notifications API
36. @GanbaroDigital $story->addAction(function() { });
37. @GanbaroDigital $story->addAction(function() { // where is our API? $hostname = fromFirstHostWithRole(‘payment-api’)
 ->getHostname(); $url = “http://{$hostname}/api/token”; // get the token $result = usingHttp()->post(…); expectsHttpResponse($result)->hasStatusCode(200); });
38. @GanbaroDigital $story->addAction(function() { // where is our API? $hostname = fromFirstHostWithRole(‘payment-api’)
 ->getHostname(); $url = “http://{$hostname}/api/token”; // get the token $result = usingHttp()->post(…); expectsHttpResponse($result)->hasStatusCode(200); });
39. @GanbaroDigital $story->addAction(function() { // where is our API? $hostname = fromFirstHostWithRole(‘payment-api’)
 ->getHostname(); $url = “http://{$hostname}/api/token”; // get the token $result = usingHttp()->post(…); expectsHttpResponse($result)->hasStatusCode(200); });
40. @GanbaroDigital https://flic.kr/p/cwK7UN
41. @GanbaroDigital as a scheme user - using a HTTP request - I can generate a new auth token for the Notifications API
42. @GanbaroDigital We haven’t proved that … yet!
43. @GanbaroDigital as a scheme user - using a HTTP request - I can generate a new auth token for the Notifications API afterwards - the token will be in the database - I can access the Notifications API
44. @GanbaroDigital $story->addPostTestInspection(function() { });
45. @GanbaroDigital We need to share information between each of our test phases
46. @GanbaroDigital The checkpoint is a data container to share data between test phases
47. @GanbaroDigital $story->addAction(function() { // where is our API? $hostname = fromFirstHostWithRole(‘payment-api’)
 ->getHostname(); $url = “http://{$hostname}/api/token”; // get the token $result = usingHttp()->post(…); expectsHttpResponse($result)->hasStatusCode(200); // remember the result $checkpoint = getCheckpoint(); $checkpoint->httpResult = $result; });
48. @GanbaroDigital $story->addPostTestInspection(function() { // get the result from the action $checkpoint = getCheckpoint(); $httpResult = $checkpoint->httpResult; // make sure it has an access token assertsString($httpResult->body)->isValidJson(); $data = json_decode($httpResult->body); assertsObject($data)->hasAttribute(‘access_token’); // get our access token $user = fromUsers()->getUser(‘scheme_user’); $user->access_token = $data->access_token; });
49. @GanbaroDigital $story->addPostTestInspection(function() { // get the result from the action $checkpoint = getCheckpoint(); $httpResult = $checkpoint->httpResult; // make sure it has an access token assertsString($httpResult->body)->isValidJson(); $data = json_decode($httpResult->body); assertsObject($data)->hasAttribute(‘access_token’); // get our access token $user = fromUsers()->getUser(‘scheme_user’); $user->access_token = $data->access_token; });
50. @GanbaroDigital $story->addPostTestInspection(function() { // where is our API? $hostname = fromFirstHostWithRole(‘payment-api’)
 ->getHostname(); $url = “http://{$hostname}/api/notifications”; // use the new access token $user = fromUsers()->getUser(‘scheme_user’); $result = fromHttp()->get( $url, [ ‘Authorization’ => $user->access_token] ); expectsHttpResponse($result)->hasStatusCode(200); });
51. @GanbaroDigital $story->addTestSetup(function() { // … }); $story->addAction(function() { // … }); $story->addPostTestInspection(function() { // … });
52. @GanbaroDigital Breaking Out From The Beach Head
53. @GanbaroDigital Build up the tests one feature at a time, one scenario at a time
54. @GanbaroDigital Payment Service Storyplayer MySQL
55. @GanbaroDigital Queue Workers Storyplayer
56. @GanbaroDigital Payment Service MySQL Queue Workers Payment Providers Storyplayer
57. @GanbaroDigital Payment Service Queue Workers API Client Storyplayer Payment Providers
58. @GanbaroDigital Payment Service MySQL Selenium Grid Firefox Queue Workers Payment Providers Outbound Proxy API Client
59. @GanbaroDigital Payment Service MySQL Selenium Grid Firefox Queue Workers Payment Providers Outbound Proxy API Client
60. @GanbaroDigital How do these tests help us ship faster?
61. @GanbaroDigital The Dev <-> Test Dance Ship Test Rework Needed Dev
62. @GanbaroDigital The Dev <-> Test Dance Ship Test Rework Needed Dev
63. @GanbaroDigital The Dev <-> Test Dance Ship Test Rework Needed Dev
64. @GanbaroDigital The Dev <-> Test Dance Ship Test Rework Needed Dev
65. @GanbaroDigital The Dev <-> Test Dance Ship Test Rework Needed Dev
66. @GanbaroDigital Reminds me of something else that spins round and around …
67. @GanbaroDigital
68. @GanbaroDigital Stop Dancing! Validate Ship Dev Next Item
69. @GanbaroDigital Stop Dancing! Validate Ship Dev Next Item
70. @GanbaroDigital Shipping Faster 1. Prove features work before you merge 2. Use features in the same way as your end-user 3. Iterate, iterate, iterate before you merge 4. Ship and move on to the next feature!
71. @GanbaroDigital Maintaining Velocity 1. Prove existing features haven’t been broken 2. Avoid “works on my laptop”
72. @GanbaroDigital Plot Twist! Just when it seemed that things were going well …
73. @GanbaroDigital Integrate here v2 v1 Live In Dev
74. @GanbaroDigital v2 v1 Live In Dev Integrate here
75. @GanbaroDigital Not a problem. With our growing test suite, we could prove that all of our work had been moved across after re-integration.
76. @GanbaroDigital v3 v1 Live In
 Dev Integrate here v2 In
 Beta
77. @GanbaroDigital v3 v1 Live In
 Dev Integrate here v2 Also
 Live Merge here
78. @GanbaroDigital v3 v1 Retire Go
 Live v2 Merge complete ☠ Retire ☠
79. @GanbaroDigital Test Environments Can Challenge Your Hardware
80. @GanbaroDigital Test your app somewhere that’s representative
81. @GanbaroDigital Representative 1. Comparable operating system 2. Comparable web server 3. Right version of PHP! 4. Comparable network restrictions
82. @GanbaroDigital Payment Service MySQL Selenium Grid Firefox Queue Workers Payment Providers Outbound Proxy API Client
83. @GanbaroDigital +
84. @GanbaroDigital https://flic.kr/p/gHsDC2
85. @GanbaroDigital Vagrant + Virtualbox 1. Slow to build on demand 2. Can’t run a full cluster locally 3. Inbound network connections are painful 4. Still causes host OS crashes at times
86. @GanbaroDigital Practically impossible to run a representative cluster for dev work
87. @GanbaroDigital Completely impossible to standup multiple versions at the same time
88. @GanbaroDigital
89. @GanbaroDigital Docker For Dev Environments 1. Very fast to build on demand 2. Can simulate multiple clusters locally 3. Inbound network connections are quick 4. Never had it cause a host OS crash
90. @GanbaroDigital Docker is now a viable option for dev environments
91. @GanbaroDigital Docker networks are your friend Run one network per version of your system
92. @GanbaroDigital storyplayer -t <test-env> Run the exact same tests against different test environments
93. @GanbaroDigital Test Environments • A list of host(s) in the environment • Hosts are tagged with one or more roles • Multiple hosts can have the same role(s) • Tests lookup hosts by role, not hostname
94. @GanbaroDigital Run Your Tests … • Locally • Against dev VMs • From your CI pipeline • And anywhere else you want to
95. @GanbaroDigital One last thing …
96. @GanbaroDigital Why did I want to give this talk?
97. @GanbaroDigital https://flic.kr/p/yTJb6b https://flic.kr/p/pETt7j
98. @GanbaroDigital Productive Developers … 1. Question everything, so that they can 2. … ship working code 3. … that’s fit for purpose 4. avoiding costly rework
99. @GanbaroDigital Representative testing is a workflow that can elevate your personal performance
100. @GanbaroDigital Storyplayer is the only PHP test tool built specifically for representative testing
101. @GanbaroDigital composer require-dev datasift/storyplayer
102. Would you like to 
 know more? We can help. Stuart Herbert ~ @stuherbert Founder @GanbaroDigital