Storyplayer

Bring your user and service stories to life through your tests.

Transcript

1. @ $story->player() Friday, 3 May 13
2. @ Bring Your Stories To Life Through Your Tests Friday, 3 May 13
3. @ Introduce Yourselves Friday, 3 May 13
4. @ @stuherbert Friday, 3 May 13
5. @ Testing I’m here to talk about Friday, 3 May 13
6. @ Don’t Switch Off Just Yet! Friday, 3 May 13
7. @ Storyplayer I’m here to launch Friday, 3 May 13
8. @ Storyplayer is a new open-source testing tool Friday, 3 May 13
9. @ Created by Friday, 3 May 13
10. @ built in Friday, 3 May 13
11. @ hosted on Friday, 3 May 13
12. @ to test this: We’ve built it Friday, 3 May 13
13. @ DataSift Technical Architecture Ultrahose Archiver push Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Node Shard push Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Node Shard ACL (with interaction counter) HttpStreaming, PuSH, Search Stream Recorder Monitoring Aggregator EDRs (licensed content metrics) Control Channels (D5) Hardware Load Balancer Ultrahose Archiver 100% Prism 100% Pickle Filtering Engine Twitter Facebook Wikipedia Reddit LexisNexis Meltwater Estimize Digg @lorenzoalberton DataSift Architecture 2.2 Links Resolution + OpenGraph + Twitter Cards + Metadata Deletes Processor Redis Input Streams NewsCred BoardReader MySpace SuperFeeder Augmentation Pipeline push Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Node Shard push Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Pickle Node Node Shard Monitoring Kafka Queue Events Storage ACL (with interaction counter) tracker Limit Manager Authentication Manager Notification Service WEB API Stream . Manager . DB Definition . Manager . DB CSDL Compiler, Validator, Normaliser Historics Scheduler Recording Scheduler Push Scheduler Interaction Targets Mapping Filtering Tardis Pickle Interaction Targets Mapping Filtering Tardis Pickle ... ... Hadoop Titan Historics Map/Reduce HBase Cluster Region 1 Region 2 Region N ... ... Data Node Data Node Data Node Data Node Data Node 100% 100% Stop PUB License Manager DB Billing Pipeline DB DB DB Mask Manager DB Connection Manager Time Machine + Insights Post-Processing, Stream Analytics jobs DB chunks DB chunk selector job tracker Worker Snapshotter Buffered Streams Redis Worker Worker Node Meteor Real-time Streams Node Node HTTP Request GET batch PUSH Scheduler subscription X subscription Y job queue PUSH Producer Subscriptions DB PUSH Delivery HTTP(S) POST (S)FTP Amazon S3 DynamoDB Microsoft Azure MongoDB Exports and Analytics WebSockets HTTPStreaming Delivery Subscriptions Connections Storage kafka-consumer Oracle Stream results CouchDB PickleDB . DB Audit Kafka Kafka Historical Queries @datasift Goblin Head Goblin Head Goblin Head Goblin Tail Goblin Tail Goblin Tail Interaction Generation Interaction Generation 3rd party APIs Demographics Trends Analysis Sentiment Analysis Named Entities Topics Analysis Language Detection Klout Score + Profile Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre Ogre IBM Cognos HDFS Archiver Data ingestion + Augmentation Bit.ly Stream Splitter/Joiner Deduper Msg splitter Google BigQuery Stream results Cloud Storage DBs BI tools Friday, 3 May 13
14. @ It Plugs A Gap In our testing strategy Friday, 3 May 13
15. @ Testing Strategy? What is our Friday, 3 May 13
16. @ Layered Approach Catch different problems using different tools Friday, 3 May 13
17. @ Common Test Approach Unit Tests Acceptance Tests Integration Tests Friday, 3 May 13
18. @ The Focus Of Each Layer Functions & Methods User Interfaces & APIs Services & Systems Friday, 3 May 13
19. @ The De Facto Standard Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Friday, 3 May 13
20. @ Popular Choices Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Behat PHPSpec Friday, 3 May 13
21. @ The Neglected Layer Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Behat PHPSpec ? Friday, 3 May 13
22. @ Services & Systems? How do we test Friday, 3 May 13
23. @ A Gap To Plug Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Behat PHPSpec Friday, 3 May 13
24. @ Where Storyplayer Fits In Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Behat PHPSpec Storyplayer Friday, 3 May 13
25. @ A Quick Tour of Storyplayer Friday, 3 May 13
26. @ Stories It’s all about Friday, 3 May 13
27. @ User Stories The things that your end-users can (and can’t!) do Friday, 3 May 13
28. @ Service Stories The things that your internal systems can do Friday, 3 May 13
29. @ Prose Friday, 3 May 13
30. @ $story = newStoryFor(); Friday, 3 May 13
31. @ Simple PHP Scripts We don’t define a new class for every story we want to test Friday, 3 May 13
32. @ Avoids the class AVeryLongAndInventiveClassname * 1000 problem! Friday, 3 May 13
33. @ Stories have up to 8 Phases Friday, 3 May 13
34. @ Creating The Test Conditions Test Environment Setup 1 Test Setup 2 Friday, 3 May 13
35. @ Before We Test Pre-Test Prediction 3 Pre-Test Inspection 4 Friday, 3 May 13
36. @ Perform The Story Steps Action 5 Friday, 3 May 13
37. @ Did Anything Happen? Post-Test Inspection 6 Friday, 3 May 13
38. @ Clean Up Afterwards Test Teardown 7 Test Environment Teardown 8 Friday, 3 May 13
39. @ Closure Each phase is a Friday, 3 May 13
40. @ $story->setTestEnvironmentSetup(function($st) { // story steps go here }); Friday, 3 May 13
41. @ the $st object All actions are done using Friday, 3 May 13
42. @ The $st object is a dynamic module loader Friday, 3 May 13
43. @ Brand new objects are instantiated every new action Friday, 3 May 13
44. @ This approach ensures no weird bugs in tests caused by re-using objects between actions Friday, 3 May 13
45. @ 3 kinds of action There are Friday, 3 May 13
46. @ $st->fromXXXX() Get the state of something Friday, 3 May 13
47. @ $st->expectsXXXX() Test the state of something Friday, 3 May 13
48. @ $st->usingXXXX() Change the state of something Friday, 3 May 13
49. @ $story->addAction(function($st) { $st->usingBrowser()->gotoPage(...); $st->usingBrowser()->waitForTitle(...); .... }); Friday, 3 May 13
50. @ $story->setPostTestInspection(function($st) { $st->usingBrowser()->gotoPage(...); $st->usingBrowser()->waitForTitle(...); $st->expectsBrowser() ->has() ->linkWithText(“My Account”); }); Friday, 3 May 13
51. @ 14 Modules Included Friday, 3 May 13
52. @ Vagrant Create test environments using Friday, 3 May 13
53. @ Using The Vagrant Module SP Vagrant VM V Vagrant VM Creates Friday, 3 May 13
54. @ Using The Vagrant Module Vagrant VM V SP Service Vagrant VM Deploys Friday, 3 May 13
55. @ Using The Vagrant Module Vagrant VM V SP Service Vagrant VM Tests SP Friday, 3 May 13
56. @ Using The Vagrant Module Vagrant VM V SP Service Vagrant VM Destroys Friday, 3 May 13
57. @ SavageD Monitor your VMs and processes using (Another DataSift tool we’re releasing tonight) Friday, 3 May 13
58. @ Using SavageD Vagrant VM V SP Vagrant VM Creates Friday, 3 May 13
59. @ Using SavageD Vagrant VM V SP Service Vagrant VM Deploys SavageD Friday, 3 May 13
60. @ Using SavageD Vagrant VM V SP Service Vagrant VM Tests SP SavageD Friday, 3 May 13
61. @ Using SavageD Vagrant VM V SP Service Vagrant VM Tests SP SavageD Monitors Friday, 3 May 13
62. @ Using SavageD Vagrant VM V SP Metrics Server Service Vagrant VM Tests SP Monitors statsd Graphite SavageD Reports To Friday, 3 May 13
63. @ Graphite Test your non-functional requirements with Friday, 3 May 13
64. @ Combined Testing Solution Vagrant VM V SP Metrics Server Service Vagrant VM Tests SP Monitors statsd Graphite SavageD Reports To Tests Metrics Friday, 3 May 13
65. @ Everything Should Log Metrics Vagrant VM V SP Metrics Server Vagrant VM Tests SP Monitors statsd Graphite SavageD Reports To Tests Metrics Service Friday, 3 May 13
66. @ Your Own Modules Extend Storyplayer with Friday, 3 May 13
67. @ Pull Requests Welcome :) Friday, 3 May 13
68. @ OS X and Linux Runs on Friday, 3 May 13
69. @ PEAR Installed via Friday, 3 May 13
70. @ (Composer doesn’t support installing packages system-wide yet) Friday, 3 May 13
71. @ datasift.github.io Docs available from (WIP!!) Friday, 3 May 13
72. @ Before You Go ... Friday, 3 May 13
73. @ This Model Is Incomplete Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Behat PHPSpec Storyplayer Friday, 3 May 13
74. @ ... getting better :) ... Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Storyplayer + Friday, 3 May 13
75. @ Storyplayer can test websites and APIs too! Friday, 3 May 13
76. @ Storyplayer doesn’t replace Behat et al Friday, 3 May 13
77. @ Behat moves back to doing what it does best Friday, 3 May 13
78. @ A Better Model Of Layered Testing Functions & Methods User Interfaces & APIs Services & Systems PHPUnit Storyplayer + Acceptance Behat PHPSpec + Friday, 3 May 13
79. @ Developers take responsibility for unit testing Friday, 3 May 13
80. @ Developers + Testers share responsibility for testing services & systems user interfaces & APIs Friday, 3 May 13
81. @ Product Owners take responsibility for acceptance testing Friday, 3 May 13
82. @ Storyplayer https://github.com/datasift/storyplayer/ available now! Friday, 3 May 13
83. @ Thank you PS: We’re hiring :-) Friday, 3 May 13