BDD and SauceLabs Integration: PHP and Ruby

Originally: "Still Testing Your Software with Computers?" Presented at the DC Selenium and DCAST Meetups. Discusses BDD cross browser testing with integration to SauceLabs.

Transcript

1. Still Testing Your Software with Computers? Using Sauce Labs to Automate Cross Browser Testing. Thursday, July 18, 13
2. Does this sound familiar? 5 Thursday, July 18, 13
3. Thursday, July 18, 13
4. The most amazing app ever. Thursday, July 18, 13
5. Features: Thursday, July 18, 13
6. Features: ✓ Web 3.0 Javascript Hotness! Thursday, July 18, 13
7. Features: ✓ Web 3.0 Javascript Hotness! ✓ Responsive Lean Super Duper! Thursday, July 18, 13
8. Features: ✓ Web 3.0 Javascript Hotness! ✓ Responsive Lean Super Duper! ✓ Ultra Cloud Social Scaling! Thursday, July 18, 13
9. It Looks Great!* Thursday, July 18, 13
10. It Looks Great!* *In Chrome... Thursday, July 18, 13
11. It Works!* Thursday, July 18, 13
12. It Works!* *On my machine... Thursday, July 18, 13
13. ? What do we do Thursday, July 18, 13
14. QA Thursday, July 18, 13
15. Thursday, July 18, 13
16. Firefox Thursday, July 18, 13
17. Firefox Looks a little different... Thursday, July 18, 13
18. Opera Thursday, July 18, 13
19. Opera This is a little strange... Thursday, July 18, 13
20. IE Thursday, July 18, 13
21. IE Something is terribly wrong... Thursday, July 18, 13
22. IE Something is terribly wrong... (I mean older IE) Thursday, July 18, 13
23. ? Don’t we have a testing computer Thursday, July 18, 13
24. Thursday, July 18, 13
25. “Yes, but Kyle is using it.” Thursday, July 18, 13
26. “Yes, but Kyle is using it.” “It has IE 9 on it and I need IE 8.” Thursday, July 18, 13
27. ? Maybe some virtual machines Thursday, July 18, 13
28. “How many windows licenses?” Thursday, July 18, 13
29. “How many windows licenses?” “It’s taking a long time to test...” Thursday, July 18, 13
30. ? There’s got to be a better way right Thursday, July 18, 13
31. Jason Fox Thursday, July 18, 13
32. Jason Fox Never Stop Building Thursday, July 18, 13
33. Jason Fox @jasonrobertfox Never Stop Building Thursday, July 18, 13
34. We have a problem. Thursday, July 18, 13
35. We have a problem. TESTING PYRAMID Thursday, July 18, 13
36. We have a problem. TESTING PYRAMID Manual Testing Thursday, July 18, 13
37. TESTING PYRAMID Thursday, July 18, 13
38. TESTING PYRAMID Too Much Manual Testing Thursday, July 18, 13
39. We are robots! TESTING PYRAMID Too Much Manual Testing Thursday, July 18, 13
40. This is expensive. $ Thursday, July 18, 13
41. This is expensive. $ Å Å Å Thursday, July 18, 13
42. This is expensive. $ c c c c c c Å Å Å Thursday, July 18, 13
43. We forget things. Thursday, July 18, 13
44. We forget things. What do we have to do each time we test? Thursday, July 18, 13
45. Behavior Driven Development. Thursday, July 18, 13
46. Behavior Driven Development. Half the Solution... Thursday, July 18, 13
47. Specify your requirements in a common language. Thursday, July 18, 13
48. Thursday, July 18, 13
49. Given the business writes features in Gherkin, Thursday, July 18, 13
50. Given the business writes features in Gherkin, When we build the features, Thursday, July 18, 13
51. Given the business writes features in Gherkin, When we build the features, Then we can develop automated acceptance tests. Thursday, July 18, 13
52. Use Cucumber with Ruby Thursday, July 18, 13
53. Use Behat with PHP Thursday, July 18, 13
54. Thursday, July 18, 13
55. Given I’ve implemented automated acceptance tests, Thursday, July 18, 13
56. Given I’ve implemented automated acceptance tests, When I run them with Selenium, Thursday, July 18, 13
57. Given I’ve implemented automated acceptance tests, When I run them with Selenium, Then I should see the expected behavior in my local browser. Thursday, July 18, 13
58. Local in-browser testing is slow. Thursday, July 18, 13
59. Universal browser support requires setup. Local in-browser testing is slow. Thursday, July 18, 13
60. Universal browser support requires setup. Local in-browser testing is slow. Specific configurations are required. Thursday, July 18, 13
61. Thursday, July 18, 13
62. Given I have configured my tests to run in a PhantomJS browser, Thursday, July 18, 13
63. Given I have configured my tests to run in a PhantomJS browser, When I run the tests, Thursday, July 18, 13
64. Given I have configured my tests to run in a PhantomJS browser, When I run the tests, Then they should execute significantly faster. Thursday, July 18, 13
65. We are getting there... Thursday, July 18, 13
66. PhantomJS remains a webkit browser. We are getting there... Thursday, July 18, 13
67. PhantomJS remains a webkit browser. We are getting there... Not all browsers covered! Thursday, July 18, 13
68. Sauce Labs! Thursday, July 18, 13
69. Sauce Labs! The Rest of the Solution! Thursday, July 18, 13
70. Disclaimer: I am not a salesman for Sauce Labs. Thursday, July 18, 13
71. In any browser. Run your acceptance tests: Thursday, July 18, 13
72. With video reports. Run your acceptance tests: Thursday, July 18, 13
73. In parallel. Run your acceptance tests: Thursday, July 18, 13
74. In the cloud. Run your acceptance tests: Thursday, July 18, 13
75. AWESOME Thursday, July 18, 13
76. AWESOME (More like “Saucesome”) Thursday, July 18, 13
77. Let’s build something in... Thursday, July 18, 13
78. Let’s build something in... PHP! Thursday, July 18, 13
79. User Story #1: Thursday, July 18, 13
80. In order to learn about the worlds buildings, User Story #1: Thursday, July 18, 13
81. In order to learn about the worlds buildings, As an architecture geek, User Story #1: Thursday, July 18, 13
82. In order to learn about the worlds buildings, As an architecture geek, I want to view basic building dimensions. User Story #1: Thursday, July 18, 13
83. #dimensions.feature Feature:  Show  a  building's  dimensions  to  the  user    In  order  to  learn  about  the  worlds  buildings    As  an  architecture  geek    I  want  to  view  basic  building  dimensions    Scenario:  I  can  see  available  buildings        Given  I  am  on  homepage        Then  I  should  see  "Freedom  Tower"        And  I  should  see  "Burj  Khalifa"    Scenario:  I  can  view  a  building's  top  floor        Given  I  am  on  homepage        And  I  follow  "Freedom  Tower"        Then  I  should  see  "Freedom  Tower"        And  I  should  not  see  "Burj  Khalifa"        And  I  should  see  "Top  Floor:  1268  ft" Thursday, July 18, 13
84. /**  *  Features  context.  */ class  FeatureContext  extends  MinkContext {        /**          *  Initializes  context.          *  Every  scenario  gets  it's  own  context  object.          *          *  @param  array  $parameters  context  parameters  (set  them  up  through   behat.yml)          */        public  function  __construct(array  $parameters)        {                $this-­‐>parameters  =  $parameters;        } } Thursday, July 18, 13
85. sauce:    filters:        #This  is  only  running  specific  features  for  the   purposes  of  the  demo        tags:  "@demo1"    extensions:        Behat\MinkExtension\Extension:            selenium2:                wd_host:  username:api_key@ondemand.saucelabs.com/ wd/hub                capabilities:  {  "browser":  "googlechrome",   "platform":  "OS  X  10.6",  "name":  "Behat  PHP  Demo"  } Thursday, July 18, 13
86. Let’s build something in... Thursday, July 18, 13
87. Let’s build something in... Ruby! Thursday, July 18, 13
88. User Story #2: Thursday, July 18, 13
89. In order to understand the dimensions of a building, User Story #2: Thursday, July 18, 13
90. In order to understand the dimensions of a building, As metric system user, User Story #2: Thursday, July 18, 13
91. In order to understand the dimensions of a building, As metric system user, I want to toggle between dimension systems. User Story #2: Thursday, July 18, 13
92. #metric.feature Feature:  Toggle  between  standard  and  metric  system    In  order  to  understand  the  dimensions  of  a  building    As  a  metric  system  user    I  want  to  toggle  between  dimension  systems    @demo2    Scenario:  There  is  a  toggle  button        Given  I  am  on  "/building/freedom-­‐tower"        Then  I  should  see  "Switch  to  Metric"    @demo2  @selenium    Scenario:  Clicking  on  the  toggle  button  will  switch  dimensions        Given  I  am  on  "/building/freedom-­‐tower"        When  I  follow  "Switch  to  Metric"        Then  I  should  see  "Top  Floor:  386.4864  m"        And  I  should  see  "Tip:  541.3248  m" Thursday, July 18, 13
93. Then(/^I  should  see  "(.*?)"$/)  do  |text|    page.should  have_content(text) end Given(/^I  follow  "(.*?)"$/)  do  |link|    click_link(link) end Thursday, July 18, 13
94. Capybara.default_driver  =  :poltergeist Capybara.app_host  =  'http://localhost:4567/' World(Capybara) Sauce.config  do  |c|    c[:start_tunnel]  =  true    c.browsers  =  [        ["OS  X  10.6","CHROME","26"],        ["Windows  7","IE","7"],        ["Windows  7","Firefox","18"],        ["Windows  7","Opera","11"]    ] end Thursday, July 18, 13
95. ? What about Java Thursday, July 18, 13
96. Use Cucumber-JVM with Java Thursday, July 18, 13
97. package  cucumber.examples.java.websockets; import  cucumber.api.java.en.Given; import  org.openqa.selenium.WebDriver; public  class  NavigationStepdefs  {        private  final  WebDriver  webDriver;        public  NavigationStepdefs(SharedDriver  webDriver)  {                this.webDriver  =  webDriver;        }        @Given("^I  am  on  the  front  page$")        public  void  i_am_on_the_front_page()  {                webDriver.get("http://localhost:"  +  ServerHooks.PORT);        } } Thursday, July 18, 13
98. Adoption Thursday, July 18, 13
99. Adoption Living the solution. Thursday, July 18, 13
100. Write good javascript. Sauce won’t: Thursday, July 18, 13
101. Write cross browser css. Sauce won’t: Thursday, July 18, 13
102. Write your unit tests! Sauce won’t: Thursday, July 18, 13
103. TESTING PYRAMID Thursday, July 18, 13