Automated UI Testing with Appium + Cucumber

Transcript

1. Automated UI Testing with Appium + Cucumber Marcio Klepacz iOS Engineering @ GetYourGuide CocoaHeads, Feb. 2016
3. Agenda • Problem • Solution • Appium • Fetching elements on screen • Creating a test case using Cucumber • Conclusion
4. Problem
5. Crashes & Bugs • We want to provide an amazing experience to our customers, crashes and bugs will not let that happen • If your app is a marketplace, or selling some product, each crash means loss of money
6. Crashes & Bugs +
7. –Compuware, 2013 “Users Have Low Tolerance For Buggy Apps – Only 16% Will Try A Failing App More Than Twice”
8. Solution (or at least how to prevent)
9. Tests (Mike Cohn - Succeeding with Agile ) UI Service Unit Tests
10. UI Automated Tests • Keep track of regressions • Detect different behaviours between OS versions • End-to-end
11. UI Automated Tests Solutions for iOS Multi Platform Work with iOS7 Big community Easy to record Xcode UI Tests Calabash Appium UIAutomation
13. Appium • Appium is an open source test automation framework for use with native, hybrid and mobile web apps. It drives iOS and Android apps using the WebDriver protocol. • Language agnostic • No need to modify the app • Easy to setup
14. Appium Architecture WebDriver UI Automation API Client Server Device/Simulator
15. Setting up Appium 1. Install Appium by cloning the repo, using npm or just download on the website $ git clone https://github.com/appium/appium 2. Generate .app or .ipa from a project $ xcodebuild build -workspace ‘Project.xcworkspace' DEPLOYMENT_LOCATION=YES DSTROOT=where/i/want/the/.app 3. Create a file with the desired capabilities $ echo ‘[caps] platformName = “ios" deviceName = "iPhone 6” platformVersion = “9.2” app = “Path/to/.app“‘ > appium.txt
16. Fetching elements on screen
17. Fetching Elements on Screen 1. Start Appium server $ node path/to/appium 2. Start a new session using the Appium Ruby Console (arc) $ arc
18. Fetching elements on the screen > page UIASearchBar name, label, value: Search GetYourGuide UIATableCell name, label: Main city UIAStaticText name, label, value: Rome … > find(‘Main City’) <Selenium::WebDriver::Element: 0x42d3a id="2">
19. Interacting with elements > find("Main City").click > find("Back").click > swipe(start_x: 100,start_y: 350, end_x: 200,end_y: 100,duration: 500) > find_elements(:xpath, '//UIATableView/ UIATableCell').first.click
20. Creating a test case using Cucumber
21. Cucumber • Cucumber is an open source framework for writing and executing high level descriptions of your software's functionality. • You define user story, not specifications. + Appium Ruby Client Cucumber Appium Server
22. Cucumber test scenario Feature: User is greeted upon login Scenario: User sign in Given the user “ccheads@getyourguide.com” has an account When he logs in Then should be able to see "Welcome CocoaHeads"
23. Cucumber / Defining Steps # ./step_definitions/steps.rb Given /^ the user "(.*?)" has an account$/ do |el_value| # Execute a command to setup our scenario end When /^he logs in$/ do # Execute command to tap the log in button end Then /^ should be able to see "(.*?)"$/ do |el_name| # Execute command that asserts that the element exists end
24. Cucumber + Appium # ./step_definitions/steps.rb Given /^ the user "(.*?)" has an account$/ do |el_value| wait { find(“Profile”).click } wait { button(“Log in or Sign up”).click } … end When /^he logs in$/ do wait { button(“Log in”).click } end Then /^ should be able to see "(.*?)"$/ do |el_name| wait do text_exists = exists { find(el_name) } expect(text_exists).to be true end end
25. Cucumber + Appium # ./env.rb require 'rspec/expectations' require 'appium_lib' require 'cucumber/ast' # Create a custom World class so we don't pollute `Object` with Appium methods class AppiumWorld end # Load the desired configuration from appium.txt, create a driver then # Add the methods to the world caps = Appium.load_appium_txt(file: File.expand_path('./', __FILE__), verbose: true) Appium::Driver.new(caps) Appium.promote_appium_methods(AppiumWorld) World { AppiumWorld.new } Before { $driver.start_driver } After { $driver.driver_quit }
26. Conclusion
27. Conclusion • Appium is easy to setup. You don’t have to modify your project and is language agnostic. • Cucumber gives you the possibility to write tests in a user stories form, with natural language • Combining Appium with Cucumber helps you keep track of regression, catch crashes & bugs, before going to production
29. Questions? @marciok marcio@getyourguide.com
30. References • http://appium.io/getting-started.html?lang=en • cucumber.io