Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Automated UI Testing: Xamarin TestCloud & Calabash

Automated UI Testing: Xamarin TestCloud & Calabash

Xamarin's recently announced TestCloud provides amazing automation for UI testing in the cloud across the top mobile device hardware. Calabash is the core testing framework and you can use it locally today.

Presented at Interactive Developers of St. Louis. http://www.meetup.com/Interactive-Developers-of-St-Louis/

340d396deb6c4987147b061705edcb54?s=128

David Ortinau

May 30, 2013
Tweet

Transcript

  1. Automated UI Testing: Xamarin TestCloud & Calabash Friday, May 31,

    13
  2. David Ortinau @davidortinau http://davidortinau.com 17 yrs web, desktop, interactive, mobile.

    BA English, Maryville University Friday, May 31, 13
  3. Friday, May 31, 13

  4. Friday, May 31, 13

  5. Friday, May 31, 13

  6. Let’s Talk About • Xamarin TestCloud • Calabash • Demo

    Friday, May 31, 13
  7. += Friday, May 31, 13

  8. Xamarin TestCloud Upload any IPA or APK Provide test scripts

    or use Xamarin Explorer Connect with continuous integration systems Results include screenshots of every test, step through events, stack trace output Reports performance, memory usage Slow is a bug Friday, May 31, 13
  9. Friday, May 31, 13

  10. How will it scale? Friday, May 31, 13

  11. Friday, May 31, 13

  12. Friday, May 31, 13

  13. Calabash C# Calabash Android Calabash iOS Your App Calabash Server

    Calabash Clients Device, Emulator or Simulator Host computer High-level Architecture JSON over HTTP ............ Friday, May 31, 13
  14. Calabash Init • Ruby 1.9.3 and bundler • Recommend rvm

    or rbenv / ruby-build to manage Ruby and Gems • $ gem install calabash-cucumber • $ calabash-ios setup • $ calabash-ios gen • Add calabash.framework to your project directory and link it • XCode: -force_load "$(SRCROOT)/calabash.framework/calabash" -lstdc++ • Xamarin: -force_load $(ProjectDir)/calabash.framework/calabash -lstdc++ • $ bundle exec cucumber -p ios features/login.feature Friday, May 31, 13
  15. Test Architecture • Features • Step Definitions • Page Objects

    / Interfaces Friday, May 31, 13
  16. Login Feature Feature: Login Scenario: Login with valid user Given

    I am on the Login screen When I login as "Nat" Then I should go to the Assignments screen Scenario: Login with invalid user Given I am on the Login screen When I login as "Invalid" Then I should not be logged in And I should see a login error message Friday, May 31, 13
  17. Login Step Definition Given /^I am on the Login screen$/

    do await(LoginScreen) screenshot_embed(:label => 'Login') end When /^I login as "([^"]*)"$/ do |user_str| user = USERS[user_str.downcase.to_sym] login(:as => user) end Then /^I should go to the Assignments screen$/ do assert_screen(AssignmentsScreen) screenshot_embed(:label => 'Assignments') end https://github.com/calabash/calabash-ios/blob/master/calabash-cucumber/features/step_definitions/calabash_steps.rb Friday, May 31, 13
  18. Login Page require 'calabash-cucumber/ibase' class LoginScreen < Calabash::IBase def trait

    "button marked:'Log In'" end def login(user) tap "Username" await_keyboard keyboard_enter_text user[:email] done keyboard_enter_text user[:password] tap('Log In') wait_for_elements_do_not_exist(['activityIndicatorView']) assignments = page(AssignmentsScreen) begin assignments.await rescue self end end Friday, May 31, 13
  19. Friday, May 31, 13

  20. Calabash Console $ calabash-ios console irb> query(“button”) irb> query(“button marked:‘Active’”)

    irb> query(“button marked:‘Accept’”) irb> query(“button marked:‘Accept’”)[0] irb> record_begin irb> record_end “feature_name” Friday, May 31, 13
  21. Resources Friday, May 31, 13

  22. Resources • Xamarin Evolve Videos • Intro to Calabash: http://xamarin.com/evolve/2013#session-xcjpj20d6s

    • TestCloud: http://xamarin.com/evolve/2013#keynote-80:44 • Calabash • http://calaba.sh/ • iOS: https://github.com/calabash/calabash-ios • Android: https://github.com/calabash/calabash-android • https://github.com/aduggin/calabash-ios-tutorial • Field Service Example with Calabash Tests • https://github.com/calabash/field-service-example • Cucumber • http://cukes.info/ • http://pragprog.com/book/hwcuc/the-cucumber-book • Frank • http://www.testingwithfrank.com/ Friday, May 31, 13
  23. Thanks! @davidortinau http://davidortinau.com dave@davidortinau.com Friday, May 31, 13