Appium vs Calabash on Native Mobile

A comparison and sample tests using Appium and Calabash, the two front-runners of the mobile app test automation world.

Transcript

1. Appium vs Calabash on Native Mobile Melanie Shafer
2. Why Appium/Calabash? • Open source • Support Android and iOS • Device cloud testing ($)
3. Appium - screens - home_screen.py - login_screen.py - login_tests.py Project hierarchy, login test - using screen objects Calabash - calabash.framework - features - screens - home_screen.rb - login_screen.rb - step_definitions - account_steps.rb - login.feature
4. Appium Login test - screen object classes Calabash
5. Appium Login test - unittest vs step definition Calabash
6. Login test - cucumber feature file Calabash
7. Login test in action!
8. Login test - Calabash results Feature: Login Scenario: Login with an existing account # features/login.feature:3 5368 KB/s (566958 bytes in 0.103s) 7291 KB/s (23320988 bytes in 3.123s) Given I login with credentials “mel-test”/“testtest” # features/step_definitions/calabash_steps.rb:5 Then I see the text "Featured" # calabash-android-0.5.14/lib/calabash-android/steps/assert_steps.rb:1 Then I click the navigation menu # features/step_definitions/calabash_steps.rb:12 And I see the text "Recently Watched" # calabash-android-0.5.14/lib/calabash-android/steps/assert_steps.rb:1 Success 1 scenario (1 passed) 4 steps (4 passed) 0m47.430s
9. Login test - Appium results test_login (__main__.SmokeTests) ... DEBUG:ANDROID:Waiting for element (('id', 'home_activity_container')) to become visible. DEBUG:ANDROID:Waiting for element (('id', 'content')) to become visible. DEBUG:ANDROID:Waiting for element (('id', 'home_activity_container')) to become visible. DEBUG:ANDROID:Waiting for element (('id', 'home_app_bar_layout')) to become visible. DEBUG:ANDROID:Opening navigation drawer. DEBUG:ANDROID:Waiting for element (('id', 'Navigate up')) to become visible. DEBUG:ANDROID:Tapping element (android.widget.ImageButton). ... DEBUG:ANDROID:Waiting for element (('id', 'Navigation Options')) to become visible. ok ---------------------------------------------------------------------- Ran 1 test in 78.325s OK
10. Appium - Already using WebDriver for desktop - Language flexibility - More active users/documentation Which is best for me? Calabash - Non-tech folks can write feature files - Write tests quickly, no code - Android/iOS can share feature files
11. Thanks! Any questions? Email: mshafer@dramafever.com