Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Beginner's Guide to the Test Automation Galaxy

Angela Riggs
February 27, 2020

Beginner's Guide to the Test Automation Galaxy

TSQA 2020!

Angela Riggs

February 27, 2020
Tweet

More Decks by Angela Riggs

Other Decks in Technology

Transcript

  1. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    Centralized QAE QA Manager at Instrument
  2. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  3. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  4. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  5. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  6. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  7. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  8. @angelariggs_ TSQA | 2020 Embedded QAE QAE for multiple teams

    QA Manager at Instrument Centralized QAE
  9. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Value
  10. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Value
  11. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Value
  12. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Value
  13. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Value
  14. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Value
  15. @angelariggs_ TSQA | 2020 This talk isn’t intended to give

    you all the answers. It’s to help you understand the questions you need to ask, so you can find the answers that work for you.
  16. @angelariggs_ TSQA | 2020 How do I choose a framework?

    Who should write the tests? Should the tests run in our pipeline? What are some best practices? ❓
  17. @angelariggs_ TSQA | 2020 Prevent defects Maintain quality Meet users’

    needs Increase confidence Understand our product Why do we test?
  18. @angelariggs_ TSQA | 2020 Why do we automate? Run tests

    faster Better coverage Increase reliability Reusable / repeatable More frequent testing
  19. @angelariggs_ TSQA | 2020 Automation is not the goal. The

    goal is to have tests that enhance your ability to achieve and maintain quality.
  20. @angelariggs_ TSQA | 2020 UI workflows Avoids tedium of manual

    testing or “selective attention” mistakes
  21. @angelariggs_ TSQA | 2020 Use automation for low-risk work so

    you can focus on high-risk or high-priority functionality.
  22. @angelariggs_ TSQA | 2020 Business-critical workflows Validate the UIs that

    are high-impact, or fall under regulatory compliance
  23. @angelariggs_ TSQA | 2020 Catch regressions Sprint goals Prevent defects

    Team confidence Stakeholder confidence Benefits for buy-in
  24. @angelariggs_ TSQA | 2020 The goal of getting buy-in is

    to make sure your automation efforts are supported by the team and business, so you can build automation that supports them.
  25. @angelariggs_ TSQA | 2020 The test automation framework is made

    up of the tools and libraries that you use to write the tests, as well as execute, verify, and report on those tests. Angie Jones!
  26. @angelariggs_ TSQA | 2020 There is no framework to rule

    them all. The right tools are the ones that you’ll actually use.
  27. @angelariggs_ TSQA | 2020 Which tests to automate Getting buy-in

    Choosing a framework Writing your tests Running your tests Recap You are here.
  28. @angelariggs_ TSQA | 2020 The goal of automation is reliable,

    anti-fragile tests that are simple to maintain, update, and hand off.
  29. @angelariggs_ TSQA | 2020 Create reservation ✦ Enter location ✦

    Select dates ✦ Select unit ✦ Book vacation Modify reservation ✦ Look up reservation ✦ Select Edit option ✦ Change dates ✦ Confirm new dates
  30. @angelariggs_ TSQA | 2020 Create reservation ✦ Enter location ✦

    Select dates ✦ Select unit ✦ Book vacation Modify reservation ✦ Look up reservation ✦ Select Edit option ✦ Change dates ✦ Confirm new dates
  31. @angelariggs_ TSQA | 2020 Create reservation ✅ Enter location ✦

    Select dates ✦ Select unit ✦ Book vacation Modify reservation ✦ Look up reservation ✦ Select Edit option ✦ Change dates ✦ Confirm new dates
  32. @angelariggs_ TSQA | 2020 Create reservation ✅ Enter location ✅

    Select dates ✦ Select unit ✦ Book vacation Modify reservation ✦ Look up reservation ✦ Select Edit option ✦ Change dates ✦ Confirm new dates
  33. @angelariggs_ TSQA | 2020 Create reservation ✅ Enter location ✅

    Select dates ✅ Select unit ✦ Book vacation Modify reservation ✦ Look up reservation ✦ Select Edit option ✦ Change dates ✦ Confirm new dates
  34. @angelariggs_ TSQA | 2020 Create reservation ✅ Enter location ✅

    Select dates ✅ Select unit ❌ Book vacation Modify reservation ✦ Look up reservation ✦ Select Edit option ✦ Change dates ✦ Confirm new dates
  35. @angelariggs_ TSQA | 2020 Create reservation ✅ Enter location ✅

    Select dates ✅ Select unit ❌ Book vacation Modify reservation ❌ Look up reservation ❌ Select Edit option ❌ Change dates ❌ Confirm new dates
  36. @angelariggs_ TSQA | 2020 Minutes 0 1 2 3 4

    5 6 Test 1 Test 2 Test 3 Test 4 Test 5 Test 6
  37. @angelariggs_ TSQA | 2020 Minutes 0 1 2 3 4

    5 6 Process 1 Process 2 Test 1 Test 3 Test 5 Test 2 Test 4 Test 6
  38. @angelariggs_ TSQA | 2020 Parallel testing is faster testing, and

    allows you to scale your automation more effectively.
  39. @angelariggs_ TSQA | 2020 { Difficult to refactor } Lack

    of granularity → dependent tests Hard to read & maintain ❌
  40. @angelariggs_ TSQA | 2020 Refactored into granular tests ↑ Independence,

    ↓ flakiness Outline tests before writing ✅
  41. @angelariggs_ TSQA | 2020 Think of your tests as narrating

    your product’s functionality. You want short, declarative sentences rather than long stream-of-consciousness narration.
  42. @angelariggs_ TSQA | 2020 The goal of automation isn’t having

    tests that pass. The goal of automation is having tests that accurately catch failures.
  43. @angelariggs_ TSQA | 2020 Planning for failure means writing your

    tests in a way that make those failures useful.
  44. @angelariggs_ TSQA | 2020 Manual kick-off & reporting Scheduled runs

    during the day Integrated into a CI pipeline Running your tests
  45. @angelariggs_ TSQA | 2020 Someone is responsible for the tests

    Report gets reviewed & prioritized Failures don’t block the process Pros
  46. @angelariggs_ TSQA | 2020 Slower and less reliable
 Reduces visibility

    into the report Silos knowledge of the automation Cons
  47. @angelariggs_ TSQA | 2020 Having tests is better than not

    having tests. Pick a method, but be willing to iterate and adjust if something isn’t working.
  48. @angelariggs_ TSQA | 2020 How can you show that the

    work has been worth the effort?
  49. @angelariggs_ TSQA | 2020 Reduced number of regressions Speed up

    development time Team morale Client confidence Showing value
  50. @angelariggs_ TSQA | 2020 Test automation helps you mitigate risk,

    validate functionality, and prioritize your testing efforts.
  51. @angelariggs_ TSQA | 2020 Understand what questions to ask, so

    you can find the answers that work for you
  52. @angelariggs_ TSQA | 2020 Understand how to research frameworks, so

    you can find the one that meets your needs
  53. @angelariggs_ TSQA | 2020 Lucy Wyman & Zach Reichert Test

    Automation University Are Our Tests Any Good? http://bit.ly/are-our-tests-good Online automation courses http://bit.ly/test-automation-uni