working together to achieve their goal.” “A group of people with a full set of complementary skills required to complete a task, job, or project.” “A team is a system of human relationships.” What is a team?
review, test strategy and plan preparation •Deliverables: test plan, test estimations Test Planning •Activities: test design, preparing testing environment, test cases execution (manual/automated) •Deliverables: test cases or scripts, test environment, test results Test Execution •Activities: documenting the testing results •Deliverables: bug report, test result report, metrics Test Reporting
to define expectations when you have defined processes. • Everyone in the team knows the rules. • A stable process can reduce risks and speed up work. • A defined process will help you hold people accountable and work well with others.
effective test cases? • How to prove that the requirements are covered by existing test cases? • How to keep test cases up to date? Test Design: Questions
expectations of most of the team • Setup process of requirements analysis – Definition of Ready – Product Backlog Grooming/Refinement – Walkthrough • Define tests format (check list, test cases, matrix…) • Define template for tests (attributes) Test Design: Suggestions
• Define process of tests review – Self-review (by the tester himself who has written the test cases) – Peer review (by another tester who hasn’t written those test cases) – Review by a supervisor (by the person who has great knowledge about the requirements and system under test): 3 amigos sessions, approve by Customer/PO • Define process of tests updating (between versions)
perform test execution in effective way? • How to manage a fairly long list of supported environments/browsers? • How not miss any important test? • How to understand that main parts of application were not broken by new features or fixes? • How to understand that the implemented feature meets PO expectation? Test Execution: Questions
Independent from DEV • Define how QA knows when and what should be tested – Notifications about new build • Define Smoke Test & Sanity Check – Automate Smoke Test – Integrate Smoke Test into CI/CD Test Execution: Suggestions
• Define and measure metrics for tracking tests execution and improving Test Strategy – Status of tests execution – Bugs per areas of product – Bugs per testing types – Declined Rate – Reopened Rate – Defect containment Test Execution: Suggestions
review bugs? • How not miss any important bug in a quite big product backlog? • How to understand the overall quality of the product? Bug Reporting: Questions
– Matrix of severity and priority • RCA (identify whether the defect was due to “testing miss”, “development miss” or was a “requirement or designs miss”) • Traceability: test cases are mapped with actual bug reports • Collect metrics and create JIRA dashboards for them • Define process of bugs prioritization – By QA team – Bug triage and prioritization sessions with Customers Bug Reporting: Suggestions
necessary? • What should be automated first? • How to avoid duplication of effort on both sides (automation and manual)? • How to measure effectiveness of TA? Automation: Questions
• Define points for Automation from following areas: - Smoke tests - Regression tests - Test data generation/preparation - Areas which are required big effort from Manual tester, but can be easily automated - Areas which are run every time • Have traceability between manual and automated testing to avoid test effort duplication Automation: Suggestions
tools (e.g. Report Portal) • Create a dashboard which reflects TA effectiveness: - Test Cases growth (the increment of automated test cases) - Product bugs (real bugs found during TA run) - Test Automation issues statistic (Passed, Failed, Skipped; Product Bug, System Issue, To Investigate, Automation Bugs) • Have a roadmap for Automation (based on priorities)
or Architectural scheme which includes 3rd party systems • Be in recipients list of Change logs related to 3rd party systems • Plan test activities based on their plans • E2E test which cover integration with 3rd party systems (it would be good if they are automated)
marymary
koukihosaka
techtekt
gogutan
yuuuuuuu168
satoshi7
ykanoh
namiki64
akhino
odashi
bitkey
greenmidori
shumei_ito
raygrieselhuber
codingconduct
tenderlove
sergeychernyshev
addyosmani
lara
427marketing
soysaucechin
danielanewman
.png){kind=avatar}
helenjbeal
keavy
seathinner
![[email protected], [email protected] THANK YOU!](https://files.speakerdeck.com/presentations/9f24502823374fc6856b4adba12c1a96/slide_36.jpg){kind=link}