QA to Improve Development Process - Expansion of Domain from QC to QA

Hiroyuki Okuda
LINE Fukuoka / QA Engineering 1 Team / QA Engineer

https://linedevday.linecorp.com/2021/ja/sessions/109
https://linedevday.linecorp.com/2021/en/sessions/109
https://linedevday.linecorp.com/2021/ko/sessions/109

Transcript

2. 2012 : System Integrator Improve Legacy System - Test Automation - Ticket Management 2020/12 : LINE Fukuoka LINE Front-end Framework (LIFF) QA Engineer Hiroyuki Okuda LINE Fukuoka QA Engineering 1 Team
3. What is Quality Assurance?
4. QA ≠ Test
5. LINE QA
6. Agenda - Vision & Mission - Case Studies in Project - Learned from the Case Studies
7. History LINE Fukuoka Quality Organization 2014 10Project 2016 40Project 2019 100Project
8. History LINE Fukuoka Quality Organization 2014 10Project 2016 40Project 2019 100Project Service Test Center QA Engineering Dept. 2020
9. Vision & Mission Mission Service Test Center Mission QA Engineering Dept. Vision Improve the quality further and shorten the lead time by improving not only the product quality but also the project quality. Manage the entire test process during the development phase to ensure product quality efficiently Design Implementation Test Planning Establish the new quality assurance style of LINE to deliver services to users in the best conditions
10. Project Quality Design Implementation Test Planning Product Quality Internal Quality Process Quality - Software - Document - Code - Procedure Product Quality & Project Quality Influences Influences
11. Design Implementation Test Planning Project Quality Product Quality Quality Control(QC) Quality Assurance(QA) QA Activity Domain
12. Design Implementation Test Planning Rework Cost Product Quality Rework Cost Rework Cost Rework Cost Need to Expand Quality Activities - Many Initial Bugs
13. Design Implementation Test Planning Rework Cost Product Quality Rework Cost Rework Cost Rework Cost Need to Expand Quality Activities Influences - Few Initial Bugs Project Quality
14. Task QC QA Design Implementation Test Planning Test No Specific Task
15. Design Implementation Test Planning Project Quality Product Quality QC QA Summary Service Test Center QA Engineering Dept.
16. Agenda - Vision & Mission - Case Studies in Project - Learned from the Case Studies
17. Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test
18. Design Implementation Test Planning PM Server Side Developer Team Front End Developer Team Native App Developer Team QA Team - E2E Manual Test - E2E Automation Test Project Structure
19. Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test
20. Product Quality Goal AS IS No Product Quality Goal TO BE Set Product Quality Goal Rate of Bug by Release Bug Level Critical Major Minor - Change Failure Rate
21. Product Quality Goal AS IS No Product Quality Goal TO BE Set Product Quality Goal Rate of Bug by Release Bug Level Critical Major Minor - Change Failure Rate
22. Product Quality Goal Detailed Bug Level AS IS TO BE Bug Level Critical As soon as possible Major Modify as soon as necessary Minor Released in the next Bug Level Function A Function B Function C Critical Major Minor
23. Product Quality Goal Detailed Bug Level AS IS TO BE Bug Level Critical As soon as possible Major Modify as soon as necessary Minor Released in the next Bug Level Function A Function B Function C Critical Major Minor - Frequency - Impact Range
24. Product Quality Goal Positive Effect Analysis Improvement - Review the bug level according to the bug level table - Analysis of the reasons for lowering the change failure rate - 33% of bugs occur with the same function - There is no regression test - Add regression test
25. Product Quality Goal Positive Effect Analysis Improvement - Review the bug level according to the bug level table - Analysis of the reasons for lowering the change failure rate - 33% of bugs occur with the same function - There is no regression test - Add regression test
26. Product Quality Goal Positive Effect Analysis Improvement - Review the bug level according to the bug level table - Analysis of the reasons for lowering the change failure rate - 33% of bugs occur with the same function - There is no regression test - Add regression test
27. Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test
28. Optimization of Regression Test Situation Function List Manual Test Automation Test Enough? Duplicates?
29. Different Structure Function Function List Automation Test Manual Test Subcategory Function Category Subcategory Function AS IS Optimization of Regression Test Structural Review
30. Optimization of Regression Test AS IS TO BE Same Structure Structural Review Function Function List Automation Test Manual Test Category Subcategory Function Category Subcategory Function Same Structure Function Function List Automation Test Manual Test Subcategory Function Category Subcategory Function
31. Optimization of Regression Test Category Subcategory Function Function List Manual + Automation Test TO BE Same Structure Category Subcategory Function Type Automation Manual TO BE Same Table Structural Review Same Table Function Function List Automation Test Manual Test Category Subcategory Function Category Subcategory Function
32. Optimization of Regression Test Category Subcategory Function Function List Manual + Automation Test TO BE Same Table Category Subcategory Function Type Automation Manual Function List Manual + Automation Test TO BE Accessible Category Subcategory Function Type Category Subcategory Function Test URL Accessible Structural Review
33. Optimization of Regression Test Function List Manual + Automation Test TO BE Category Subcategory Function Type Automation Manual Category Subcategory Function Test URL Same Structure Structural Review Same Table Accessible
34. Optimization of Regression Test Removed Test Cases Bug Level Function A Function B Function C Critical Major Minor Function Pattern Function A Function B Function C Pattern 1 Pattern 2 Pattern 3 Pattern 4 Manual + Automation Test - Frequency - Impact Range
35. Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test
36. Design Implementation Test Plan Test Run Planning Design Implementation Test Run Planning 1 Test Planning in Parallel with Design 2 Review the Test Plan by All 3 Sharing E2E and Unit Test Test Plan 1 Just Before the Test Starts 2 Reviewed by Only Some Members 3 Not Sharing E2E and Unit Test Test Planning in Parallel with Design AS IS TO BE
37. AS IS TO BE 1 Test Planning in Parallel with Design 2 Review the Test Plan by All 3 Sharing E2E and Unit Test Test Plan 1 Just Before the Test Starts 2 Reviewed by Only Some Members 3 Not Sharing E2E and Unit Test Test Planning in Parallel with Design Design Implementation Test Plan Test Run Planning Design Implementation Test Run Planning
38. Agenda - Vision & Mission - Case Studies in a Project - Learned from the Case Studies
39. Challenge
40. I don't know what to do
41. Design Implementation Test Planning QA Team Project Structure QA Team Expectations from Project Mission QA Engineering Dept. Gap
42. Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test
43. Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test
44. Imagining Success Mission Start What I need to know Success - Participate in the design - Discuss testing with developers - Improve Project Quality - What design work is being done - What the developers are testing
45. Direction to Go
46. Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test
47. Design Implementation Test Planning Quality Challenge List Find and Refine Challenge - Find Challenge - Refine Challenge
48. Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test
49. Design Implementation Test Planning Quality Challenge List Improve Beyond the Test Optimization of Regression Test Test Planning in Parallel with Design Product Quality Goal
50. Improve Beyond the Test AS IS - No Product Quality Goal TO BE - Set Product Quality Goal Quality Challenge List - Think About Quality by All Project Situation - Set Project KPI Product Quality Goal
51. Design Implementation Test Planning Quality Challenge List Improve Beyond the Test Optimization of Regression Test Test Planning in Parallel with Design Product Quality Goal
52. AS IS - Just Before the Test Starts - Reviewed by Only Some Members - Not Sharing E2E and Unit Test TO BE - Test Planning in Parallel with Design - Review the Test Plan by All - Sharing E2E and Unit Test Quality Challenge List - Participate in the design - Discuss testing with developers Project Situation - Lack of Unit test Test Planning in Parallel with Design Improve Beyond the Test
53. Design Implementation Test Planning Quality Challenge List Improve Beyond the Test Project Situation Optimization of Regression Test Test Planning in Parallel with Design Product Quality Goal
54. I want to do × Team Problem Quality Challenge List Project Situation - Team Member’s Perspective Improve Beyond the Test
55. Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test
56. Design Implementation Test Planning Project Quality Product Quality QC QA Summary Silo
57. Anxiety I don't know what to do Summary I don't know if the team will accept it Imagining Success Solve Team Problems Feature Another Person Uncertainty
58. Thank you