QA to Improve Development Process - Expansion of Domain from QC to QA

Slide 1

Slide 1 text

No content

Slide 2

Slide 2 text

2012 : System Integrator Improve Legacy System - Test Automation - Ticket Management 2020/12 : LINE Fukuoka LINE Front-end Framework (LIFF) QA Engineer Hiroyuki Okuda LINE Fukuoka QA Engineering 1 Team

Slide 3

Slide 3 text

What is Quality Assurance?

Slide 4

Slide 4 text

QA ≠ Test

Slide 5

Slide 5 text

LINE QA

Slide 6

Slide 6 text

Agenda - Vision & Mission - Case Studies in Project - Learned from the Case Studies

Slide 7

Slide 7 text

History LINE Fukuoka Quality Organization 2014 10Project 2016 40Project 2019 100Project

Slide 8

Slide 8 text

History LINE Fukuoka Quality Organization 2014 10Project 2016 40Project 2019 100Project Service Test Center QA Engineering Dept. 2020

Slide 9

Slide 9 text

Vision & Mission Mission Service Test Center Mission QA Engineering Dept. Vision Improve the quality further and shorten the lead time by improving not only the product quality but also the project quality. Manage the entire test process during the development phase to ensure product quality efficiently Design Implementation Test Planning Establish the new quality assurance style of LINE to deliver services to users in the best conditions

Slide 10

Slide 10 text

Project Quality Design Implementation Test Planning Product Quality Internal Quality Process Quality - Software - Document - Code - Procedure Product Quality & Project Quality Influences Influences

Slide 11

Slide 11 text

Design Implementation Test Planning Project Quality Product Quality Quality Control(QC) Quality Assurance(QA) QA Activity Domain

Slide 12

Slide 12 text

Design Implementation Test Planning Rework Cost Product Quality Rework Cost Rework Cost Rework Cost Need to Expand Quality Activities - Many Initial Bugs

Slide 13

Slide 13 text

Design Implementation Test Planning Rework Cost Product Quality Rework Cost Rework Cost Rework Cost Need to Expand Quality Activities Influences - Few Initial Bugs Project Quality

Slide 14

Slide 14 text

Task QC QA Design Implementation Test Planning Test No Specific Task

Slide 15

Slide 15 text

Design Implementation Test Planning Project Quality Product Quality QC QA Summary Service Test Center QA Engineering Dept.

Slide 16

Slide 16 text

Agenda - Vision & Mission - Case Studies in Project - Learned from the Case Studies

Slide 17

Slide 17 text

Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test

Slide 18

Slide 18 text

Design Implementation Test Planning PM Server Side Developer Team Front End Developer Team Native App Developer Team QA Team - E2E Manual Test - E2E Automation Test Project Structure

Slide 19

Slide 19 text

Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test

Slide 20

Slide 20 text

Product Quality Goal AS IS No Product Quality Goal TO BE Set Product Quality Goal Rate of Bug by Release Bug Level Critical Major Minor - Change Failure Rate

Slide 21

Slide 21 text

Product Quality Goal AS IS No Product Quality Goal TO BE Set Product Quality Goal Rate of Bug by Release Bug Level Critical Major Minor - Change Failure Rate

Slide 22

Slide 22 text

Product Quality Goal Detailed Bug Level AS IS TO BE Bug Level Critical As soon as possible Major Modify as soon as necessary Minor Released in the next Bug Level Function A Function B Function C Critical Major Minor

Slide 23

Slide 23 text

Slide 24

Slide 24 text

Product Quality Goal Positive Effect Analysis Improvement - Review the bug level according to the bug level table - Analysis of the reasons for lowering the change failure rate - 33% of bugs occur with the same function - There is no regression test - Add regression test

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test

Slide 28

Slide 28 text

Optimization of Regression Test Situation Function List Manual Test Automation Test Enough? Duplicates?

Slide 29

Slide 29 text

Different Structure Function Function List Automation Test Manual Test Subcategory Function Category Subcategory Function AS IS Optimization of Regression Test Structural Review

Slide 30

Slide 30 text

Optimization of Regression Test AS IS TO BE Same Structure Structural Review Function Function List Automation Test Manual Test Category Subcategory Function Category Subcategory Function Same Structure Function Function List Automation Test Manual Test Subcategory Function Category Subcategory Function

Slide 31

Slide 31 text

Optimization of Regression Test Category Subcategory Function Function List Manual + Automation Test TO BE Same Structure Category Subcategory Function Type Automation Manual TO BE Same Table Structural Review Same Table Function Function List Automation Test Manual Test Category Subcategory Function Category Subcategory Function

Slide 32

Slide 32 text

Optimization of Regression Test Category Subcategory Function Function List Manual + Automation Test TO BE Same Table Category Subcategory Function Type Automation Manual Function List Manual + Automation Test TO BE Accessible Category Subcategory Function Type Category Subcategory Function Test URL Accessible Structural Review

Slide 33

Slide 33 text

Optimization of Regression Test Function List Manual + Automation Test TO BE Category Subcategory Function Type Automation Manual Category Subcategory Function Test URL Same Structure Structural Review Same Table Accessible

Slide 34

Slide 34 text

Optimization of Regression Test Removed Test Cases Bug Level Function A Function B Function C Critical Major Minor Function Pattern Function A Function B Function C Pattern 1 Pattern 2 Pattern 3 Pattern 4 Manual + Automation Test - Frequency - Impact Range

Slide 35

Slide 35 text

Case Studies in Project Product Quality Goal Test Planning in Parallel with Design Optimization of Regression Test

Slide 36

Slide 36 text

Design Implementation Test Plan Test Run Planning Design Implementation Test Run Planning 1 Test Planning in Parallel with Design 2 Review the Test Plan by All 3 Sharing E2E and Unit Test Test Plan 1 Just Before the Test Starts 2 Reviewed by Only Some Members 3 Not Sharing E2E and Unit Test Test Planning in Parallel with Design AS IS TO BE

Slide 37

Slide 37 text

AS IS TO BE 1 Test Planning in Parallel with Design 2 Review the Test Plan by All 3 Sharing E2E and Unit Test Test Plan 1 Just Before the Test Starts 2 Reviewed by Only Some Members 3 Not Sharing E2E and Unit Test Test Planning in Parallel with Design Design Implementation Test Plan Test Run Planning Design Implementation Test Run Planning

Slide 38

Slide 38 text

Agenda - Vision & Mission - Case Studies in a Project - Learned from the Case Studies

Slide 39

Slide 39 text

Challenge

Slide 40

Slide 40 text

I don't know what to do

Slide 41

Slide 41 text

Design Implementation Test Planning QA Team Project Structure QA Team Expectations from Project Mission QA Engineering Dept. Gap

Slide 42

Slide 42 text

Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test

Slide 43

Slide 43 text

Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test

Slide 44

Slide 44 text

Imagining Success Mission Start What I need to know Success - Participate in the design - Discuss testing with developers - Improve Project Quality - What design work is being done - What the developers are testing

Slide 45

Slide 45 text

Direction to Go

Slide 46

Slide 46 text

Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test

Slide 47

Slide 47 text

Design Implementation Test Planning Quality Challenge List Find and Refine Challenge - Find Challenge - Refine Challenge

Slide 48

Slide 48 text

Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test

Slide 49

Slide 49 text

Design Implementation Test Planning Quality Challenge List Improve Beyond the Test Optimization of Regression Test Test Planning in Parallel with Design Product Quality Goal

Slide 50

Slide 50 text

Improve Beyond the Test AS IS - No Product Quality Goal TO BE - Set Product Quality Goal Quality Challenge List - Think About Quality by All Project Situation - Set Project KPI Product Quality Goal

Slide 51

Slide 51 text

Design Implementation Test Planning Quality Challenge List Improve Beyond the Test Optimization of Regression Test Test Planning in Parallel with Design Product Quality Goal

Slide 52

Slide 52 text

AS IS - Just Before the Test Starts - Reviewed by Only Some Members - Not Sharing E2E and Unit Test TO BE - Test Planning in Parallel with Design - Review the Test Plan by All - Sharing E2E and Unit Test Quality Challenge List - Participate in the design - Discuss testing with developers Project Situation - Lack of Unit test Test Planning in Parallel with Design Improve Beyond the Test

Slide 53

Slide 53 text

Design Implementation Test Planning Quality Challenge List Improve Beyond the Test Project Situation Optimization of Regression Test Test Planning in Parallel with Design Product Quality Goal

Slide 54

Slide 54 text

I want to do × Team Problem Quality Challenge List Project Situation - Team Member’s Perspective Improve Beyond the Test

Slide 55

Slide 55 text

Steps to Achievements Imagining Success Find and Refine Challenge Improve Beyond the Test

Slide 56

Slide 56 text

Design Implementation Test Planning Project Quality Product Quality QC QA Summary Silo

Slide 57

Slide 57 text

Anxiety I don't know what to do Summary I don't know if the team will accept it Imagining Success Solve Team Problems Feature Another Person Uncertainty

Slide 58

Slide 58 text

Thank you