台⼤資⼯所企業訪談 - QA Session Richard Chang 2022.10.28

About Me LINE TW QA Manager - 在QA領域打滾了20年的QA⼈，做過Ve ry Large Ent., SMB, Consumer, Incub ation, IoT, Set-top box hardware, OS kernel, Network application各式產品 - 負責過年營收3億美⾦的⼤產品，也做 過找不到客⼾的新創 - 做過千萬user-base的火紅產品，也做 過只有⼩貓兩三隻在⽤的客制專案 - 喝過無數的慶功宴，也搞砸過，不間斷 加班⼆個⽉收拾爛攤⼦ - 最引以為傲的是告訴親朋好友：你正在 使⽤的東⻄就是我們做的!!

01 02 03 04 05 06 Contents QA Roles in LINE Working Model QA Activities in LINE QA Automation Life On LINE Q & A

Automation Engineer Service QA Test Engineer QA Roles in LINE

Test Engineer Working Model (1/3) v.s.

Test Engineer Working Model (2/3) v.s. Project Base – 常駐型QA QA Pool

Scrum 2-week sprint : • Planning (backlog force-ranking) • Daily (AC+DOD) • Security review • PBR (refinement) • Regression • Demo (review) • Release • Post-release issue review • Retrospective Working Model (3/3)

※Source from︓ IBM System Science Institute Bug Fixing Cost

QA Activities in LINE (1/4) Design Stage • Clarify requirement/spec with planner/business owner(BO) • Discuss architecture/flow/API with Dev • Go through usability with Designer • Define data metric with planner • Come out acceptance criteria(AC) with Dev/planner • Create test plan/test mindmap

QA Activities in LINE (2/4) Implementation Stage • Create test cases & peer review • Prepare test data / fake date with MockServer • Discuss automation hooking points with Dev • Implement BDD automation script (Given-When-Then) • Implement load test script • Security review process • Every PR has to pass unit tests and SonarQube scan

QA Activities in LINE (3/4) Testing Stage • Feature manual test • Feature automation test • System load test • Code freeze control • RC regression • Exploratory test & Bug bash • E2E test & CUJ(critical user journey)

QA Activities in LINE (4/4) Release Management • Continuous Integration(CI): GibHub, Jenkins, Drone, Harbor • Continuous Deployment(CD): K8S, ArgoCD, manifest repo • Release checklist: Nginx routing rules, CDN config, Varnish cache, Redis, DB script, ...etc • Server healthy check • Real environment monitoring • Post-release defect review

QA Automation (1/2) CI / CD Jenkins / Kubernetes Tools MockServer / test data Feature Automation Load Test Healthy Check Real monitor

QA Automation (2/2)

Projects LINE TODAY LINE TRAVEL LINE SHOPPING LINE SPOT

Life ON LINE

WELCOME to JOIN US !!

No content

THANK YOU