20210731 - What Does QA Do in LINE?

LINE Sponsor Booth QA team session by Richard Cheng @ COSCUP 2021
Event page: https://coscup.org/2021/zh-TW/venue

Transcript

1. What Does QA Do in LINE? Richard Chang 2021.07.31
2. About Me LINE TW QA Manager - 在QA領域打滾了20年的QA⼈，總是以 產品品質為⼰任 - 負責過年營收3億美⾦的⼤產品，也做 過找不到客⼾的新創 - 做過千萬user-base的火紅產品，也做 過只有⼩貓兩三隻在⽤的客制專案 - 喝過無數的慶功宴，也搞砸過，不間斷 加班⼆個⽉收拾爛攤⼦ - 最引以為傲的是告訴親朋好友：你正在 使⽤的東⻄就是我們做的!!
3. 01 02 03 04 05 06 Contents QA Roles in LINE Working Model QA Activities in LINE QA Automation Life On LINE Q & A
4. Automation Engineer Service QA Test Engineer QA Roles in LINE
5. Test Engineer Working Model (1/3) v.s.
6. Test Engineer Working Model (2/3) v.s. Project Base – 常駐型QA QA Pool
7. Scrum 2-week sprint : • Planning (backlog force-ranking) • Daily (AC+DOD) • Security review • PBR (refinement) • Regression • Demo (review) • Release • Post-release issue review • Retrospective Working Model (3/3)
8. ※Source from︓ IBM System Science Institute Bug Fixing Cost
9. QA Activities in LINE (1/4) Design Stage • Clarify requirement/spec with planner/business owner(BO) • Discuss architecture/flow/API with Dev • Go through usability with Designer • Define data metric with planner • Come out acceptance criteria(AC) with Dev/planner • Create test plan/test mindmap
10. QA Activities in LINE (2/4) Implementation Stage • Create test cases & peer review • Prepare test data / fake date with MockServer • Discuss automation hooking points with Dev • Implement BDD automation script (Given-When-Then) • Implement load test script • Security review process • Every PR has to pass unit tests and SonarQube scan
11. QA Activities in LINE (3/4) Testing Stage • Feature manual test • Feature automation test • System load test • Code freeze control • RC regression • Exploratory test & Bug bash • E2E test & CUJ(critical user journey)
12. QA Activities in LINE (4/4) Release Management • Continuous Integration(CI): GibHub, Jenkins, Drone, Harbor • Continuous Deployment(CD): K8S, ArgoCD, manifest repo • Release checklist: Nginx routing rules, CDN config, Varnish cache, Redis, DB script, ...etc • Server healthy check • Real environment monitoring • Post-release defect review
13. QA Automation (1/2) CI / CD Jenkins / Kubernetes Tools MockServer / test data Feature Automation Load Test Healthy Check Real monitor
14. QA Automation (2/2)
15. Projects LINE TODAY LINE Travel LINE SHOPPING LINE SPOT
16. Life ON LINE
17. WELCOME to JOIN US !!
19. THANK YOU