台大資工所軟體工程企業訪談 - 從測試出發談 LINE 軟體開發流程

20221028 - 台大資工所軟體工程企業訪談
從測試出發談 LINE 軟體開發流程
講師： Richard Chang

Transcript

1. 台⼤資⼯所企業訪談 - QA Session Richard Chang 2022.10.28
2. About Me LINE TW QA Manager - 在QA領域打滾了20年的QA⼈，做過Ve ry Large Ent., SMB, Consumer, Incub ation, IoT, Set-top box hardware, OS kernel, Network application各式產品 - 負責過年營收3億美⾦的⼤產品，也做 過找不到客⼾的新創 - 做過千萬user-base的火紅產品，也做 過只有⼩貓兩三隻在⽤的客制專案 - 喝過無數的慶功宴，也搞砸過，不間斷 加班⼆個⽉收拾爛攤⼦ - 最引以為傲的是告訴親朋好友：你正在 使⽤的東⻄就是我們做的!!
3. 01 02 03 04 05 06 Contents QA Roles in LINE Working Model QA Activities in LINE QA Automation Life On LINE Q & A
4. Automation Engineer Service QA Test Engineer QA Roles in LINE
5. Test Engineer Working Model (1/3) v.s.
6. Test Engineer Working Model (2/3) v.s. Project Base – 常駐型QA QA Pool
7. Scrum 2-week sprint : • Planning (backlog force-ranking) • Daily (AC+DOD) • Security review • PBR (refinement) • Regression • Demo (review) • Release • Post-release issue review • Retrospective Working Model (3/3)
8. ※Source from︓ IBM System Science Institute Bug Fixing Cost
9. QA Activities in LINE (1/4) Design Stage • Clarify requirement/spec with planner/business owner(BO) • Discuss architecture/flow/API with Dev • Go through usability with Designer • Define data metric with planner • Come out acceptance criteria(AC) with Dev/planner • Create test plan/test mindmap
10. QA Activities in LINE (2/4) Implementation Stage • Create test cases & peer review • Prepare test data / fake date with MockServer • Discuss automation hooking points with Dev • Implement BDD automation script (Given-When-Then) • Implement load test script • Security review process • Every PR has to pass unit tests and SonarQube scan
11. QA Activities in LINE (3/4) Testing Stage • Feature manual test • Feature automation test • System load test • Code freeze control • RC regression • Exploratory test & Bug bash • E2E test & CUJ(critical user journey)
12. QA Activities in LINE (4/4) Release Management • Continuous Integration(CI): GibHub, Jenkins, Drone, Harbor • Continuous Deployment(CD): K8S, ArgoCD, manifest repo • Release checklist: Nginx routing rules, CDN config, Varnish cache, Redis, DB script, ...etc • Server healthy check • Real environment monitoring • Post-release defect review
13. QA Automation (1/2) CI / CD Jenkins / Kubernetes Tools MockServer / test data Feature Automation Load Test Healthy Check Real monitor
14. QA Automation (2/2)
15. Projects LINE TODAY LINE TRAVEL LINE SHOPPING LINE SPOT
16. Life ON LINE
17. WELCOME to JOIN US !!
19. THANK YOU