LINE Dev Meetup 16 - QA team

QA Engineering in LINE by Hsiao, Yi-Han @ LINE Developers Meetup 16

Event: https://linegroup.kktix.cc/events/20220324

Transcript

1. QA Engineering in LINE Hsiao, Yi-Han
2. Hsiao, Yi-Han TECH FRESH | LINE TW QA ▸ TECH FRESH ▸ LINE Taiwan（QA3 - SHOPPING） ▸ Automation Engineer ▸ NTU ESOE / Major in CS ▸ Computer Vision / C++, Python, JavaScript ▸ Photography / Guitar / Volleyball
3. 大標題Title 副標題subtitle QA is ”only” testing? Actually it’s a complicated job.
4. Agenda ▸ QA Roles in LINE ▸ Working Model ▸ QA Works in LINE ▸ As an QA TECH FRESH in LINE SHOPPING ▸ LINE SHOPPING & LINE Services
5. ※Image Source from︓https://www.flaticon.com/free-icon When QA in a team… QA Issue Tracking Sign Off Release Dev PM Feature Specs Discuss
6. When QA in a team… Dev PM Feature Specs Discuss Issue Tracking Sign Off Release ※Image Source from︓https://www.flaticon.com/free-icon Test Cases Service QA Automation Engineer Test Engineer Sign Off Release Communicate Communicate Automation Tools Issue Tracking Issue Tracking
7. When QA in a team… Dev PM Feature Specs Discuss Issue Tracking Sign Off Release ※Image Source from︓https://www.flaticon.com/free-icon Test Cases Service QA Automation Engineer Test Engineer Sign Off Release Communicate Communicate Automation Tools Issue Tracking
8. Working Model - #1/2 Project Base QA Pool ※Image Source from︓https://www.flaticon.com/free-icon
9. Working Model - #2/2 Scrum Feature Test Regression Test Exploratory Test Release Sanity Test / Health Check / Monitor Demo Refinement Post-Release Issue Review Release Planning Daily Retrospective Code Freeze ※Image Source from︓https://www.activestate.com/blog/activestate-2020-state-of-enterprise-ci-cd-survey/
10. Design Stage Implementation Stage Testing Stage Release Management QA Works in LINE
11. Design Stage QA Works in LINE - #1/4 #1 Clarify the requirement/spec with PM/Business owner #2 Discuss architecture/flow/API with Dev #3 Define data metric with people #4 Come out AC with Dev/PM #5 Create test plan and test mind-map
12. Implementation Stage QA Works in LINE - #2/4 #1 Create test cases and peer review #2 Prepare test data/fake data with Mock Server #3 Discuss automation hooking points with Dev #4 Implement BDD automation script (Given-When-Then) #5 Implement performance test script #6 Security review process #7 Every PR has to pass unit test and static code scan
13. Testing Stage QA Works in LINE - #3/4 #1 Feature manual test/automation test #2 System load test #3 Code freeze control #4 Staging regression #5 Exploratory test & Bug bash #6 E2E test & CUJ (Critical user journey) #7 Performance Test (Load test/Stress test/Spike test)
14. Release Management QA Works in LINE - #4/4 #1 Continuous Integration (CI): Github / Jenkins / Drone / Harbor #2 Continuous Deployment (CD): K8s / ArgoCD / Manifest Repo #3 Release Checklist #4 Server health check #5 Production environment monitoring
15. QA Automation in LINE SHOPPING Test Cases Research ※ 1 ※ 2 E2E Test ※ 3 Performance Test ※ 4 API Test ※ 5 Monitor & Health Check
16. Automation Tools in LINE SHOPPING
17. 25% 25% 25% 15% 10% E2E Test Scheduler Monitor Automation Performance Test Meeting Workshop QA Automation TECH FRESH in LINE SHOPPING ▸E2E Test ▸Scheduler Monitor Automation ▸Performance Test ▸Meeting ▸Workshop
18. LINE SHOPPING Overview
19. E-commerce platform based on shopping guide, points feedback, and information integration. What’s LINE SHOPPING? Guide LINE POINTS Information
20. LINE Services …
21. QA IS…? We alert before you discover.
22. THANK YOU Welcome to join us!