How LINE Runs a Product with LINE MUSIC as Example

How LINE Runs a Product with LINE MUSIC as Example by Marc Lihan Test Corner #23 https://testcorner.kktix.cc/events/testcorner23

Transcript

1. How LINE Runs a Product with LINE MUSIC as Example Marc Lihan 2019.09.03
2. LINE QA Manager Marc Lihan
   LINER for 5+ years
   LINE MUSIC, LINE TODAY, LINE MART
   Movies, Games
3. How LINE runs a project People involved and their R&R Business-related process Product features decision making Development and deployment flow API and mobile testing practices 01 02 03 04 05 06 Contents
4. Business Taskforce PM Operations Strategy Marketing Planner Developer QA Product
5. Taskforce R&R Operations • Events • Content Marketing • Campaign • Ads Strategy • KPI • Sales Planner • User Research • Spec, Feature Prioritization Developer • Technical PM • Development QA • Testing • Release Management Business Product
6. Business Operations Strategy Product Operations, Marketing Users’ POV Pre-production
7. Business Operations : Content • Editor’s picks, Melody • Trending topics • Sourcing, Ranking Strategy Product Operations, Marketing Post production
8. Marketing • Online • Promotion • Google, FB, YouTube, LINE TV, etc • Monitor • CPC, CPI, CPV, etc • Offline • Newspaper • MRT/Taxi • Concert
11. Business Strategy • SMART Goals measured by KPI • Review by WoW, MoM, QoQ, YoY • Evolve to fit changing needs of business • Visibility with stakeholders • LINE Music’s KPI? Source: https://www.paldesk.com/what-is-kpi/
12. Monitor • App Rating • Netizens • PTT • mobile01 • Analyze problem • Technical Problems • Content Problems • Pricing Problems
13. Taskforce R&R Operations • Events • Content Marketing • Campaign • Ads Strategy • KPI • Sales Planner • User Research • Spec, Feature Prioritization Developer • Technical PM • Development QA • Testing • Release Management Business Product
14. Planner’s Tasks User/Biz Requirements Feature Prioritization Feature/UX Study Spec Documentation Product Development
15. Prioritization: Theme Scoring 1. Key members: 2. Discuss Backlog: Description F1 Social media login F2 … F3 … Criteria Score C1 Sales 0.5 C2 New User 0.4 C3 Competitor 0.2 3. Define weight of criteria: F1 F2 F3 C1 2 … … C2 5 ... … C3 4 … … 4. Score based on criteria: Ave F1 Weight Score C1 3.5 0.5 1.75 C2 5.0 0.4 2 C3 3.3 0.1 0.33 5. Net score: Total score for F1: 4.08 6. Sort features based on total score
16. User Research • Conduct qualitative interviews • Recruit real users • 1 person / hour Source: https://www.uxmatters.com/mt/archives/2018/06/user-research-within-budget.php
17. Spec: Documentation Diagram Flow Description
18. Spec: Design • Zeplin • Accurate design spec • Assets • Code snippet
19. Development Modules Music Dev Music Android iOS Search, Recommendation LINE Messenger Timeline Ringtone / Ringbacktone Background Music LINE Login SDK Payment Server, CMS Content Provider LINE Pay Invoice Web QA
20. Framework & Tools LINE MUSIC In-house AI
21. Server-side Deployment K8s config microservice Image upload beta staging real Auto deploy QA Gate Beta server Real server (internal only) Real server (Public) ____ ____ ____ kustomization.yaml PR Trigger build +
22. iOS: Fastlane Android: Gradle Client-side Deployment Dev Github PR Reviewer Merge Build Test Deploy webhook Daily build In-house App Storage Alpha Beta RC Real Dev QA QA User App Store Connect Testflight QA
23. API Management Server Dev Client Dev TW Dev API Documentation API Testing Postman + Newman 1. Jenkins + npm + newman 2. Export postman collection.json 3. Test triggered after deploy
24. Testing API Performance + Metrics • API Response time • Concurrent users Tips: • Check with marketing expected max volume • Work closely with developers • API with DB access
25. Mobile Automation App Daily Build Automated Tests • Unit Test • E2E Test Deploy • Manual Test XCUITest XCTest espresso UI automator Instrumented test Native Testing Framework • Write test with developers • Increase code coverage
26. Summary • (Business + Product) x Teamwork = Success! • Trust & respect each others’ R&R • Lots of useful tools which increases collaboration • Download and subscribe to LINE MUSIC!
27. Q&A
28. THANK YOU