Measures to Address the Load to Yahoo! JAPAN Shopping App

Akinori Izumi (Yahoo! JAPAN / Production Division 1, Shopping Services Group, Commerce Group / Senior Manager)

https://tech-verse.me/ja/sessions/136
https://tech-verse.me/en/sessions/136
https://tech-verse.me/ko/sessions/136

Transcript

2. About Me Akinori Izumi JOIN I joined Yahoo! JAPAN as a new graduate COMPANY HISTORY 2012 - Web frontend FOHJOFFS 2014 - Backend FOHJOFFS 2016 - System operator & Manager 2019 - App engineer & Manager 2019 - System general load manager CURRENT Head of development responsible for the native application LIKE Camp / Basketball
3. Introduction Super sales place a high load on the system. In this session, we will introduce the load measures and efforts related to loads on Yahoo! JAPAN Shopping App.
4. Agenda - About “Super PayPay Festival” - Comparison with server-side applications - Load balancing for Yahoo! JAPAN Shopping App - Prepare for the unexpected - Conclusion
5. Agenda - About “Super PayPay Festival” - Comparison with server-side applications - Load balancing for Yahoo! JAPAN Shopping App - Prepare for the unexpected - Conclusion
6. Super PayPay Festival? - What is Super PayPay Festival ? Large-scale campaign measures to be held simultaneously offline and online You can also save at Yahoo! JAPAN Shopping - Preparedness for system load Increased load on the system Countermeasures in cooperation with a team of load specialists Native apps are also covered
7. Currently being held in November 2022
8. Impact of Super Sale in App
9. Impact of Super Sale in App In the past, load has affected app functionality. Stopped major functions Major functions of the application were suspended with the start of the promotional event. Stopped top page Top page module could not be displayed due to high load. Stopped native app functions Native cart and order history could not be displayed due to high load
10. Agenda - About “Super PayPay Festival” - Comparison with server-side applications - Load balancing for Yahoo Shopping App - Prepare for the unexpected - Conclusion
11. Troubleshooting Comparison 4FSWFS
    TJEF
    BQQMJDBUJPO $MJFOU
    BQQMJDBUJPO Image: Aflo
12. Troubleshooting in server side application Image: Aflo
13. Frontend Server API Server Data Base Troubleshooting in server side application Access Request Request
14. .BTT
    BDDFTT Troubleshooting in server side application Frontend Server API Server Data Base
15. Troubleshooting in server side application Completed only on the server side Frontend Server API Server Data Base .BTT
    BDDFTT
16. Troubleshooting in client application Image: Aflo
17. API 4FSWFS Data Base Troubleshooting in client application /BUJWF
    "QQ Request Request
18. API 4FSWFS Data Base Troubleshooting in client application /BUJWF
    "QQ .BTT
    BDDFTT Request
19. API 4FSWFS Data Base /BUJWF
    "QQ × Troubleshooting in client application .BTT
    BDDFTT Request
20. API 4FSWFS Data Base /BUJWF
    "QQ Update required Submit Troubleshooting in client application .BTT
    BDDFTT Request
21. Troubleshooting in Yahoo! JAPAN Shopping App Failure notification Hiding modules Emergency release Access control by app × × ただいま障害が発生しています クーポン機能に障害が発生しています
22. Issues For Yahoo! JAPAN Shopping App - Update required Emergency release is not available Bugs will remain - App engineers will be on the sidelines Fewer means of app Request a server-side engineer
23. Agenda - About “Super PayPay Festival” - Comparison with server-side applications - Load balancing for Yahoo! JAPAN Shopping App - Prepare for the unexpected - Conclusion
24. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App "DDFTT
    
    "1*
    $BMM /BUJWF
    "QQ Focus on API communication load
25. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App /BUJWF
    "QQ External file API on-off .BTT
    BDDFTT
26. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App /BUJWF
    "QQ ᶃ3FBEJOH
    TFUUJOH
    WBMVF External file API on-off .BTT
    BDDFTT
27. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App /BUJWF
    "QQ ᶄ"1*
    DPNNVOJDBUJPO
    KVEHNFOU ᶃ3FBEJOH
    TFUUJOH
    WBMVF External file API on-off
28. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App ᶅ"DDFTT
    $POUSPM /BUJWF
    "QQ ᶄ"1*
    DPNNVOJDBUJPO
    KVEHNFOU ᶃ3FBEJOH
    TFUUJOH
    WBMVF External file API on-off Access control enabled on app
29. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App ᶅ"DDFTT
    $POUSPM /BUJWF
    "QQ ᶄ"1*
    DPNNVOJDBUJPO
    KVEHNFOU ᶃ3FBEJOH
    TFUUJOH
    WBMVF External file Request Frequency Access control enabled on app
30. API 4FSWFS Data Base Load balancing for Yahoo! JAPAN Shopping App ᶅ"DDFTT
    $POUSPM /BUJWF
    "QQ ᶄ"1*
    DPNNVOJDBUJPO
    KVEHNFOU ᶃ3FBEJOH
    TFUUJOH
    WBMVF External file API on-off Request Frequency App Developer
31. External File { "host": "apihost.yahooapis.jp", "children": [ { "path": "/api/path/hoge", "limit": 600, "emg": false }, { "path": "/api/path/fuga", "limit": 0, "emg": true } ] }, { "host": "apihost2.yahooapis.jp", - Simple json array • host • path • limit • For frequency caps • emg • For API switch - Multiple input
32. External File { "host": "apihost.yahooapis.jp", "children": [ { "path": "/api/path/hoge", "limit": 600, "emg": false }, { "path": "/api/path/fuga", "limit": 0, "emg": true } ] }, { "host": "apihost2.yahooapis.jp", - Simple json array • host • path • limit • For frequency caps • emg • For API switch - Multiple input
33. External File { "host": "apihost.yahooapis.jp", "children": [ { "path": "/api/path/hoge", "limit": 600, "emg": false }, { "path": "/api/path/fuga", "limit": 0, "emg": true } ] }, { "host": "apihost2.yahooapis.jp", - Simple json array • host • path • limit • For frequency caps • emg • For API switch - Multiple input
34. External File { "host": "apihost.yahooapis.jp", "children": [ { "path": "/api/path/hoge", "limit": 600, "emg": false }, { "path": "/api/path/fuga", "limit": 0, "emg": true } ] }, { "host": "apihost2.yahooapis.jp", - Simple json array • host • path • limit • For frequency caps • emg • For API switch - Multiple input
35. What we have achieved Switching APIs Remotely Introduction of Circuit Breaker Benefit to Server Side Engineers
36. Agenda - About “Super PayPay Festival” - Comparison with server-side applications - Load balancing for Yahoo! JAPAN Shopping App - Prepare for the unexpected - Conclusion
37. Unexpected load Critical Bugs Prepare for the unexpected Still, trouble will occur
38. Display in webview Still, trouble will occur For top page Has the ability to open pages in webview
39. Still, trouble will occur For item detail page Automatically opens a webview normal abnormality
40. Modules Durability Countermeasure Campaign High No problem Ranking High /P
    QSPCMFN
    CVU
    VTF
    DBDIF Order History Low Simplified view View History Low Switch to another module Coupon Low Change to static module Still, trouble will occur Always take load measures
41. Agenda - About “Super PayPay Festival” - Comparison with server-side applications - Load balancing for Yahoo! JAPAN Shopping App - Prepare for the unexpected - Conclusion
42. The mind of a Native App Engineers - App engineers also have to deal with load Apps are the first system users touch Consider the app means Image: Aflo
43. Image: Aflo - Remember to be aware of high loads Assume a high load Workaround Preparation The mind of a Native App Engineers
44. Image: Aflo - Need to understand Backend system It's not just about Apps knowledge Considering the optimal solution The mind of a Native App Engineers
45. Conclusion The mind of a native app engineers - App engineers also have to deal with load - Remember to be aware of high loads - Need to understand the Backend system We reduced the request over 10000 req/sec Image: Aflo
46. Thank you for listening