Call Platform Service triggered by COVID-19

Sanghyun Lee
LINE Plus VoIP Platform Dev Software Engineer
https://linedevday.linecorp.com/2020/ja/sessions/0339
https://linedevday.linecorp.com/2020/en/sessions/0339

Transcript

2. Agenda › LINE call service in COVID-19 › Improve LINE call quality › ‘Planet’ for call service › Next plan
3. LINE call service in COVID-19 KPI trend and new features
4. LINE 1:1 video call duration 2019, May 2020, May 2x
5. LINE group video call duration 2020, Jan 2020, May 14x
6. › Up to 500 participants at a group › Display 6 on smartphone and 9 on iPad Expand group call
7. › Share your screen › Co-view YouTube videos Watch Together
8. › Join group video call through a URL LINE Meeting
9. Support for PC › HD screen sharing › Background Effect
10. Operation of service LINE call concurrent video count at peak time in Japan 2020 3/21 3/28 4/4 4/11 4/18 4/25 5/2 5/9 5/16 16x
11. 125.4% 129.5% 217.4% 213.3% 156.4% Operation of service LINE call server traffic at peak time in Japan 3/21 3/28 4/4 4/11 4/18 4/25 5/2 5/9 5/16 Traffic (JP Peak)
12. Improve LINE call quality Quality improvement works in COVID-19
13. Improve call quality Adaptive de-jitter buffer Noise suppressor … Avoid jerkiness Enhance clearness … Loss robustness Bitrate control … H/W codec Optimization … Video Network Device Voice
14. Voice quality › Voice quality › Mobile : HD+ › Desktop : Full HD › Voice Quality Enhancement › Acoustic Echo Cancellation › Noise suppressor › Auto gain control › …
15. Voice Quality Enhancement PLANET + NOISE + ECHO VOICE VOICE + NOISE + ECHO Inconvenient!
16. Voice Quality Enhancement PLANET + NOISE + ECHO VOICE ACOUSTIC ECHO CANCELATION NOISE SUPPRESSOR AUTO GAIN CONTROL VQE VOICE - NOISE - ECHO Comport!
17. MLNS Multi Level Noise suppressor based on Machine Learning + NOISE NOISE SUPPRESSOR Machine Learning VOICE Perfect! VOICE
18. Video Quality › Maximum Video quality › Mobile : HD (720P) › Desktop : FHD (1080P) › Scalable video coding › Hybrid codec FHD (1080P) HD (720P) VGA QVGA
19. Scalable Video Coding Non-scalable video coding with transcoder Transcoder VIDEO HD VGA QVGA HD - SINGLE LAYER
20. Scalable Video Coding Scalable video coding and layer filtering Layer Filter VIDEO LAYER0 LAYER0 LAYER1 LAYER2 LAYER0 LAYER1 LAYER0 LAYER1 LAYER2
21. Hybrid coding system Scalable video coding with hybrid coding system Layer Filter VIDEO LAYER0 LAYER0 LAYER1 LAYER2 LAYER0 LAYER1 LAYER0 LAYER1 LAYER2 HYBRID CODING SYSTEM H/W CODEC + S/W CODEC
22. Network Adaptation CCFS: Congestion Control based on Forward Path Status Sender Receiver FEEDBACK MEDIA PACKET
23. Network Adaptation CCFS: Congestion Control based on Forward Path Status Layer Filter VIDEO LAYER0 LAYER1 LAYER2 FEEDBACK FEEDBACK Decide encoding bitrate Filtering to proper layer Estimate forward bandwidth Estimate foward bandwidth LAYER0 LAYER1
24. Planet for call service Call service build-up and Planet platform
25. VoIP stack and service Service CONFIGURATION MANAGEMENT VoIP (Realtime communication) SESSION MANAGEMENT PACKET DELIVERY AUDIO CODEC VIDEO CODEC NETWORK STACK AUDIO STACK VIDEO STACK
26. Planet Service PLANET VoIP (Realtime communication)
27. Planet interfaces AppClient PlanetKit SDK AppServer Planet Cloud Client API Server API Client side Server side Planet platform
28. PlanetKit SDK Android ( Kotlin ) Web ( Javascript ) Mac ( Objective-C ) Windows ( C++ ) iOS ( Swift ) PlaneKit core
29. Implement Client-side PLANETKIT SAMPLE’S CODE
30. Implement › Callback APIs › PlanetCloud → AppServer › Restful (HTTPS) › SLA-Key › Pre-defined key › To find out AppServer Server-side SERVICE PLANET PLATFORM SLA-KEY ENVIRONMENT APP SERVER URI SERVICE ID
31. Planet integration General topology MOBILE PUSH SYSTEM APP SERVER PLANET CLOUD SERVICE-DEFINED PUSH SYSTEM PLANEKIT SDK CALLER APP PLANEKIT SDK CALLEE APP 1. REGISTER TO SERVICE
32. Planet integration General topology MOBILE PUSH SYSTEM APP SERVER PLANET CLOUD SERVICE-DEFINED PUSH SYSTEM PLANEKIT SDK CALLER APP PLANEKIT SDK CALLEE APP 2. MAKE CALL 1. REGISTER TO SERVICE
33. Planet integration General topology MOBILE PUSH SYSTEM APP SERVER PLANET CLOUD SERVICE-DEFINED PUSH SYSTEM PLANEKIT SDK CALLER APP PLANEKIT SDK CALLEE APP 2. MAKE CALL 3. NOTIFY CALLBACK 1. REGISTER TO SERVICE
34. Planet integration General topology MOBILE PUSH SYSTEM APP SERVER PLANET CLOUD SERVICE-DEFINED PUSH SYSTEM PLANEKIT SDK CALLER APP PLANEKIT SDK CALLEE APP 2. MAKE CALL 3. NOTIFY CALLBACK 1. REGISTER TO SERVICE 4. REQUEST PUSH 4. REQUEST PUSH
35. Planet integration General topology MOBILE PUSH SYSTEM APP SERVER PLANET CLOUD SERVICE-DEFINED PUSH SYSTEM PLANEKIT SDK CALLER APP PLANEKIT SDK CALLEE APP 2. MAKE CALL 3. NOTIFY CALLBACK 1. REGISTER TO SERVICE 4. REQUEST PUSH 4. REQUEST PUSH 5. PUSH 5. PUSH
36. Planet integration General topology MOBILE PUSH SYSTEM APP SERVER PLANET CLOUD SERVICE-DEFINED PUSH SYSTEM PLANEKIT SDK CALLER APP PLANEKIT SDK CALLEE APP 2. MAKE CALL 3. NOTIFY CALLBACK 1. REGISTER TO SERVICE 4. REQUEST PUSH 4. REQUEST PUSH 5. PUSH 5. PUSH 6. VERIFY CALL
37. Services with Planet Launched 3 Day 1 Developing 4
38. Feedback about Planet “… The basic call scenario was able to be developed within a day by referring to the PlanetKit sample after issuing the service ID and SLA key …” “… It can be developed with little cost to the core functions of the call service …”
39. Advantage of Planet Support tech & features Prepared High quality Advanced Large-scale operation Stable
40. Next plan Milestone and vision
41. Next plan Multi channel for media Open to public Inter-service connectivity
42. LINE call history and future Open to public 2018 Oct Integrate ‘Planet’ into LINE 2013 Sep Addition of Video call 2020 Feb Launched Planet Platform 2016 Mar Group call released 2011 Oct Launched first free call
43. Summary › LINE call service provides New features, High-end quality, Stable operation › With “Planet”, able to integrate “Call service” into Your service › Arrived the ‘New normal’, increased the needs of LINE call service
44. Thank you