Streaming Segment Parser

Internship project at Amazon Prime Video

Transcript

1. STREAMING SEGMENT PARSER PRESENTED BY YIQI YAN XP PLAYER INTERN PRESENTATION
2. CONTENTS ▸ ISO-BMFF Parser ▸ Current Design ▸ Proposed Design ▸ Implementation ▸ Demo & Analysis
3. ISO-BMFF PARSER bytes box segment box parser segment parser
4. ISO-BMFF PARSER bytes box segment box parser segment parser
5. ISO-BMFF PARSER bytes box segment box parser segment parser
6. ISO-BMFF PARSER bytes box segment box parser segment parser MEDIA DATA
7. CURRENT DESIGN ▸ Fully synchronous process ▸ Unnecessary latency ▸ Each stage relies on the completeness of the previous one ▸ The decoder has to wait for the entire segment while it is able to perform on separate media samples
8. PROPOSED DESIGN ▸ Asynchronous process ▸ Whenever some data is downloaded, pass it to the parser. ▸ Whenever some media sample is available, send it to the decoder.
9. CURRENT DESIGN
10. CURRENT DESIGN bytes box segment box parser segment parser
11. CURRENT DESIGN bytes box segment box parser segment parser
12. CURRENT DESIGN bytes box segment box parser segment parser
13. CURRENT DESIGN bytes box box parser segment parser segment
14. PROPOSED DESIGN bytes box box parser segment parser segment
15. PROPOSED DESIGN bytes box box parser segment parser segment
16. PROPOSED DESIGN bytes box box parser segment parser segment
17. PROPOSED DESIGN bytes box box parser segment parser segment
18. PROPOSED DESIGN bytes box box parser segment parser segment
19. PROPOSED DESIGN bytes box box parser segment parser segment
20. PROPOSED DESIGN bytes box box parser segment parser segment
21. PROPOSED DESIGN bytes box box parser segment parser segment
22. IMPLEMENTATION STREAM-BASED IMPLEMENTATION ▸ Third-party stream processing library ▸ Doesn’t have control of implementation details - potential performance problem ▸ Relies on primitive Node modules - not supported on Roku
23. IMPLEMENTATION EVENT-BASED IMPLEMENTATION
24. DEMO & ANALYSIS Audio Segment Video Segment (encrypted) Trailer Segment (non-encrypted) number of media samples 47 109 69 size of segment (kB) ~17 ~744 ~1485 metrics ▸ time to first sample (tFirst, ms) ▸ time to last sample (tLast, ms) environment ▸ 2.5GHz Intel i7 processor ▸ 16GB memory (2133 MHz LPDDR3) ▸ macOS Mojave ▸ node.js 10
25. DEMO & ANALYSIS AUDIO SEGMENT (500 RUNS)
26. DEMO & ANALYSIS VIDEO SEGMENT (ENCRYPTED, 500 RUNS)
27. DEMO & ANALYSIS TRAILER SEGMENT (NON-ENCRYPTED, 500 RUNS)
28. TO DO ▸ Integration to XP player framework ▸ Event-based decoder ▸ Error handling ▸ Performance measurement in real case ▸ With pre-buffer ▸ Counting decoding time
29. Q&A Q & A