Cross Platform Video Player

Slide 1

Slide 1 text

$SPTT1MBUGPSN7JEFP1MBZFS 4FQUFNCFSUI /"9" --$"MM3JHIUT3FTFSWFE

Slide 2

Slide 2 text

4IVNQFJ63"#& /"9" --$$&0

Slide 3

Slide 3 text

$SPTTQMBUGPSN

Slide 4

Slide 4 text

J04 "OESPJE NBD04 8JOEPXT

Slide 5

Slide 5 text

UseCase • Play Video from File • Get Raw Video Buffer

Slide 6

Slide 6 text

Supported Codecs iOS macOS Android Windows H.264 H.264 H.264 H.264 H.265 H.265 H.265 H.265 VP8 VP8 VP9 VP9

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

Supported Codecs iOS macOS Android Windows H.264 H.264 H.264 H.264 H.265 H.265 H.265 H.265 VP8 VP8 VP9 VP9

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

Supported Codecs iOS macOS Android Windows H.264 H.264 H.264 H.264 H.265 H.265 H.265 H.265 VP8 VP8 VP9 VP9

Slide 11

Slide 11 text

8IBUEPZPVBDUVBMMZEP

Slide 12

Slide 12 text

6TF044UBOEBSE"1*

Slide 13

Slide 13 text

iOS / macOS 1. AVPlayer(AVFoundation) 2. VTDecompressionSession to MTKView

Slide 14

Slide 14 text

iOS / macOS 1. AVPlayer(AVFoundation) 2. VTDecompressionSession to MTKView

Slide 15

Slide 15 text

iOS / macOS VTDecompressionSession CVMetalTexture MTKView CVMetalTextureCache MTLTexture

Slide 16

Slide 16 text

Android 1. ExoPlayer (Google OSS) 2. MediaCodec to SurfaceView

Slide 17

Slide 17 text

Android 1. ExoPlayer (Google OSS) 2. MediaCodec to SurfaceView

Slide 18

Slide 18 text

Android MediaExtractor MediaCodec SurfaceView

Slide 19

Slide 19 text

Windows 1. MediaFoundation.MediaEngine 2. MediaFoundation.MFCreateVideoRenderer

Slide 20

Slide 20 text

Windows 1. MediaFoundation.MediaEngine 2. MediaFoundation.MFCreateVideoRenderer

Slide 21

Slide 21 text

Windows Set up Video sink (Enhanced Video Renderer) Set up Video source. Create a media type and set on the source and sink. Set up event handler for sink events. Srart the sample loop.

Slide 22

Slide 22 text

No content

Slide 23

Slide 23 text

WMDPSNQW

Slide 24

Slide 24 text

mpv

Slide 25

Slide 25 text

mpv • Famous as a video player. • Backend is ffmpeg. • There is a libmpv that can be used as a library.

Slide 26

Slide 26 text

libmpv • embedded into other programs as video/audio playback backend. • Compared to other libraries, it is very simple to use.

Slide 27

Slide 27 text

libmpv 1. Embed Native Window (Windows / X11) 2. Rendering API (OpenGL)

Slide 28

Slide 28 text

Basic Usage mpv_handle *ctx = mpv_create(); mpv_initialize(ctx); const char *cmd[] = {"loadfile", filename, NULL}; mpv_command(ctx, cmd);

Slide 29

Slide 29 text

OpenGL

Slide 30

Slide 30 text

Native Window Renderer (Windows) _mpvHandle = _mpvCreate.Invoke(); _mpvInitialize.Invoke(_mpvHandle); _mpvSetOption(_mpvHandle, GetUtf8Bytes("wid"), mpvFormatInt64, ref windowId); DoMpvCommand("loadfile", filename);

Slide 31

Slide 31 text

Tips • If you use libmpv, you can't handle the raw buffer. • mpv iOS build is pretty hard to do.

Slide 1

Slide 1 text

Slide 2

Slide 2 text

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

Slide 9

Slide 9 text

Slide 10

Slide 10 text

Slide 11

Slide 11 text

Slide 12

Slide 12 text

Slide 13

Slide 13 text

Slide 14

Slide 14 text

Slide 15

Slide 15 text

Slide 16

Slide 16 text

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Slide 24

Slide 24 text

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Slide 29

Slide 29 text

Slide 30

Slide 30 text

Slide 31

Slide 31 text

Slide 32

Slide 32 text

Slide 33

Slide 33 text