ミラティブとWebRTC - WebRTC framework の中身を覗いてみよう / WebRTC framework AudioUnit Processing

by naru-jpn

Slide 1

Slide 1 text

ϛϥςΟϒͱWebRTC WebRTC framework ͷத਎Λ೷͍ͯΈΑ͏ Naruki Chigira @_naru_jpn / Lib arXiv / ໌೔ϫΫνϯ2ճ໨

Slide 2

Slide 2 text

WebRTC framework

Slide 3

Slide 3 text

https://webrtc.org

Slide 4

Slide 4 text

WebRTC ͸ϛϥςΟϒͷͲ͜Ͱ࢖ΘΕ͍ͯΔͷ͔

Slide 5

Slide 5 text

ίϥϘ௨࿩ ഑৴ऀ ࢹௌऀ ࢹௌऀͱձ࿩Λ͠ͳ͕Β഑৴͕Ͱ͖ΔΑ

Slide 6

Slide 6 text

ίϥϘ഑৴ ഑৴ऀ A ഑৴ऀ B ഑৴ऀಉ࢜Ͱձ࿩Λ͠ͳ͕Β഑৴͕Ͱ͖ΔΑ

Slide 7

Slide 7 text

NEW! ίϥϘϚονϯά ഑৴ऀ A ഑৴ऀ B ಉ͡ήʔϜͰ഑৴͍ͯ͠Δਓಉ࢜ͰϚονϯά͢ΔʢҰ෦ެ։

Slide 8

Slide 8 text

։ൃ͢ΔதͰͪΐͬͱࠔͬͨ͜ͱ͕͋ͬͨ

Slide 9

Slide 9 text

഑৴ऀ ࢹௌऀ WebRTC ͷ઀ଓ࣌ʹΞϓϦ͕όοΫάϥ΢ϯυঢ়ଶʹ͋ΔͱɺԻ੠ͷೖग़ྗ͕Ͱ͖ͳ͘ͳͬͯ͠·͏ ϛϥςΟϒΞϓϦ͸ όοΫάϥ΢ϯυͰ ىಈத

Slide 10

Slide 10 text

όοΫάϥ΢ϯυͰ઀ଓ଴ػঢ়ଶΛ Ωϟϯηϧ͢ΔͳͲͯ͠ɺ੍ޚ͸Ͱ͖ͨ

Slide 11

Slide 11 text

ػೳ্͸੍ޚͰ͖͍ͯΔ͚Ͳɺ Ͳ͏ͯͦ͠͏ͳ͍ͬͯΔͷ͔ཧղͰ͖͍ͯͳ͍ͷͰ৮Δͷ͕ා͍!

Slide 12

Slide 12 text

WebRTC framework ͷத਎Λ೷͍ͯΈΑ͏!

Slide 13

Slide 13 text

https://webrtc.googlesource.com/src/

Slide 14

Slide 14 text

https://webrtc.googlesource.com/src/

Slide 15

Slide 15 text

https://webrtc.googlesource.com/src/+/refs/heads/main

Slide 16

Slide 16 text

Ի੠ͷ੍ޚΛ͍ͯ͠Δͱ͜ΖΛ೷͍ͯΈΑ͏!

Slide 17

Slide 17 text

https://webrtc.googlesource.com/src/+/refs/heads/main/sdk/objc/ This directory contains the Obj-C SDK for WebRTC. This includes wrappers for the C++ PeerConnection API and some platform speci fi c components for iOS and macOS.

Slide 18

Slide 18 text

https://webrtc.googlesource.com/src/+/refs/heads/main/sdk/objc/native/src/audio/ .mm ͍ͬͯ͏ͷ͸ Objective-C++ Λද֦͢ுࢠͩΑ

Slide 19

Slide 19 text

https://webrtc.googlesource.com/src/+/refs/heads/main/sdk/objc/native/src/audio/voice_processing_audio_unit.mm AudioOutputUnitStart ΛݺͿͱԻ੠ͷೖग़ྗॲཧ͕͸͡·ΔΑ voice_processing_audio_unit.mm

Slide 20

Slide 20 text

https://developer.apple.com/documentation/audiotoolbox/1439763-audiooutputunitstart AudioOutputUnitStart ΛݺͿͱԻ੠ͷೖग़ྗॲཧ͕͸͡·ΔΑ

Slide 21

Slide 21 text

AudioOutputUnitStart ͷৼΔ෣͍Λௐ΂ͯΈΑ͏

Slide 22

Slide 22 text

https://stackover fl ow.com/questions/61312360/auaudiounit-cant-play-audio-in-the-background-error-code-561145187

Slide 23

Slide 23 text

https://developer.apple.com/documentation/avfaudio/avaudiosession/errorcode/cannotstartrecording

Slide 24

Slide 24 text

AudioOutputUnitStart ͕όοΫάϥ΢ϯυͰࣦഊ͢ Δͷ͸ɺOSͷ࢓༷తʹ΋ͦ͏ͳ͍ͬͯΔΒ͍͠!

Slide 25

Slide 25 text

AudioOutputUnitStart ͕͍ͭݺ͹Ε͍ͯΔͷ͔΋֬ೝ͓ͯ͜͠͏

Slide 26

Slide 26 text

https://webrtc.googlesource.com/src/+/refs/heads/main/audio/audio_state.cc WebRTC ͷ઀ଓཱ͕֬ͨ͠ޙʹ AddReceivingStream ͕ݺ͹Εɺ  StartPlayout ͷதͰ AudioOutputUnitStart ͕ݺ͹ΕΔ

Slide 27

Slide 27 text

ΞϓϦ͕όοΫάϥ΢ϯυঢ়ଶͩͱɺԻ੠ͷೖग़ྗॲ ཧͷ։࢝ʹࣦഊͯ͠͠·͏͜ͱ͕ཧղͰ͖ͨ!

Slide 28

Slide 28 text

·ͱΊ όοΫάϥ΢ϯυͰԻ੠ͷ΍ΓͱΓ͕Ͱ͖ͳ͘ͳΔݱ৅͕ɺί ʔυϨϕϧͰཧղͰ͖ΔΑ͏ʹͳͬͨ ɾݪҼ͕Θ͔ͬͯɺͳͥͳͷ͔Λઆ໌Ͱ͖ΔΑ͏ʹͳͬͨ ɾWebRTC framework ͱগ͚ͩ͠஥ྑ͘ͳΕͨ

Slide 29

Slide 29 text

͋Γ͕ͱ͏͍͟͝·ͨ͠! WE ARE HIRING! ੵۃ࠾༻தͩΑ!