Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ミラティブとWebRTC - WebRTC framework の中身を覗いてみよう / WebRTC framework AudioUnit Processing

2bfb16e53b154afc9f141f831b4aaaf2?s=47 naru-jpn
July 29, 2021
Programming
1
960

ミラティブとWebRTC - WebRTC framework の中身を覗いてみよう / WebRTC framework AudioUnit Processing

WebRTC framework の中身がわからなくて近付くのが怖かったけど、少しだけわかりあえた話

2bfb16e53b154afc9f141f831b4aaaf2?s=128

naru-jpn

July 29, 2021
Tweet

More Decks by naru-jpn

See All by naru-jpn
Updating an App to Use Swift Concurrency 解説
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
1
38
PiP で実現するミラティブの配信コメントバー / pip-streaming-comment-bar
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
0
360
App Extension のスタックトレース情報からクラッシュを解析/集計する / Analyzing app extension's stack trace
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
3
480
CoreML3のオンデバイストレーニングでつくる母音推定
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
0
240
AltConfと周辺の歩き方
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
0
1.6k
エンジニア経験を活かしたスクラムマスターとして 開発チームとプロダクトを成長させる
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
1
290
GASで作るファネル分析ツール
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
1
94
Quick Tour of Sessions about Metal
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
0
610
Beyond WWDC + try! Swift San Jose
2bfb16e53b154afc9f141f831b4aaaf2?s=48 narujpn
2
580

Other Decks in Programming

See All in Programming
回帰分析ではlm()ではなくestimatr::lm_robust()を使おう / TokyoR100
7a0892afffbcbd35fd84d46508b3a914?s=48 dropout009
0
4.6k
このタイミングで知っておきたい 開発生産性の高いエンジニア組織の特徴とは / dev-sumi-20220721-productivity-features
6f425ca5b796b421dca359b95046184f?s=48 findyinc
7
2.7k
ベストプラクティス・ドリフト
A15b71ae6fbdecb3216bdcba552d9a77?s=48 sssssssssssshhhhhhhhhh
1
210
段階的な技術的負債の解消方法.pdf
41e5cd2b99a8e7c84f91a8137c8be3ed?s=48 ko2ic
2
940
Edge Side Frontend という新領域
3aebd86547bfc5cdb451d5f2f95ed5d8?s=48 mizchi
24
10k
Isar勉強会
693ed679c8dde3eccbc682ff44f357e1?s=48 hoddy3190
0
510
Scaling Productivity- How we have improved our dev experience
63c8b0590595c3de58406678ef99a6bf?s=48 sockeqwe
1
120
パラメタライズドテスト
4f8c3a1aedaf9aafd6c74ab077d9ad18?s=48 ledsun
0
220
Amazon Lookout for Visionで 筆跡鑑定してみた
B3cc0e7ba8e6c941f08a2e6f69d3e4c2?s=48 cmnakamurashogo
0
170
読みやすいコード クラスメソッド 2022 年度新卒研修
E86b46be0f4e61db6b28becc5493bbab?s=48 januswel
0
2.9k
OSS貢献を気軽にしたい Let's Go Talk #1
Aa0368c69701536321af9db1ae552b45?s=48 yuyaabo
2
240
Introduction to Property-Based Testing @ COSCUP 2022
Fd9f21969cd8a0cbf0b2f48a9af0cc28?s=48 cybai
1
150

Featured

See All Featured
Agile that works and the tools we love
462dad0dd24c568a32dcdb0ae895ae1b?s=48 rasmusluckow
319
19k
No one is an island. Learnings from fostering a developers community.
6bb82b13cda86d3b821fa44100335ddf?s=48 thoeni
9
1.3k
Pencils Down: Stop Designing & Start Developing
79acae287842acf29084005533a7fb3b?s=48 hursman
113
9.8k
Designing for humans not robots
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
242
24k
Fight the Zombie Pattern Library - RWD Summit 2016
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
226
15k
A Tale of Four Properties
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
149
21k
Clear Off the Table
Ef32e0b1ac5082450dc8c1fca3a26b5c?s=48 cherdarchuk
79
290k
The Mythical Team-Month
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
210
39k
What’s in a name? Adding method to the madness
C0390e8b11079f8761c0cd3274ed61cb?s=48 productmarketing
11
1.6k
The Illustrated Children's Guide to Kubernetes
0438ae60cde4c7add6f9da48f28c15cc?s=48 chrisshort
18
40k
Why You Should Never Use an ORM
88bc30284c6a424b63a92aad27d0ba36?s=48 jnunemaker
PRO
47
7.7k
The Web Native Designer (August 2011)
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
75
2k

Transcript

  1. ϛϥςΟϒͱWebRTC WebRTC framework ͷத਎Λ೷͍ͯΈΑ͏ Naruki Chigira @_naru_jpn / Lib arXiv

    / ໌೔ϫΫνϯ2ճ໨

  2. WebRTC framework

  3. https://webrtc.org

  4. WebRTC ͸ϛϥςΟϒͷͲ͜Ͱ࢖ΘΕ͍ͯΔͷ͔

  5. ίϥϘ௨࿩ ഑৴ऀ ࢹௌऀ ࢹௌऀͱձ࿩Λ͠ͳ͕Β഑৴͕Ͱ͖ΔΑ

  6. ίϥϘ഑৴ ഑৴ऀ A ഑৴ऀ B ഑৴ऀಉ࢜Ͱձ࿩Λ͠ͳ͕Β഑৴͕Ͱ͖ΔΑ

  7. NEW! ίϥϘϚονϯά ഑৴ऀ A ഑৴ऀ B ಉ͡ήʔϜͰ഑৴͍ͯ͠Δਓಉ࢜ͰϚονϯά͢ΔʢҰ෦ެ։

  8. ։ൃ͢ΔதͰͪΐͬͱࠔͬͨ͜ͱ͕͋ͬͨ

  9. ഑৴ऀ ࢹௌऀ WebRTC ͷ઀ଓ࣌ʹΞϓϦ͕όοΫάϥ΢ϯυঢ়ଶʹ͋ΔͱɺԻ੠ͷೖग़ྗ͕Ͱ͖ͳ͘ͳͬͯ͠·͏ ϛϥςΟϒΞϓϦ͸ όοΫάϥ΢ϯυͰ ىಈத

  10. όοΫάϥ΢ϯυͰ઀ଓ଴ػঢ়ଶΛ Ωϟϯηϧ͢ΔͳͲͯ͠ɺ੍ޚ͸Ͱ͖ͨ

  11. ػೳ্͸੍ޚͰ͖͍ͯΔ͚Ͳɺ Ͳ͏ͯͦ͠͏ͳ͍ͬͯΔͷ͔ཧղͰ͖͍ͯͳ͍ͷͰ৮Δͷ͕ා͍!

  12. WebRTC framework ͷத਎Λ೷͍ͯΈΑ͏!

  13. https://webrtc.googlesource.com/src/

  14. https://webrtc.googlesource.com/src/

  15. https://webrtc.googlesource.com/src/+/refs/heads/main

  16. Ի੠ͷ੍ޚΛ͍ͯ͠Δͱ͜ΖΛ೷͍ͯΈΑ͏!

  17. https://webrtc.googlesource.com/src/+/refs/heads/main/sdk/objc/ This directory contains the Obj-C SDK for WebRTC. This

    includes wrappers for the C++ PeerConnection API and some platform speci fi c components for iOS and macOS.

  18. https://webrtc.googlesource.com/src/+/refs/heads/main/sdk/objc/native/src/audio/ .mm ͍ͬͯ͏ͷ͸ Objective-C++ Λද֦͢ுࢠͩΑ

  19. https://webrtc.googlesource.com/src/+/refs/heads/main/sdk/objc/native/src/audio/voice_processing_audio_unit.mm AudioOutputUnitStart ΛݺͿͱԻ੠ͷೖग़ྗॲཧ͕͸͡·ΔΑ voice_processing_audio_unit.mm

  20. https://developer.apple.com/documentation/audiotoolbox/1439763-audiooutputunitstart AudioOutputUnitStart ΛݺͿͱԻ੠ͷೖग़ྗॲཧ͕͸͡·ΔΑ

  21. AudioOutputUnitStart ͷৼΔ෣͍Λௐ΂ͯΈΑ͏

  22. https://stackover fl ow.com/questions/61312360/auaudiounit-cant-play-audio-in-the-background-error-code-561145187

  23. https://developer.apple.com/documentation/avfaudio/avaudiosession/errorcode/cannotstartrecording

  24. AudioOutputUnitStart ͕όοΫάϥ΢ϯυͰࣦഊ͢ Δͷ͸ɺOSͷ࢓༷తʹ΋ͦ͏ͳ͍ͬͯΔΒ͍͠!

  25. AudioOutputUnitStart ͕͍ͭݺ͹Ε͍ͯΔͷ͔΋֬ೝ͓ͯ͜͠͏

  26. https://webrtc.googlesource.com/src/+/refs/heads/main/audio/audio_state.cc WebRTC ͷ઀ଓཱ͕֬ͨ͠ޙʹ AddReceivingStream ͕ݺ͹Εɺ
 StartPlayout ͷதͰ AudioOutputUnitStart ͕ݺ͹ΕΔ

  27. ΞϓϦ͕όοΫάϥ΢ϯυঢ়ଶͩͱɺԻ੠ͷೖग़ྗॲ ཧͷ։࢝ʹࣦഊͯ͠͠·͏͜ͱ͕ཧղͰ͖ͨ!

  28. ·ͱΊ όοΫάϥ΢ϯυͰԻ੠ͷ΍ΓͱΓ͕Ͱ͖ͳ͘ͳΔݱ৅͕ɺί ʔυϨϕϧͰཧղͰ͖ΔΑ͏ʹͳͬͨ ɾݪҼ͕Θ͔ͬͯɺͳͥͳͷ͔Λઆ໌Ͱ͖ΔΑ͏ʹͳͬͨ ɾWebRTC framework ͱগ͚ͩ͠஥ྑ͘ͳΕͨ

  29. ͋Γ͕ͱ͏͍͟͝·ͨ͠! WE ARE HIRING! ੵۃ࠾༻தͩΑ!