Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Pushing WebRTC Up That Broadcast Hill
Search
danjenkins
June 01, 2023
Technology
0
46
Pushing WebRTC Up That Broadcast Hill
danjenkins
June 01, 2023
Tweet
Share
More Decks by danjenkins
See All by danjenkins
Building ICEPerf.com
danjenkins
0
62
Using GStreamer to build real-time applications with Golang
danjenkins
0
930
VON: Builder - Controlling Physical Devices with WebRTC
danjenkins
0
52
When Worlds Collide: The Blurring Lines of Real-Time and Traditional Media
danjenkins
0
100
Passkeys, FIDO2, WebAuthn… What does it all mean?
danjenkins
0
120
Spiderman's Uncle Ben and his advice for casting your Web(RTC)
danjenkins
0
87
Don't talk SRT about my WHIP
danjenkins
0
710
WebRTC 101 - How to get started building your first WebRTC application
danjenkins
1
180
WebRTC Reborn London Node User Group
danjenkins
0
120
Other Decks in Technology
See All in Technology
組織貢献をするフリーランスエンジニアという生き方
n_takehata
1
280
All you need to know about InnoDB Primary Keys
lefred
0
110
『AWS Distinguished Engineerに学ぶ リトライの技術』 #ARC403/Marc Brooker on Try again: The tools and techniques behind resilient systems
quiver
0
130
Googleマップ/Earthが一般化した 地図タイルのイマ
mapconcierge4agu
1
190
5分で紹介する生成AIエージェントとAmazon Bedrock Agents / 5-minutes introduction to generative AI agents and Amazon Bedrock Agents
hideakiaoyagi
0
190
2.5Dモデルのすべて
yu4u
1
370
テストアーキテクチャ設計で実現する高品質で高スピードな開発の実践 / Test Architecture Design in Practice
ropqa
3
510
日経電子版 x AIエージェントの可能性とAgentic RAGによって提案書生成を行う技術
masahiro_nishimi
1
260
Data-centric AI入門第6章:Data-centric AIの実践例
x_ttyszk
1
330
自動テストの世界に、この5年間で起きたこと
autifyhq
5
5k
技術負債の「予兆検知」と「状況異変」のススメ / Technology Dept
i35_267
1
940
実践!OpenTelemetry
oracle4engineer
PRO
0
220
Featured
See All Featured
The Cost Of JavaScript in 2023
addyosmani
47
7.3k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
45
2.3k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
132
33k
Side Projects
sachag
452
42k
What's in a price? How to price your products and services
michaelherold
244
12k
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
Making the Leap to Tech Lead
cromwellryan
133
9.1k
Optimising Largest Contentful Paint
csswizardry
34
3.1k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
8
260
Statistics for Hackers
jakevdp
797
220k
Code Reviewing Like a Champion
maltzj
521
39k
Transcript
Streaming Tech Sweden 2023 Pushing WebRTC Up That Broadcast Hill
Dan Jenkins
Dan Jenkins WebRTC & Real Time Media Geek @dan_jenkins @
[email protected]
Founder - Everycast Labs / Nimble Ape Organiser CommCon (19-23 June - UK)
Broadcast Bridge - bring remote collaborators into your professional work
fl ow @everycastlabs broadcastbridge.app everycastlabs.uk
Pushing WebRTC Up That Broadcast Hill
WebRTC Is Now 12 Years Old.
And It Has Barely Been A "Thing" Inside Broadcast Media.
So First... Let's Define WebRTC
WebRTC Allows Two Peers behind NATs To Connect to One
Another
It Uses an ICE Process To Make Those Connections.
WebRTC Allows for Media and Data To Be Sent Over
a Peer Connection
WebRTC Is Encrypted by Default.
A Peer Doesn't Need To Be a Client
An SFU or MCU Is Also a Peer.
WebRTC Media Is Sent as RTP
Which Allows for RTP Extensions To Be Used.
RTX
Absolute Capture Time
Audio Levels
Absolute Send Time
Video Orientation
Playout Delay
Video Content Type
That's Just a Few.
It's a Fantastic Toolset To Have at Your Fingertips.
Some May Say It's Rather Prosumer https://twitter.com/OpenBroadcastSy/status/1662075098172358657
But In Order To Understand Some Of The Whys...
We Need To Look at WebRTCs Past
Google Acquired Global IP Solutions...
And Then Open Sourced WebRTC (YAY!)
The IETF And The W3C Were Then Involved With Standardisation
But at its Core...
WebRTC Was Designed for Conference Calls
"Real Time Media on the Web"
And the IETF Process Was Led by VoIP People
Real Time Media = (Web) Real Time Media
And This Led to Decisions.
Like Using SDP To Handle Negotiation of a Session.
But The Biggest* Decision Was Having No Standard Signalling Method.
(*At Least in my mind)
People Could Use What They Wanted.
JSON Over Websocket
SIP Over Websocket
XMPP
GraphQL
Some Proprietary Binary Format Over Websocket
*N
You Could Do It Your Way
Whatever Made Sense for Your Application
Include SDP? Sure!
Get Rid Of SDP And Fill It In Later?
That Works Too!
But No Standard Signalling Isn't Ecosystem Friendly
SRT, RTMP, NDI, HLS & DASH (And many others)
They Just Work (Mostly)
The Lack of a Common Signalling Layer Was Both Great
and Terrible
Now...
The Lack Of Common Signalling Wasn't The Only Issue.
Lack Of Controllable Latency
Lack Of Encode/ Decode Control In A Browser
Lack Of Control Generally.
Pray Be To The Browser Gods.
But.
WebRTC Has Its Own Superpowers
None
WebRTCs Superpower Is That It Works on Billions of Devices
Without Installing A Thing
Use The Right Tool For The Right Job.
WebRTC In A Browser Is The Right Tool.
For The Right Job.
It Might Just Be A Different Job Than You Expected.
Now...
Let's Take A Look at WebRTCs Present
Works In All Browsers Yes, even on Mobile (Safari, Chrome,
Firefox - Edge is a clone)
Supports New Codecs (AV1, H265)
OPUS RED.
More Than Just libWebRTC (Pion, WebRTC.rs, aiortc, |pipe| to name
a few)
SVC (One Video encoded once resulting in one stream with
multiple qualities)
...But Different Support in Every Browser
Simulcast (Multiple encoded videos sent independently as multiple streams) (Now
includes VP9 and AV1 in Chrome)
...But Different Support in Every Browser
X & Y Features
...But Different Support in Every Browser
Scaling Isn't Simple
Scaling To 100,000s Of Connections
It's Tricky
And Expensive
So WebRTCs Present Is Just Tricky.
However.
Something Is Becoming Simpler...
Standardised & Simple Signalling
WHIP (WebRTC HTTP Ingest Protocol)
WHEP (WebRTC HTTP Egress Protocol) https://eyevinntechnology.medium.com/whip-whpp-for-webrtc-based-broadcast-streaming-2cf469e95299
They Go Hand In Hand.
Let's Take A Look At WHIP
At The Heart Of Both Is A HTTP POST Request/
Response
POST /whip/endpoint/test HTTP/1.1 Host: localhost:7080 Content-Type: application/sdp Authorization: Bearer verysecret
Accept-Encoding: gzip, de fl ate Connection: Keep-Alive Content-Length: 1162 v=0 [..sdp] (WHIP) POST with an OFFER
HTTP/1.1 201 Created Location: /whip/resource/test Content-Type: application/sdp Connection: keep-alive Transfer-Encoding:
chunked Content-Length: 569 v=0 [..sdp] (WHIP) POST RESPONSE WITH ANSWER
WHEP Is the SAME
Super Simple.
And Finally Means Ecosystem Friendliness
Both WHIP and WHEP Are Getting Industry Support
Dolby.io
Cloudflare
Osprey Talon Encoders
OBS
Flowcaster
LiveU
And Lastly...
Broadcast Bridge
What's Coming in WebRTCs Future?
Or...
What Do I Hope We Will See Soon?
WebCodec Support
DRED (Deep Audio Redundancy)
Bringing All Browsers Up To The Same Spec
LOL.
This Is a Web Problem Generally.
So What's In It For You?
Lack of Control?
Issues Scaling?
You're Not Selling Me on This Dan...
But Seriously.
Use WebRTC Right...
And It Will Work Well for You.
WebRTC Isn't Right for Broadcasting to 100,000 People
WebRTC Isn't Right for Broadcasting to 100,000 People (Usually)
WebRTC Is Not Right for Transporting Media Inside a Studio.
WebRTC Is Right for Real Time Collaboration
Where You Need the Lowest Friction
WebRTC Is Right for Weird Network Scenarios
It Is a Tool in the Toolbelt.
And Even Though Web Browsers Frustrate Me
A LOT.
It Is Only Because of the Web Browser That WebRTC
Has Its Superpower
It Works Everywhere
Not Everything Is a Nail Needing a Hammer.
I've Seen Stranger Things Than WebRTC Being Used in Broadcast
That's Me!
Cheers!
Thanks! We're hiring in the UK! https://jobs.everycastlabs.uk @dan_jenkins @
[email protected]
@everycastlabs