Slide 1

Slide 1 text

RTC Performance Testing Monitoring and Management Varun Singh @vr000m, @callstatsio Chicago, 01st October 2014

Slide 2

Slide 2 text

Contributions •  Research – Congestion control – Error resilience •  Standardization – Circuit breakers, adaptive FEC – Extending RTCP XR reports – Multipath RTP – WebRTC Statistics API 2

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

Deconstruction •  Testing –  In Testbeds –  In deployments •  Monitoring à Measure –  RTCP Extended Reports –  WebRTC Stats API •  Management –  Congestion control –  Application interaction –  Infrastructure control 4

Slide 5

Slide 5 text

Measurement Architecture Browser Internals (WebRTC Stack) Browser Internals (WebRTC Stack) WebRTC API WebRTC API APP APP WebRTC Server Signaling Protocol (e.g., SIP, Jingle, …) PeerConnection SRTP/DTLS/UDP Data/SCTP/DTLS/UDP Network Monitoring •  TURN •  Gateway Client Monitoring STATS API Monitoring Server HTTP or WebSockets HTTP, IPFIX, or NetFlow RTCP XR 5

Slide 6

Slide 6 text

Gameplan 1.  Wait for feedback/emails customers 2.  RTCP XR monitoring 3.  WebRTC StatsAPI 6

Slide 7

Slide 7 text

Manual data gathering •  Use chrome://webrtc-internals •  User monitors their session 7

Slide 8

Slide 8 text

RTCP Monitoring •  Send metrics to a performance monitoring server •  Needs support in the WebRTC Stack – Implement RTCP Extension Reports http://tools.ietf.org/html/rfc6792 8 http://tools.ietf.org/html/draft-huang-xrblock-rtcweb-rtcp-xr-metrics

Slide 9

Slide 9 text

WebRTC Stats API •  pc.getStats() – ICE Transport metrics – Audio metrics – Video metrics – Data channel metrics – … •  Endpoints adapt their settings http://w3c.github.io/webrtc-stats/ 9

Slide 10

Slide 10 text

Performance Monitoring •  Annoyances – Call setup time, call failures, NAT traversal •  Transport quality – Relayed or not – Session throughput, delay and loss •  Per-stream media quality – Quality Models, MoS, User feedback 10

Slide 11

Slide 11 text

Management •  Endpoint management –  Congestion control –  DSCP markings •  WebRTC Infra management –  TURN server –  Conference server –  Media Resource Function •  Network Management –  DPI à SNMP –  SDN/NFV 11

Slide 12

Slide 12 text

12 Gather Report Analyze FIX Deploy? webrtc-internal? via email? Has this been reported before? Did it solve the issue? Until next report? Integrate Deploy Diagnose FIX