Tweet
Tweet

Slide 1

Slide 1 text

Engineering a Live Streaming Workflow for Super Bowl 53 at CBS

Slide 2

Slide 2 text

Flavio Ribeiro Director of Engineering, Video Processing Team

Slide 3

Slide 3 text

AGENDA ● Signal Acquisition & Encoding ○ Bitrate Ladder ○ Output Locking ● Advertisement System ● Delivery ● Monitoring ● Testing ● Game Day

Slide 4

Slide 4 text

MISSION: PROMOTE A GOOD EXPERIENCE FOR OUR USERS THROUGHOUT THE GAME

Slide 5

Slide 5 text

SIGNAL ACQUISITION & ENCODING

Slide 6

Slide 6 text

SIGNAL ACQUISITION & ENCODING

Slide 7

Slide 7 text

SIGNAL ACQUISITION & ENCODING ← Master Encoder @ NYBC

Slide 8

Slide 8 text

SIGNAL ACQUISITION & ENCODING ← TIMECODE EMBEDDER FRAME TIMECODE EMBEDDER CARD ➞

Slide 9

Slide 9 text

BITRATE LADDER ● 400x224, 29.97 @ 250 Kbps (QVBR, Quality Level: 7) ● 512x288, 29.97 @ 500 Kbps (QVBR, Quality Level: 7) ● 640x360, 29.97 @ 900 Kbps (QVBR, Quality Level: 7) ● 960x540, 29.97 @ 1.8 Mbps (QVBR, Quality Level: 7) ● 1280x720, 29.97 @ 3 Mbps (QVBR, Quality Level: 7) ● 1280x720, 59.94 @ 6 Mbps (QVBR, Quality Level, 8)

Slide 10

Slide 10 text

QVBR

Slide 11

Slide 11 text

OUTPUT LOCKING More about it: https://d2908q01vomqb2.cloudfront.net/fb644351560d8296fe6da332236b1f8d61b2828a/2019/02/25/AWS_Product-Documentation_OUTPUT-LOCKING.pdf ● Same output medatada across encoders in the pool ○ PTS/DTS ● Encoders talk via Multicast ● Distributed Consensus ○ No master node ● Beware of Ad Breaks and SCTE/ID3/API integrations

Slide 12

Slide 12 text

ADVERTISEMENT SYSTEM

Slide 13

Slide 13 text

DELIVERY

Slide 14

Slide 14 text

OUTCOME

Slide 15

Slide 15 text

OUTCOME

Slide 16

Slide 16 text

MONITORING ● Mux.com

Slide 17

Slide 17 text

MONITORING ● Mux.com ● TouchStream

Slide 18

Slide 18 text

MONITORING ● Mux.com ● TouchStream ● SumoLogic

Slide 19

Slide 19 text

MONITORING ● Mux.com ● TouchStream ● SumoLogic ● Manifest Monitor

Slide 20

Slide 20 text

MONITORING ● Mux.com ● TouchStream ● SumoLogic ● Manifest Monitor ● MultiScreen Viewer ○ Clappr + Clappr RTMP + Nginx

Slide 21

Slide 21 text

MONITORING ● Mux.com ● TouchStream ● SumoLogic ● Manifest Monitor ● MultiScreen Viewer ○ Clappr + Clappr RTMP + Nginx ● Slack Alerts

Slide 22

Slide 22 text

TESTING ● Streaming in Production prior to Game Day ● Identifying Potential Points of Failure ○ Simulate Chaos ● Runbooks / Playbooks

Slide 23

Slide 23 text

TESTING ● Streaming in Production prior to Game Day ● Identifying Potential Points of Failure ○ Simulate Chaos ● Runbooks / Playbooks

Slide 24

Slide 24 text

TESTING ● Streaming in Production prior to Game Day ● Identifying Potential Points of Failure ○ Simulate Chaos ● Runbooks / Playbooks

Slide 25

Slide 25 text

TESTING ● Streaming in Production prior to Game Day ● Identifying Potential Points of Failure ○ Simulate Chaos ● Runbooks / Playbooks ● Tooling for Quickly Making Changes ○ Must be well tested

Slide 26

Slide 26 text

GAME DAY NY - ENCODING SF - DELIVERY FL - SITE

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

GAME DAY Streaming coverage of Super Bowl LIII set viewership records, (...). Across 7.5 million unique devices, (...) viewers consumed more than 560 million total minutes of live game coverage, up +19% from last year. The average minute audience of 2.6 million viewers during the game window is up +31% year-over-year. Reference: https://www.cbspressexpress.com/cbs-sports/releases/view?id=51928

Slide 29

Slide 29 text

WE ARE HIRING!

Slide 30

Slide 30 text

Thanks! @flavioribeiro