Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Elastic{ON} 2018 - Visualizing Content Performance with Elastic at Canadian Broadcasting Corporation (CBC)
Search
Elastic Co
March 01, 2018
Technology
1
4.1k
Elastic{ON} 2018 - Visualizing Content Performance with Elastic at Canadian Broadcasting Corporation (CBC)
Elastic Co
March 01, 2018
Tweet
Share
More Decks by Elastic Co
See All by Elastic Co
Les Vendredis noirs : même pas peur ! - Breizhcamp
elastic
15
810
Confoo Montreal: Ingest node: enriching documents within Elasticsearch
elastic
16
820
Elastic{ON} 2018 - Sipping from the Firehose: Scalable Endpoint Data for Incident Response
elastic
6
4.2k
Elastic{ON} 2018 - A Security Analytics Platform for Today
elastic
3
11k
Elastic{ON} 2018 - The State of Geo in Elasticsearch
elastic
7
12k
Elastic{ON} 2018 - Reliable by design - Applying formal methods to distributed systems
elastic
5
4.7k
Elastic{ON} 2018 - Bigger, Faster, Stronger - Leveling Up Enterprise Logging
elastic
1
5k
Elastic{ON} 2018: Latest in Logstash
elastic
1
4.5k
Elastic{ON} 2018 - Lessons Learned from Workday's Search Application Journey from POC to Production
elastic
2
2.4k
Other Decks in Technology
See All in Technology
Azure AI ことはじめ
tsubakimoto_s
0
130
さらに高品質・高速化を目指すAI時代のテスト設計支援と、めざす先 / AI Test Lab vol.1
shift_evolve
0
190
dxd2024-生成AIに振り回された3か月間の成功と失敗/dxd2024-link-and-motivation
lmi
2
260
What is DRE? - Road to SRE NEXT@広島
chanyou0311
3
630
CEL(Common Expression Language)で書いた条件にマッチしたIAM Policyを見つける / iam-policy-finder
fujiwara3
0
710
コミュニティサービスに「あなたへ」フィードを リリースするまでの試行錯誤
takapy
1
150
AWSで”最小権限の原則”を実現するための考え方 /20240722-ssmjp-aws-least-privilege
opelab
10
4.4k
Azure OpenAI Service Dev Day / LLMでできる!使える!生成AIエージェント
masahiro_nishimi
3
800
フルリモートワークはエンジニアの夢を叶えたか? #cm_odyssey
mamohacy
2
600
VPoEの視点から見た、ヘンリーがサーバーサイドKotlinを使う理由 / Why Server-side Kotlin 2024
cho0o0
1
420
AIエージェントを現場に導入する目線とは
masahiro_nishimi
1
1.5k
開発生産性をむしろ向上させる セキュリティパートナーの作り方 / Dev Productivity Con 2024
flatt_security
0
380
Featured
See All Featured
Music & Morning Musume
bryan
43
5.9k
Teambox: Starting and Learning
jrom
130
8.6k
The Power of CSS Pseudo Elements
geoffreycrofte
64
5.2k
Building Applications with DynamoDB
mza
89
5.8k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
129
32k
Designing for Performance
lara
604
67k
Leading Effective Engineering Teams 2024
addyosmani
3
300
Faster Mobile Websites
deanohume
303
30k
Making the Leap to Tech Lead
cromwellryan
127
8.7k
Become a Pro
speakerdeck
PRO
15
4.8k
Building Effective Engineering Teams - LeadDev
addyosmani
47
2.2k
Code Review Best Practice
trishagee
58
16k
Transcript
Canadian Broadcasting Corporation February 28th, 2018 Visualizing Content Performance with
Elastic Sean Bennett & Stefan Piruzevski
In brief We are going to talk about… - Some
history - What brought us here - Our challenge
Who we are Stefan Piruzevski Sean Bennett
A little history
Our mandate • Distinctly Canadian • Contribute to cultural expression
• Shared national consciousness and identity • Meet Canadians where they consume content • Reflect the cultural of Canada
We’re local.
Like, really local ENGINEERING PHOTO FROM RESOLUTE BAY
Which is big!
Getting our house in order
What we deliver Vertical focused content (News, Comedy, Lifestyle, Sports)
How do we deliver it?
We’re a Broadcaster
The Ask - Where it all started (SP) Number of
stories updated per day, per location, per particular time of day
Educated guess with rudimentary numbers
mvn exec:java -Dexec.mainClass="ca.cbc.INTERNAL.PATH.util.ReferringContent" -Dexec.args="http://<internal path>:<port>/connection-properties/conn ection.properties sysadmin sysadmin output.csv 'inputTemplate:Image
AND (text:Flickr OR text:Flicker)'" Done. Documents found: 421 Success: 421 Failed: 0 Referring content ids: 533 Sample Report!
CBC’s Infrastructure
Content Management System
Owned and Operated
Owned and Operated
Owned and Operated
Owned and Operated
System map
System map CDN (Cache) Internal (Cache) CMS (Cache) CMS (Disk)
CMS (DB)
We looked at:
We looked at: building a custom solution
We looked at: logging tools used by our network teams
We looked at: other vendors and CMS platforms
We looked at: existing internal tools
We looked at: creating more JAVA classes
We looked at: The possibility of creating a mirrored environment
with real-time replication of our data so we could query the db in a non-audience facing environment.
We looked at: EVERYTHING
You said “Banana”!
BANANAS! Query existing Solr indexes Graphical UI!!! No more manual
Solr queries We loved it Performance vs Flexibility
None
Dynamic provisioning Not complicated Easily incorporate into our CMS
None
What are we using
What are we using To Logstash or not to Logstash
Real-time data with Beats Easily add Filebeat into our CMS
What are we using Easy to learn Already used in
by some teams Not directly connected to Production
What are we using Bad Data Wiping Everything Duplicate Data
What are we using
What are we using Apply Banana Lessons Real-time Dashboards Don’t
judge us.
What are we using
Let’s Assemble! ?
The players !
None
The Ask - Where it all started (SP) Number of
stories updated per day, per location, per particular time of day
Number of stories updated per day, per location, per particular
time of day
Now what? ?
Capture all the things!
Number of stories updated per day, per location, per particular
time of day
Number of stories updated per day, per location, per particular
time of day
Number of stories updated per day, per location, per particular
time of day
Number of stories updated per day, per location, per particular
time of day
None
None
None
None
None
None
None
None
None
None
Rinse, Repeat
Next level data-driven decision making •Workflow/Process improvements •Identifying opportunities •Giving
more accurate performance measurement
Let’s loop in the audience!
Thanks! Catch us at the AMA booth! Stefan Piruzevski Sean
Bennett