Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
How to Support Multi-AZs in NFV Services
LINE Developers
PRO
July 13, 2022
Technology
0
73
How to Support Multi-AZs in NFV Services
JANOG50での登壇資料です
LINE Developers
PRO
July 13, 2022
Tweet
Share
More Decks by LINE Developers
See All by LINE Developers
SONiCをLINEのClosネットワークに導入した話 / A story to adopt SONiC in LINE’s Clos Network
line_developers
PRO
1
69
ML PM, DS PMってどんな仕事をしているの?
line_developers
PRO
1
220
LINE iOSエンジニアの日々 / LINE iOS Engineer Days
line_developers
PRO
1
140
“Do you have a virtual router?” Discuss how to use virtual routers
line_developers
PRO
0
540
LINEにおけるネットワーク自動化チーム / Network Automation Team in LINE
line_developers
PRO
0
280
ひとりで書ける! 日英文章作成のコツ / Do-it-yourself! - Tips for writing in Japanese-English
line_developers
PRO
1
410
UIT Survey 2022
line_developers
PRO
0
120
LINE’s Journey; Road to 4 Million Cores in the Private Cloud
line_developers
PRO
0
78
Investigating Kafka performance issue caused by lock contention in xfs
line_developers
PRO
0
240
Other Decks in Technology
See All in Technology
マイクロサービス宣言から8年 振り返りとこれから / Eight Years After the Microservices Declaration A Look Back and A Look Ahead
eisuke
2
130
グローバルチームことはじめ / Bootstrapping a global team
tasshi
1
650
MoT/コネヒト/Kanmu が語るプロダクト開発xデータ分析 - 分析から機械学習システムの開発まで一人で複数ロールを担う大変さ
masatakashiwagi
2
600
OCI DevOps 概要 / OCI DevOps overview
oracle4engineer
PRO
0
480
Deep dive in Reserved Instance ~脳死推奨量購入からの脱却~
kzkmaeda
0
480
メドレー エンジニア採用資料/ Medley Engineer Guide
medley
3
5k
データ分析基盤の要件分析の話(202201_JEDAI)
yabooun
0
210
Oracle Cloud Infrastructure:2023年1月度サービス・アップデート
oracle4engineer
PRO
0
110
MarvelClient Upgrade 64bit クライアントへの自動アップグレード設定
mitsuru_katoh
0
100
ROS_Japan_UG_#49_LT
maeharakeisuke
0
210
IoT から見る AWS re:invent 2022 ― AWSのIoTの歴史を添えて/Point of view the AWS re:invent 2022 with IoT - with a history of IoT in AWS
ma2shita
0
230
400種類のWeb APIをサポートしているデータパイプラインツールにおけるWeb APIとの共存戦略
cdataj
0
160
Featured
See All Featured
Making Projects Easy
brettharned
102
4.8k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
182
15k
Design by the Numbers
sachag
271
18k
Why You Should Never Use an ORM
jnunemaker
PRO
49
7.9k
Embracing the Ebb and Flow
colly
75
3.6k
Faster Mobile Websites
deanohume
295
29k
A better future with KSS
kneath
230
16k
Designing on Purpose - Digital PM Summit 2013
jponch
108
5.9k
GraphQLの誤解/rethinking-graphql
sonatard
39
7.8k
Web development in the modern age
philhawksworth
197
9.6k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
7
570
Code Review Best Practice
trishagee
50
11k
Transcript
Kento KAWAKAMi, Verda Network Development Team, LINE Corporation How to
Support Multi-AZs in NFV Services
l l (Kento KAWAKAMi) l LINE Corporation
l ITSC Network Development Team l l 2019~LINE () DNS Service NAT Service, LB Service, Overlay NW ABOUT ME
Agenda • Our NFV Services • Multi-AZs Support Policy •
How to support Multi-AZs in our NFVs • Conclusion
Our Services A C C B 4
Our Services: NFV A C C B 5
Our NFV Services: DNS DNS l DNS CacheDNS Auth
l IP ANYCAST 6 IP ANCYAST
Our NFV Services: Load Balancer DNS l DNS CacheDNS Auth
l IP ANYCAST Load Balancer l L4LBL7LB l L4LBIP ANYCAST 7 IP ANCYAST
Our NFV Services: NAT DNS l DNS CacheDNS Auth
l IP ANYCAST Load Balancer l L4LBL7LB l L4LBIP ANYCAST NAT l InternetNAT l NATD-PlaneIP ANYCAST 8 IP ANCYAST
• AZ$.- :9%7 • Default :9/, AZ:904 •
# &86 :9 • '2 3 AZ 5)+ • 1( AZ :9* • '2 D-Plane"!# 5) Multi-AZs Support Policy in NFV Services 9
Our NFV Services DNS l DNS CacheDNS Auth l
IP ANYCAST Load Balancer l L4LBL7LB l L4LBIP ANYCAST NAT l InternetNAT l NATD-PlaneIP ANYCAST 10
Our NFV Services DNS l DNS CacheDNS Auth l
IP ANYCAST Load Balancer l L4LBL7LB l L4LBIP ANYCAST NAT l InternetNAT l NATD-PlaneIP ANYCAST 11
DNS: Architecture VM !' l DNS. & VM %+!$
l )# VM + HV BGP / , l Full L3 !$ l VMHV-DNS VIP , l VM ( BGP Daemon*" 12
13 JANOG48: Refresh DNS Infrastructure with Modern Datacenter Network
DNS: Multi-AZs Support(1/2) 2AZDNS%( ". l DNSVMA= 3E l
AZ7> VM68 #'- AZ),*.BGPD l DNS /32 VIP5C l DNS$+&!B; AZ?4F5C/> <1 9:
[email protected]
14
DNS: Multi-AZs Support(2/2) 7AZDNS!(,#%2 l DNSVMPG 8T l AZ=I VM<A
&+1 AZ- 0".2BGPS l DNS /32 VIP:R l DNS'/)$QE AZN9U:R3I F6 BD4O 15 Advertise same VIP CAZM VIP:R l AZ Down>?LJ5KHDNS Server Routing; l DNS!*#
[email protected]
DNSL< Check
• AZ,!( &- ,!1 • Full L3 Network VIP%*
• '"$02 • BGP #3)+ ./"$02 Multi-AZs Support in DNS 16
Our NFV Services DNS l DNS CacheDNS Auth l
IP ANYCAST Load Balancer l L4LBL7LB l L4LBIP ANYCAST NAT l InternetNAT l NATD-PlaneIP ANYCAST 17
LB: Architecture L4LB l l LB Prefix
l IP ANYCAST L7LB l k8sPods l L4LB 18
• !!"" • LB DC$ !0,#/+NFV • (*) !2'%.
• " • LB DNS 1!- • " " !#/+& LB: AZ Support Consideration Points 19
LB: Traffic Balancing(1/2) AZ>!( 8 !&(("( 20 l DC,�- l
'(/ 59 A:< l AZ3* 59 LBDown 4. =)AZBackendDB l AZ> $DB274. %Capacity+E?C l LB6;@1
LB: Traffic Balancing(2/2) AZ!# ( 0$ 21 l AZ%/41
l ( AZ LB "+ ',53. 2*- l DC ) l Latency).&
AZ Pros Cons
• DCA !,7 % *6 • DCA @& "# /- • $AZ Capacity4? 2>8 • ' AZ LB(@ # "$ #+:*6 • AZ) ! 1$ 4? 2> • LB AZB05 !# #;9 • LB =C#"$ # 2> • DCA !;9 • DCA @&"#$ /- .<3 22
AZ Pros Cons
• DCA !,7 % *6 • DCA @& "# /- • $AZ Capacity4? 2>8 • ' AZ LB(@ # "$ #+:*6 • AZ) ! 1$ 4? 2> • LB AZB05 !# #;9 • LB =C#"$ # 2> • DCA !;9 • DCA @&"#$ /- .<3 23
LB: Service-in l Old Network LB l
AZ LB 24
LB: Service-in $4 l Old Network LB%6+5 l AZ!#
LB &3 /27+5 ) ' l %6&3(*1/ +0, 2. 1- l 1 LB 90Gbps"7 25
LB: Service-in $-	U l Old NetworkLB:XDV l AZ68LB=T /27DV
B1? $-&#% $ l :X=T4AC1M) $$-&# DN F5RI 2QH l 1 LB- !90Gbps7Y 3<@ l NW"+(.,/>B3< l AZP$-&#S J; 0K' /EWGL 26 AZP:X0O !*/' /
• VerdaNFVN+1). 4' • DNS • BGP IP ANYCAST •
LB • BGP + L4 L702). • +7).!"5$ ). • & * AZ4'* LINE/1%6-, • LINE"/1 (8 #34' Conclusion 27