How to Support Multi-AZs in NFV Services

JANOG50での登壇資料です

Transcript

1. Kento KAWAKAMi, Verda Network Development Team, LINE Corporation
   How to Support Multi-AZs
   in NFV Services
   

   View Slide

2. l
   
   l (Kento KAWAKAMi)
   l LINE Corporation
   l ITSC Network Development Team
   l
   l 2019~LINE ()
   DNS Service
   NAT Service, LB Service, Overlay NW
   ABOUT ME
   

   View Slide

3. Agenda • Our NFV Services
   • Multi-AZs Support Policy
   • How to support Multi-AZs in our NFVs
   • Conclusion
   

   View Slide

4. Our Services
   A C
   C B
   4
   

   View Slide

5. Our Services: NFV
   A C
   C B
   5
   

   View Slide

6. Our NFV Services: DNS
   DNS
   l DNS CacheDNS Auth
   l IP ANYCAST
   
   6
   IP ANCYAST
   

   View Slide

7. Our NFV Services: Load Balancer
   DNS
   l DNS CacheDNS Auth
   
   l IP ANYCAST
   Load Balancer
   l L4LBL7LB
   
   l L4LBIP ANYCAST
   7
   IP ANCYAST
   

   View Slide

8. Our NFV Services: NAT
   DNS
   l DNS CacheDNS Auth
   l IP ANYCAST
   Load Balancer
   l L4LBL7LB
   l L4LBIP ANYCAST
   NAT
   l InternetNAT
   
   l NATD-PlaneIP ANYCAST
   8
   IP ANCYAST
   

   View Slide

9. • AZ$.-:9%7
   • Default
   :9/,AZ:904
   • #
   &86:9
   • '2 3 AZ 5)+
   • 1(
   AZ :9*
   • '2 D-Plane"!# 5)
   Multi-AZs Support Policy in NFV Services
   9
   

   View Slide

10. Our NFV Services
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT
    
    l NATD-PlaneIP ANYCAST
    10
    

    View Slide

11. Our NFV Services
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT
    
    l NATD-PlaneIP ANYCAST
    11
    

    View Slide

12. DNS: Architecture
    VM !'
    l DNS. &VM
    %+!$
    l )#VM
    +HV
    BGP / ,
    l Full L3!$
    l VMHV-DNSVIP ,
    l VM( BGP Daemon*"
    12
    

    View Slide

13. 13
    JANOG48: Refresh DNS Infrastructure with Modern Datacenter Network
    

    View Slide

14. DNS: Multi-AZs Support(1/2)
    2AZDNS%( ".
    l DNSVMA=
    3E
    l AZ7> VM68 #'-
    
    AZ),*.BGPD
    l DNS /32 VIP5C
    l DNS$+&!B;
    AZ?4F5C/> <1
    9:0@
    14
    

    View Slide

15. DNS: Multi-AZs Support(2/2)
    7AZDNS!(,#%2
    l DNSVMPG8T
    l AZ=I
    VM&+1
    AZ- 0".2BGPS
    l DNS /32 VIP:R
    l DNS'/)$QE
    AZN9U:R3I
    F6
    BD4O
    15
    Advertise same VIP
    CAZMVIP:R
    l AZ Down>?LJ5KHDNS Server
    Routing;
    l DNS!*#?@DNSL<
    Check
    
    

    View Slide

16. • AZ,!(
    &-
    ,!1
    • Full L3 NetworkVIP%*
    • '"$02
    • BGP #3)+ ./"$02
    Multi-AZs Support in DNS
    16
    

    View Slide

17. Our NFV Services
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT
    
    l NATD-PlaneIP ANYCAST
    17
    

    View Slide

18. LB: Architecture
    L4LB
    l
    l LB Prefix
    
    l IP ANYCAST
    
    L7LB
    l k8sPods
    l L4LB
    18
    

    View Slide

19. • !!""
    • LB DC$!0,#/+NFV
    • (*)!2'%.
    • "
    • LB DNS
    1!-
    • "" !#/+&
    LB: AZ Support Consideration Points
    19
    

    View Slide

20. LB: Traffic Balancing(1/2)
    AZ>!( 8
    !&(("(
    20
    l DC,0-
    l '(/59
    A:<
    l AZ3*59LBDown 4.
    =)AZBackendDB
    l AZ>$DB274.
    %Capacity+E?C
    l LB6;@1
    

    View Slide

21. LB: Traffic Balancing(2/2)
    AZ!#( 0$
    21
    l AZ%/41
    l ( AZ LB
    "+ ',53.
    2*-
    l DC )
    l Latency).&
    

    View Slide

22. AZ
    
    
    
    
    Pros
    Cons
    • DCA
    !,7%
    *6
    • DCA
    @& "#
    
    /-
    • $AZ
    Capacity4?
    2>8
    • '
    AZ
    LB(@
    #
    "$ #+:*6
    • AZ)
    !
    1$
    4?2>
    • LB
    AZB05 !#
    #;9
    • LB =C#"$ #
    2>
    • DCA
    !;9
    • DCA
    @&"#$
    /-.<3
    22
    

    View Slide

23. AZ
    
    
    
    
    Pros
    Cons
    • DCA
    !,7%
    *6
    • DCA
    @& "#
    
    /-
    • $AZ
    Capacity4?
    2>8
    • '
    AZ
    LB(@
    #
    "$ #+:*6
    • AZ)
    !
    1$
    4?2>
    • LB
    AZB05 !#
    #;9
    • LB =C#"$ #
    2>
    • DCA
    !;9
    • DCA
    @&"#$
    /-.<3
    23
    

    View Slide

24. LB: Service-in
    
    l Old Network LB
    l AZ LB
    
    
    24
    
    

    View Slide

25. LB: Service-in
    $4
    l Old NetworkLB%6+5
    l AZ!#LB&3/27+5
    )'
    
    l %6&3(*1/
    +0, 2. 1-
    l 1
    LB90Gbps"7
    25
    

    View Slide

26. LB: Service-in
    $-9U
    l Old NetworkLB:XDV
    l AZ68LB=T /27DV
    B1?
    $-% $
    l :X=T4AC1M) $$-
    DN F5RI2QH
    l 1 LB- !90Gbps7Y
    3<@
    l NW"+(.,/>B3<
    l AZP$-S
    J;
    0K' /EWGL
    26
    AZP:X0O
    !*/' /
    

    View Slide

27. • VerdaNFVN+1).
    4'
    • DNS
    • BGP
    IP ANYCAST
    • LB
    • BGP + L4L702).
    • +7).!"5$).
    • & *AZ4'*
    LINE/1%6-,
    • LINE"/1
    (8 #34'
    Conclusion
    27
    

    View Slide