Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How to Support Multi-AZs in NFV Services

How to Support Multi-AZs in NFV Services

JANOG50での登壇資料です

LINE Developers
PRO

July 13, 2022
Tweet

More Decks by LINE Developers

Other Decks in Technology

Transcript

  1. Kento KAWAKAMi, Verda Network Development Team, LINE Corporation
    How to Support Multi-AZs
    in NFV Services

    View Slide

  2. l

    l (Kento KAWAKAMi)
    l LINE Corporation
    l ITSC Network Development Team
    l
    l 2019~LINE ()
    DNS Service
    NAT Service, LB Service, Overlay NW
    ABOUT ME

    View Slide

  3. Agenda • Our NFV Services
    • Multi-AZs Support Policy
    • How to support Multi-AZs in our NFVs
    • Conclusion

    View Slide

  4. Our Services
    A C
    C B
    4

    View Slide

  5. Our Services: NFV
    A C
    C B
    5

    View Slide

  6. Our NFV Services: DNS
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST

    6
    IP ANCYAST

    View Slide

  7. Our NFV Services: Load Balancer
    DNS
    l DNS CacheDNS Auth

    l IP ANYCAST
    Load Balancer
    l L4LBL7LB

    l L4LBIP ANYCAST
    7
    IP ANCYAST

    View Slide

  8. Our NFV Services: NAT
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT

    l NATD-PlaneIP ANYCAST
    8
    IP ANCYAST

    View Slide

  9. • AZ$.-:9%7
    • Default
    :9/,AZ:904
    • #
    &86:9
    • '2 3 AZ 5)+
    • 1(
    AZ :9*
    • '2 D-Plane"!# 5)
    Multi-AZs Support Policy in NFV Services
    9

    View Slide

  10. Our NFV Services
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT

    l NATD-PlaneIP ANYCAST
    10

    View Slide

  11. Our NFV Services
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT

    l NATD-PlaneIP ANYCAST
    11

    View Slide

  12. DNS: Architecture
    VM !'
    l DNS. &VM
    %+!$
    l )#VM
    +HV
    BGP / ,
    l Full L3!$
    l VMHV-DNSVIP ,
    l VM( BGP Daemon*"
    12

    View Slide

  13. 13
    JANOG48: Refresh DNS Infrastructure with Modern Datacenter Network

    View Slide

  14. DNS: Multi-AZs Support(1/2)
    2AZDNS%( ".
    l DNSVMA=
    3E
    l AZ7> VM68 #'-

    AZ),*.BGPD
    l DNS /32 VIP5C
    l DNS$+&!B;
    AZ?4F5C/> <1
    9:[email protected]
    14

    View Slide

  15. DNS: Multi-AZs Support(2/2)
    7AZDNS!(,#%2
    l DNSVMPG8T
    l AZ=I
    VM&+1
    AZ- 0".2BGPS
    l DNS /32 VIP:R
    l DNS'/)$QE
    AZN9U:R3I
    F6
    BD4O
    15
    Advertise same VIP
    CAZMVIP:R
    l AZ Down>?LJ5KHDNS Server
    Routing;
    l DNS!*#[email protected]<
    Check

    View Slide

  16. • AZ,!(
    &-
    ,!1
    • Full L3 NetworkVIP%*
    • '"$02
    • BGP #3)+ ./"$02
    Multi-AZs Support in DNS
    16

    View Slide

  17. Our NFV Services
    DNS
    l DNS CacheDNS Auth
    l IP ANYCAST
    Load Balancer
    l L4LBL7LB
    l L4LBIP ANYCAST
    NAT
    l InternetNAT

    l NATD-PlaneIP ANYCAST
    17

    View Slide

  18. LB: Architecture
    L4LB
    l
    l LB Prefix

    l IP ANYCAST

    L7LB
    l k8sPods
    l L4LB
    18

    View Slide

  19. • !!""
    • LB DC$!0,#/+NFV
    • (*)!2'%.
    • "
    • LB DNS
    1!-
    • "" !#/+&
    LB: AZ Support Consideration Points
    19

    View Slide

  20. LB: Traffic Balancing(1/2)
    AZ>!( 8
    !&(("(
    20
    l DC,0-
    l '(/59
    A:<
    l AZ3*59LBDown 4.
    =)AZBackendDB
    l AZ>$DB274.
    %Capacity+E?C
    l LB6;@1

    View Slide

  21. LB: Traffic Balancing(2/2)
    AZ!#( 0$
    21
    l AZ%/41
    l ( AZ LB
    "+ ',53.
    2*-
    l DC )
    l Latency).&

    View Slide

  22. AZ




    Pros
    Cons
    • DCA
    !,7%
    *6
    • DCA
    @& "#

    /-
    • $AZ
    Capacity4?
    2>8
    • '
    AZ
    LB(@
    #
    "$ #+:*6
    • AZ)
    !
    1$
    4?2>
    • LB
    AZB05 !#
    #;9
    • LB =C#"$ #
    2>
    • DCA
    !;9
    • DCA
    @&"#$
    /-.<3
    22

    View Slide

  23. AZ




    Pros
    Cons
    • DCA
    !,7%
    *6
    • DCA
    @& "#

    /-
    • $AZ
    Capacity4?
    2>8
    • '
    AZ
    LB(@
    #
    "$ #+:*6
    • AZ)
    !
    1$
    4?2>
    • LB
    AZB05 !#
    #;9
    • LB =C#"$ #
    2>
    • DCA
    !;9
    • DCA
    @&"#$
    /-.<3
    23

    View Slide

  24. LB: Service-in

    l Old Network LB
    l AZ LB


    24

    View Slide

  25. LB: Service-in
    $4
    l Old NetworkLB%6+5
    l AZ!#LB&3/27+5
    )'

    l %6&3(*1/
    +0, 2. 1-
    l 1
    LB90Gbps"7
    25

    View Slide

  26. LB: Service-in
    $-9U
    l Old NetworkLB:XDV
    l AZ68LB=T /27DV
    B1?
    $-% $
    l :X=T4AC1M) $$-
    DN F5RI2QH
    l 1 LB- !90Gbps7Y
    3<@
    l NW"+(.,/>B3<
    l AZP$-S
    J;
    0K' /EWGL
    26
    AZP:X0O
    !*/' /

    View Slide

  27. • VerdaNFVN+1).
    4'
    • DNS
    • BGP
    IP ANYCAST
    • LB
    • BGP + L4L702).
    • +7).!"5$).
    • & *AZ4'*
    LINE/1%6-,
    • LINE"/1
    (8 #34'
    Conclusion
    27

    View Slide