Lock in $30 Savings on PRO—Offer Ends Soon! ⏳

Refresh DNS Infrastructure with Modern Datacent...

Refresh DNS Infrastructure with Modern Datacenter Network

JANOG48 Meeting
https://www.janog.gr.jp/meeting/janog48/linedns-en/

Verda Network Development Team, LINE Corporation
Kawakami Kento

LINE Developers

July 16, 2021
Tweet

More Decks by LINE Developers

Other Decks in Technology

Transcript

  1. • Network software engineer • DNS • OpenStack • Kubernetes

    • Kawakami Kento • LINE Corporation • Network Development Team • LINE New grad in 2019 2
  2. DNS Architecture Designate l ')#846? l *& ! A5 

    DNS Relay l DesignateDNS CacheDNS Auth *;9:.3 DNS Auth l 0@2+$("-<  DNS Cache l Full resolver  =4 ,@%" B>@ B7/13 * %"  6
  3. DNS Architecture Designate l ')#846? l *& ! A5 

    DNS Relay l DesignateDNS CacheDNS Auth *;9:.3 DNS Auth (VRRP => IP ANYCAST) l 0@2+$("-<  DNS Cache (HWLB => IP ANYCAST) l Full resolver  =4 ,@%" B>@ B7/13 * %"  7
  4. Background of the replacement 8 • (#+/'0,2M@ • 2 I5JDNS$<L

    12 named.conf>E9  • 8D!4 • Physical MachineM@ • PM$.&0;.!)F • VerdaAVM  8G • DNS Auth/CacheBH4<PK3 • *2"2<? 7O:DNR • BH4<PK39 • C2%-SQ • CLOS NetworkA8G • CLOS Network*. 6= 8D
  5. VRRP(Virtual Router Redundancy Protocol) • VIP6 APR Request6 Primary #:*

    ,/9$* • DNS Auth /9$>? +A • DNS Auth('.   Service • DoS('-5Service"& <3  • @8 • Act-Stb)2 •  * • L2)2=0 • Act-Stb47! <3 %;1 9
  6. HWLB(Hardware Load Balancer) • HWLB1I #*!#  ($E74 • DNS

    Cache [email protected] 6K • DNS Auth -0D32 /C;A:8 LK • )J, • &)HWLB 4 • H> • #?= DNS'*"* B :5 • VIP(%)HWLB+ <  • EoL • EoS 10
  7. VRRP HWLB Pros Cons •  -*' • Act-Act&$ "

      •  • Act-Act&$+ • L2#, • Act-Stb ! % )( • -*' 11
  8. CLOS Network • LeafSpine  $08 *2 *5! • !%6+

    • Spine7# Leaf&3"1# • Spine/ Super-Spine7# 4': ! • East-West ( • ECMP(Equal Cost Multi Path) )< 9,3" - .; 12 [1]: LINE   https://www.janog.gr.jp/meeting/janog43/program/line/
  9. Full L3 CLOS Network • ToR SwitchHypervisoreBGP Peering • Hypervisor

    FRRCLOSVM   • Hypervisor  VM IP  /32 13
  10. Advertise DNS VIP(2/3) • BGP VM   VM DNSVIP

     • DNSVM Hypevisor    •   DNSVM VIP  16
  11. Advertise DNS VIP(3/3) • BGP %"VM $#VMDNS VIP" • DNS

    VMHypevisor  !  •   DNS VMVIP" • ECMP#  • CLOS Network Best Path % 17
  12. Benefit of IP ANYCAST for DNS(1/4) •   

    • ECMP • L3 Switch! )   • CLOS Network %  $ ( • L2 network#' • BGP& Full L3 Network " 18
  13. Benefit of IP ANYCAST for DNS(2/4) • Act-Act41 (0 !

    !$'*3 • CLOS& IP ANYCST;  ECMP9 ! :<+2 • % $$)8BGP9 ;'*3 • >/ NW6- ! =. ,5 #7  "% $;'*3 19
  14. Benefit of IP ANYCAST for DNS(3/4) • DNS Auth DNS

    Cache !  ( • VRRP HWLB " *'  • IP ANYCAST DNS Auth/Cache  !$ )"%&# 20
  15. VRRP HWLB Pros Cons •  -*' • Act-Act&$ "

      •  • Act-Act&$+ • L2#, • Act-Stb ! % )( • -*' 22
  16. DNS Server VM • DNS VM  • FRR •

       • DNS Server • Bind • NSD • Prometheus Exporters • node_exporter • bind_exporter • nsd_exporter • Health Check Daemon • Next Page=> 23
  17. DNS Server VM Traffic • DNSVMInterface2 • Mgmt Interface •

    Prometheus scrape • ssh •   • Service Interface •  DNS Query  • BGP 24
  18. Monitoring 25 • Prometheus • Scrape exporters • DNS Exporter

    +' • blackbox_exporter •  !Exporter" #0 • DNS QueryVIP )(%  DNS $*  •  ! -, DNS /.&
  19. Health Check Daemon • Health Check DaemonDNSVIP - +)% 

    • VMHV5. !  BGPDown( Service Out% • DaemonDNS2&% • DNS - DNS Query,* • TTL: 1 • Destination: VIP • 6 • 31 • Down #/ "7$40' 26
  20. VRRP HWLB Pros Cons •  -*' • Act-Act&$ "

      •  • Act-Act&$+ • L2#, • Act-Stb ! % )( • -*' 27
  21. Disadvantage of IP ANYCAST • DNS 9@/   VM><&=?B

    • BGP Best Path %F:; • E#76* VM350%  D0 • NW(8"2 VM.8 )?B • -5%F'+ @/4C • BGP%F3A1$, E%F'+!  VM1100%  D0 VM1 VM2 VM3 28
  22. • DNSCN4IP ANYCASTS=J,/#&I<  • !.*/$9B • CLOSBVMO5; -) $H76P

    • ,1$'1!D9B • VM8V1&06P • VIP+"*/$9B • IP ANYCASTCN4%,/#& • BGPBest Path8VFM  NW:E2>  (.1 1 QT • IP ANYCASTK3@URLKA QT • Health Check Daemon?G Conclusion 29