Upgrade to Pro — share decks privately, control downloads, hide ads and more …

LINEのネットワーク / Network of LINE

LINEのネットワーク / Network of LINE

LINE Developers

February 15, 2019
Tweet

More Decks by LINE Developers

Other Decks in Technology

Transcript

  1. -*/&ʹ͓͚ΔlωοτϫʔΫz 2019-02-06 /$!D9 %2D9 <5B@ &+ -"%)/ NAT E6@ :H'+

    ?@LAN IP",C5 (#*/ NIC TCP TLS + /  + 7G14  =I3  F>; 0$!.A8 /!-) DNS 6
  2. ΦϯϓϨϛε؀ڥͰͷయܕతͳ-#αʔϏεߏ੒ 2019-02-06 OpenStack Octavia     HAProxy LVS

    (IPVS) LBaaS Frontend LBaaS Backend LB API / Web UI API API / Web UI / CLI 14
  3. /  .VMUJUJFSߏ੒  4UBUFMFTTԽ (PPHMF 'BDFCPPLͳͲͰ࠾༻͞Ε͍ͯΔΞʔΩςΫνϟɾํࣜ <> 2019-02-06 

     / .VMUJUJFS Client L4LB (Hardware) Real Server : In service : Not in service L4LB (Software) Real Server L7LB (Software) L3 Switch (Hardware) Client Stateful L3DSR TCP/HTTP(S) Proxy Stateless L3DSR ECMP [1]     http://yunazuno.hatenablog.com/entry/2016/02/29/090001 16
  4. /  .VMUJUJFS / ϝϯςφϯε༰қԽɺো֐υϝΠϯͷ࠷খԽ .VMUJUJFSಛఆͷॲཧʹूதͤ͞Δ͜ͱͰεέʔϧΞ΢τΛ༰қԽ 2019-02-06 L3 Switch L4LB

    L7LB Whitebox Switch 100G x 32 ports JPY 2,000,000 x86 Linux Server 25G x 1 ports JPY 800,000 x86 Linux Server 25G x 1 ports JPY 800,000          17
  5. L4LB Program -*/&ͷ-#։ൃͱύέοτॲཧͷؔ܎ --#ͷύέοτॲཧ෦෼͸ιϑτ΢ΣΞ 9%1 Ͱ࣮૷ 2019-02-06 Rx Tx Match

    Lookup Rewrite Table VIP-Backend table Statistics table From L3 Switch To L7 LB NIC 1. Match Dst. IP/Port  2. Lookup Hash  Real Server   3. Rewrite IP  Dst. IP, DSCP     18
  6. ղܾࡦ -MFTT  #(1 $-04 ωοτϫʔΫػثɾαʔό૒ํ͕-ϧʔςΟϯά #(1 Λ࢖༻ / ߏ੒ʹΑΓεέʔϥϏϦςΟͱΩϟύγςΟΛ֬อ

    2019-02-06   7,200 servers / POD 7,200 servers / POD 100G x 720 links 10G x 14,400 links 100G x 80 links 100G x 1,440 links 72,000Gbps Capacity L3 22