Upgrade to Pro — share decks privately, control downloads, hide ads and more …

카카오의 Kubernetes가 Data Center 화재를 견디는 방법

kakao
November 01, 2024

카카오의 Kubernetes가 Data Center 화재를 견디는 방법

#cloud #kubernetes #cni

판교 Data Center 화재 이후, 카카오의 Kubernetes 구조를 개선한 경험과 이를 구현하면서 겪었던 다양한 문제와 고민에 대해 이야기합니다. Data Center 화재 시, 실제 Kubernetes에 발생했던 여러 문제를 공유하고, 고가용성 Kubernetes 클러스터를 제공하기 위한 설계 아이디어를 공유합니다. 또한 고가용성을 위해 고민했던 etcd, CNI Plugin에 대해서도 설명합니다.

비슷한 문제로 고민하는 Cloud 엔지니어와 Kubernetes를 사용하는 서비스 개발자들에게 도움이 되었으면 합니다.

발표자 : gyu.gyu
카카오의 Kubernetes as a Service를 개발하고 있는 규입니다.

kakao

November 01, 2024
Tweet

More Decks by kakao

Other Decks in Programming

Transcript

  1. ࣗѐ ߊ಴੗ח־ҳੋоਃ  ,VCFSOFUFT"T"4FSWJDFܳѐߊೞחࣗ೐౟ਝযূ૑פয  %,04ѐߊܻ؊ ب਑غ঻ਵݶೞחѪ  ,VCFSOFUFT"T"4FSWJDFѐߊ੗ 

    4JOHMF;POF -> .VMUJ;POF੹ജदҊ۰ೠ੼ FUDE $POUBJOFS/FUXPSL  ,VCFSOFUFT௿۞झఠ਍৔੗  4JOHMF;POFীࢲߊࢤೞח੢গਬഋ  ௿ۄ਋٘֎੉౭࠳ജ҃੄ࢲ࠺झѐߊ੗ ,VCFSOFUFTҙ۲ӝࣿীҙब੓ਵन࠙
  2. $POUSPM1MBOF5PQPMPHZ BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF BQJTFSWFS DPOUSPMMFS

    - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF 4UBDLFE5PQPMPHZ
  3. %,04੄ӝઓҳઑ BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF BQJTFSWFS DPOUSPMMFS

    - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF 4JOHMF;POF 4JOHMF%BUB$FOUFS
  4. %,04੄ӝઓҳઑ -PBE#BMBODFS %BUB1MBOF/PEF %BUB1MBOF/PEF $POUSPM1MBOF/PEF ;POF" -PBE#BMBODFS %BUB1MBOF/PEF %BUB1MBOF/PEF $POUSPM1MBOF/PEF

    ;POF# -PBE#BMBODFS %BUB1MBOF/PEF %BUB1MBOF/PEF $POUSPM1MBOF/PEF ;POF$ (4-# $MVTUFS" $MVTUFS# $MVTUFS$
  5. FUDE۽ੋೠ$SPTT;POF5SBG fi D BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF

    BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF BQJTFSWFS DPOUSPMMFS - NBOBHFS TDIFEVMFS FUDE $POUSPM1MBOF/PEF .VMUJ;POF .VMUJ%BUB$FOUFS ;POF" ;POF# ;POF$
  6. FUDE'PMMPXFS8SJUF BQJTFSWFS FUDE BQJTFSWFS FUDE BQJTFSWFS FUDE ;POF" ;POF# ;POF$

    -FBEFS 'PMMPXFS 8SJUF -PH3FQMJDBUJPO -PH3FQMJDBUJPO 'PMMPXFS
  7. FUDE'PMMPXFS3FBE BQJTFSWFS FUDE BQJTFSWFS FUDE BQJTFSWFS FUDE ;POF" ;POF# ;POF$

    -FBEFS 'PMMPXFS -JOFBSJ[BCMF3FBE -JOFBSJ[BCJMJUZ 'PMMPXFS -JOFBSJ[BCJMJUZ
  8. FUDE-FBEFS3FBE8SJUF BQJTFSWFS FUDE BQJTFSWFS FUDE BQJTFSWFS FUDE ;POF" ;POF# -FBEFS

    'PMMPXFS -JOFBSJ[BCJMJUZ -JOFBSJ[BCJMJUZ 'PMMPXFS -JOFBSJ[BCMF3FBE 
 XSJUF ;POF$
  9.  FUDEݫ౟ܼਸ੉ਊೠ׮  QFFS@TFOU@CZUFT@UPUBM QFFS@SFDFJWFE@CZUFT@UPUBM  TPDLFUMBZFS݅૘҅غחѪਵ۽- -)FBEFS௼ӝоನೣغ૑ঋ਺  QDBQਸࢎਊೠ׮

     UDQEVNQ HPQBDLFU JGUPQ  - -)FBEFS௼ӝನೣ  ݫ౟ܼਸੌੌ൤ઑഥೞ૑ঋҊ$POUSPM1MBOF/PEFীࢲऔѱஂٙоמ  JGUPQ - 1 - #JFUIGrQPSUPSQPSUs FUDE5ISPVHIQVUஏ੿ߑߨ
  10.  ѐ௿۞झఠ੄-FBEFSীࢲݽفஂٙೞৈ೤࢑  оמೞ૑݅࠺ബਯ੸  ಴ࠄ୶୹ਸࢎਊೞ੗  ױࣽޖ੘ਤ୶୹ 4JNQMF3BOEPN4BNQMJOH 

    ಞೞ૑݅੿ഛبоڄয૗  கചޖ੘ਤ୶୹ 4USBUJ fi FE3BOEPN4BNQMJOH  ҅கਸযڌѱաׂѪੋо ҅கਸੜաׂࣻ۾੿ഛبоৢۄх  FUDE౟ې೗੉݆׮ -> FUDEؘ੉ఠ߸ച۝੉݆׮ -> EFTJSFETUBUF ZBNM ੄߸ചо௼׮ ->
 ߓನػXPSLMPBEо݆׮ -> FUDE%#TJ[Fо௼׮  FUDE%#ࢎ੉ૉӝળਵ۽௿۞झఠܳա׀׮ ѐ௿۞झఠ੄FUDE҅࢑਷
  11. Ѿҗ %#4*;& .# 59 ,CT 39 ,CT 505"- ,CT _

       _    _    _   
  12. Ѿҗ %#4*;& .# 59 ,CT 39 ,CT 505"- ੐੄੄௿۞झఠѐࣻ _

         _      _       _       FUDEDSPTT[POFUSBG fi D (CT %#4*;&߹۽௿۞झఠѐࣻоѐۄҊо੿ ࢸ҅ఋ׼ࢿഛੋ
  13.  -BUFODZ  .JDSPTFSWJDF$IBJO-FOHUI  ୭ঈ੄҃਋-BUFODZ $IBJO-FOHUI  NT NT

     ৘ٜܳযҟҊࢲ࠺झ੄҃਋ -BUFODZী޹х $SPTT;POF5SBG fi Dীࢲо੢ޙઁغחѪ
  14. 1BSUJBMF#1'XJUI*174 FUI 
  QSFSPVUJOH 
 *174 %/"5 
 

    SPVUJOHEFDJTJPO UP 
 DJMJVNIPTU DJMJVN@IPTU 4$)&%@$-4 FCQG MYD9999 FUI 
  $SPTT;POF5SBG fi D
  15. 'VMMF#1' FUI 
  QSFSPVUJOH 
 *174 %/"5 
 

    SPVUJOHEFDJTJPO UP 
 DJMJVNIPTU DJMJVN@IPTU 4$)&%@$-4 FCQG FUI 
  4$)&%@$-4 FCQG
  16.  ߧਊ'MBWPS֢٘ѐܳо૑Ҋ੓ח%,04௿۞झఠ  W$16 (J#.FNPSZ  ֢٘חпп׮ܲ;POFীߓ஖  LVCF -

    QSPYZח׮ܲઓী੓חূ٘ನੋ౟݅ਸо૑ب۾ࢲ࠺झࢸ੿  OFUQFSGW੄5$1CZUFSPVOEUSJQMBUFODZஏ੿ ࢿמపझ౟ജ҃
  17. ࢿמѐࢶѾҗ $SPTT;POF-BUFODZ LVCF - QSPYZ VTFD VTFD VTFD VTFD VTFD

    VTFD  'VMMF#1'ܳా೧NTхࣗ  $SPTT;POF-BUFODZחࠁా 
 NT_NTࢎ੉  $SPTT;POFী੄ೠ-BUFODZ 
 ୭ࣗ_୭؀хࣗബҗ  $SPTT;POFࡺ݅ইפۄ*OUSB;POF੄ 
 ࢿמبೱ࢚ؽ
  18. 'VMMF#1'ী੄ೠ5VOOFM -%43 য়ز੘ FUI 
  QSFSPVUJOH 
 *174 %/"5

    
  SPVUJOHEFDJTJPO UP 
 DJMJVNIPTU DJMJVN@IPTU 4$)&%@$-4 FCQG FUI 
  QSFSPVUJOH 
 *174 %/"5 
  SPVUJOHEFDJTJPO UP 
 DJMJVNIPTU DJMJVN@IPTU 4$)&%@$-4 FCQG UVOM
  19. 'VMMF#1'ী੄ೠ5VOOFM -%43 য়ز੘ FUI 
  QSFSPVUJOH 
 *174 %/"5

    
  SPVUJOHEFDJTJPO UP 
 DJMJVNIPTU DJMJVN@IPTU 4$)&%@$-4 FCQG UVOM FUI 
  4$)&%@$-4 FCQG UVOM FCQGחPVUFSUVQMFਸࠁӝٸޙীTWDܳೡࣻহ਺
  20. 'VMMF#1'ী੄ೠ5VOOFM -%43 য়ز੘೧Ѿ FUI 
  4$)&%@$-4 FCQG UVOM FUI

    
  %FDBQTVMBUJPO 4$)&%@$-4 FCQG FCQGEFDBQDPEFܳҳഅೞҊJOKFDUJPO
  21.  %,04੄ӝઓҳઑ 4JOHMF;POF  4JOHMF;POF੄അप੸ੋޙઁ  .VMUJ;POF੹ജदҊ۰ೠѪ  য়ט੄੉ঠӝ 

    FUDE5ISPVHIQVU  $POUBJOFS/FUXPSL1FSGPSNBODF  Ӓ৻  ,T௿۞झఠܳ1SPWJTJPOJOHೞח%,04ղࠗदझమ੄.VMUJ;POFী؀ೠ੉೧  ௿۞झఠղীز੘ೞחпઙ$POUSPMMFS -# 7PMVNF ੿ܻ
  22. 2"