Upgrade to Pro — share decks privately, control downloads, hide ads and more …

NDC 2014: 모바일 게임서비스를 위한 사설 클라우드 구축/운영 분투기

NDC 2014: 모바일 게임서비스를 위한 사설 클라우드 구축/운영 분투기

OpenStack과 linux KVM 을 이용해서 사설 클라우드를 구축하고, 그 위에서 모바일 게임 서비스를 했다.
개발 과정과 그 이후 실제 서비스 운영 과정에서 생긴 문제점과 해결 방법 등을 공유한다.

reinkim

May 28, 2014
Tweet

More Decks by reinkim

Other Decks in Programming

Transcript

  1. ݽ߄ੌѱ੐ࢲ࠺झܳਤೠ ࢎࢸ௿ۄ਋٘ҳ୷਍৔࠙ైӝ ӣ૓਌ KJOVLLJN!JGVOGBDUPSZDPN  J'VO'BDUPSZ*OD

  2. 8IP"N* ࣗ೐౟ਝযূ૑פয _J'VO'BDUPSZ*OD _/&90/,PSFB _/$TPGU $ ӝ߈੄ѱ੐ࢲߡ1ZUIPOӝ߈੄ߔূ٘ࢲ࠺झ੘ࢿ

  3. #VJMEJOH1SJWBUF$MPVEGPS.PCJMF(BNFT © Arun Kulshreshtha

  4. 8JUI$PNNPEJUZ
 )BSEXBSF ੌ߈੸ੋYࢲߡ ൔ൤ॳח֎౟ਕ௼झਤ஖ ৈ۞оׯ੄ےࢶ ੸׼ೠ౵ਕࣗझ

  5. 8JUI0QFO4PVSDF4PGUXBSFT -JOVY,7.MJOVYழօ੄о࢚ചࣛܖ࣌ 0QFO4UBDLօܻॳ੉ח௿ۄ਋٘ஶ౟܀۞೐۽ં౟ 1VQQFUಁః૑ઁযࢸ੿ઁয )"1SPYZ۽٘ߖ۠ࢲ ӒܻҊ/(*/9 V84(* EOTNBTR EQLH 'BCSJD

    j
  6. $VSSFOUMZ4FSWFTj ֙ਘࠗఠ࢚ਊࢲ࠺झ नӏѱ੐ࣻѐ۠୊ ੌࠗӝઓࢲ࠺झ઺ੋѱ੐੉੹

  7. -PUTPG5SPVCMFT © iStock.

  8. ޛܻੋ೐ۄझ౟۟୛ ࢲߡ ֎౟ਕ௼झਤ஖ j 04 ࢲߡ झਤ஖ о࢚ച48 04 о࢚ݠन

    "QQMJDBUJPOT 8FCTFSWFS 1)1 +7. j ಌ࠶ܼ௿ۄ਋٘ ഑਷૒੽ࢲ࠺झ ೡٸҊ޹ೡޙઁ ૒੽ࢲ࠺झ഑਷ ಌ࠶ܻयޙઁ 1SPCMFN%PNBJO
  9. *OGSBTUSVDUVSF ޛܻ੸ੋޙઁ  ࢸ੿ҙܻ  ಁ஖ҙܻ  ࢸ஖੗زച  j

    © Fyodor Borisov
  10. ޛܻ੸ੋ ޙઁ ےࢶޙઁࠛ۝ےࢶਵ۽؊ծ਷ࣘب۽ز੘ೞח҃਋ ࣃࢲޙઁࣃࢲয়੘زࣃࢲܻࣇೞ۰ݶݠन੤द੘೧ঠj ౵ਕޙઁٓ঴౵ਕ઺ೞաоաоח҃਋ߊࢤ ٣झ௼ޙઁ*1.*ীࢲ٣झ௼য়ܨܳ҅ࣘ೧ࢲܻನ౴ *1.*੗୓о਽׹উೞח҃਋ j

  11. ࢸ஖੗زചೞӝ ਬࢎೠޛܻࢲߡٜ੉݆׮ࢸ஖੗زചоऔ׮ ੗زࢸ஖ࢲ࠺झਊ48झఖ ੷ࣻળ19& ֎౟ਕ௼ࠗ౴XJUI%)$1 5'51  04ࢸ஖߂ળ࠺%FCJBO*OTUBMMFS ࢲߡࣗ೐౟ਝযझఖࢸ੿1VQQFU CBTITDSJQUT

    j  jӒܻҊਤܳॄࢲ݆਷Ѧࣻ੿೧ঠೣ
  12. ࢸ஖੗زച%)$1ޙઁ 19&ח%)$1੄ ઁೠػ ߸ഋ੉೙ਃ ౠ੿ ֎౟ਕ௼झਤ஖ח׮ܲझਤ஖৬োѾೞݶ೧׼ನ౟ী؀೧%)$1ਃ୒ %)$1೐۽ష௒਷ౠ੿઱ࣗܳt߈ժuೞۄҊݺ۸ೞӝ൨ٜ׮ 19& %FCJBO*OTUBMMFS*1ܳفߣਃ୒ೡ׼߉ח׮ %)$1

     19&ࠗ౴ೞݶࢲ୐ߣ૩*1઱ࣗਃ୒ %FCJBO*OTUBMMFSࢸ஖ೡٸ*1઱ࣗਃ୒੉ٸझਤ஖о%)$1/"$,ਸࠁղ ࢲࢸ஖पಁ
  13. ࢸ஖੗زച%FCJBO*OTUBMMFSޙઁ %FCJBOಁః૑दझమEFCҗVEFC VEFC04ܳࢸ஖ೡٸࢎਊೞӝਤ೧ࢲEFCীࢲݻо૑ࠗ࠙җઁড ਸઁѢೠ࢚؀੸ਵ۽௼ӝо੘਷ಁః૑ ಁః૑޷۞݂ਸೠ׮ݶ߈٘दVEFC౵ੌਸನೣ೧ࢲ޷۞݂೧ঠ ژೠ ٘ۄ੉ߡ૑ਗ੉ݏب۾੸׼ೠழօߡ੹ਸ૑੿೧ঠ

  14. ࢸ஖੗زചࢸ੿ҙܻ1VQQFU ݽٚઁযחQVQQFUࢸ੿ਵ۽ઁযೞ૑݅  ੋૐࢲTJHOJOHޙઁݽٚޛܻݠन੄ੋૐࢲܳഛੋ  ֢٘ఋੑ੄ޙઁݽٚޛܻݠन਷э਷ѱࢸ஖غחо  ಁః૑ߡ੹ ੄ઓࢿ jੜޅػ੄ઓࢿਸٜ݅ݶ੹ഃ࢚ҙহחۄ੉࠳۞ܻস

    Ӓۨ੉٘റী݆਷ࢲ࠺झо੤द੘ػ׮ ழօݽٕ۽٬ࣽࢲޙઁ1VQQFUप೯द੼ীݽٚழօݽٕ۽٘غ૑ঋ਺
  15. ಁః૑੷੢ࣗޙઁ  ࢸ஖ࣘب৬ղࠗীࢲࣻ੿ೠಁః૑ٸޙী۽ஸ੷੢ࣗ਍৔ ਊ۝ޙઁ %FCJBO6CVOUVಁః૑੷੢ࣗℳ(J# SE1BSUZಁః૑੷੢ࣗ 11" ℳ (J# _(J#ࣻળ

     1Z1*޷۞ℳ(J# ೠߣبॳ૑ঋחಁః૑о؀ࠗ࠙ ࠁউޙઁ1Z1*חIUUQӝ߈ җѢ  TJHOJOHহ਺
  16. ಁః૑੷੢ࣗޙઁ  ղࠗ੷੢ࣗࢲߡীBQUDBDIFSOH੉ਊ೧ࢲಁః૑நद நय೐۾द  7.਷੗ӝ߃ী੓חDPNQVUFOPEFীࢲ݅ಁః૑ܳ঳য১ 1Z1*޷۞݂୶о߂1Z1*੗୓о$%/ਸॳѱ߄Պ ֙  1Z1*੽Ӕߑध੉44-ӝ߈

    IUUQT ۽߸҃ Ӕؘ੉ઁ$FOUPTਊZVN੷੢ࣗ SQN ب୶оೞҊ੓׮j
  17. 3FTPVSDF .BOBHFNFOU ޛܻݠन੗ਗೡ׼  -JOVY֎౟ਕ௼ಁ۞޷ఠ  %JTL&MFWBUPS 
 00.,JMMFS 

    4DBMF0VU j © Neo139
  18. ੗ਗೡ׼ઁೠ -JOVY੄VMJNJUҗTZTDUM੄ৈ۞ಁ۞޷ఠীࢲ੗ਗࢎਊ۝ਸઁೠ ֎౟ਕ௼ࢲ࠺झীࢲॳӝীӝࠄч੉ծѢա੘׮ ౠ൤VMJNJU੄OPGJMFҗTZTDUMࢸ੿ਸࣗ௄ࣻ۽ࢤп೧ࢲט۰઻ঠೠ׮ োѾ੉ױदрীށܻӝए਋פTPNBYDPOO OFUEFW@NBY@CBDLMPH чبழঠೠ׮ ݫݽܻ୨۝ૐо৬ডр੄ࢿמ੷ೞ݅੓׮

  19. -JOVY/FUXPSL1BSBNFUFST $PNQVUFOPEFחѐ߹7.ীֈѹ઻ঠೡ*1ಁఉٜਸMJOVYDPOOUSBDLӝמ ਸా೧ҙܻೠ׮ LFSOFMOFUGJMUFS  ೠޛܻݠनীڸ਎7.ࣻY7.߹୭؀*1ࣁ࣌ࣻ݅ఀ੉ч੉ழঠೠ׮ 5$1ҙ۲ಁ۞޷ఠܳࣻ੿೧ࢲ੉޷ՐӟোѾਸ୭؀ೠࡈܻUBCMFীࢲઁѢ JQ@DPOOUSBDL@UDQ@UJNFPVU@ ಁ۞޷ఠࣻ੿ 7.ীࢲ৻ࠗ۽BDUJWFೞѱоחোѾ੉݆ਵݶFQIFNFSBMQPSU੄ߧਤبט

    ۰ঠೠ׮ OFUJQWJQ@MPDBM@QPSU@SBOHF
  20. 00.,JMMFS -JOVY੄ݫݽܻೡ׼਷Ԩաբҙ੸੉׮޺૑݈Ѫ -JWFNJHSBUJPOೞח7.੄ݫݽܻো࢑੉ݒ਋݆਷҃਋ ޛܻݠन੄ ݫݽܻࢎਊ۝әૐ0VU0G.FNPSZ,JMMFSز੘ѐद ԙ࢓ইঠೞח೐۽ࣁझ ૊7.ٜী؀೧ࢲ00.,JMMFS੄WJDUJN੉غ ૑ঋѱQSPDࢸ੿ਸҊ୛ঠ

  21. %JTL&MFWBUPS ѐ߹ഥࢎীࢲחৈ۞ઙܨ੄*0दझమਸࢎਊೠ׮ 44%3"*%WT4"43"*%WT4"5"3"*% j ೞ૑݅੿੘7.ࣻળীࢲח੉ಁ۞޷ఠࢶఖ੉Ѣ੄ର੉оহ׮ ޛܻݠनࣻળীࢲبই઱ডр੄ର੉݅դ׮Ӓېبର੉חաפө %*4,BSSBZఋੑীݏחࢸ੿ਸҊܲ׮

  22. 4DBMF0VU4UBUVT2VP ݆਷ࣻ੄ѱ੐ࢲߡоਢӝࣿӝ߈ ਢࢲߡn਽ਊ೐۽Ӓ۔ࢲߡnؘ੉ఠ߬੉झҳࢿ ਽ਊ೐۽Ӓ۔
 1)1 GBTUDHJ 1ZUIPO84(* +7.ӝ߈੄ৈ۞঱য೐ۨ੐ਖ  ؀੄ѱ੐ࢲߡоѱ੐ਃ୒ਸ׮୊ܻޅೞݶ

  23. Game Server Game Server Game Server Load Balancer Game Server

    Game Server Game Server Game Server Game Server Game Server Data Store Data Store Game Server Data Store 147.46.113.114 147.46.113.114 4DBMF0VU8JUI-PBE#BMBODFS
  24. 4DBMF0VU%FQMPZJOH)"1SPYZ )"1SPYZࣗ೐౟ਝয۽٘ߖ۠ࢲ पઁࢎਊೡٸW$16 (ݫݽܻ۽ডL_L)551SFRVFTUTFD୊ܻ ױ খীࢲ঱әೠVMJNJU DPOOUSBDL j١੄ࢸ੿ਸ׮೧ىঠ )"1SPYZ੄TUBUTTPDLFU੿ࠁഛੋా೧ࢲ੸੺൤ࣻ੿ ࢸ੿߸҃ਸࣗ೐౟੤द੘ਵ۽੸ਊೞݶࢲ਍ਊ

    )"1SPYZ୊ܻਊ۝ਸୡҗೞݶ
  25. Game Server Game Server Game Server Load Balancer Game Server

    Game Server Game Server Game Server Game Server Game Server Data Store Data Store 147.46.113.114 Game Server Game Server Game Server Load Balancer Game Server Game Server Game Server Game Server Game Server Game Server Data Store Data Store 147.46.113.114 Load Balancer 147.46.113.115 4DBMF0VU.VMUJQMF)"1SPYJFT
  26. 4DBMF0VU%/433 )"1SPYZ ೞա੄)"1SPYZ۽୊ܻޅೞח҃਋ূ  ৈ۞؀੄)"1SPYZܳҳࢿ\N؀੄-#^ƒ\O؀੄ѱ੐ࢲߡ^ ௿ۄ੉঱౟ৈ۞؀੄)BQSPYZܳযڌѱࢶఖ  %/4SPVOESPCJOਵ۽੸׼൤࠙ߓ %/433୶оػ%/4੿ࠁо௿ۄ੉঱౟ೠపಌ૕ٸө૑חदр੉Ѧܿ ୶оೠ۽٘ߖ۠ࢲ*1ܳযڌѱೞݶࡈܻ੹׳ೡө

  27. Game Server Game Server Game Server Load Balancer Game Server

    Game Server Game Server Game Server Game Server Game Server Data Store Data Store 147.46.113.114, 147.46.113.115 Game Server Game Server Game Server Load Balancer Game Server Game Server Game Server Game Server Game Server Game Server Data Store Data Store 147.46.113.114 Load Balancer 147.46.113.115 4DBMF0VU.VMUJQMF'MPBUJOH*1T
  28. 4DBMF0VU.VMUJQMF'MPBUJOH*1T рױೠߑߨ%/4઱ࣗ੄FYQJSBUJPOਸ઴ੋ׮ %/4RVFSZ҅க੄நय௿ۄ੉঱౟நयjੜউؽ Ӓېࢲ ೞա੄۽٘ߖ۠ࢲо޷ܻৈ۞ѐ੄*1ܳೡ׼߉ח׮ %/4ۨ௏٘ח୊਺ࠗఠৈ۞ѐ੄*1ܳ33 ࠗೞоழઉࢲೠ؀о׮х׼ޅೞݶ  ۽٘ߖ۠ࢲܳ୶оೞҊৈ۞ѐ੄*1઺ੌࠗܳ৤ӟ׮

  29. -JWFXJUI'044 'SFFPQFO4PVSDF48ߡӒ਋ഥೞӝ .BKPSߡ੹স ߡӒಁ஖ )PUGJY؀਽ೞӝ © OpenSource.org

  30. 0QFO4UBDL#VHT য়ېػ߬੉झ੉޷૑ܳ࢜۽ࢸ੿ೠIZQFSWJTPSীࢲחޅ଺חߡӒ ޛܻݠन%/4઱ࣗоं੗۽द੘ೞݶ7.MJWFNJHSBUJPOपಁ ޛܻݠनਸ࢏ઁೞחੋఠಕ੉झহ਺࢏ઁೞݶਢੋఠಕ੉झࢎݎ ֎౟ਕ௼о࢚ച೐۽ં౟ /FVUSPOBLBRVBOUVN ח঱ઁ৮ࢿ  $16UPQPMPHZܳޖदDPSFX)5TPDLFUDPSFUISFBET j

  31. 0QFO4UBDL.JTTJOH'FBUVSFT 1SJWBUF%/4ҳഅ ૑Ә਷j  $PNQVUFIPTUܳҳ࠙ೡ%/4ࢲ࠺झоহ׮ ૑Әبj  ࢎਊ઺ੋDPNQVUFOPEFઁѢ ૑Әبj 

    ؀दࠁ٘ীࢲഐझ౟૑੿೧ࢲ7.ڸ਋ӝ р੽੸ਵ۽݅j  ۽٘ߖ۠ࢲ ࢤӝח઺঱ઁ  7.ݽפఠ݂ ౵ਕ࢚క݅j
  32. )"1SPYZ-JNJUT ױੌझۨ٘೐۽ࣁझӝ߈੄ࢲ࠺झ प೷੸ੋݣ౭೐۽ࣁझҳഅ੉੓ӟೣ  ೞ૑݅ࢿמ਷DPSFੌٸ؊જ׮   4UBCMFߡ੹਷ই૒44-UFSNJOBUPSӝמ੉হ׮ $POOUSBDLઁೠী઱੄ٜযয়חݽٚোѾ ݽٚ਽ਊ೐۽Ӓ۔ࢲߡোѾ

    4PGUSFTUBSUೡٸীبࣻभ_ࣻߔNT੄HMJUDIоաఋզࣻ੓׮
  33. ࠁউஂড੼؀਽ೞӝ ޛܻݠन7.пࣻળীࢲݽف؀਽೧ঠ ੗઱ ੌযաחޙઁٜ0QFO44- MJCWJSU MJOVYLFSOFM BQBDIFNPE  LFSOFM഑਷੤द੘ޙઁ7.ಁ஖߂੤द੘਷औ૑݅ޛܻݠन਷ 

    ѐ߹7.ীࢲࢎਊೞחݽٚಁః૑ী؀ೠ੿ࠁо੓חѱইפ׮j
  34. .JDSPTPGU 8JOEPXT 8JOEPXTPOMJOVY,7.  ࢜۽਍ಁః૚  ࢜۽਍ݽפఠ݂  j

  35. 8JOEPXT0QFO4UBDL ,7.ޙઁ 8JOEPXT੉޷૑о௼׮-JOVY(J#WT8JOEPXT(J#
 NJHSBUJPO SFTJ[F j7.ҙ۲ো࢑੉ו۰૓׮ ࠂࣻ੄ BSQJOH੉৳ਸٸ߈਽੉MJOVY৬׮ܰ׮ 0QFO4UBDL ,7.੉$16UPQPMPHZ

    ࣗ௄௏যझۨ٘ࣻ ܳઁ؀۽੹׳ೞ ૑ঋח׮ ୡӝചޙઁDMPVEJOJUҗਬࢎೠبҳٜ੉૑ਗೞח8JOEPXTߡ੹੉֫׮
  36. 8JOEPXT"8IPMF/FX8PSME ӝઓ੄ಁః૚दझమࢎਊࠛо1Z1*݅੉ਊоמ /VHFUਊਵ۽߹بಁః૑ઁ੘೧ঠ ݽפఠ݂ਸਤೠӝࠄਬ౰ܻ౭ٜ੉MJOVY৬׮ܴ -%"1হ੉औѱ1,*ӝ߈۽Ӓੋਸਬ૑ೞӝয۵׮ ۄ੉ࣃझҙܻ   

  37. .POJUPSJOH ޙઁ੿੄ೞӝ  ৻ࠗࢲ࠺झ੢গ  ޙઁా૑ೞӝ  j © Sergiomiguelrp

  38. tޙઁu੿੄ೞӝ ੢গ࢚ടਸ੿੄ೞӝয۵׮ $16ࢎਊ۝੉ޛܻݠन7.ࣻ ળীࢲ઴যٜݶtޙઁuੌө  ੿ӝ੼Ѩ  ాनࢎ੢গ 
 ഑਷׮ܲ৻ࠗࢲ࠺झ੢গ

  39. ࠶ۑ߅झపझ౟ ݽ߄ੌѱ੐ب௿ۄ੉঱౟৬ࢲߡ חాन ಁఉؒ೐ ܻߡय )551 QSPUPCVGٮۄೞח௿ۄ ੉঱౟ٜ݅ӝ о૞௿ۄ੉঱౟۽૑ࣘపझ౟

  40. ৻ࠗࢲ࠺झ੢গ ஠஠য়సѱ੐ࢲ࠺झ੢গ  ాनࢎݎ ੌࠗ ੢গ ղࠗࢲ࠺झ೒ۖಬ੢গ  (PPHMF"QQMF࠽݂ࢲߡ਽׹૑ো 

    ഑਷ ౠ੿QBZHBUF੢গ
  41. "MBSN ٜ҅ࣘৈ׮ࠅࣽহযࢲ
 ঌܿӝמҳഅ FNBJߎীউӹ 4.4੸׼ೠ"1*ઁҕ੗  ੗ز੹ചѦӝоѺ

  42. 4VNNBSZ ಣߧೠೞ٘ਝযਤীয়೑ࣗझࣗ೐౟ਝযܳࣻ੿೧ࢲࢎࢸ௿ۄ਋٘ҳ୷ ੋ೐ۄझ౟۟୊ࢸ஖߂਍ਊਸਤ೧ࣗ೐౟ਝযܳѐߊౚ׬ 047.ࣻળ੄ಁ۞޷ఠܳࣻ੿ೞҊపझ౟ 8JOEPXTח׮ܲઙܨ੄ޙઁܳਖ਼ڱj ੹୓ੋ೐ۄ 7. ѱ੐ࢲ࠺झ"1*ܳхदೞҊݽפఠ݂

  43. None