こんなこともあろうかと、 サーバーは予め増やして置いた 〜アクセス頻度予測を用いてサーバーを自動増減する「計画的スケーリング」その後〜 / LINE Developer Meetup #32

C84357a21083c81c5ccd5550422abc8d?s=47 Ryo Takaishi
April 25, 2018
Technology
7
3.3k

こんなこともあろうかと、 サーバーは予め増やして置いた 〜アクセス頻度予測を用いてサーバーを自動増減する「計画的スケーリング」その後〜 / LINE Developer Meetup #32

LINE Developer Meetup #32 https://line.connpass.com/event/83597/

C84357a21083c81c5ccd5550422abc8d?s=128

Ryo Takaishi

April 25, 2018
Tweet

More Decks by Ryo Takaishi

See All by Ryo Takaishi
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
2
2k
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
2
560
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
1
870
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
2
1.5k
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
2
1.4k
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
0
100
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
4
2.3k
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
2
540
C84357a21083c81c5ccd5550422abc8d?s=48 takaishi
8
880

Other Decks in Technology

See All in Technology
13d936e697fe0f4fa96f926d0a712f6c?s=48 sansanbuildersbox
3
110
7a0bc9670ff654b04d4361a9afd1bba8?s=48 hcrane
18
1.8k
Cd341135f01e6abaf3e9906ca8977256?s=48 emory
0
140
2c58367194cdc9bb97f8e0fd5b20b511?s=48 kenthamaguchi
2
110
1ae8fc4f63ab4770dd4545006489234c?s=48 yukinaga
2
520
C58d9fc209cfdc0b822f851911110fa6?s=48 coe
14
6.2k
1a9a49807415fb97544a7383a9288b84?s=48 conao3
0
140
Df739988f32c42e8c318ef844d6e902b?s=48 oliver_diary
2
120
B46a00cafe34a9437d3a5bc6afc5bee3?s=48 aditya45
0
450
De266761b955b2636e454a1bc7a99ed4?s=48 masayaaoyama
0
110
0af658ea4f11fa7bf803115451890d4c?s=48 ararajp
2
560
5059d3f370ad7e1f4d8de4be79ae1a2c?s=48 rvirus0817
2
340

Featured

See All Featured
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
224
8.3k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
13
480
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
293
39k
Eb8975af8e49e19e3dd6b6b84a542e26?s=48 qrush
282
18k
A0517b08532aec8ab2aae3f65d40ad86?s=48 hannesfritz
26
870
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
5
260
5ce91fa49a613cbc3e20d5f96856473f?s=48 edds
55
9.2k
2bb923c57a1fdc3a2eb484bb8d565fd2?s=48 ufuk
55
5.2k
B83d5b590577969ee79a5ad845411a7d?s=48 ammeep
653
54k
719435d98d452de7ac367c828266cf01?s=48 erikaheidi
10
3.8k
C0b42577cfc2b321be3474618107e933?s=48 samanthasiow
53
6k
32de0bd2ba869609d26fd052a4622778?s=48 cromwellryan
100
5.7k

Transcript

  1. ∁ੴྒ / GMO Pepabo, Inc. 2018-04-24 LINE Developer Meetup #32

    ʙΞΫηεස౓༧ଌΛ༻͍ͯαʔόʔΛࣗಈ૿ݮ͢ΔʮܭըతεέʔϦϯάʯͦͷޙʙ ͜Μͳ͜ͱ΋͋Ζ͏͔ͱɺ αʔόʔ͸༧Ί૿΍ͯ͠ஔ͍ͨ

  2. ιϑτ΢ΣΞΤϯδχΞ ∁ੴ ྒ / @r_takaishi https://repl.info/ TAKAISHI Ryo ٕज़෦ ٕज़ج൫νʔϜ

  3. ΩϟύγςΟϓϥϯχϯά

  4. μ΢ϯ͠ͳ͍ෛՙΛ͞͹͘  ແବͳ͘ద੾ͳϦιʔεΛ഑ஔ͢Δ

  5. !5 • ϐʔΫλΠϜʹ͋Θͤͯ୆਺Λܾఆ • ϝσΟΞ࿐ग़ɾΩϟϯϖʔϯ࣌ʹ͸ݸผʹ૿ઃ ΞϓϦέʔγϣϯαʔόʔͷ৔߹@minne

  6. !6 ϐʔΫλΠϜʹ͋Θͤͯ୆਺Λઃఆ͢Δ৔߹        

      ࣌ؒ             ΞΫηεස౓ʢਖ਼نԽࡁʣ αʔόʔ୆਺

  7. ΞΫηε͕গͳ͍࣌ؒ͸αʔόʔ ୆਺Λ͍͍ײ͡ʹݮΒ͍ͨ͠

  8. ΞΫηε͕ଟ͍࣌ؒ͸ͦΕΛࡹ͚ ΔΑ͏ͳαʔόʔ୆਺ʹ͍ͨ͠

  9. ෛՙʹԠͯ͡ Φʔτεέʔϧ͢Ε͹͍͍

  10. !10 • ϐʔΫ࣌ͷෛՙ͸ॠؒతʹൃੜ͢ΔͨΊɺݕ஌ͯ͠ ͔ΒͷεέʔϧΞ΢τͰ͸ؒʹ߹Θͳ͍ • αʔόʔͷىಈʙαʔϏεΠϯʹ͔͔ΔλΠϜϥά • Ծ૝Ϛγϯͷىಈ • ىಈ࣌ʹ࠷৽ͷΞϓϦέʔγϣϯίʔυΛσϓϩΠ

    ෛՙΛݕ஌ͯ͠Φʔτεέʔϧ͢Δख๏

  11. ͳ͔ͳ͔೉͍͠ʜ

  12. ͱࢥ͍ͬͯͨΒɺ೥ͷ಄ʹ

  13. ͍͍΋ͷ͋ΔΑ…ʂ

  14. ࡾ୐ݚڀॴһʹΑΔ ఏҊख๏

  15. ΞΫηεස౓༧ଌΛ༻͍ͨ ܭըతεέʔϦϯά

  16. ͜Ε·Ͱ஝ੵ͖ͯͨ͠ ΞΫηεϩάΛ࢖ͬͯ ະདྷͷΞΫηεස౓Λ༧ଌ͢Δ

  17. ࣄલʹΞΫηεස౓͕Θ͔Ε͹ɺ ඞཁͳαʔόʔ୆਺΋Θ͔Δ

  18. • minneͰ͸ΞΫηεϩάɾߦಈϩάΛอଘ͍ͯ͠Δ • ྫ͑͹աڈ1ϲ݄ؒɺ1࣌ؒ୯ҐͷΞΫηεස౓͕Θ͔Δ • ͜ͷ࣌ܥྻσʔλΛ༻͍ͯɺະདྷͷΞΫηεස౓Λ༧ଌ͢Δ • ࣄલʹΞΫηεස౓͕Θ͔Ε͹ɺॲཧՄೳͳ୆਺ʹ૿ݮͰ͖Δ !18 Ͳ͏͍͏΋ͷ͔ͬ͘͟Γ

  19. • minneͰ͸ΞΫηεϩάɾߦಈϩάΛอଘ͍ͯ͠Δ • ྫ͑͹աڈ1ϲ݄ؒɺ1࣌ؒ୯ҐͷΞΫηεස౓͕Θ͔Δ • ͜ͷ࣌ܥྻσʔλΛ༻͍ͯɺະདྷͷΞΫηεස౓Λ༧ଌ͢Δ • ࣄલʹΞΫηεස౓͕Θ͔Ε͹ɺॲཧՄೳͳ୆਺ʹ૿ݮͰ͖Δ !19 Ͳ͏͍͏΋ͷ͔ͬ͘͟Γ

    ࠓ೔࿩͢ͷ͸ɺಛʹ͜ͷ෦෼

  20. !20 ϩάऩू෦෼͕ؾʹͳΔํ͸εϥΠυΛνΣοΫʂ IUUQTTQFBLFSEFDLDPNNPOPDISPNFHBOFQFQBCPMPHJOGSBTUSVDUVSFCJHGPPU

  21. !21 ༧ଌʹ͍ͭͯؾʹͳΔํ͸ϖύݚϒϩάΛνΣοΫʂ IUUQTSBOEQFQBCPDPNBSUJDMFJPUNJZBLFZ

  22. ͱ͍͏Θ͚Ͱ ࡞͍ͬͯͧ͘

  23. !23 • ΞΫηεස౓༧ଌ܅ʢϖύݚʣ • αʔόʔ୆਺ܭࢉɾ૿ݮ܅ʢminneʣ ඞཁͳίϯϙʔωϯτ͸Կ͔ʁ

  24. !24 ͜Ε͕ܭըతεέʔϦϯάͷߏ੒ͩʂ cron Redis ΞΫηεස౓༧ଌ܅ (Sidekiq) IaaS API Endpoint ༧ଌΞΫηε਺ͷऔಘ

    ఆظ࣮ߦ αʔόʔ୆਺ܭࢉɾ૿ݮ܅ (hakata) ඞཁαʔόʔ୆਺Λܭࢉɾ૿ݮ ༧૝ΞΫηεස౓Λอଘ

  25. !25 ܭըతεέʔϦϯάͷྲྀΕ ࣌ ࣌ ࣌ ࣌ ຖ೔0࣌ա͗ɿ 1೔෼ͷΞΫηεස౓Λ༧ଌ͢ΔΑ ຖ࣌40෼࣌ա͗ɿ ࣍ͷ1࣌ؒͷΞΫηεස౓༧ଌ͔Βαʔόʔ୆਺Λ૿ݮ͢ΔΑ

  26. • ༧ଌΞΫηεස౓(ϦΫΤετ਺/࣌)Λϕʔεͱ͢Δ • αʔόʔ͕ৗʹҰఆͷεϧʔϓοτ(rpm)Λอͭ୆਺Λ໨ࢦ͢ • εϧʔϓοτظ଴஋(rpm)͸NewRelicͷϝτϦΫε͔Βࢉग़ !26 ඞཁαʔόʔ਺ͷܭࢉ ඞཁ୆਺༧ଌΞΫηεස౓εϧʔϓοτظ଴஋

  27. !27 • ༧ଌΞΫηεස౓ɿ60,000 ϦΫΤετ/࣌ • εϧʔϓοτظ଴஋ɿ1,000 rpm αʔόʔ୆਺ܭࢉͷྫ ඞཁ୆਺༧ଌΞΫηεස౓εϧʔϓοτظ଴஋ 

      

  28. • ʮΞΫηεස౓༧ଌʯͱʮϦιʔεྔܭࢉɾ૿ݮʯͷ2͕ͭඞཁ • ΞΫηεස౓༧ଌ͸1೔ʹ1ճ • Ϧιʔε૿ݮͷλΠϛϯά͸1࣌ؒʹ1ճ • Ϧιʔεྔܭࢉ͸༧ଌ஋ͱεϧʔϓοτظ଴஋Λݩʹܭࢉ !28 ܭըతεέʔϦϯάͷઃܭ·ͱΊ

  29. ධՁɾ՝୊

  30. !30 ΞϓϦέʔγϣϯαʔόʔͷCPU࢖༻཰ ܭըతεέʔϧɿແޮ ܭըతεέʔϧɿ༗ޮ

  31. !31 ΞϓϦέʔγϣϯαʔόʔ୆਺ͷભҠ ܭըతεέʔϧɿແޮ ܭըతεέʔϧɿ༗ޮ

  32. ݁ߏ͍͍͔Μ͡ʹಈ͍͕ͨʜ

  33. ͍͔ͭ͘՝୊΋

  34. !34 • ༧ଌͷਫ਼౓௿ԼʹΑΔϦιʔεෆ଍ • ༧ଌʹݱΕͳ͍ΞΫηε΁ͷରԠ • εέʔϧΞ΢τ͕ؒʹ߹Θͳ͍έʔε ՝୊

  35. ͜͜·Ͱ͸೥ͷ࿩

  36. ผ࡞ۀͷͨΊɺ Ұ࣌తʹఀࢭ͍ͯͨ͠

  37. ݄ࠒ͔Βվળʹணख

  38. εέʔϧΞ΢τ ͕ؒʹ߹Θͳ͍໰୊

  39. !39 • αʔόʔىಈ࣌ʹΞϓϦέʔγϣϯͷίʔυΛऔಘɾ ల։͓ͯ͠ΓɺϘτϧωοΫͱͳ͍ͬͯΔ • ࠷৽Πϝʔδ ≠ ࠷৽ΞϓϦ • ΞϓϦͷϥΠϑαΠΫϧ

    ≠ αʔόʔͷϥΠϑαΠΫϧ ͳͥɺεέʔϧΞ΢τ͕ؒʹ߹Θͳ͍ͷ͔ʁ

  40. !40 ϥΠϑαΠΫϧ CentOS minimal www www build minimal image build

    www image image lifecycle server lifecycle install puppet apply puppet deploy minne-app launch www server www deploy minne-app terminate www server deleted release minne-app

  41. !41 • ࠷৽ΞϓϦ = ࠷৽ΠϝʔδΛ໨ࢦ͢ • ϦϦʔε࣌ʹΠϝʔδΛϏϧυ͠ɺ࠷৽ͷΞϓϦΛ ؚΉΑ͏ʹ͢Δ ϦϦʔε࣌ʹΠϝʔδΛϏϧυ͢Δ

  42. !42 • baseΠϝʔδͷϏϧυ • wwwΠϝʔδͷϏϧυ • wwwΠϝʔδͷݕࠪ • αʔόʔͱͯ͠ىಈ͢Δͷ͔ʁ •

    ىಈͨ͠ޙɺͪΌΜͱ֤ϓϩηε͕ಈ͍ͯΞΫηεͰ͖Δ͔ʁ ΠϝʔδϏϧυʹඞཁͳ΋ͷ͸…ʁ

  43. !43 ͍͍͔Μ͡ʹΠϝʔδΛϏϧυͯ͘͠ΕΔ΍ͭ hakata workflow - build - push - verify

    notify run खݩ͔Βssh࣮ͯ͠ߦ ΞϓϦͷϦϦʔε࣌ʹϏϧυ IaaCͷϦϦʔε࣌ʹϏϧυ

  44. ࣮૷ͯ͠ɺಈ࡞Λ֬ೝ ࠷৽ΞϓϦ࠷৽Πϝʔδ✨

  45. ܭըతεέʔϦϯάΛ࠶Քಇͯ͠ɺ վળ͞Ε͔ͨݕূͨ͠

  46. ܭըతεέʔϦϯάΛ࠶Քಇͯ͠ɺ վળ͞Ε͔ͨݕূͨ͠

  47. !47 • ΠϝʔδͷࣗಈϏϧυʹࢥͬͨΑΓ͕͔͔࣌ؒͬͨ • ࠶Քಇ͠Α͏ͱͨ͠Β͍Ζ͍Ζಈ͔ͣbug fix ࠶Քಇ͸͜ͷMeetupʹؒʹ߹Θͣ…

  48. ࠓޙʹ͝ظ଴͍ͩ͘͞ʂ

  49. ·ͱΊ

  50. !50 • ΞΫηεස౓༧ଌΛ༻͍ɺΞΫηε͕૿͑ΔલʹΦʔ τεέʔϧ • ϖύݚͱ࿈ܞɾ෼୲͠ɺ࣮ݱ • ࢼݧӡ༻͠ɺ՝୊Λચ͍ग़ͨ͠ • ͕ɺվળ·Ͱ͸Ͱ͖ͣ…

    ·ͱΊ

  51. Α͔ͬͨ͜ͱ

  52. !52 • ϖύݚͱ࿈ܞ͠ɺ৽ٕज़Λ࣮ࡍͷαʔϏεʹಋೖ • Φʔτεέʔϧʹ͍ͭͯͷ஌ݟΛಘΔ͜ͱ͕Ͱ͖ͨ Α͔ͬͨ͜ͱ

  53. !53 • ࢓૊Έͷ൚༻Խ • ࠓճ͸IaaS্Ͱ࡞͕ͬͨɺ࢓૊Έࣗମ͸ଞͰ΋࢖͑Δ • ྫɿKubernetesͷΑ͏ͳίϯςφج൫΁ͷల։ • ༧ଌʹݱΕͳ͍ΞΫηε΁ͷରԠ •

    ෛՙΛτϦΨʔͱͨ͠εέʔϧΞ΢τ ࠓޙ΍͍͖͍ͬͯͨ͜ͱ

  54. We are hiring! ϗεςΟϯάαʔϏεͰ৽ٕज़Λ׆༻ ΢ΣϒαʔϏεͷ4JUF3FMJBCJMJUZ&OHJOFFSJOH શࣾతͳٕज़ج൫Λ͕ͬͭΓ ࣄۀΛࠩผԽͰ͖Δٕज़Λ࡞Γग़͍ͨ͠ FUDʜ