About CICD and Monitoring at LINE

「LINEにおけるCI/CDとMonitoring」
LINE Growth Technology 黒木亮太

うちのDevOps事情〜大規模サービスのモニタリングあれこれ〜
https://techplay.jp/event/765163

Transcript

1. LINEにおける
   CI/CD と Monitoring
   うちのDevOps事情〜大規模サービスのモニタリングあれこれ〜
   2020.01.29
   LINE Growth Technology株式会社
   ⿊⽊亮太
   

   View Slide

2. ࠇ໦ ྄ଠ
   -*/&(SPXUI5FDIOPMPHZגࣜձࣾ
   ։ൃࣨࣨ௕
   Ϡϑʔגࣜձࣾ
   גࣜձࣾ$ZCFS"HFOU
   -*/&(SPXUI5FDIOPMPHZגࣜձࣾ
   .Z1SPGJMF
   DIBNQ@NFMPO
   SZPUBLVSPLJ
   

   View Slide

3. -*/&(SPXUI5FDIOPMPHZʁ
   $*$%
   .POJUPSJOH"MFSU
   01
   02
   03
   Agenda
   

   View Slide

4. -*/&(SPXUI5FDIOPMPHZʁ
   $*$%
   .POJUPSJOH"MFSU
   01
   02
   03
   Agenda
   

   View Slide

5. 子会社(100%)
   開発組織
   

   View Slide

6. .JTTJPO
   'PS(SPXUIPG4FSWJDFTBOE:PV
   αʔϏεͷ੒௕ ਓͷ੒௕
   

   View Slide

7. (SPXUI։ൃͱ͸ʁ
   -*/&ઐ໳ͷۀ຿ҕୗ૊৫ʁ
   (SPXUI)BDLઐ໳ͷνʔϜʁ
   

   View Slide

8. (SPXUI։ൃͱ͸ʁ
   -*/&ઐ໳ͷۀ຿ҕୗ૊৫ʁ
   (SPXUI)BDLઐ໳ͷνʔϜʁ
   -*/&αʔϏεͷ੒௕Λ୲͏։ൃ૊৫
   

   View Slide

9. (SPXUI։ൃͱ͸ʁ
   -*/&αʔϏεͷ੒௕
   ಺ଆͷྖҬ ֎ଆͷྖҬ
   

   View Slide

10. -*/&(SPXUI5FDIOPMPHZ
    • -*/&ͷ։ൃ૊৫
    • -*/&ͷಉਫ४Ͱ։ൃΛߦ͏
    • ٕज़
    • ΞʔΩςΫνϟ
    • (SPXUI։ൃΛઐ໳ྖҬͱ͢ΔνʔϜ
    

    View Slide

11. -*/&(SPXUI5FDIOPMPHZ
    

    View Slide

12. • Ҏ߱ͷϓϨθϯ͸ɺ-*/&(SPXUI5FDIOPMPHZʢ(5ʣͷۀ຿
    ࣠Ͱͷ࿩ͱͳΓ·͢
    • -*/&άϧʔϓશମͰ͸ɺඞͣ͠΋ಉ༷ͱ͍͏ࣄͰ͸͋Γ·ͤΜ
    ͸͡Ίʹ
    

    View Slide

13. -*/&(SPXUI5FDIOPMPHZʁ
    $*$%
    .POJUPSJOH"MFSU
    01
    02
    03
    Agenda
    

    View Slide

14. $*$%
    

    View Slide

15. $*$%
    +FOLJOT
    $JSDMF$*
    %SPOF
    1.$ ˞
    
    $*$% 5PPM
    ˞ -*/&಺੡ͷ$*$%πʔϧɻৄࡉ͸ޙड़
    

    View Slide

16. $*$%
    +FOLJOT
    $JSDMF$*
    %SPOF
    1.$ ˞
    
    $*$% 5PPM
    ˞ -*/&಺੡ͷ$*$%πʔϧɻৄࡉ͸ޙड़
    

    View Slide

17. • -*/&Ͱඪ४తʹར༻͞Ε͍ͯΔEFQMPZπʔϧ
    • ໾ׂ
    • $.%# DPOGJHVSBUJPONBOBHFNFOUEBUBCBTF
    
    • #VJME
    • %FQMPZ
    • ؂ࠪ༻ʹϩάΛҰఆظؒʢࣾ಺نఆʣอ࣋͠ɺ(6*ͰՄࢹԽ͕Մೳ
    1.$ͱ͸ʁ
    

    View Slide

18. αʔϏε
    (JUIVC
    &OUFSQSJTF
    1.$
    1.$Λར༻ͨ͠$*$%ͷύλʔϯ
    +FOLJOT
    $* $%
    .BWFO
    CVJMEͰͷੜ੒ϑΝΠϧΛࣾ಺ϦϙδτϦʹೖΕɺཤྺ؅ཧͳͲ΋ߦ͍ͬͯΔ
    

    View Slide

19. ,TͳͲίϯςφͰͷར༻͸૝ఆ͞Ε͍ͯͳ͍ͨΊɺҎԼͷ͍ͣΕ͔ͷରԠ͕ඞਢʹͳͬͯ
    ͘Δ
    • 1.$ͷπʔϧ֦ுʢίϯςφରԠʣ
    • 1.$Ҏ֎ͷ୅ସखஈͷݕ౼
    1.$ͷݱঢ়Ͱͷ՝୊
    

    View Slide

20. ͦ͜Ͱɺ
    

    View Slide

21. ࣮༻Խʹ޲͚ͨࢼΈΛ࣮ࢪத
    ͳͥ%SPOFΛར༻͢Δͷ͔ʁ
    • %PDLFSωΠςΟϒͰ͋Δ
    • εέʔϧϝϦοτ
    • +FOLJOTΑΓ΋ɺCVJMEUFTU͕ߴ଎ʹ࣮ߦՄೳ
    • ࣾ಺ʹશࣾ%SPOF؀ڥ͕͋Δ
    %SPOF
    

    View Slide

22. %SPOFΛ༻͍ͨࢼΈʢΠϚίίʣ
    αʔϏε
    (JUIVC
    &OUFSQSJTF
    1.$
    %SPOF
    )BSCPS
    ˞1SJWBUF%PDLFS3FQPTJUPSZ
    $* $%
    

    View Slide

23. %SPOFΛ༻͍ͨࢼΈʢࠓޙʣ
    αʔϏε
    (JUIVC
    &OUFSQSJTF
    %SPOF
    $*
    )BSCPS
    ˞1SJWBUF%PDLFS3FQPTJUPSZ
    $% "SHP$%
    ˞LTͷͨΊͷΦʔϓϯιʔεͳ
    ίϯςφωΠςΟϒϫʔΫϑϩʔΤϯδϯ
    

    View Slide

24. %SPOFΛ༻͍ͨࢼΈʢࠓޙʣ
    αʔϏε
    (JUIVC
    &OUFSQSJTF
    %SPOF
    $*
    )BSCPS
    ˞1SJWBUF%PDLFS3FQPTJUPSZ
    $% "SHP$%
    ˞LTͷͨΊͷΦʔϓϯιʔεͳ
    ίϯςφωΠςΟϒϫʔΫϑϩʔΤϯδϯ
    αʔϏεಋೖʹ޲͚ͯಈ͍͍ͯΔ͕࣮༻Խʹ͸·ͩ
    ͍͔ͭ͘ϋʔυϧ͕ɻɻ
    ͜ͷ࿩͸࣍ͷػձʹͰ΋
    

    View Slide

25. -*/&(SPXUI5FDIOPMPHZʁ
    $*$%
    .POJUPSJOH"MFSU
    01
    02
    03
    Agenda
    

    View Slide

26. ʢ࣍ͷ"HFOEBʹߦ͘લʹʣ
    -*/&Ͱͷ৬छͷ࿩Λগ͠
    

    View Slide

27. • ΤϯδχΞϩʔϧ
    • αʔόʔαΠυ
    • ϑϩϯτΤϯυ
    • ։ൃࢧԉʢ%FW0QTʣ
    • ։ൃࢧԉʢ%FW0QTʣ
    • αʔϏε։ൃʹ͓͚Δʮࢧԉπʔϧʢ6UJMJUZʣͷ։ൃʯͳͲ43&ͷΑ͏ͳಈ͖ํΛ͢
    ΔνʔϜ
    ΤϯδχΞͷ৬छ
    

    View Slide

28. ৬छͱΧόʔൣғ
    Πϯϑϥ
    ։ൃࢧԉʢ%FW0QTʣ
    αʔόʔαΠυ
    ϑϩϯτΤϯυ
    ϓϥΠϕʔτΫϥ΢υ
    ʢ7FSEBʣ
    ৬छ
    ϛυϧ΢ΣΞ
    ։ൃࢧԉπʔ
    ϧ
    ΞϓϦέʔ
    γϣϯ
    Χόʔൣғ
    

    View Slide

29. -*/&(SPXUI5FDIOPMPHZʁ
    $*$%
    .POJUPSJOH"MFSU
    01
    02
    03
    Agenda
    

    View Slide

30. .POJUPSJOH"MFSU
    

    View Slide

31. .POJUBSJOH
    ;BCCJY
    1SPNFUIFVT
    /4JHIU ˞
    
    .POJUPSJOH 5PPM
    ˞ -*/&಺੡ͷαʔόʔͷ؂ࢹπʔϧɻओʹαʔϏεԣஅͰαʔόʔঢ়گͷ؂ࢹʹ༻͍͍ͯΔ
    

    View Slide

32. .POJUBSJOH
    ;BCCJY
    1SPNFUIFVT
    /4JHIU ˞
    
    .POJUPSJOH 5PPM
    ˞ -*/&಺੡ͷαʔόʔͷ؂ࢹπʔϧɻओʹαʔϏεԣஅͰαʔόʔঢ়گͷ؂ࢹʹ༻͍͍ͯΔ
    

    View Slide

33. 1SPNFUIFVTΛར༻ͨ͠.POJUPSJOHͷύλʔϯ
    (SBGBOB
    1SPNFUIFVT
    .POJUPSJOH 7JTVBMJ[F
    1SPNHFO
    

    View Slide

34. • 1SPNFUIFVTΛΞϓϦέʔγϣϯΤϯδχΞ͕ར༻͠΍͘͢͢Δπʔϧ
    • ػೳ
    • 1SPNFUIFVTͷઃఆϑΝΠϧͷ࡞੒؅ཧ
    • Ξϥʔτͱ௨஌ͷߏ੒؅ཧ
    • 0QFO4PVSDFͱͯ͠ެ։
    • IUUQTHJUIVCDPNMJOFQSPNHFO
    1SPNHFO
    

    View Slide

35. 1SPNHFO
    &OHJOFFSJOH#MPHͰͷؔ࿈هࣄ>
    1SPNFUIFVTΛαʔϏεͱͯ͠ఏڙ͢Δ
    IUUQTFOHJOFFSJOHMJOFDPSQDPNKBCMPHQSPWJ
    EJOHQSPNFUIFVTBTBTFSWJDF
    

    View Slide

36. 1SPNHFOɿ3VMFT
    • ϞχλϦϯάϧʔϧͷઃఆ
    • ࠷௿ݶͷϧʔϧ͸ɺσϑΥϧτͰ༻ҙ͞Ε͍ͯ
    Δ
    • αʔϏεଆͰΧελϚΠζՄೳ
    • దԠͷ0O0GG
    • ᮢ஋
    • ϧʔϧͷΦʔόʔϥΠυ
    

    View Slide

37. 1SPNHFOɿ4FOEFS
    • ௨஌ͷઃఆ
    • ར༻Ͱ͖Δ௨஌ͷछྨ
    • .BJM
    • 4MBDL
    • -*/&
    • XFCIPPL
    

    View Slide

38. 1SPNHFOɿ1SPKFDUT
    • άϧʔϓͷઃఆ
    • ద੾ͳ୯ҐͰάϧʔϐϯάͭͭ͠ɺ؅ཧ͢Δࣄ͕Մೳ
    • ྫʣ
    • 8FC
    • "1*
    • #BUDI ͳͲ
    

    View Slide

39. ͦͷଞͷศརπʔϧ
    

    View Slide

40. • ࣾ಺൛ͷ"OTJCMF(BMBYZ༻ͷϦϙδτϦ
    • ؅ཧର৅
    • 1SPNFUIFVTͷ֤छFYQPSUFS
    • ֤छϛυϧ΢ΣΞ
    • ΞϓϦέʔγϣϯଆʹ"OTJCMF
    ͰೖΕΔ͚ͩͰɺ؅ཧ͠΍͍͢
    ઃఆͰಋೖͰ͖Δ
    $PTNP
    

    View Slide

41. • ΞϥʔτΛ4MBDL΁௨஌ͯ͘͠ΕΔ#PU
    • 1SPNHFOͱ࿈ܞͯ͠ΞϥʔτͷTJMFODFΛ4MBDL্͔ΒઃఆͰ͖Δ
    ".#PU
    

    View Slide

42. ࣭ٙԠ౴
    

    View Slide

43. View Slide

44. View Slide