Log Operation -今あるログと向き合う- / phpconfuk2019

Slide 1

Slide 1 text

ࠓ͋Δϩάͱ޲͖߹͏ খࢁ݈Ұ࿠(.01FQBCP *OD 1)1ΧϯϑΝϨϯε෱Ԭ -PH0QFSBUJPO

Slide 2

Slide 2 text

IUUQTHJUIVCDPNL-P8 ϓϦϯγύϧΤϯδχΞ খࢁ݈Ұ࿠!L-P8 ϗεςΟϯάࣄۀ෦ϗεςΟϯάάϧʔϓϚωʔδυΫϥ΢υνʔϜ

Slide 3

Slide 3 text

w UCMTJTB$*'SJFOEMZUPPMGPSEPDVNFOU BEBUBCBTF XSJUUFOJO(P w σʔλϕʔεʹ઀ଓͯ͠υΩϡϝϯτΛੜ ੒ͯ͘͠ΕΔίϚϯυϥΠϯπʔϧ w 1PTUHSF42-.Z42-42-JUF42- 4FSWFS#JH2VFSZ"NB[PO3FETIJGU w IUUQTHJUIVCDPNL-P8UCMT

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

wϨϯλϧαʔόͷΑ͏ʹߏஙɾӡ༻͕Ϛωʔδυͳ wΦʔτεέʔϧػೳ΋͋Δ wΩϟογϡػೳ΋͋Δ wϗεςΟϯάαʔϏε ͲΜͳαʔϏε

Slide 7

Slide 7 text

IUUQTTQFBLFSEFDLDPNLMPXMPMJQPQNBOBHFEDMPVEJTOPUGBBT ٕज़తͳ͓࿩͸ͪ͜Β

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

ϩά

Slide 10

Slide 10 text

σʔλϩάཤྺɺ৘ใΛه࿥ʹ ࢒͢͜ͱɻ·ͨɺͦͷه࿥ࣗମΛ ࢦ͢ɻ 8JLJQFEJB

Slide 11

Slide 11 text

w 1)1ΞϓϦέʔγϣϯ w 8FC%#ͷγϯϓϧͳߏ੒ w -".1-"11 w "84 w ϏδωεϩδοΫ෦෼͕ൺֱత೉͠Ί w ҙࣝΛूத͢Δ΂͖Օॴ ࠓ·Ͱ

Slide 12

Slide 12 text

w ϕΞϝλϧɺ0QFO4UBDLɺ,VCFSOFUFTΫϥελ/&8 w Ϣʔβ͕ૢ࡞͢ΔμογϡϘʔυ w /VYU1PTUHSF42- )" w ϢʔβͷαΠτΛϗετ͢ΔϗεςΟϯάྖҬ w OHY@NSVCZ(P1PTUHSF42- )" w Ϣʔβʹఏڙ͢Δ.Z42- w ͦͷଞɺΩϟογϡαʔόɺϩʔυόϥϯαɺϦόʔεϓϩΩγɺόο ναʔόɺ"$.&δϣϒΩϡʔγεςϜɺετϨʔδδϣϒΩϡʔγ εςϜ w $POTVM)BTIJ$PSQ7BVMU w FUDFUDFUD w ϚωʔδυΫϥ΢υ

Slide 13

Slide 13 text

w αʔϏεΛߏ੒͢Δཁૉʢαʔό΍ϛυϧ΢ΣΞʣͷछྨ͕૿͑ͨ w 8FCΞϓϦέʔγϣϯͱ%#ͱ8FCαʔόछྨͮͭɺͰ͸ͳ͘ෳ ਺ w αʔϏεΛߏ੒͢Δཁૉͷ਺͕૿͑ͨ w ୯७ʹ਺͕૿͑ͨ w αʔϏεΛར༻͢ΔϢʔβ͕૿͑ͨ w αʔϏεͱͯ͠ͷఏڙ શ͘ҟͳΔಛੑͷγεςϜʹରͯ͠ɺࠓ·Ͱͱಉ͡Α͏ͳϩάͱͷ޲ ͖߹͍ํΛͨ݁͠Ռɺ·ͬͨ͘໾ʹཱͨͳ͍ঢ়گ͕ൃੜ Կ͕ҧ͏ͷ͔

Slide 14

Slide 14 text

τϥϒϧγϡʔτͱϩά

Slide 15

Slide 15 text

ো֐ʹؔ܎ͷ͋Γͦ͏ͳϩάΛݟ͚ͭΔɾूΊΔ ϩά͔Βো֐ͷݪҼΛಡΈղ͘ ͜ͷ͚ͭͩ αʔϏεʹো֐͕ൃੜͨ͠Β

Slide 16

Slide 16 text

͜ͷ͚ͭͩɺ͔͠͠೉͍͠

Slide 17

Slide 17 text

w Ͳ͜ʹϩά͕͋Δͷ͔ w ͦ΋ͦ΋ͲͷαʔόͰԿ͕ಈ͍͍ͯͯͲΜͳϩάΛు͍͍ͯΔͷ͔ɺ γεςϜͷߏ੒Λ೺Ѳ͓ͯ͘͠ඞཁ͕͋Δ w ౰વͱ͍͑͹౰વ w ϩʔϧͱͯ͠΋Λ௒͓͑ͯΓɺDPOTVMED΋ෳ਺ɺDPOTVM NFNCFST֬ೝ͢Δͱۙ͘ͷαʔόʢΠϯελϯεʣ͕͋Δ w ͞Βʹ֤ϩʔϧ্Ͱϛυϧ΢ΣΞ΍ΞϓϦͱ͍ͬͨίϯϙʔωϯ τ͕Ҏ্Քಇ͍ͯ͠Δ w શͯͷ׬શʹ೺Ѳ͓ͯ͘͠ͷ͕೉͍͠ ϩάΛݟ͚ͭΔ೉͠͞

Slide 18

Slide 18 text

w γεςϜ͸ͭͷαʔόͰಈ͍͍ͯΔΘ͚Ͱ͸ͳ͍ɻͦΕͧΕ͕࿈ܞ ͍ͯ͠Δɻ w ඞཁͳϩά͸Ͳͷϩʔϧ·Ͱ w ৑௕ߏ੒ͷ৔߹ɺඞཁͳϩά͸Ͳ͜ʹ͋Δͷ͔ w .BTUFS4MBWFߏ੒ͩͱࠓͲ͕ͬͪ.BTUFS w ෳ਺୆ʹϩʔυόϥϯγϯά͞Ε͍ͯΔߏ੒ͩͱɺશͯͷϩάΛ ू໿͢Δඞཁ͕͋Δ w ୆ʹϩʔυόϥϯγϯά͞ΕͯΕ͹ɺͭͷϖʔδΛදࣔ͢Δ ҝͷϦΫΤετ͸୆ʹ෼ࢄ ϩάΛूΊΔ೉͠͞

Slide 19

Slide 19 text

w ༷ʑͳϑΥʔϚοτͰग़ྗ͞Ε͍ͯΔ w */'0΋8"3/΋&33΋ಉ͡ϩάϑΝΠϧʹ͋Δ͜ͱ΋͋Δ͠෼͔Ε ͍ͯΔ͜ͱ΋͋Δ w ௨ৗΛ஌Βͳ͍ͱҟৗ͕Θ͔Βͳ͍ w αʔϏεΛߏ੒͢Δίϯϙʔωϯτͷछྨͷ෼͚ͩ͋Δ ϩάΛಡΈղ͘೉͠͞

Slide 20

Slide 20 text

Ͳ͏ཱͪ޲͔͏ͷ͔

Slide 21

Slide 21 text

ٕܳ

Slide 22

Slide 22 text

w ·ͣΞϥʔτͷ͋ͬͨαʔόΛΈΔɻΞϥʔτͷͳ͍ো֐ͷ৔߹͸ ͦͷಛੑ͔Βؔ܎͕͋Γͦ͏ͳαʔόΛΈΔ w Ξϥʔτ࣌ࠁ෇ۙɺো֐ൃੜ࣌ࠁ෇ۙͷWBSMPHTZTMPH͔ΒΈΔ w TZTUFNEͰ؅ཧ͞Ε͍ͯΔϓϩηεͷTUEPVUTUEJO͸େ఍TZTMPH ʹू໿͞Ε͍ͯΔ͔Β w 4UBOEBSE0VUQVUTZTMPH4UBOEBSE&SSPSTZTMPH w TZTMPH ͕͋Δ͔Βྺ࢙తʹTZTMPHʹूத͢Δʁ w ͋ͱ͸ͦͷͱ͖ͷঢ়گͰҧ͏͠ɺਓͦΕͧΕελΠϧ͕ҧ͏ ۩ମతʹʢνʔϜϝϯόʔʹฉ͍ͯΈ·ͨ͠ʣ

Slide 23

Slide 23 text

ਓͦΕͧΕͰελΠϧ͕ҧ͏

Slide 24

Slide 24 text

΢ΣϒΦϖϨʔγϣϯ͸ٕܳͰ͋ΓɺՊֶͰ͸ͳ͍ɻਖ਼نͷֶߍڭҭɾ ࢿ֨ɾඪ४͸ গͳ͘ͱ΋ࠓ͸·ͩ ͳ͍ɻզʑͷ΍͍ͬͯΔ͜ͱ͸ɺֶ शʹ΋शಘʹ΋͕͔͔࣌ؒΓɺͦͷޙ΋ࣗ෼ࣗ਎ͷελΠϧΛ໛ࡧ͠ͳ ͚Ε͹ͳΒͳ͍୅෺Ͱ͋Δɻʮਖ਼͍͠ํ๏ʯ͸Ͳ͜ʹ΋ଘࡏ͠ͳ͍ɻͦ ͜ʹ͋Δͷ͸ɺ ͱΓ͋͑ͣࠓ͸ ͏·͍͘͘ͱ͍͏ࣄ࣮ͱɺ࣍͸΋ͬͱ ྑ͘͢Δͱ͍͏֮ޛ͚ͩͩɻ l΢ΣϒΦϖϨʔγϣϯαΠτӡ༻؅ཧͷ࣮ફςΫχοΫz·͕͖͑ΑΓ

Slide 25

Slide 25 text

ٕܳ͸ඞཁ ͔ٕ͚ܳͩ͠͠Ͱ͸πϥ͍ े෼ͳٕܳͷशಘ·Ͱπϥ͍

Slide 26

Slide 26 text

ٕܳΛίʔυͰϘτϜΞοϓ

Slide 27

Slide 27 text

ϩάΛݟ͚ͭΔɾूΊΔ

Slide 28

Slide 28 text

IUUQTTQFBLFSEFDLDPNQZBNBBOGBMTF[IPOHEFKJOLBGLBHBXBORVBOOJSFJ େ౷Ұϩάج൫ʢ,BGLB(SBZMPHʣ

Slide 29

Slide 29 text

w εΩʔϚΛఆ͓ٛͯ͘͜͠ͱͰɺαʔό΁ͷࣄલΠϯετʔϧͳ͠ ʹɺෳ਺ͷαʔόͷϩάΛͭʹू໿͠ɺ࣌ܥྻʹอଘͨ͠ΓɺϦΞ ϧλΠϜʹUBJMͨ͠Γ͢Δπʔϧ w 44)ϩʔΧϧϑΝΠϧ,VCFSOFUFTͷϩάΛಁաతʹू໿Մೳ w IUUQTHJUIVCDPNL-P8IBSWFTU )BSWFTU

Slide 30

Slide 30 text

ϩάΛಡΈղ͘

Slide 31

Slide 31 text

IUUQTTQFBLFSEFDLDPNQZBNBXB[VIXPMJZPOHTJUBEBUPOHTBCBKJBODIBKJQBO 8B[VI

Slide 32

Slide 32 text

IUUQTTQFBLFSEFDLDPNQZBNBXB[VIXPMJZPOHTJUBEBUPOHTBCBKJBODIBKJQBO 8B[VI

Slide 33

Slide 33 text

w ֤αʔόͷओཁͳϩάΛ-PHDPMMFDUPS͕ऩू͠ɺBHFOUܦ༝Ͱ8B[VITFSWFS ʹసૹ w 8B[VITFSWFS͕ύλʔϯϚονʹΑΓϩάΛࣗಈͰಡΈղ͖ɺϨϕϧʹԠͯ͡ ௨஌ w ීஈಡΜͰ͍ͳ͍ϩάΛ୅ΘΓʹಡΜͰҟৗΛڭ͑ͯ͘ΕΔ w ྫ͑͹TZTUFNEͰ؅ཧ͞Εͨ3FTUBSUPOGBJMVSFͳϓϩηεͷ࠶ىಈͳͲ w BVEJUMPH΍BVUIMPHͳͲॏཁ͚ͩΕͲ΋Θ͔Γʹ͍͘ϩά΋ಡΈղ͍ͯ͘Ε Δ w ಠࣗͷϧʔϧ΋؆୯ʹઃఆՄೳ w IUUQTHJUIVCDPNXB[VIXB[VISVMFTFU -PHDPMMFDUPS

Slide 34

Slide 34 text

ϝτϦΫεͱͯ͠ͷϩά

Slide 35

Slide 35 text

w ੜͷϩά͔ΒϝτϦΫεɺ͍ΘΏΔ਺஋ͷ৘ใΛऔಘ͢Δͱ͍͏Ξ ϓϩʔν ϝτϦΫεͱͯ͠ͷϩά k1low@webproxy:~# cat /var/log/nginx/access-443.log | awk '{ i=substr($4, 6, 14);arr[i]++ }END{for(z in arr){ print z,": ",arr[z] } }' | sort 19/Jan/2019:00 : 14957 19/Jan/2019:01 : 58690 19/Jan/2019:02 : 109914 19/Jan/2019:03 : 133299 19/Jan/2019:04 : 156445 19/Jan/2019:05 : 6126 19/Jan/2019:06 : 8578 19/Jan/2019:07 : 13158 19/Jan/2019:08 : 20153 19/Jan/2019:15 : 27856 19/Jan/2019:16 : 27041 19/Jan/2019:17 : 29583

Slide 36

Slide 36 text

w UBJM͍ͯ͠ΔϩάͳͲΛඪ४ೖྗܦ༝ͰϦΞϧλΠϜʹ୯Ґ࣌ؒ୯Ґ ߦͰूܭͳͲ͕Ͱ͖ΔίϚϯυ w ྫ͑͹ඵ͝ͱͷΞΫηε਺ w IUUQTHJUIVCDPNL-P8FWSZ FWSZ # tail -F /var/log/nginx/access-443.log | evry -s 10 -- wc -l

Slide 37

Slide 37 text

w ೚ҙͷϩάΛUBJMͭͭ͠ɺઃఆ͞Εͨ%4-ʹैͬͯϩάΛύʔεͯ͠ ूܭɺϝτϦΫεΛੜ੒͢Δπʔϧ w IUUQTHJUIVCDPNHPPHMFNUBJM w 1SPNFUIFVTͷ&YQPSUFSͱͯ͠΋ػೳ͢Δ w ϚωʔδυΫϥ΢υͰ͸/(*/9ͷϩά͔Β֤ϗετͷϦΫΤετ਺ ΍ϦΫΤεταΠζͷऔಘͳͲʹར༻ NUBJM

Slide 38

Slide 38 text

ϩάΛ࡞Δ

Slide 39

Slide 39 text

w 5$1ύέοτΛղੳͯ͠ߏ଄ԽϩάͰμϯϓ͢Δπʔϧ w 1PTUHSF42-.Z42-ʹରԠʢ3%#.4ઐ༻ͷͭ΋Γ͸ͳ͍ʣ w IUUQTHJUIVCDPNL-P8UDQEQ w ΞϓϦέʔγϣϯͱ3%#.4ͷؒͷ5$1ύέοτΛΩϟϓνϟͯ͠Ϋ ΤϦΛߏ଄Խϩάͱͯ͠औಘ͢Δ͜ͱ͕Մೳ w ύέοτΛΩϟϓνϟ͢Δ͚ͩͳͷͰɺಋೖ΋ఫڈ΋༰қ w ࢲ͸׳Ε͍ͯͳ͍03.ͷΫΤϦϩά͸UDQEQͰݟͨΓ͠·͢ w ߏ଄Խϩάʢ+40/-547ʣͰͷग़ྗΛ͢ΔͷͰػցతʹ࢖͍΍͍͢ UDQEQ

Slide 40

Slide 40 text

w Կ͔࡞ۀΛ࣮ࢪ͢Δͱ͖ɺ4MBDL΍(JU)VC*TTVFʹϩάΛ࢒͢จԽ ͕͋Δ w ࣮ߦͨ͠ίϚϯυͱͦͷ݁Ռ w ͦͷͱ͖ߟ͑ͨ͜ͱ w ࡞ۀͷྲྀΕ΍ίϚϯυ͸ܦݧ΍ٕܳͷܧঝʹͭͳ͕͍ͬͯΔ w ߟ͑ͨ͜ͱ͕ॻ͍ͯ͋ΔͱपΓͷΤϯδχΞ͕ඇಉظʹΞυόΠε͠ ΍͍͢ w ূ੻ͱͳΔ w ͜Ε͸ͲΕ͘Β͍Ұൠతʁ✋ ΦϖϨʔγϣϯͷϩάΛ࢒͢

Slide 41

Slide 41 text

ϩά͔ΒίʔυΛಡΉ

Slide 42

Slide 42 text

w 8B[VIBHFOU͕z"HFOUFWFOURVFVFJTqPPEFEzͱΤϥʔϩ άΛग़͍ͯͨ͠ w BHFOU͕8B[VITFSWFSʹૹΔΠϕϯτͷྔ͕૿͍͑ͯΔͷ͸Θ͔ͬ ͕ͨԿͷΠϕϯτͳͷ͔͸શ͘Θ͔Βͳ͔ͬͨ w ݪҼͷΠϕϯτΛಛఆ͢ΔͨΊʹɺΤϥʔϩάग़ྗ࣌ࠁ෇ۙͰԿͷϓ ϩηε͕ಈ͍͍ͯΔ͔֬ೝͯ͠ΈͨΓɺଞͷϩάͱͷ૬ؔΛௐ΂ͯ ΈͨΓͨ͠ ಛఆͰ్͖ͣํʹ͘Ε͍ͯͨʜ ϩά͚ͩͩͱݫ͍͠

Slide 43

Slide 43 text

8B[VIBHFOUࣗલͰϏϧυͯ͠ σόοάίʔυࠩ͠ࠐΊ͹ ͍͍Μ͡Όͳ͍͔͢Ͷ !QZBNB

Slide 44

Slide 44 text

Slide 45

Slide 45 text

8B[VI͸044

Slide 46

Slide 46 text

IUUQTHJUIVCDPNXB[VIXB[VIͰ͓΋ΉΖʹz"HFOUFWFOU RVFVFJTqPPEFEzͰݕࡧ '-00%&%@#6''&3Ͱఆٛ͞Ε͍ͯͨͷͰࠓ౓ ͸z'-00%&%@#6''&3zͰݕࡧ ಛఆͷؔ਺ʹͨͲΓண͘ɻ$͸ॻ͚ͳ͍͕ϓϩάϥϚͳͷͰɺงғ ؾͰॲཧΛ௥͏ɻ ΠϕϯτΛड͚औΔؔ਺ͱϩάΛग़ྗ͍ͯ͠Δؔ਺͕Θ͔ͬͨͷ ͰɺงғؾͰશͯͷΠϕϯτΛϩάʹग़ྗ͢ΔΑ͏ʹߦ௥Ճͯ͠ ΈΔ Ϗϧυ όΠφϦΛஔ͖׵͑ɻ࣮ߦɻ ϩάͷ৘ใΛى఺ʹίʔυΛಡΉ

Slide 47

Slide 47 text

ݪҼ͕Θ͔ͬͨͧ

Slide 48

Slide 48 text

w Α͘ߟ͑ΔͱݪҼͷղܾํ๏͸ͨͩͷQSJOUσόοά w 1)1ΞϓϦέʔγϣϯͳΒઈର΍͍ͬͯͨͷʹͳͥͦͷ ࢥߟʹ͍ͨΒͳ͔ͬͨͷ͔ʁ w ར༻͍ͯ͠Δ044ΛʮΦʔϓϯͳιϑτ΢ΣΞ 0T4 ʯ ͱΈΔ͔ʮΦʔϓϯͳιʔείʔυ 04T ʯͱΈΔ͔ w ࢹ࠲ͷҧ͍ w ͍͍ܦݧʹͳͬͨ 044Λ0T4ͱΈΔ͔04TͱΈΔ͔

Slide 49

Slide 49 text

·ͱΊ

Slide 50

Slide 50 text

wϩάʹ·ͭΘΔ༷ʑͳΞϓϩʔνΛ঺հͨ͠ wϩά͔ΒޮՌతʹ৘ใΛऔಘ͢Δ͜ͱͰɺ೔ʑ ͷΦϖϨʔγϣϯʹඞཁͳ৘ใྔ͸૿͑Δ wϩάΛى఺ʹ w·ͣ͸ࠓ͋ΔϩάΛಡΉͱ͜Ζ͔Β ·ͱΊ

Slide 51

Slide 51 text

5IBOLZPV ࠷৽ͷ࠾༻৘ใΛνΣοΫˠ !QC@SFDSVJU