Git scrapingで始める継続的なデータ追跡 / Git Scraping

東京Ruby会議12前夜祭

https://connpass.com/event/339170/

Transcript

1. (JU
   TDSBQJOHͰ࢝ΊΔ
   ܧଓతͳσʔλ௥੻  .BTBUP
   0ICB
   !PICBSZF
   ౦ژ3VCZձٞ
   લ໷ࡇ
   
2.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ w 8FCαΠτΛோΊͯ͜Μͳ͜ͱࢥ͍·ͤΜ͔ʁ
   w ʮ͜ͷσʔλఆظతʹνΣοΫ͍ͨ͠ͳʯ
   w ʮߋ৽͕͋ͬͨΒ௨஌͕ཉ͍͠ʯ
   w ݴ͍׵͑Δͱɺ࣌ؒͷܦաͱͱ΋ʹมԽ͢Δ σʔλΛ௥੻͍ͨ͠χʔζ
   🏃💨🚶 ೔ʑͷ฻Β͠ͷͪΐͬͱͨ͠ࠔΓ
3.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ w ଟ਺͕ڵຯ͋Δσʔλ͸୭͔͕͢Ͱʹ௥੻ͯ͠Δ
   w ࣗ෼͔͠ڵຯ͕ͳ͍σʔλ͸୭΋௥੻ͯ͠ͳ͍
   w ؅ཧऀͰ͋ͬͯ΋ࣗ෼ͷ8FCαΠτͷมԽΛ௥੻ ͯ͠ͳ͍͜ͱ͸ଟ͍
   w աڈͷ͋Δ࣌఺ͰͲ͏͍͏σʔλͩͬͨͷ͔
   w ݱ࣌఺ͷσʔλ͸/೔લͱൺֱͯ͠Ͳ͏͍͏ঢ়گ ͳͷ͔ ॳΊ͔Β௥੻Մೳͳ΋ͷɺͦ͏Ͱͳ͍΋ͷ͕͋Δ
4. ղܾࡦ
   (JU
   TDSBQJOH
   
   Ћ
5.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO /PUJ fi DBUJPO 2 3 "HHSFHBUJPO 888 1  ͸͓·͚
6.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ w 4JNPO
   8JMMJTPOࢯ
   ͷ
   (JU
   TDSBQJOH
   USBDL
   DIBOHFT
   PWFS
   UJNF
   CZ
   TDSBQJOH
   UP
   B
   (JU
   SFQPTJUPSZ
   
   ʹৄ͍͠
   w εΫϨΠϐϯά
   
   (JU
   ʹΑΔόʔδϣϯ؅ཧ
   w (JU)VC
   "DUJPOTͰεΫϦϓτΛఆظ࣮ߦ
   w มߋΛ344Ͱ഑৴Մೳ (JU
   TDSBQJOHͱ͸
   %KBOHPͷ࡞ऀɻ࠷ۙ͸--.ؔ࿈ͷൃ৴͕ଟ͘ɺ5IJOHT
   XF
   MFBSOFE
   BCPVU
   --.T
   JO
   ΛಡΜͩਓ΋ଟ͍ͷͰ͸
   
   IUUQTTJNPOXJMMJTPOOFU0DUHJUTDSBQJOH
   
7.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "HHSFHBUJPO 888 1  εΫϨΠϐϯάεΫϦϓτΛ  (JU)VC
   "DUJPOTͰఆظ࣮ߦͯ͠  EJ ff ͕͋ͬͨΒࣗಈίϛοτ͢Δ
8.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "HHSFHBUJPO 888 1  εΫϨΠϐϯάεΫϦϓτΛ  (JU)VC
   "DUJPOTͰఆظ࣮ߦͯ͠  EJ ff ͕͋ͬͨΒࣗಈίϛοτ͢Δ εΫϨΠϐϯάͷ໘౗ष͍ͱ͜Ζબ
   ɹ✅ɹ
   ࣮ߦ؀ڥΛ༻ҙ͢Δ
   ɹ✅ɹ
   ఆظ࣮ߦ͢Δ࢓૊ΈΛ༻ҙ͢Δ
   ɹ✅ɹ
   σʔλͷอଘ৔ॴΛ༻ҙ͢Δ
   ɹɹɹ
   ݁ՌΛ௨஌͢Δ࢓૊ΈΛ༻ҙ͢Δ
9.  (JU
   TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻
   IUUQTTUBDLPWFS fl PXDPNRVFTUJPOTTFUUJOHVQBHJUIVCDPNNJUSTTGFFE /PUJ fi DBUJPO 2 w 4VCTDSJCF
   344
   GFFE
   w (JU)VC͸ϨϙδτϦͷDPNNJUT
   GFFEΛ "50.ܗࣜͰ഑৴͍ͯ͠Δ
   w IUUQTHJUIVCDPNNZSFQPDPNNJUT NBJOBUPN
   w 4MBDLͳΓ'FFEMZͳΓ೚ҙͷ344
   SFBEFSͰ TVCTDSJCF͢Δ͚ͩ
   w ΋͘͠͸(JU)VCΞΧ΢ϯτͰ8BUDI
   SFQPTJUPSZ ߋ৽͞Εͨ࣌ͷΈ௨஌Λड͚औΔ
10.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻
    IUUQTTUBDLPWFS fl PXDPNRVFTUJPOTTFUUJOHVQBHJUIVCDPNNJUSTTGFFE /PUJ fi DBUJPO 2 w 4VCTDSJCF
    344
    GFFE
    w (JU)VC͸ϨϙδτϦͷDPNNJUT
    GFFEΛ "50.ܗࣜͰ഑৴͍ͯ͠Δ
    w IUUQTHJUIVCDPNNZSFQPDPNNJUT NBJOBUPN
    w 4MBDLͳΓ'FFEMZͳΓ೚ҙͷ344
    SFBEFSͰ TVCTDSJCF͢Δ͚ͩ
    w ΋͘͠͸(JU)VCΞΧ΢ϯτͰ8BUDI
    SFQPTJUPSZ ߋ৽͞Εͨ࣌ͷΈ௨஌Λड͚औΔ εΫϨΠϐϯάͷ໘౗ष͍ͱ͜Ζબ
    ɹ✅ɹ
    ࣮ߦ؀ڥΛ༻ҙ͢Δ
    ɹ✅ɹ
    ఆظ࣮ߦ͢Δ࢓૊ΈΛ༻ҙ͢Δ
    ɹ✅ɹ
    σʔλͷอଘ৔ॴΛ༻ҙ͢Δ
    ɹ✅ɹ
    ݁ՌΛ௨஌͢Δ࢓૊ΈΛ༻ҙ͢Δ 💯
11.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ w ࣗ෼Ҏ֎͸ڵຯͳͦ͞͏ʙͳ΋ͷͨͪ
    w ചΓָ͍ͨثͷ૬৔Ձ֨
    w 4QFBLFS
    %FDLʹެ։ͨ͠εϥΠυͷϒοΫϚʔΫ਺
    w ެ։͍ͯ͠ΔΞϓϦͷετΞϥϯΩϯά
    w HJUTDSBQJOHλά෇͖SFQPTJUPSZ͔Βଞਓͷڵຯ͕ ݟ͑ͯ໘ന͍
    w IUUQTHJUIVCDPNUPQJDTHJUTDSBQJOH
    ࣮ࡍͲ͏͍͏σʔλΛऩूͯ͠Δʁ
12. ͓·͚
    "OBMZ[BUJPO
13.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO 3 HJU
    IJTUPSZΛ׆༻ͨ͠σʔλ෼ੳ w DPNNJUTؒͷࠩ෼Λḷ͍ͬͯ͘͜ ͱͰ࣌ܥྻσʔλ͕ಘΒΕΔ
    w ௥੻ͨ͠σʔλͷมભͷ෼ੳ΍Մ ࢹԽΛͯ͠ΈΔͷ͸͍͔͕͔
14.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO 3 HJUίϚϯυͱ3VCZεΫϦϓτͰ
    ࣌ܥྻσʔλͷ+40/ͱͯ͠ग़ྗ
15.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO 3 %VDL%#
    IUUQTEVDLECPSHXIZ@EVDLEC w γϯάϧόΠφϦͰಈ࡞͢ΔΠϯϓ ϩηε%#
    w 42-JUFΑΓ΋खܰʹ෼ੳͰ͖Δ
    w $47
    +40/
    1BSRVFUϑΝΠϧΛର ৅ʹͦͷ··ΫΤϦΛ࣮ߦՄೳ
    w εΩʔϚΛࣄલʹఆٛ͠ͳͯ͘΋ ΫΤϦΛ࣮ߦՄೳ
16.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO 3 +40/ϑΝΠϧΛର৅ʹ௚઀ΫΤϦ
17.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO 3 ΫΤϦ݁ՌΛ:PV1MPUͰ͓खܰWJTVBMJ[BUJPO
    IUUQTEVDLECPSHEPDTHVJEFTEBUB@WJFXFSTZPVQMPU
    
    MJOF
    DIBSUͰग़͢΂͖ͩͬͨͷΛͳ͔ͥCBS
    DIBSUʹ͍ͯ͠Δ͕͝༰͍ࣻͩ͘͞ ิ଍ :PV1MPU͸
    3VCZ੡ͷ$-*πʔϧ
18.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ "OBMZ[BUJPO /PUJ fi DBUJPO 2 3 "HHSFHBUJPO 888 1 ਺ेߦͷ3VCZεΫϦϓτͰ
    ΄ΜͷΓ฻Β͕͠ศརʹͳΔײ͡ɺָ͍͠
19.  (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻ ͓ΘΓ 💪 (JU
    TDSBQJOH
    
    ЋΛ3VCZͰ࣮ݱ͢Δ࢓૊ΈΛ঺հ͠·ͨ͠
    ʮࣗ෼΋3VCZͱ฻Βͯ͠ΈΑ͏͔ͳʯͱࢥ͑ͨํ͕͍ͨΒ޾͍Ͱ͢ 🚀 ؆୯ʹ࢝ΊΒΕΔςϯϓϨʔτϦϙδτϦΛ࡞ͬͨͷͰͲ͏ͧ
    IUUQTHJUIVCDPNPICBSZFHJUTDSBQJOHUFNQMBUF
    🤝 %JTDMBJNFS
    εΫϨΠϐϯάΛߦ͏ࡍ͸ҎԼΛ֬ೝ͍ͯͩ͘͠͞
    🙏
    ར༻ن໿
    
    SPCPUTUYUͷ९कɺαʔόʔෛՙ΁ͷ഑ྀɺऔಘͨ͠σʔλͷऔΓ ѻ͍ʢஶ࡞ݖ
    
    ݸਓ৘ใͷऔΓѻ͍
    FUD
20.  4NBSU#BOL
    *OD
    
    4PGUXBSF
    &OHJOFFS
    
    &OHJOFFSJOH
    .BOBHFS .BTBUP
    0ICB !PICBSZF !PICBSZF (JU
    TDSBQJOHͰ࢝ΊΔܧଓతͳσʔλ௥੻