自家製オタクソリューションの紹介

Archive everything you want

Transcript

1. W8LT#04 ࣗՈ੡ΦλΫιϦϡʔγϣϯͷ঺հ
   @tondol 2015-07-29 (Wed.)
   
2. Self Introduction
   @tondol ܭࢉ޻ֶઐ߈M2 ˓˓ݚڀࣨ ˠ௕໺ˠେࡕˠ޿ౡˠ໊ݹ԰ˠ ˠʢΠϚίίʣˠࡳຈˠઋ୆ˠ •  ୭͔50ສԁ͘Ε •  ࠓظͷϥϒϥΠϒʂ
3. Self Introduction
   @tondol ܭࢉ޻ֶઐ߈M2 ˓˓ݚڀࣨ ˠ௕໺ˠେࡕˠ޿ౡˠ໊ݹ԰ˠ ˠʢΠϚίίʣˠࡳຈˠઋ୆ˠ •  ୭͔50ສԁ͘Ε •  ࠓظͷϥϒϥΠϒʂ
4. എܠ •  ΦλΫ͸ଟ๩ – ΠϕϯτࢀՃ – ΞϧόΠτ – ݚڀ – W8LTͷࢿྉ࡞੒ •  ࡏ୐ίϯςϯπ – ΞχϝɾϥδΦɾχίੜ౳
   – ϦΞϧλΠϜʹফԽͰ͖ͳ͍͜ͱ΋͋Δ – ظؒݶఆίϯςϯπͷݫ͠͞
5. Archive everything you want
6. ͜ͷੈʹଘࡏ͢Δ͢΂ ͯͷظؒݶఆίϯςϯ πΛΞʔΧΠϒ͍ͨ͠
7. ఏҊ •  NicoAnime –  χίχίͷΞχϝνϟϯωϧΛొ࿥ –  ֤Τϐιʔυ͕ࣗಈΞʔΧΠϒ͞ΕΔ •  NicoKako –  ಛఆͷχίχίੜ์ૹΛొ࿥ –  λΠϜγϑτػೳͰμ΢ϯϩʔυ •  koeradi –  ಛఆͷωοτϥδΦΛ࿥Ի •  ֤αʔϏεͷن໿తʹ͸……ʁ
8. NicoAnime
9. ֓ཁ •  Ϣʔβʔ͕νϟϯωϧΛొ࿥ – ֤Ϋʔϧͷॳճ഑৴ظؒʹ΍Δ •  ఆظతʹcrawler͕ొ࿥ಈըΛ֬ೝ – ߋ৽෼͕͋Ε͹DLϦετʹೖΕΔ •  ఆظతʹdownloader͕ಈըΛDL – DLϦετʹ͋Δ΋ͷΛΞʔΧΠϒ͢Δ •  Ϣʔβʔͷૢ࡞͸΢ΣϒͰ׬݁ – ಈըͷ࠶ੜɾϩʔΧϧ΁ͷDL΋Մೳ
10. σϞ
11. ߏ੒ crawler (Ruby) downloader (Ruby) Niconico Live DB (MySQL) frontend (PHP) file system crontab nginx, php-fpm
12. ٕज़తৄࡉ
    (1) •  Niconico΁ͷϩάΠϯ – secure.nicovideo.jp/secure/login – ্هʹIDͱύεϫʔυΛPOST͢Δ – Ϩεϙϯεͷset-cookieϔομ͔Β user_session஋Λऔಘ͠هԱ͢Δ •  getflv/getthumbinfo – ಈըϝλσʔλΛऔಘ͢ΔAPI – user_sessionΛcookieͰૹ৴ͭͭ͠get – GETύϥϝʔλ/XMLϑΥʔϚοτ
13. ٕज़తৄࡉ
    (2) •  watch – user_sessionΛcookieͰૹ৴ͭͭ͠GET – Ϩεϙϯεͷset-cookieϔομ͔Β history஋Λऔಘ͠هԱ͢Δ •  μ΢ϯϩʔυ – user_session, historyΛcookieͰૹ৴ͭͭ͠ getflvͰऔಘͨ͠ಈըURLΛGET
14. ิ଍ •  Niconico APIʹؔ͢Δৄࡉ – https://github.com/tondol/NicoVideo •  ࿈ଓ࠶ੜ੍ݶͱ͔ը࣭ͱ͔ ϓϨϛΞϜ͡Όͳ͍ͱΩπ͍ͱࢥ͏ – ݄500ԁ͸ޡࠩ
15. NicoKako
16. ֓ཁ •  Ϣʔβʔ͕χίχίੜ์ૹΛొ࿥ – λΠϜγϑτՄೳظؒʹ΍Δ – DLϦετʹ௥Ճ͞ΕΔ •  ఆظతʹdownloader͕ಈըΛDL – DLϦετʹ͋Δ΋ͷΛΞʔΧΠϒ͢Δ •  Ϣʔβʔͷૢ࡞͸΢ΣϒͰ׬݁ – ಈըͷ࠶ੜɾϩʔΧϧ΁ͷDL΋Մೳ – λΠϜγϑτ༧໿؅ཧػೳ΋
17. σϞ
18. ߏ੒ downloader (Ruby) Niconico Live DB (MySQL) frontend (PHP) file system crontab nginx, php-fpm
19. ٕज़తৄࡉ
    (1) •  Niconico΁ͷϩάΠϯ – লུ •  getplayerstatus – χίੜͷϝλσʔλΛऔಘ͢ΔAPI – user_sessionΛcookieͰૹ৴ͭͭ͠GET – XMLϑΥʔϚοτ – λΠϜγϑτDLʹඞཁͳύϥϝʔλͳͲ
20. ٕज़తৄࡉ
    (2) •  λΠϜγϑτDL –  rtmpeϓϩτίϧͰͷ഑৴ –  getplayerstatusͷϨεϙϯεΛݩʹDLʹඞཁͳ ύϥϝʔλΛߏ੒͢Δ –  ύϥϝʔλΛrtmpdumpʹ౉͢ –  DLঢ়گ͕100%ʹͳΔ·ͰϨδϡʔϜ •  ஫ҙ఺ –  ظݶ੾Εͷੜ์ૹ͸DLෆՄ –  ՝ۚࡁΈͳΒ༗ྉੜ์ૹ΋ಉ͡ํ๏ͰDLՄೳ
21. ิ଍ •  λΠϜγϑτDLʹؔ͢Δৄࡉ – https://gist.github.com/tondol/7039259 •  λΠϜγϑτ༧໿ͷ্ݶͱ͔λΠϛϯά ͱ͔ϓϨϛΞϜ͡Όͳ͍ͱΩπ͍ͱࢥ͏ – ݄500ԁ͸ޡࠩ
22. koeradi
23. ֓ཁ •  ωοτϥδΦΛDL͢ΔεΫϦϓτ܊ – ରԠہɿ ௒A&GɾڹɾϦεϥδɾradikoɾϫϩοϓ – ؆қWeb UIΛඋ͑Δ •  ࿥Ի͍ͨ͠์ૹຖʹcrontabʹهड़ – ִि഑৴ͱ͔͸໘౗͔ͩΒඇରԠ – ݱࡏ14ϓϩάϥϜ/ि΄ͲΞʔΧΠϒӡ༻த
24. σϞ
25. ߏ੒ downloader(s) (Ruby/bash) net radio server(s) frontend (PHP) file system crontab nginx, php-fpm
26. ٕज़తৄࡉ •  ࢖༻πʔϧ – rtmpdump/ffmpeg/swftools – rtmpdump: rtmpϓϩτίϧʹΑΔDL – ffmpeg: HLSϓϩτίϧʹΑΔDL, ม׵ – swftools: radikoͷpartialkeyऔಘ༻ •  εΫϦϓτ – RubyͩͬͨΓbashͩͬͨΓ – ઃఆϑΝΠϧ͸dotenvʹهड़
27. ิ଍ •  radikoʹؔ͢Δৄࡉ – http://kyoshiaki.hatenablog.com/entry/ 2014/05/04/184748 •  ஍ํͷϥδΦΛฉ͘ͳΒ radikoϓϨϛΞϜΛܖ໿͠·͠ΐ͏ – ݄300ԁ͸ޡࠩ
28. NicoAnime NicoKako koeradi
29. Q and A?