LINEで馬券を購入する / Purchase a betting ticket at LINE

Transcript

1. LINEͰഅ݊Λߪೖ͢Δ ؔ੢NodeֶԂ #3 2018/08/03 େౡ ޫو@sbntaminif

2. ࣗݾ঺հ • ΢ΣϒϦΦגࣜձࣾWEBΤϯδχΞ + ϓϩμΫτ Ϛωʔδϟʔɹ࠷ۙ͸ϚωʔδϟʔଟΊ • ҰԠओ࠵΍ͬͯ·͕͢ࢲͩͬͯ஻Γ͍ͨ • ීஈ͸ژ౎Ͱಇ͍͍ͯ·͢

   • ࠓ೔͜Εͷ࿩Ұ੾͠·ͤΜ↘

3. Q. അ݊͸ Ͳ͏΍ͬͯ ߪೖ͢Δʁ A. ωοτߪೖ αʔϏεΛ ࢖༻͠·͢

4. അ݊ωοτߪೖαʔϏε • JRA I-PATͱݴ͍·͢ɻ • ଈPAT, A-PAT΋͋Γ·͢ • ਃ͠ࠐΈ੍ͷձһઐ༻αΠτ •

   Webݶఆ • ΋ͪΖΜ20ࡀҎ্ʢֶੜͰ΋OKʣ

5. ϑΝϛίϯ + ి࿩ઢͰ΋ ߪೖͰ͖ͨ ※ݱࡏ͸αʔϏεऴྃɻεʔϑΝϛɺυϦʔϜΩϟετͰ΋ങ͑·ͨ͠ https://www.youtube.com/watch?v=ks0JeyhZsR4

6. LINEͰഅ݊ΛങͬͯΈ͍ͨ εϚʔτϑΥϯશ੝ظ ࣗ෼ͷ޷͖ͳUIͰ അ݊Λങ͍͍ͨ

7. ͍ͣΕ௕೥ͷເ അ݊Λߪೖ͢ΔΞϓϦΛ ࡞Γ͍ͨ ※ͨͩ͠API͸ఏڙ͞Εͳ͍

8. API͕ͳ͍ͳΒ ࡞Ε͹ྑ͍

9. I-PAT https://www.ipat.jra.go.jp/

10. ΦϯϥΠϯߪೖ͸Ͱ͖Δ WebαΠτΛ AutomationԽ࣮ͯ͠ݱ Ͳ͏΍Δ͔➡

11. Headless Chrome https://developers.google.com/web/updates/2017/04/headless-chrome?hl=en

12. Headless Chromeͱ͸ • ChromeΛϔουϨεͰಈ࡞͢Δ • ϔουϨε = UIͳ͠Ͱ࣮ߦ • Chrome59͕Πϯετʔϧ͞Ε͍ͯΕ͹࢖༻Մ

    ೳʢWindows͸61ʣ • Chromeͷػೳ͕શͯ࢖͑Δ

13. ίϚϯυ͔Β ChromeΛUIͳ͠Ͱ ࣮ߦͰ͖Δ

14. Ͱ΋CLIͰ શͯͷૢ࡞Λॻ͘ͷ͸ਏ͍

15. ChromeΛ ૢ࡞͢ΔͨΊʹ։ൃ͞Εͨ ϥΠϒϥϦ

16. puppeteer https://github.com/GoogleChrome/puppeteer

17. puppeteerͱ͸ • NodeJSͰHeadless ChromeΛ
 ૢ࡞͢ΔϥΠϒϥϦ • Chrome DevToolsͷ্͔Βૢ࡞͢ΔAPI • GoogleChromeνʔϜ͕࣮૷

    • ʮύϖςΟΞʯͱൃԻ

18. ಈ࡞ϨΠϠʔ

19. ChromeΛࣗಈͰಈ͔ͯ͠ അ݊ߪೖ·Ͱ ͨͲΓͭ͘

20. ࣮૷͢Δ const puppeteer = require(‘puppeteer'); (async () => { const

    browser = await puppeteer.launch({headless: true}); const page = await browser.newPage(); await page.setViewport({width: 640, height: 460}); await page.goto(‘https://www.ipat.jra.go.jp/’); //////////////////////////////////////////// })(); $ISPNFΛىಈ ৽͍͠λϒΛ։͘ ΢Οϯυ΢αΠζΛܾఆ 63-Λࢦఆͯ͠ભҠ

21. ࣮૷͢Δ

22. ࣮૷͢Δ //////////////////////////////////////////// await page.type(‘[name=“inetid”]’,’********’); await page.click(".button a"); await page.waitForNavigation(); ////////////////////////////////////////////

    *%Λೖྗ ϩάΠϯϘλϯΛΫϦοΫ ભҠΛ଴ͭ

23. ࣮૷͢Δ

24. ͜Μͳײ͡Ͱ Ұͭͣͭૢ࡞ͯ͠ ໨త·Ͱୡ੒͢Δ

25. ࡞ͬͨ΋ͷ͕ͪ͜Β https://github.com/taminif/bettingInTheIPAT

26. await஍ࠈ

27. Ͳ͏ͯ͠΋ϦΫΤετΛ ଴ͭඞཁ͕͋ΔͷͰ ݁ՌΛ଴ͨ͟ΔΛಘͳ͍

28. ίϚϯυΛୟ͚͹ അ͕݊ങ͑ΔAPI͕Ͱ͖ͨ

29. API͕Ͱ͖ͨ .BD؀ڥͰ
    ಈ࡞͢Δ"1* ίϚϯυݺͼग़͠ ͜Ε͚ͩͰ͸͜ͷMacͰ͔͠࢖͑ͳ͍

30. ͜ͷAPIΛαʔόʔͰ ݺͼग़ͤΔΑ͏ʹ͍ͨ͠

31. APIΛͲ͜Ͱಈ͔͔͢ • Headless Chrome͸Ͳͷ؀ڥͰ΋ಈ͘ • puppeteer͸Node v6.4.0͔Βಈ͘ • ͭ·Γαʔόʔߏஙͯ͠؀ڥΛ༻ҙ͢Ε͹ಈ͘
 ->

    Ͱ΋ΊΜͲ͍͘͞ • AWS Lambda΍GCPͰ΋ಈ͘ ->AWS LambdaͰಈ͔ͯ͠APIʹ͢Δ

32. LambdaͰಈ͔ͨ͠ -BNCEBͰ
    ಈ࡞͢Δ"1* -BNCEBݺͼग़͠ +40/
    \
    
    
    
    
    QMBDF
    bവؗ
    
    
    
    
    SBDF/P
    b
    

    
    
    
    
    SBDFS/P
    ``
    
    
    
    
    BNPVOU
    
    ^ ʢิ଍ʣ
    "84
    -BNCEBͷ࠷େλΠϜΞ΢τઃఆ͸ ඵ
    
    ෼
    ભҠ͕ଟ͗͢Δͱ͕࣌ؒ଍Γͳ͍
    Մೳੑ͸͋Δ

33. ·ͩAWSͷ ؅ཧը໘͔Β͔͠࢖͑ͳ͍ ͜ͷAPIΛͲ͔͜ΒͰ΋ ݺͼग़ͤΔΑ͏ʹ͍ͨ͠

34. API Gateway͔Βݺͼग़͢ -BNCEBͰ
    ಈ࡞͢Δ"1* )551
    3FRVFTUΛ
    ड͚෇͚Δ )5514௨৴ +40/
    \
    
    
    
    
    QMBDF
    bവؗ

    
    
    
    
    
    SBDF/P
    b
    
    
    
    
    SBDFS/P
    ``
    
    
    
    
    BNPVOU
    
    ^

35. ͔͠͠ɺ্ख͍͜ͱ ಈ͍ͯ͘Εͳ͍ API GatewayͷλΠϜΞ΢τʹ Ҿ͔͔ͬΔ

36. API GatewayͷλΠϜΞ΢τ͸ ໿2෼

37. Lambda͔ΒLambdaΛίʔϧ ඇಉظͰݺͼग़͢ )5514௨৴ +40/
    \
    
    
    
    
    QMBDF
    bവؗ
    
    
    
    
    SBDF/P
    b
    
    
    
    
    SBDFS/P
    ``

    
    
    
    
    
    BNPVOU
    
    ^ ݺͼग़ͨ͠Β
    ऴΘΓ

38. Ͳ͔͜ΒͰ΋APIΛ ݺͼग़ͤΔΑ͏ʹͳͬͨ

39. ωοτϫʔΫΛܦ༝͢Ε͹ അ݊Λങ͑ΔΑ͏ʹͳͬͨ

40. ωοτϫʔΫؒͰ LINE͕APIΛݺͼग़ͤ͹ അ͕݊ങ͑ΔͷͰ͸

41. LINE Messaging API https://developers.line.me/ja/services/messaging-api/

42. LINE Messaging APIͱ͸ • LINE DeveloperͷҰػೳ • ʮ͋ͳͨͷαʔϏεͱLINEϢʔβʔͷ
 ɹ૒ํ޲ίϛϡχέʔγϣϯΛՄೳʹ͢Δʯ •

    LINEͷ༑ୡ௥Ճ΍ϝοηʔδૹ৴ͳͲͷΠϕϯτ ΛτϦΨʔʹWebhookΛ࣮ߦ͢Δ

43. LINEʹૹ৴ͨ͠஋Λ API Gateway͔ΒLambdaʹ ౉͢

44. LINE BotͰഅ݊Λߪೖ͢Δ ʢਖ਼֬ʹ͸͜͜ʹ-*/&͞Μͷ αʔόʔ͕͋Δʣ ϝοηʔδ
    വؗ
    
    
    

    -*/&ʹೖྗ͞Εͨ ৘ใΛड෇
    -BNCEB༻ʹՃ޻ +40/
    \
    
    
    
    
    QMBDF
    bവؗ
    
    
    
    
    SBDF/P
    b
    
    
    
    
    SBDFS/P
    ``
    
    
    
    
    BNPVOU
    
    ^

45. ങ͑ΔΑ͏ʹ͸ͳ͕ͬͨ Ϩεϙϯε͕ͳ͍ LINE Messaging APIͰ ϦΫΤετΛड͚ͨޙʹ Ԡ౴ϝοηʔδΛฦ͢

46. Ԡ౴ϝοηʔδػೳ • Ϣʔβʔ͔ΒͷϝοηʔδҰ݅ʹରͯ͠
 Ұճ͚ͩฦ٫Ͱ͖Δ • ϝοηʔδʹ͍͍ͭͯΔϢʔβʔIDΛ࢖ͬͯ
 Ԡ౴ϝοηʔδΛૹ৴ • ࣗ༝ʹϢʔβʔʹૹ৴͢ΔPush API͸༗ྉɾɾ


    ˢ͜Ε͕͋Ε͹ߪೖ൑ఆ͕ฦͤΔɾɾ

47. Ԡ౴ϝοηʔδΛฦ͢ \
    
    
    QMBDF
    bവؗ
    
    
    SBDF/P
    b
    
    
    SBDFS/P
    ``
    
    
    BNPVOU
    
    

    ^ വؗ
    
    
     ύϥϝʔλʔ͕ਖ਼ৗͳΒ
    -BNCEBΛݺͼग़ͯ͠
    Ԡ౴ϝοηʔδΛૹΔ -BNCEB͔Β-BNCEBΛඇಉظͰ
    ݺͼग़͍ͯ͠ΔͷͰ੒ޭ͔ͨ͠͸ෆ໌

48. LINEͰഅ݊Λ ങ͑ΔΑ͏ʹͳͬͨ!

49. ࣮ફฤ puppeteerͰ ͭ·͍ͮͨ͜ͱ

50. puppeteerͰͭ·͍ͮͨ͜ͱ • ൣғ֎ͷཁૉΫϦοΫ • onclickΠϕϯτ͕ൃՐ͠ͳ͍ • waitForͱwaitForNavigationͱwaitForSelector • ChromeͱpuppeteerͷόʔδϣϯΛ߹ΘͤΔ •

    (AWS Lambda͸ͱͯ΋ॲཧ͕஗͍)

51. ൣғ֎ͷཁૉΫϦοΫ

52. Headless ChromeͰ͸ ը໘֎ͷཁૉͷΫϦοΫ͕ൃՐ͠ͳ͍ ΢Οϯυ΢αΠζΛ
    ͜͜·Ͱʹઃఆ ͜ͷϘλϯ͸
    ΫϦοΫͰ͖ͳ͍ ϒϥ΢β෯

53. const puppeteer = require(‘puppeteer'); (async () => { const browser

    = await puppeteer.launch({headless: true}); const page = await browser.newPage(); await page.setViewport({width: 1920, height: 2160}); await page.goto(‘https://www.ipat.jra.go.jp/’); })(); ը໘શ͕ͯ࿮಺ʹ͓͞·ΔΑ͏ͳେ͖͞ ʢղܾࡦʣ ը໘Λେ͖͘͢Δ

54. ͜͏͢Ε͹ԡͤΔΑ͏ʹͳͬͨʂ ϒϥ΢β෯ ۭന

55. waitForͱ waitForNavigationͱ waitForSelector

56. ͦΕͧΕͷ࢖͍෼͚ • waitFor
 -> ϛϦඵΛࢦఆɻࢦఆ͚ͨ࣌ؒͩ͠଴ͭ • waitForNavigation
 -> Ҿ਺ͳ͠ɻ •

    waitForSelector
 -> ηϨΫλͰࢦఆɻཁૉ͕දࣔ͞ΕΔ·Ͱ଴ͭ ->͜ΕΒ͚ͩͰ͸ͳ͍ɻଞʹ΋·ͩ͋Δ

57. ࠷ॳͷ͏ͪ͸waitForͰ ϩʔυΛ଴ͭ ׳Εͯ͘Ε͹ ਖ਼͘͠࢖͍෼͚Δͱ ਐΊ΍͍͢

58. ·ͩHeadless Chromeͷ ັྗΛ஻ͬͯͳ͍

59. Ξϐʔϧฤ Headless Chrome͸ ૉ੖Β͍͠ϓϩμΫτͰ͋Δʂ

60. ·ͣ͸͡Ίʹ Headless ChromeΛ࿩্͢Ͱ ͔ܽͤͳ͍ಈը

61. The power of Headless Chrome https://www.youtube.com/watch?v=lhZOFUY1weo 2018೥ͷGoogle IOͷߨԋ

62. Headless Chromeͱ puppeteerͰग़དྷΔ 10ͷ͜ͱ͕࿩͞Ε͍ͯ·͢ ʢൈਮʣ SSR ABςετ Web Audio ύοΫϚϯ

63. Headless Chrome͸ େ͖ͳՄೳੑΛൿΊ͍ͯΔ

64. ࢲͷߟ͑Δ ࠷΋ັྗతͳٕज़

65. ͲΜͳWebαʔϏεͰ΋ APIԽͰ͖Δ

66. Πϯλʔωοτશ੝ظ ϒϥ΢βΛ࢖Θͳ͍ਓ͸ ΄΅͍ͳ͍Ͱ͢ΑͶ

67. ීஈͷωοταʔϑΟϯΛ ࣗಈԽͰ͖Δ

68. ࣗಈԽͯ͠APIʹ͢Ε͹ ͍ͭͰ΋ݺͼग़ͤΔ

69. APIԽ͓͚ͯ͠͹ ΠϯλʔϑΣʔε͸ ͲΕͰ΋࢖͑Δ ࠓ࿩୊ͷεϚʔτεϐʔΧʔ Ͱ΋OK

70. ԿͰ΋Ͱ͖Δ

71. ເ͕޿͕Γ·ͤΜ͔ʁ

72. ⚠8BSOJOH

73. Ԭ࡚ࢢཱதԝਤॻؗࣄ݅ https://ja.wikipedia.org/wiki/Ԭ࡚ࢢཱதԝਤॻؗࣄ݅

74. ΍Γ͗͢Δͱॻྨૹݕ·Ͱ ͋Γ·͢ ৗࣝతͳΞΫηεʹ ԡ͑͞·͠ΐ͏

75. ͜ͷηογϣϯʹײԽ͞Εͯ ൃੜͨ͠ଛ֐౳ʹ͍ͭͯɺ ੹೚͸ෛ͍݉Ͷ·͢

76. ༻๏༻ྔΛकͬͯ ศརʹ࢖͍·͠ΐ͏

77. ͱ͜ΖͰɺࠓ·Ͱͷ
    εΫϨΠϐϯάπʔϧͰ͸
    Ͱ͖ͳ͔ͬͨͷʁ

78. Ͱ͖ͳ͍͜ͱ͸ͳ͍͚ΕͲ ೉͔ͬͨ͠ • ֤ݴޠͷHTTPϦΫΤετͰ͸ϩάΠϯ৘ใΛ
 อ࣋͢Δ͜ͱ͕೉͔ͬͨ͠ • PhantomJS͸webkitϕʔεͰɺSPA΍৽͍͠λϒ Λ։͘Α͏ͳαʔϏεͷରԠ͕Ͱ͖ͳ͔ͬͨ
 (Headless Chrome͕ग़ͨ͜ͱͰαʔϏεऴྃ)

    • Selenium͸৮ͬͯͳ͍͚ͲɺAPIԽ͸೉͍͠ʁ

79. Headless Chrome͸ ChromeΛ࢖͍ͬͯΔ Α͏ͳ΋ͷͳͷͰ ΄ͱΜͲͷ͜ͱΛָʹରԠͰ͖Δ

80. ࠷ߴ͡Όͳ͍Ͱ͔͢ʁ

81. ͜ͷಈըͷதͰ ڧ͘࿩͞Ε͍ͯΔ͜ͱ https://www.youtube.com/watch?v=lhZOFUY1weo

82. ʮ͜ͷ࿩͸ςετࣗಈԽͷ ࿩Ͱ͸͋Γ·ͤΜʯ ʮࣗಈԽ͢Δ͜ͱ͕Ͱ͖Δʯ ʮࣗಈԽ͢ΔπʔϧͰ͋Δʯ

83. ීஈͷ࡞ۀΛࣗಈԽ͢Δ ͜Εͦ͜ΤϯδχΞϦϯά

84. ΍ͬͯΈͨ͘ͳΓ·ͤΜ͔ʁ

85. ࣗಈԽ Έͳ͞Μͥͻ ΍ͬͯΈ·͠ΐ͏ʂ

86. ͋Γ͕ͱ͏͍͟͝·ͨ͠