Upgrade to Pro — share decks privately, control downloads, hide ads and more …

サーバレス?で重たいバッチ処理

 サーバレス?で重たいバッチ処理

Lambda, DataPipeline, Step Functions
Serverless Meetup Sapporo LT

Kazuya Takahashi

December 11, 2016
Tweet

More Decks by Kazuya Takahashi

Other Decks in Technology

Transcript

  1. -BNCEB %BUB1JQFMJOF 4UFQ'VODUJPOT
    αʔόϨεʁͰॏ͍ͨόονॲཧ
    ϦΞϧϫʔϧυθωϥϧϚωʔδϟʔɹ∁ڮ࿨໵
    4FSWFSMFTT.FFUVQ4BQQPSP

    View Slide

  2. ࢓ࣄΛͯ͠ϙΠϯτΛஷΊΔ ങ͍෺΍αʔϏεͰϙΠϯτΛஷΊΔ
    ϦΞϧϫʔϧυͷϙΠϯταʔϏε

    View Slide

  3. ϙΠϯτརଉαʔϏε΍ͬͯ·͢

    View Slide

  4. ೔࣍΍݄࣍ͷόονॲཧͷΈͳͷͰɺαʔόΛ༻ҙͨ͘͠ͳ͍
    αʔόϨεΞʔΩςΫνϟΛ࠾༻ʂ

    View Slide

  5. ͜Μͳײ͡ͷશମ૾

    View Slide

  6. ཁ݅
    ຖ೔རଉΛܭࢉ
    ܭࢉର৅͕ԯ͙݅Β͍
    -BNCEB͸ॲཧ͕࣌ؒ࠷େ̑෼
    ̑෼ͰऴΘΔ͔ෆ҆ʜ

    View Slide

  7. ݕ౼݁Ռ
    5SFBTVSF%BUBͰܭࢉͯ͠4ʹΞοϓϩʔυ
    4΁ͷΞοϓϩʔυΛτϦΨʔʹ-BNCEB͕ىಈ
    ϐλΰϥεΠονతϫʔΫϑϩʔ

    View Slide

  8. View Slide

  9. ॏ͍ͨσʔλҠߦॲཧΛͲ͏͠Α͏ʁ

    View Slide

  10. ཁ݅
    .Z42-⾩5SFBTVSF%BUBͰσʔλҠߦΛ͍ͨ͠
    -BNCEB͸ॲཧ͕࣌ؒ࠷େ̑෼
    ̑෼ͰऴΘΔؾ͕͠ͳ͍ʜ

    View Slide

  11. ݕ౼݁Ռ
    %BUB1JQFMJOFͰσʔλҠߦ
    &$ϦιʔεͰॲཧ͢ΔͷͰ௕࣌ؒͷόον΋Մ
    ඞཁͳϥΠϒϥϦΛೖΕͨ".*Λ༻ҙ͢Ε͹ԿͰ΋Ͱ͖Δ
    &$Λ࢖͏ͷͰαʔόϨε͡Όͳ͍͔΋ʂʁ

    View Slide

  12. View Slide

  13. %BUB1JQFMJOFɿσʔλϫʔΫϑϩʔαʔϏε
    (6*͸Ϋη͕ڧ͍ͷͰ+40/ฤू͕Φεεϝ

    View Slide

  14. େྔͷτϥϯβΫγϣϯॲཧΛͲ͏͠Α͏ʁ

    View Slide

  15. ཁ݅
    ςʔϒϧߋ৽ͨ͠Γɺ"1*ΩοΫͨ͠Γͱ
    ͨ͘͞ΜͷτϥϯβΫγϣϯॲཧΛ͍ͨ͠
    -BNCEB͸ॲཧ͕࣌ؒʢSZ
    ݄ҰͷॲཧͳͷͰαʔόΛ༻ҙͨ͘͠ͳ͍ʜ

    View Slide

  16. ݕ౼݁Ռ
    %PDLFSͰτϥϯβΫγϣϯͱ͔ͷόονॲཧ
    &MBTUJD#FBOTUBMLͰ%PDLFSσϓϩΠ
    -BNCEBͰ؀ڥ࡞੒ˍऴྃޙʹ࡟আ
    4UFQ'VODUJPOTͰ-BNCEBͷϑϩʔ؅ཧ
    ΋͸΍αʔόϑϧʂʁ

    View Slide

  17. View Slide

  18. 4UFQ'VODUJPOTɿεςʔτϚγϯΛ+40/Ͱఆٛ
    ϐλΰϥεΠονతϫʔΫϑϩʔ͔Βͷଔۀ

    View Slide

  19. αʔόϨεʁͰόονॲཧΛ΍ͬͯΈͯ

    View Slide

  20. ࢖ͬͨ෼͚ͩίετ͕ൃੜ
    Ϧιʔεͷ࠷దԽˠόονʹ࠷ద
    εέʔϥϏϦςΟɾՄ༻ੑΛ೚ͤΒΕΔ
    ӡ༻ίετͷ௿ݮ
    طଘͷαʔϏεͱૄ݁߹
    ϚΠΫϩαʔϏεతͳઃܭ΁

    View Slide

  21. ΤϯδχΞืूͯ͠·͢ʂ
    SFBEPDPKQSFDSVJU
    ΞυςΫɺϑΟϯςοΫʹڵຯͷ͋Δਓ΋ʂ
    αʔόϨεͰαʔϏεΛ࡞Γ͍ͨਓ
    ৽͍͜͠ͱʹνϟϨϯδ͍ͨ͠ਓ

    View Slide