サーバレス？で重たいバッチ処理

Lambda, DataPipeline, Step Functions
Serverless Meetup Sapporo LT

Transcript

1. -BNCEB %BUB1JQFMJOF 4UFQ'VODUJPOT
   αʔόϨεʁͰॏ͍ͨόονॲཧ
   ϦΞϧϫʔϧυθωϥϧϚωʔδϟʔɹ∁ڮ࿨໵
   4FSWFSMFTT.FFUVQ4BQQPSP
   

   View Slide

2. ࢓ࣄΛͯ͠ϙΠϯτΛஷΊΔ ങ͍෺΍αʔϏεͰϙΠϯτΛஷΊΔ
   ϦΞϧϫʔϧυͷϙΠϯταʔϏε
   

   View Slide

3. ϙΠϯτརଉαʔϏε΍ͬͯ·͢
   

   View Slide

4. ೔࣍΍݄࣍ͷόονॲཧͷΈͳͷͰɺαʔόΛ༻ҙͨ͘͠ͳ͍
   αʔόϨεΞʔΩςΫνϟΛ࠾༻ʂ
   

   View Slide

5. ͜Μͳײ͡ͷશମ૾
   

   View Slide

6. ཁ݅
   ຖ೔རଉΛܭࢉ
   ܭࢉର৅͕ԯ͙݅Β͍
   -BNCEB͸ॲཧ͕࣌ؒ࠷େ̑෼
   ̑෼ͰऴΘΔ͔ෆ҆ʜ
   

   View Slide

7. ݕ౼݁Ռ
   5SFBTVSF%BUBͰܭࢉͯ͠4ʹΞοϓϩʔυ
   4΁ͷΞοϓϩʔυΛτϦΨʔʹ-BNCEB͕ىಈ
   ϐλΰϥεΠονతϫʔΫϑϩʔ
   

   View Slide

8. View Slide

9. ॏ͍ͨσʔλҠߦॲཧΛͲ͏͠Α͏ʁ
   

   View Slide

10. ཁ݅
    .Z42-⾩5SFBTVSF%BUBͰσʔλҠߦΛ͍ͨ͠
    -BNCEB͸ॲཧ͕࣌ؒ࠷େ̑෼
    ̑෼ͰऴΘΔؾ͕͠ͳ͍ʜ
    

    View Slide

11. ݕ౼݁Ռ
    %BUB1JQFMJOFͰσʔλҠߦ
    &$ϦιʔεͰॲཧ͢ΔͷͰ௕࣌ؒͷόον΋Մ
    ඞཁͳϥΠϒϥϦΛೖΕͨ".*Λ༻ҙ͢Ε͹ԿͰ΋Ͱ͖Δ
    &$Λ࢖͏ͷͰαʔόϨε͡Όͳ͍͔΋ʂʁ
    

    View Slide

12. View Slide

13. %BUB1JQFMJOFɿσʔλϫʔΫϑϩʔαʔϏε
    (6*͸Ϋη͕ڧ͍ͷͰ+40/ฤू͕Φεεϝ
    

    View Slide

14. େྔͷτϥϯβΫγϣϯॲཧΛͲ͏͠Α͏ʁ
    

    View Slide

15. ཁ݅
    ςʔϒϧߋ৽ͨ͠Γɺ"1*ΩοΫͨ͠Γͱ
    ͨ͘͞ΜͷτϥϯβΫγϣϯॲཧΛ͍ͨ͠
    -BNCEB͸ॲཧ͕࣌ؒʢSZ
    ݄ҰͷॲཧͳͷͰαʔόΛ༻ҙͨ͘͠ͳ͍ʜ
    

    View Slide

16. ݕ౼݁Ռ
    %PDLFSͰτϥϯβΫγϣϯͱ͔ͷόονॲཧ
    &MBTUJD#FBOTUBMLͰ%PDLFSσϓϩΠ
    -BNCEBͰ؀ڥ࡞੒ˍऴྃޙʹ࡟আ
    4UFQ'VODUJPOTͰ-BNCEBͷϑϩʔ؅ཧ
    ΋͸΍αʔόϑϧʂʁ
    

    View Slide

17. View Slide

18. 4UFQ'VODUJPOTɿεςʔτϚγϯΛ+40/Ͱఆٛ
    ϐλΰϥεΠονతϫʔΫϑϩʔ͔Βͷଔۀ
    

    View Slide

19. αʔόϨεʁͰόονॲཧΛ΍ͬͯΈͯ
    

    View Slide

20. ࢖ͬͨ෼͚ͩίετ͕ൃੜ
    Ϧιʔεͷ࠷దԽˠόονʹ࠷ద
    εέʔϥϏϦςΟɾՄ༻ੑΛ೚ͤΒΕΔ
    ӡ༻ίετͷ௿ݮ
    طଘͷαʔϏεͱૄ݁߹
    ϚΠΫϩαʔϏεతͳઃܭ΁
    

    View Slide

21. ΤϯδχΞืूͯ͠·͢ʂ
    SFBEPDPKQSFDSVJU
    ΞυςΫɺϑΟϯςοΫʹڵຯͷ͋Δਓ΋ʂ
    αʔόϨεͰαʔϏεΛ࡞Γ͍ͨਓ
    ৽͍͜͠ͱʹνϟϨϯδ͍ͨ͠ਓ
    

    View Slide