実践サーバレス + α / Serverless Practices

Transcript

1. SERVERLESS PRACTICES + α MASASHI TERUI @ WE WANNA TECH

   AOMORI

2. SERVERWORKS CO.,LTD. + FREELANCER • Serverless Oji-san • Serverlessconf Tokyo

   2016,2017,2018 speaker • Remote worker (in Sapporo) • @marcy_terui • https://willy.works MASASHI TERUI ARCHITECT / DEVELOPER

3. AGENDA SERVERLESS ͬͯͳΜ͚ͩͬʁ 1 6 2 7 3 8 4

   9 5 10 SERVERLESS ͷ࣮ମΛଊ͑Δ SERVERLESS ͷઃܭ SERVERLESS ͷ࣮૷ SERVERLESS ͷσϓϩΠ SERVERLESS ͷӡ༻ SERVERLESS ͷݱ࣮ SERVERLESS ͷະདྷ SERVERLESS ͷ͓·͚ SERVERLESS ͷςετ

4. SERVERLESSͬͯͳΜ͚ͩͬʁ WHAT IS

5. CNCF SERVERLESS WHITEPAPER V1.0 • Serverless computing refers to the

   concept of building and running applications that do not require server management • A platform may provide one or both of the following: • Functions-as-a-Service (FaaS) • Backend-as-a-Service (BaaS) • Products or platforms deliver the following benefits to developers: • Zero Server Ops • No Compute Cost When Idle 
 https://github.com/cncf/wg-serverless/tree/master/whitepaper

6. FaaS + Functional SaaS (BaaS) = Serverless https://www.slideshare.net/acloudguru/ant-stanley-being-serverless

7. SERVERLESS USE CASES (FROM CNCF WP) • Asynchronous, concurrent, easy

   to parallelize into independent units of work • Infrequent or has sporadic demand, with large, unpredictable variance in scaling requirements • Stateless, ephemeral, without a major need for instantaneous cold start time • Highly dynamic in terms of changing business requirements that drive a need for accelerated developer velocity • Non-HTTP-centric and non-elastic scale workloads that weren’t good fits for an IaaS, PaaS, or CaaS solution (Event Driven workloads)

8. SERVERLESSͷ࣮ମΛଊ͑Δ

9. FaaSͬͯͲΜͳ΋ͷʁ

10. SERVERLESS PROCESSING MODEL https://github.com/cncf/wg-serverless/tree/master/whitepaper#detail-view-serverless-processing-model ॲཧͷશମ૾Λ௫Ή Πϕϯτιʔε͔ΒͷΠϕϯτॲཧཁٻΛ ଟ਺ͷΠϯελϯε্ͷFunction͕෼ࢄॲཧ

11. THE INTERNAL FLOW OF PROCESSING https://github.com/apache/incubator-openwhisk/blob/master/docs/about.md#the-internal-flow-of-processing Πϕϯτ͕ॲཧ͞ΕΔྲྀΕΛ௫Ή ετϦʔϜ΍ΩϡʔΛڬΜͰ෼ࢄॲཧ͢Δͷ͕جຊ ಉظͷ৔߹͸௚઀TCPͰ௨৴͢ΔΒ͍͠(Lambda͸)

12. FaaS ≒ ίϯςφͰִ཭͞Εͨؔ਺

13. BaaSͬͯͲΜͳ΋ͷʁ

14. FROM OWNERSHIP TO USE SERVICES Ϋϥ΢υʹΑͬͯαʔό͕ॴ༗͔Βར༻΁ ͞Βʹϛυϧ΢ΣΞ΍ϥΠϒϥϦ΋ར༻΁ BaaSΛ࢖͏ͷ͸ͦ͏͍͏ࣗવͳྲྀΕ

15. BaaS ≒ ϑϧϚωʔδυ͔ͭந৅Խ͞ΕͨMW

16. SERVERLESS͸ؔ਺ͱMWͰͰ͖ͯΔ ߴ౓ʹந৅Խ͞ΕͯΔ͚ͩ

17. ΍Δ΂͖͜ͱΛͪΌΜͱ΍Δ SERVERLESS͔ͩΒͬͯࣼʹߏ͑ͣʹ

18. SERVERLESSͷઃܭ

19. • ϝοηʔδϯά • ಉظ/ඇಉظ • Interactive/PubSub • σʔλετΞ • εέʔϦϯά

    • σʔλΞΫηε • ࣮ߦํ๏ • ฒྻ/௚ྻ • ܾఆత/ඇܾఆత ໨తΛՌͨͨ͢Ίͷ࠷దղ͸ҟͳΔ

20. BE EVENT DRIVEN

21. ͢΂ͯ͸EVENTͱHANDLERͷ૊Έ߹Θͤ

22. • ಉظ • API Gateway • ඇಉظ • ௚ྻ •

    Kinesis Streams • ฒྻ • SNS • SQS • ͦͷଞ • Step Functions EVENTΛͲͷΑ͏ʹॲཧ͢΂͖͔ʁ

23. ඇಉظɾ෼ࢄΛϕʔεʹߟ͑Δ Կ΋ͤͣʹ଴ͬͯΔͳΒࣗ෼(MONOLITH)Ͱ΍Ε͹ྑ͍ͷͰ͸ʁ

24. • ͭ·ΔॴΤϥʔϋϯυϦϯά • ϦτϥΠՄೳͳΤϥʔ͸ϦτϥΠ͢Δ • ಉظͰ΍Ε͹ΫϥΠΞϯτ͕ϦτϥΠͯ͘͠ΕΔͱ͍͏ͷ͸ݬ૝ • ϦτϥΠͰ͖ͳ͍Τϥʔ΋ҰͭͷΠϕϯτͰ͋Δ • ผͷܦ࿏ͰવΔ΂͖ॴʹ఻͑Δͱ͍͏͜ͱΛߟ͑Δ

    • ͦͯ͠ϞχλϦϯάɾτϨʔγϯά • ඞཁͳ৘ใ͸ू໿͢Δ • ৄ͘͠͸͋ͱͰ ඇಉظɾ෼ࢄʹ͓͚Δෆ҆

25. Event Source + Handler = Microservice ʓʓʹରͯ͠☓☓͢Δɺશͯ͸ͦͷ૊Έ߹Θͤ

26. • ࣮ࡍʹEvent SourceͱHandlerຖʹ؅ཧ୯ҐΛ෼͚Δ͔͸։ൃઓུґଘ • গਓ਺Ͱશ෦࡞ͬͯΔͷʹσϓϩΠύΠϓϥΠϯ΍GitϦϙδτϦΛ
 ෼͚Δͷ͸ΦʔόʔϔουͰ͔͠ͳ͍ • Event SourceͱHandlerͷ૊Έ߹ΘͤͰॲཧ಺༰͕ࣗ໌͔ͭ؅ཧՄೳͳ
 ঢ়ଶΛอ͍ͬͯΕ͹ޙͰ෼͚Δͷ͸ۤ͡Όͳ͍

    • ೚ҙͷίϯςΩετͰEvent SourceΛ઀ଓ఺ʹ্ख͘੾Γग़ͤΔ • େࣄͳͷ͸Function͕૿͑Δ͜ͱΛԀΘͣઃܭͷෳࡶԽΛݏ͏͜ͱ Practices

27. • ґଘؔ܎ͷ޲͖Λἧ͑Δ • ඇಉظΛॏࢹ • Event SourceΛू໿఺ɾ෼ذ఺ͱ͢Δ • ෳࡶԽͷݪҼ͸େ఍σʔλΞΫηεʹ͋Δ •

    ॻ͖ࠐΈͱࢀরؔ܎ͷෳࡶԽ • σʔλͷॴ༗ؔ܎ • CQRS, Materialized View ෳࡶԽͤ͞ͳ͍ͨΊʹ

28. • ॻ͖ࠐΈͱಡΈࠐΈͰಉ͡σʔλΛѻ͏ඞཁ͸ͳ͍ • ॻ͖ࠐΈͷݪ୯ҐΛߟ͑ɺΞΠςϜʹ·ͱΊΔ͜ͱͰ੔߹ੑΛकΔ • ಡΈࠐΈ͸݁Ռ੔߹Λड͚ೖΕͯޮ཰ͷྑ͍σʔλΛੜ੒͍ͯ͘͠ • Ͱ͖ΔݶΓҰͭͷHandler͕ѻ͏΂͖σʔλΛҰͭͱ͢Δ • Write͸ൺֱత؆୯

    • Read͸CQRS, Materialized ViewΛ্ख͘࢖͏ Data Modeling

29. ۩ମతʹ͸ “DynamoDB ދͷר” [ݕࡧ] http://marcy.hatenablog.com/entry/2018/07/31/213705

30. SERVERLESSͷ࣮૷

31. • EventΛҾ਺ʹ݁ՌΛฦ͢ • ͨͩͦΕ͚ͩͳͷͰผʹී௨ʹҰൠతʹྑ͍ͱ͞ΕΔίʔυॻ͚͹͓̺ • ͋Δͱ͢Ε͹ • FaaSͷੑ্࣭ύϑΥʔϚϯεʹؔΘΔTips • EventॲཧͷϙΠϯτ

    ݴ͏ͯͨͩͷؔ਺

32. • Cold Start/Warn StartΛҙࣝ͢Δ • ίʔυ͕ಉ͡Ͱ͋Ε͹Ұ౓ىಈͨ͠ίϯςφ͸͋Δఔ౓࢒Δʢ਺ेඵ) • ಉ͡ίϯςφ͕࠶ར༻͞ΕΔ -> Warm

    Start • ৽͍͠ίϯςφ্ཱ͕͕ͪΔ -> Cold Start (Φʔόʔϔου͕͋Δ) • ෆཁͳΦϒδΣΫτΛ޿͍ScopeͰੜ੒͠ͳ͍ • Warm Start࣌ʹ͸Global Scope΍StaticͳΦϒδΣΫτ͸࢒Δ • ࢖͍ճͤΔΦϒδΣΫτ͸࢖͍ճ͢(Lazy Loading, Singleton) • ಛʹTCPίωΫγϣϯ࣋ͬͯΔΦϒδΣΫτͱ͔͸Φʔόϔου͕σΧΠ͔Βେࣄ FaaSͷੑ্࣭ύϑΥʔϚϯεʹؔΘΔTips

33. • Event Sourceͷछผຖʹॲཧํ๏ΛܾΊͯ౷Ұ͢Δ • ϝοηʔδͷड͚౉͠ํ • JSON/ProtocolBuffers, Plain/GZip etc… •

    Trace ID(ޙड़)ͳͲͷMetadataͷ࢓ࠐΈํ • ྫ֎ॲཧ • ແࢹʢϩάʹ࢒͢ʣͯ͠ྑ͍΋ͷ • ൃੜͨ࣌͠఺Ͱผϧʔτʹྲྀ͢΂͖΋ͷ • Failͤͯ͞ϦτϥΠػߏʹ৐ͤΔ΋ͷ • PythonͩͱDecoratorΛ࢖͏ͱศར EventॲཧͷϙΠϯτ

34. DECORATOR Trace IDΛϔομͰ΍ΓऔΓ EventͱResult͸ඞͣϩάʹ࢒͢ ͱ͍͏࠷௿ݶͳαϯϓϧ

35. SERVERLESSͷςετ

36. UNIT TESTΛॻ͘ •ී௨ʹؔ਺ͩΑʁ •↓ඞݟ • https://speakerdeck.com/twada/ test-driven-architecture-aws-dev- day-tokyo-2018

37. • جຊతʹ࣮ࡍͷAWS αʔϏεΛ࢖ͬͯ΍Δ • ౷߹؅ཧͰ͖ΔFWΛબͿ(AWS SAM, Serverless etc…) • ͦͷ··ಉ͡؀ڥ͕σϓϩΠͰ͖Δ

    • ςετ͍ͨ͠ൣғΛܾΊɺऴ୺ͷEvent SourceͱHandlerΛஔ͖׵͑Δ • ؀ڥม਺ͰEvent SourceΛ੾Γସ͑ • VerifyՄೳͳܗͰOutputͤ͞Δ Integration Test

38. PRODUCTION SSM Parameter Store΍CFn Expot/Import ValueͰ֎෦ࢀরՄೳͱ͓ͯ͘͠ ؀ڥม਺͔ΒEndpointΛ஫ೖ͢ΔΑ͏ʹ࣮૷

39. INTEGRATION TEST ͨͩདྷͨEventΛPut͢Δ͚ͩˠͦΕΛVerify͢Δ ʢTrace IDͷ࢓૊Έ͕͋Δͱঘྑʣ

40. SERVERLESSͷσϓϩΠ

41. • ࢖͏αʔϏε͕౷߹؅ཧͰ͖ΔFWΛબͿ(AWS SAM, Serverless etc…) • ઌड़ͷIntegration Testͷ࢓૊Έ͸CFnͷػೳʹڧ͘ґଘ͢ΔͷͰ
 CFnϕʔεͷFW͡Όͳ͍ͱ࢖͑ͳ͍ςΫχοΫ •

    ൣғ͕ݶఆతͳ΋ͷ͸ͦͷൣғͰऩ·Δ৔߹ʹͷΈ(Chalice, Apex etc…) • ͦͷൣғͰऩ·ΔͳΒศརͳͷͰੵۃతʹ࢖ͬͯྑ͍ Framework͸Կ࢖͏ʁ

42. • ౷߹؅ཧͰ͖͍ͯΕ͹جຊతʹίϚϯυୟ͚ͩ͘ͰσϓϩΠͰ͖Δ͸ͣ • ී௨ʹύΠϓϥΠϯ૊ΊΔ • ػີ৘ใ΍σϓϩΠ࣌ʹల։͍ͨ͠৘ใ͸؀ڥม਺͔Β஫ೖ • FWͷεςʔδػೳ΍CFnͷ࢓૊ΈΛར༻ͯ͠؀ڥຖʹϦιʔε͕෼͚Δ • ໋໊نଇେࣄ

    • CFnͷࣗಈ໋໊ʹ೚ͤͯ࿦ཧతͳࢀর͚ͩΛ࢖༻͢Δͱָ(SAMͷ৔߹) • !Ref, !GetAtt, !Import/ExportValue CI/CD

43. SERVERLESSͷӡ༻

44. • ແ͍ͷ͸ʮαʔόͷӡ༻ʯ • EC2తͳαʔό • αʔόʔϓϩηεతͳαʔό • γεςϜࣗମͷӡ༻͸΋ͪΖΜ͋Δ • ΑΓຊ࣭తͳӡ༻ʹϑΥʔΧεͰ͖Δͷ͸͔֬

    ӡ༻͕ແ͍ͷ͕Sereverless??

45. • ࣮ࡍʹ໰୊͕ى͖ͨ͜ͱΛ؂ࢹ͢Δ • Τϥʔͷൃੜ΍஗ԆΛ؂ࢹ͢Δ • API Gateway: Latency, 5XX Response

    • Lambda: Duration, Errors, Throttling, DeadLetterErrors • DynamoDB: Consumed Capacity, Throttling, Latency, Errors
 •Ұ൪େ੾ͳͷ͸ΞϓϦέʔγϣϯͷϩά ؂ࢹ

46. • DeadLetterErrors • ͿͬͪΌ͚LambdaͷىಈError͸ى͖Δ࣌͸ͪΐ͍ͪΐ͍ى͖Δ • ࠶࣮ߦͰ্ख͘ݴͬͯΔέʔε͕΄ͱΜͲ • ࠶࣮ߦ΋ࣦഊͯ͠औΓ͜΅ͨ͠Error͸͜ΕΛݟͳ͍ͱ෼͔Βͳ͍(ཁઃఆ) • Throttling

    • SDK͸Throttlingͯ͠΋಺෦Ͱউखʹ࠶࣮ߦ͢Δ • Τϥʔ͕ى͖ͯͳ͍͔ΒThrottling͕ى͖ͯͳ͍ͱ͸ݶΒͳ͍ • ͜ΕΛݟΔͱൃੜঢ়گ͕෼͔ΔˠCapacity௥Ճ ཁ஫ҙͳ؂ࢹ߲໨

47. • ෼ࢄͨ͠FaaS؀ڥͰ͸͍͔ʹू໿ͯ͠ޮ཰Α͘ݟΒΕΔΑ͏ʹ͢Δ͔͕େࣄ • ·ͣू໿͢Δͷ͸େલఏ • CloudWatch Logs͸ͨͩͷόοΫΞοϓ • Datadog LogsΦεεϝ

    • https://github.com/marcy-terui/ddlogs • Trace IDͷड͚౉͠ํΛܾΊͯԣ۲ͰݕࡧͰ͖ΔΑ͏ʹ͢Δ ϩά

48. LOGS WITH TRACE ID Datadog Logsͷ࣮ࡍͷը໘Ͱ͢

49. SERVERLESSͷݱ࣮

50. • REST API + SPA/MobileAppͳΞϓϦέʔγϣϯ • ผʹѱ͘͸ͳ͍ • αʔόӡ༻͠ͳͯ͘ྑ͍Ҏ্ͷϝϦοτ͕ͳ͍ •

    ͦΕɺCaaS or PaaSͰΑ͘Ͷʁʁ • ී௨ʹRDB࢖͑ΔΑʁʁ • όοΫΤϯυॲཧΛ্ख͘෼ղͰ͖ͳ͍ͳΒແཧʹServerlessԽ͢Δඞཁ͸ͳ͍ • ࣮ࡍɺطଘWebΞϓϦͷServerlessԽ͸࡞Γ௚͢ؾ͕֓ͳ͚Ε͹
 ͍͍ͩͨίϯςφԽ, PaaSԽʹ଩੾Γ͢Δ͜ͱ͕΄ͱΜͲ WebΞϓϦέʔγϣϯʹผʹ޲͍ͯͳ͍

51. SERVERLESSͷະདྷ

52. • ͜͜Ͱݴ͏BaaS͸AppSync, FirebaseͷΑ͏ͳچདྷ͔ΒBaaSͱݺ͹Ε͍ͯͨ΋ͷ • Frontend͕΍ΓऔΓ͢Δͷ͸͋͘·ͰBaaS͚ͩ • όοΫΤϯυͰBaaSʹର͢ΔEvent DrivenͰ༷ʑͳॲཧ͕ߦΘΕΔ •ࣦ৬͢Δʘ(^o^)ʗśƂŦ •

    ͔΋͠Εͳ͍ʢΘΓͱߴ֬཰Ͱͦ͏ͳΔͱࢥͬͯΔʣ BaaSΛத৺ʹServerless͕ิ׬͢Δ

53. SERVERLESSͷ͓·͚

54. “CloudͰେن໛γεςϜ͸ͪΐͬͱɾɾɾ” THANKS!! “ServerlessͰେن໛γεςϜ͸ͪΐͬͱɾɾɾ” “݁ہશ෦Ͱ͖ΔΑ͏ʹͳͬͯΔ”