GoとNature ~ Nature Remoの裏側 / Nature Bath vol6

Transcript

1. ݫൿɿຊࢿྉͷҰ෦·ͨ͸શ෦ΛɺNatureגࣜձࣾͷڐՄͳ͠ʹɺෳ੡ɺసࡌ͢Δ͜ͱΛې͡·͢ɻ
   Introduce about
   September 3, 2019
   Natureגࣜձࣾ
   Go ͱ
   Nature Bath vol.6 ʮGo։ൃɾӡ༻ͷݱ৔ʯ
   19th November, 2020
   ~ Nature Remoͷཪଆ
   

   View Slide

2. 2
   Me
   • দ໦ խ޾ (id:Songmu)
   • Nature גࣜձࣾ औక໾CTO
   • https://songmu.jp/riji
   • https://github.com/Songmu
   • ޷͖ͳݴޠ͸GoͱPerlͱதࠃޠ
   • 3 Times ISUCON Winner
   • ஶॻʹʮΈΜͳͷGoݴޠʯ౳
   • झຯ͸OSS׆ಈͰ͢
   

   View Slide

3. 3
   Created Miscellaneous Go Tools
   • maltmill
   • πʔϧΛ؆୯ʹhomebrewͰ഑෍͢ΔͨΊͷπʔϧ
   • horenso
   • όονδϣϒͷͨΊͷϥούʔ
   • peep
   • ϓϩηεͷऴྃ௨஌Λͯ͘͠ΕΔ܅
   • gocredits
   • Goͷπʔϧ഑෍࣌ʹґଘϥΠϒϥϦͷLICENSEΛಉࠝ
   • etc.
   • ref. ʮGoͰπʔϧΛྔ࢈͢Δ๻ͷํ๏ʯ
   • https://junkyard.song.mu/slides/gocon2019-fukuoka/#0
   

   View Slide

4. 4
   Maintaining major Go tools
   • ghq (github.com/x-motemen/ghq)
   • ιʔείʔυϦϙδτϦ؅ཧπʔϧ
   • ghq handbook
   • https://leanpub.com/ghq-handbook
   • ghr (github.com/tcnksm/ghr)
   • GitHub΁ͷόΠφϦϦϦʔε༻πʔϧ
   

   View Slide

5. 5
   Recent Works
   • Let's Encryptͷϧʔτূ໌ॻมߋ໰୊
   • Android7.1ҎલͰLet's Encryptূ໌ॻͷαΠτ͕ݟΒ
   Εͳ͘ͳΔ
   • https://songmu.jp/riji/entry/2020-09-22-letsencrypt.html
   • Let's Encryptͷূ໌ॻ੾ସपΓͦͷޙ
   • https://songmu.jp/riji/entry/2020-09-22-letsencrypt.html
   

   View Slide

6. 6
   Recent Works
   • GoͷΫϥΠΞϯτ΁ͷରԠ
   • ͝ར༻͍ͩ͘͞
   

   View Slide

7. 7
   ৽࡞
   • github.com/Songmu/gotesplit
   • github.com/Songmu/ecschedule
   • ޙͰղઆ͠·͢
   

   View Slide

8. 8
   We are Hiring
   • GoΤϯδχΞઈࢍืूதͰ͢ʂ
   • ݱࡏ3໊
   • ιϑτ΢ΣΞΤϯδχΞ͸7໊
   

   View Slide

9. ࠓ೔࿩͢͜ͱ
   Agenda
   9
   

   View Slide

10. 10
    Agenda
    • ܰ͘Nature Remoͷ঺հ
    • Nature RemoͱGo
    • ೔ʑͷGo׆༻΍OSS׆ಈͳͲ
    

    View Slide

11. ձࣾͱ੡඼
    Company and Product
    11
    

    View Slide

12. Mission
    12
    Mission
    ⾃然との共⽣を
    テクノロジーでドライブする
    

    View Slide

13. Product
    

    View Slide

14. ֎ग़ઌ͔ΒεϚϗͰΤΞίϯΛON εϚʔτεϐʔΧʔͱ࿈ܞͯ͠੠ͰՈిΛૢ࡞
    14
    Features
    

    View Slide

15. How It Works
    

    View Slide

16. Traction
    20ສ୆ಥഁ
    ೝ஌ˍγΣΞۀքNo.1
    ʢ2020೥2݄࣮ࢪɺࣗࣾௐ΂ʣ
    

    View Slide

17. Nature RemoͱGo
    Nature Remo and Go
    17
    

    View Slide

18. API
    Stream
    Worker
    Amazon ECS
    Subscribe
    Publish
    WS
    WS Pub/Sub
    System Diagram
    

    View Slide

19. Nature Remoͷཪଆ
    • αʔόʔαΠυ͸΄΅શͯGo
    • ࣮͸ׂͱී௨ͷWebٕज़Λ࢖࣮ͬͯݱ͍ͯ͠Δ
    • WebSocketͷ઀ଓ؅ཧपΓ͕νϟϨϯδϯά
    • αʔϏε΋ٸ੒௕த
    

    View Slide

20. Components
    • API
    • εϚϗΞϓϦ΍εϚʔτεϐʔΧʔͱͷ௨৴
    • Stream
    • Nature RemoͱͷWebSocket௨৴
    • Worker
    • ϧʔϧͷ࣮ߦ
    ͢΂ͯGo੡ͰAmazon ECS্Ͱಈ͔͍ͯ͠Δ
    

    View Slide

21. Remarkable Points
    • ૉ๿ͳGo੡ͷWebΞϓϦέʔγϣϯ
    • Redis Pub/SubΛ༻͍ͨɺAPI - Streamؒͷ΍ΓͱΓ
    • Nature Remo͸ALBΛܦ༝ͯ͠streamαʔόʔʹ
    WebSocket઀ଓ͍ͯ͠Δ
    • AlexaͷΧελϜεΩϧ͸AWS Lambdaܦ༝Λ࢖࣮ͬͯߦ
    ͞ΕΔ
    

    View Slide

22. Simple Web Applications with Go
    • ී௨ͷWebΞϓϦέʔγϣϯ
    • ΋ͱ΋ͱherokuͰϗετ໊͍ͯͨ͠࢒΋
    • ϑϨʔϜϫʔΫ
    • github.com/nbio/hitch
    • Gorilla web toolkitΛ෦෼తʹར༻
    • MySQL/Redis
    • gorp/redigo
    • guregu/dynamo
    

    View Slide

23. Utilize Redis Pub/Sub
    • Redis Pub/SubΛ׆༻͍ͯ͠Δ
    • API͔Β͸RedisʹPublish
    • Stream͸RedisΛSubscribe
    • ૬ޓ௨৴͠ͳ͍ૄ݁߹Λ࣮ݱ͍ͯ͠Δ
    • Streamଆ͸͋͘·ͰWebSocketͱRedis͔ΒͷSubscribeͰ
    ड͚෇໋͚ͨྩͷ࣮ߦ͔͓͜͠ͳΘͣঢ়ଶΛ࣋ͨͳ͍
    

    View Slide

24. WebSocket connection via ALB
    • Nature Remo͸ALBΛܦ༝ͯ͠streamαʔϏεʹ
    WebSocket઀ଓ͍ͯ͠Δ
    • ҰͭͷGoΞϓϦͷίϯςφͰ਺ສ઀ଓ͞͹͚Δʂ
    • Goͷ͓खܰͳྑ͞Λ࣮ײ
    • Go͸खܰʹͦΕͳΓͷύϑΥʔϚϯε͕ग़ͤΔͷ͕͔ͳΓ
    ྑ͍
    

    View Slide

25. ೔ʑͷ։ൃɾӡ༻
    Go Topics
    25
    

    View Slide

26. ೔ʑͷۀ຿
    • GitHub্Ͱ։ൃ
    • CircleCI্ͰCI/CD
    • developϒϥϯν͔ΒfeatureϒϥϯνΛ੾Δ
    • ϨϏϡʔͯ͠Ϛʔδ
    • renovateʹΑΔϥΠϒϥϦࣗಈΞοϓσʔτ
    • developϒϥϯν͔Βmasterϒϥϯν΁ͷpull request
    • git-pr-releaseʹΑͬͯࣗಈ࡞੒
    • Ϛʔδ͞ΕͨΒࣗಈͰຊ൪deploy
    

    View Slide

27. CI/CD Pipelines
    git-pr-release
    git push
    go test
    go build
    docker build
    docker push
    ecspresso deploy
    1
    2
    3
    4
    

    View Slide

28. ECSͷdeployʹecspressoಋೖ
    • github.com/kayac/ecspresso
    • ecs-deploy͔Β৐Γ׵͑
    • ৐Γ׵͑ઌͱͯͪ͠ΐ͏ͲΑ͔ͬͨ
    • طଘͷTask DefinitionΛར༻ͯͦ͠ͷ··γʔϜϨεʹ
    ҠߦՄೳ
    • CircleCI͔Βdeploy͍ͯ͠Δ
    • ଞʹ΋ kayac/go-katsubushi ͳͲkayac OSSΛ׆༻
    

    View Slide

29. ECS Task Definition͕reviewableʹ
    • Task΁ͷαΠυΧʔ௥Ճ΍ύϥϝʔλʔมߋ͕reviewable
    ʹͳͬͨͷ͸ྑ͔ͬͨ
    

    View Slide

30. github.com/Songmu/flextime
    • ςετͰ࣌ࠁܥΛࠩ͠ସ͑ΔͨΊͷϥΠϒϥϦ
    • timeύοέʔδͱಉ༷ͷΠϯλʔϑΣʔεΛඋ͑Δ
    

    View Slide

31. github.com/Songmu/smartcache
    • ϓϦϑΣον͢ΔΠϯϝϞϦΩϟογϡ
    • Ωϟογϡߋ৽ॲཧ͕
    • ॏෳ͠ͳ͍Α͏ʹɾϒϩοΫ͠ͳ͍Α͏ʹ
    

    View Slide

32. ECS Scheduled Task؅ཧͷͨΊͷπʔϧecschedule
    • github.com/Songmu/ecschedule
    • όονྨ͸ɺECSͷScheduled TaskΛར༻͍ͯ͠Δ͕ͦΕ
    Λόʔδϣϯ؅ཧ͍ͨ͠ͱ͍͏ಈػ
    

    View Slide

33. খωλ: όονྨͷಈ͔͠ํ
    • APIͱworkerͱόον͸ಉ͡GoόΠφϦɺಉ͡ίϯςφ
    • Task Definition͸ҧ͏΋ͷ΋
    • αϒίϚϯυͰॲཧΛ෼͚Δ
    • nature server: APIαʔόʔͷىಈ
    • nature squadrons: ϫʔΧʔͷىಈ
    • nature batch hoge ... : όονྨͷىಈ
    

    View Slide

34. 34
    ςετߴ଎ԽͷͨΊͷgotesplit
    • github.com/Songmu/gotesplit
    • CI؀ڥͰͷςετฒྻ࣮ߦΛ؆୯ʹ࣮ݱ
    • CircleCI / GitHub Actions
    • ࣾ಺ͷςετ͕࣌ؒ15෼->5෼ʹ
    • ͔ͳΓศརͳͷͰͥͻ͝ར༻͍ͩ͘͞
    

    View Slide

35. 35
    @soh335࡞ͷOSS
    • github.com/soh335/go-test-redisserver
    • github.com/soh335/shukujitsu (new!)
    • github.com/schemalex/schemalex
    • ← ͜Ε͸·ͩಋೖग़དྷ͍ͯͳ͍
    

    View Slide

36. 36
    github.com/soh335/shukujitsu
    • ࡢ൩஀ੜ
    • ҎԼͷσʔλΛ΋ͱʹ೔ຊͷॕ೔൑ఆ
    • https://www8.cao.go.jp/chosei/shukujitsu/syukujitsu.csv
    • ͜Ε͸typoͰ͸͋Γ·ͤΜ
    • σʔλϑΥʔϚοτ͸ឯ༨ۂં͋ͬͨΑ͏͕ͩࠓ͸ׂͱ·ͱ΋
    

    View Slide

37. 37
    ࣗ࡞OSSΛຊ൪ʹಋೖ͢Δ
    • ͱΓ͋͑ͣOSSͰ࡞ͬͯΈΔ
    • ࢼ͠ʹຊ൪౤ೖͯ͠͠·͏
    

    View Slide

38. OSS΁ͷpull request
    38
    

    View Slide

39. 39
    nbio/hitch#11
    

    View Slide

40. 40
    nbio/hitch#12
    

    View Slide

41. 41
    kayac/go-katsubushi#40
    

    View Slide

42. 42
    blang/semver#56
    

    View Slide

43. 43
    pressly/goose#180
    

    View Slide

44. 44
    pressly/goose#181
    

    View Slide

45. 45
    kayac/ecspresso#37
    

    View Slide

46. 46
    kayac/ecspresso#38
    

    View Slide

47. 47
    kayac/ecspresso#161
    

    View Slide

48. 48
    guregu/dynamo#106
    

    View Slide

49. 49
    goccy/go-yaml#23
    

    View Slide

50. 50
    goccy/go-yaml#36
    

    View Slide

51. 51
    go-gorp/gorp#411
    

    View Slide

52. 52
    manifoldco/promptui#132
    

    View Slide

53. 53
    shogo82148/go-sql-proxy#42
    

    View Slide

54. 54
    OSS΁ͷpull request
    • ʮڠௐʯͰ͖Δ͔Λॏࢹ
    • pull requestΛૹͬͯΈͯ୳ΓΛೖΕΔ
    • ࢥ૝͕Ϛον͍ͯͦ͠͏͔
    • ϝϯςφϯε͕ΞΫςΟϒ͔
    • ϝϯςφϯε͕ࢭ·ͬͯΔͱࢥ͍͖΍͙͢ʹ
    ରԠͯ͘͠ΕΔ͜ͱ΋
    • 1೥ܦ͔ͬͯΒϚʔδ͞ΕΔ͜ͱ΋
    

    View Slide

55. ·ͱΊ
    55
    

    View Slide

56. Natureͷ։ൃ
    • αʔόʔαΠυ͸΄΅શ෦Go
    • 10ສ୆௒͑ͷIoTσόΠεΛϋϯυϦϯά͢ΔWebSocketίϯςφ܈
    • αʔόʔଆͷ੍ޚ͕݁ߏϔϏʔͰ໘ന͍
    • ૊ΈࠐΈ΍Appͱͷ࿈ܞͷ໘ന͞
    • OSSΛͪΌΜͱ׆༻͍ͨ͠
    • ڠௐͰ͖ΔOSSΛબΜͰߩݙ΋͍ͯ͘͠
    • OSSʹͰ͖Δ΋ͷ͸ͯ͠͠·͏
    

    View Slide

57. We are Hiring!
    ੵۃ࠾༻தͰ͢ʂ
    • όοΫΤϯυΤϯδχΞ
    • εϚʔτϑΥϯΤϯδχΞ
    • ϑϩϯτΤϯυΤϯδχΞ
    • ػցֶशΤϯδχΞ
    • ૊ΈࠐΈΤϯδχΞ
    

    View Slide