プロダクションで使うGo Pluginの利便性とパフォーマンス性 / Simplicity and Performance of Go plugin for Production

Dec 2, 2023, Go Conference mini Winter in Kyotoでの発表資料です。

Transcript

1. 小 田 Software Engineer @Go Conference mini 2 0 2 3 Winter in Kyoto Go Plugin
2. https://tomohisaoda.com 🍜 A ff i liation: COGNANO Community: Fukuoka.go Weight Training Tomohisa Oda / @linyows
3. https://research.sakura.ad.jp/ Mission: 力 人 ・ ・文 ・ Mission: 革
4. Outline 1 . Computing Plugin 2 . Go Plugin Mechanism 3 . Plugin Mechanism 4 . Plugin Mechanism Benchmark 比 5 . Conclusion 🙏 方
5. Computing Plugin
6. Plugin Plugin 心 高 Attack Surface 小 Plugin 目 Host Application Plugins … .
7. Plugin 生 Plugin 大 Browser Plugin 止 Capability Extension Extension 入
8. Go Plugin Mechanism
9. Plugin 手 Host Application 一 Shared Library 用 Host Application API 用 CLI 用 Host Application Plugin
10. Plugin 手 Shared Library 用 https://pkg.go.dev/plugin 用 API 用 https://github.com/hashicorp/go-plugin HashiCorp Products 十 Host Plugin GRPC CLI 用 https://github.com/kubernetes/kubectl git-style
11. Plugin Mechanism 比 ⾒ ** ** Performance Maintainability Deployability Reliability Scalability Security Shared Library 👍 👍 👍 ⏳ ⏳ ⏳ API ⏳ ⏳ ⏳ 👍 👍 👍 CLI ⏳ 👍 👍 👍 ⏳ ⏳
12. Plugin Mechanism
13. SMTP 用 Proxy: WARP 用 Mail Transfer Agent MTA MTA SMTP 高
14. SMTP 用 Proxy: WARP https://github.com/linyows/warp Multi-Tenancy Plugin 自 用
15. Shared Library 力 見 Multi-Tenancy 自 自 用 自 Performance Maintainability Deployability Reliability Scalability Security Shared Library 👍 👍 👍 ⏳ ⏳ ⏳
16. HashiCorp Products API Plugin 🥢 🏢 🤔 🔌
17. " " What About Shared Libraries? When we started using plugins (late 2 0 1 2 , early 2 0 1 3 ), plugins over RPC were the only option since Go didn't support dynamic library loading. Today, Go supports the plugin standard library with a number of limitations. Since 2 0 1 2 , our plugin system has stabilized from tens of millions of users using it, and has many benefits we've come to value greatly.For example, we use this plugin system in Vault where dynamic library loading is not acceptable for security reasons. That is an extreme example, but we believe our library system has more upsides than downsides over dynamic library loading and since we've had it built and tested for years, we'll continue to use it.Shared libraries have one major advantage over our system which is much higher performance. In real world scenarios across our various tools, we've never required any more performance out of our plugin system and it has seen very high throughput, so this isn't a concern for us at the moment. https://github.com/hashicorp/go-plugin#what-about-shared-libraries
18. Shared Library go-plugin plugin library plugin go-plugin 人 用 入 高
19. Plugin Plugin => 面 見 ok, ok.. Application Plugin v 1 . 21 . 4 v 1 . 20 . 1 1 🙅
20. Shared Library 方 !
22. Plugin cgo glibc Production GoReleaser GitHub Actions Production Actions 行 Self-Hosted Runner 🙅
23. Plugin Mechanism 比 高 Performance Maintainability Deployability Reliability Scalability Security Shared Library 👍 👍 👍 ⏳ ⏳ ⏳ API ⏳ ⏳ ⏳ 👍 👍 👍 CLI ⏳ 👍 👍 👍 ⏳ ⏳ ❌ ❌
25. Plugin Mechanism Benchmark 比
26. Shared Library API CLI Benchmark Plugin 文 echo Web Shared Library API 5 CLI 29 CLI 高 一方
28. 一
29. " " Warnings The ability to dynamically load parts of an application during execution, perhaps based on user-defined configuration, may be a useful building block in some designs. In particular, because applications and dynamically loaded functions can share data structures directly, plugins may enable very high- performance integration of separate parts. However, the plugin mechanism has many significant drawbacks that should be considered carefully during the design. For example: … . Ref: https://github.com/golang/go/issues/ 5 68 93 https://pkg.go.dev/plugin#hdr-Warnings
30. Plugin 大 欠 欠 一 Go Plugin Linux, FreeBSD, macOS 目 用
31. WASM Plugin Mechanism https://github.com/knqyf 2 6 3 /go-plugin @knqyf 2 6 3 手 HashiCorp go-plugin GRPC README 見 `It uses the same de fi nition as gRPC, but go-plugin communicates with plugins in memory, not over RPC.` WASM Sandbox Secure by Default ⾒
32. Conclusion Plugin 一方 Plugin 見 Plugin Production 一方 高
33. GMO 🙏