Widebullet - Proxying RESTful APIs with JSON-RPC in Go

Transcript

1. Widebullet - Proxying RESTful APIs with JSON-RPC in Go Tatsuhiko Kubo@cubicdaiya Go 1.6 Release Party 2016/02/17
2. @cubicdaiya / Tatsuhiko Kubo Principal Engineer, SRE @ Mercari, Inc. ngx_small_light, ngx_dynamic_upstream, nginx-build, slackboard,cachectl, gaurun, etc…
3. nginxຊΛࣥච͠·ͨ͠ʢ2016/01/16ൃചʣ
5. https://www.mercari.com/ Mercari - Your Friendly Mobile Marketplace
6. Agenda • Use cases Go @ • Widebullet - proxying RESTful APIs with JSON-RPC
7. Use cases for Go @
8. Use cases for Go @ • nginx-build - seamless nginx builder (github.com/cubicdaiya/nginx-build) • cachectl - page cache controller (github.com/cubicdaiya/cachectl) • Slackboard - proxying message to Slack (github.com/cubicdaiya/slackboard) • Gaurun - proxying push notification (github.com/mercari/gaurun) • fluent-agent-hydra - A Fluentd log agent (github.com/fujiwara/fuluent-agent-hydra)
9. Use cases for Go @ • zabbix-cli - CLI tool for Zabbix • CLI tools and plugins for Mackerel • Widebullet - proxying multi API requests • etc… (e.g. internal CLIs and daemons…)
10. Use cases for Go @ • zabbix-cli - CLI tool for Zabbix • CLI tools and plugins for Mackerel • Widebullet - proxying multi API requests • etc… (e.g. internal CLIs and daemons…)
11. Widebullet - Proxying RESTful APIs with JSON-RPC in Go
12. Overview of mercari API call - Before NFSDBSJ
    "1* Multimedia Corporate data center Traditional server Mobile Client Example: IAM Add-on Requester Workers HTTPS HTTP private network global network
13. Overview of mercari API call - Now NFSDBSJ
    "1* Multimedia Corporate data center Traditional server Mobile Client Example: IAM Add-on Requester Workers HTTPS HTTP HTTP TVCTZT private network global network
14. Overview of mercari API call - Now NFSDBSJ
    "1* Multimedia Corporate data center Traditional server Mobile Client Example: IAM Add-on Requester Workers HTTPS HTTP HTTP TVCTZT TVCTZT HTTP private network global network
15. Overview of mercari API call - Now NFSDBSJ
    "1* Multimedia Corporate data center Traditional server Mobile Client Example: IAM Add-on Requester Workers HTTPS HTTP HTTP TVCTZT TVCTZT HTTP TVCTZT HTTP private network global network
16. Overview of mercari API call - Now NFSDBSJ
    "1* Multimedia Corporate data center Traditional server Mobile Client Example: IAM Add-on Requester Workers HTTPS HTTP HTTP TVCTZT TVCTZT HTTP TVCTZT HTTP … private network global network
17. Performance reduction due to API mismatch • mercari API is not always constructed optimally for every situation • some subsystem must call multiple APIs at once • Call APIs concurrently for high performance • BTW, some subsystem is powered by PHPʂ
18. Call APIs concurrently in PHP • We tried with Guzzle ( internally curl_exec_multi) • succeed a bit optimization • But overhead is not negligible switched concurrent API call PHP wait API response consumed time graph
19. Next step • Try to call multiple APIs with single request • Nice to have anyway • JSON-RPC is reasonable choice • But mercari API does not provides JSON-RPC • I tried to write the proxy server in Go • It’s the Widebullet.
20. Widebullet • The proxy server between JSON-RPC and RESTful API server • Protocol • based JSON-RPC ( a little extended) • Configuration with TOML • Not published yetʂ
21. Overview NFSDBSJ
    "1* TVCTZT JSON-RPC XJEFCVMMFU
22. Start Widebullet $ wbt -c wbt.toml
23. Configuration with TOML Port = "29300" LogLevel = "error" Timeout = 5 MaxIdleConnsPerHost = 100 DisableCompression = false [[Endpoints]] Name = "ep-1" Ep = “ep-1:30001" ProxySetHeaders = [ ["Host", "ep1.example.com"], ] [[Endpoints]] Name = "ep-2" Ep = “ep-2:30001" ProxySetHeaders = [ ["Host", "ep2.example.com"], ]
24. JSON-RPC request example [ { “jsonrpc”: “2.0”, “ep”: “ep-1”, “method”: “/goods/get”, “params”: { “id”: 1234, “status”: “alive” } }, { “jsonrpc”: “2.0”, “ep”: “ep-2”, “method”: “/users/get”, “params”: { “id”: 5678 } } ]
25. Convert to RESTful API requests GET http://ep-1/goods/get?id=1234&status=alive HTTP/1.1 GET http://ep-2/users/get?id=5678 HTTP/1.1
26. Sending HTTP requests concurrently // error handling is eliminated for simplicity func jsonRpc2Http(reqs *[]jsonrpc.Request) ([]jsonrpc.Response) { wg := new(sync.WaitGroup) resps := make([]jsonrpc.Response, len(reqs) for i, reqj := range *reqs { wg.Add(1) go func(i int, reqj jsonrpc.Request) { defer wg.Done() reqh := buildHttpRequest(&reqj) resp, _ := HttpClient.Do(reqh) defer resp.Body.Close() body, _ := ioutil.ReadAll(resp.Body) resps[i] = buildJsonRpcResponse(string(body), reqj.ID) }(i, reqj) } wg.Wait() return resps }
27. Overview NFSDBSJ
    "1* TVCTZT JSON-RPC 8JEFCVMMFU REST [ { “jsonrpc”: “2.0”, “ep”: “ep-1”, “method”: “/goods/get”, “params”: { “id”: 1234, “status”: “alive” } }, { “jsonrpc”: “2.0”, “ep”: “ep-2”, “method”: “/users/get”, “params”: { “id”: 5678 } } ] GET http://ep-1/goods/get?id=1234&status=alive HTTP/1.1 GET http://ep-2/users/get?id=5678 HTTP/1.1
28. Result PHP wait API response from widebullet consumed time graph introduced Widebullet
29. We are hiring Go Engineer! https://www.mercari.com/jp/jobs/