How to rebuild a websocket service by golang and redis

1. Why rebuild
2. Redesign Architecture
3. Problems we met
4. How to scale and test scalability

We will talk about Golang, RabbitMQ, Redis PubSub, Kubernetes, Grafana

https://www.meetup.com/golang-taipei-meetup/events/272373659/

Transcript

1. How to rebuild a websocket service by golang and redis LY @MaiCoin 2020.08.25
2. BACKGROUND
3. CRYPTOCURRENCY EXCHANGE
4. API EVERYWHERE
5. API EVERYWHERE /depth
6. API EVERYWHERE /markets
7. API EVERYWHERE /kline
8. API EVERYWHERE /public_trades /private_orders
9. Websocket v1 • Rails em-websocket • RabbitMQ • Ticker • Push when data changed • Order Book Push order book operation • Private channel • Account only
10. Websocket v2 • Golang gorilla/websocket • Deploy with Rails • Ticker • Push when data changed Push data every 5 seconds • Order Book • Not production ready • Private channel • Not implement
11. PAIN POINTS
12. Too Many Requests Polling Every 3 seconds 6 requests 120 requests/minutes
13. Slow Response Polling 1.5 seconds CDN issues
14. Low priority New Features Bug fix Operations
15. ARCHITECTURE
16. At the Beginning
17. Final RabbitMQ Worker Redis WebSocket Server WebSocket Client
18. THE RIGHT WAY
19. Good Infra Kubernetes Helm chart Jenkins Gitflowd Grafana Kibana Machine Management CI/CD Monitor/Log
20. Reuse good Part Message Queue Codebase
21. RABBITMQ https://codedestine.com/rabbitmq-headers-exchange/ Fanout Headers
22. REDIS PUBSUB https://medium.com/@saurabh.singh0829/redis-pub-sub-implementation-f3208e4625c7 Topic Keep server simple Reduce memory Improve scalability
23. PROBLEMS
24. JSON Format [1,”b”,[…,…],true] Readability Small size {“event”:”orderbook”,”bids”:} {“e”:”orderbook”,”b”:}
25. Authentication Ruby https://www.facebook.com/yhsiang/posts/10157307118952883 AES GCM Base64 Golang cipher text / encrypted_xx yDIBC ==\nxZyyc= nonce / encrypted_xx_iv gCkjsa ==\n
26. Scalability
27. REDIS https://rtfm.co.ua/en/redis-replication-part-1-overview-replication-vs-sharding-sentinel-vs-cluster-redis-topology/ Primary-replica Sentinel Cluster
28. Kubernetes Metric server Kubernetes v1.6 Kubernetes v1.5 Client-go HPA CPU
29. LOAD TESTING https://artillery.io/ Artillery Scenarios Ramp Up
30. Achievement
31. Reduce API Calls
32. Lower latency Order book update latency 3ms Market trade update latency 291ms
33. CONCLUSION
34. RECAP Good Infra Reuse Good Part Design First
35. WE ARE HIRING AMIS Blockchain/Backend Frontend MaiCoin Backend Frontend Site Reliability ly@maicoin.com Full Stack