Highly Scalable WebSockets with AWS

Transcript

1. Highly Scalable WebSockets with AWS
2. Why WebSockets? • Real-time communication • Full duplex connection • Low complexity • Less network chatter • Reduced latency
3. Technologies • AWS • Socket.IO • Cluster • Sticky-sessions • Sift • Javascript SDK for AWS • Node.JS
4. Basic Steps • Register with Route53 • Register for SNS Topics • Wait for clients to subscribe • Listen for matching SNS notifications • Emit matches to clients over a WebSocket
6. Configuring an ELB for WebSockets
7. Configuration Tweaks • ELB Idle Timeout must be greater than the WebSocket heartbeat time • Increase number of open files per process
 
 
 
 • Increase file descriptor limits, and NAT limits
 File: /etc/security/limits.d/websockets.conf root soft nofile 1000000 root hard nofile 1000000 * soft nofile 1000000 * hard nofile 1000000 File: /etc/sysctl.conf fs.file-max = 1000000 fs.nr_open = 1000000 net.ipv4.netfilter.ip_conntrack_max = 1048576 net.nf_conntrack_max = 1048576
8. Route 53 registration init.d script runs on startup and termination to add or remove DNS records
9. Subscribing to SNS Topics This uses the AWS SDK for Javascript and RxJS
10. Namespacing requests Creating Socket.IO namespaces dynamically as clients subscribe
11. Returning results to clients We test each SNS notification we receive against queries that clients have registered, if we have a match we send it to the client.
12. Handling SNS Notifications As notifications arrive we pass them to our handlers to see if we have any matches
13. Unsubscribing from SNS This is another init.d script that runs on termination and unsubscribes from all SNS topics
14. Removing Route53 Records Removing Route53 records on instance termination
15. Questions?