Evolution of realtime and AnyCable Pro – Rocky Mountain Ruby, 2024 Irina Nazarova

Transcript

1. Irina Nazarova, Rocky Mountain Ruby 2024 and… me Any Cable Pro Evolution of real-time,
2. Rocky Mountain Ruby 2024 Boulder 2
3. Rocky Mountain Ruby 2024 Boulder 3
4. Rocky Mountain Ruby 2024 Boulder Trivia 4 Vote here now!
5. Rocky Mountain Ruby 2024 Boulder 5 Summer 2008 Built with Powered by
6. Rocky Mountain Ruby 2024 Boulder 6
7. Rocky Mountain Ruby 2024 Boulder Trivia 7 know your heroes
8. Rocky Mountain Ruby 2024 Boulder The key difference 8 -HTTP connection: request, response, CLOSE -WS connection: request, response, STAY OPEN PERFECT FOR REAL-TIME
9. Rocky Mountain Ruby 2024 Boulder Real-time evolution 9 2005 2007 2011 2012 2014 2017 2021 2024 PREHISTORIC DARK AGES FUTURE CAMBRIAN EXPLOSION 💥
10. Rocky Mountain Ruby 2024 Boulder Ira Nazarova CEO The story of AnyCable Vova Dementyev Head of Backend 10
11. Rocky Mountain Ruby 2024 Boulder 11 We support startups building with Rails 🔗evl.ms/railsstack Yabeda 11
12. 2015 - 2019
13. Rocky Mountain Ruby 2024 Boulder -First-class built-in support for WebSockets -Chats, noti fi cations, etc. w/o leaving the comfort zone of the framework Rails 5 brings Action Cable 13 2015 Phoenix—2014, Django—2016, Laravel—2024
15. Rocky Mountain Ruby 2024 Boulder -Erlang Go server -Redis for multi-node clusters -Action Cable protocol -Rails plug-in-play integration -Open source Vova brings AnyCable 15 2016
16. Rocky Mountain Ruby 2024 Boulder AnyCable in a nutshell 16 System of 3 components: -WS server (Go) -Rails with RPC -Redis
17. Rocky Mountain Ruby 2024 Boulder -10x less RAM usage -Lower latency at scale Motto: "Performant WebSockets for Rails" 17 2016 🥇
18. Rocky Mountain Ruby 2024 Boulder -Action Cable said “You can build real-time features” -AnyCable said “And you can scale them” It aged well 18 WebSockets, caution no longer required!
19. Rocky Mountain Ruby 2024 Boulder The only thing missing was… 19
20. 😷 2020 - 2021
21. Rocky Mountain Ruby 2024 Boulder 21 😷
22. Rocky Mountain Ruby 2024 Boulder 22
23. Rocky Mountain Ruby 2024 Boulder Pre Pro era 23 Consulting gigs -Working closely with AnyCable users helped us to better understand our powers and their needs
24. Rocky Mountain Ruby 2024 Boulder Pre Pro era 24 Consulting gigs -Working closely with AnyCable users helped us to better understand our powers and their needs -We learned use cases and industries: GPS tracking, virtual events, edtech, devtools
25. Rocky Mountain Ruby 2024 Boulder -Working closely with AnyCable users helped us to better understand our powers and their needs -We learned use cases and industries: GPS tracking, virtual events, edtech, devtools -As a result, we launched the fi rst major version 1.0! Pre Pro era 25 Consulting gigs
26. Rocky Mountain Ruby 2024 Boulder 26 AnyCable learnings Something about scaling WebSockets Architecture vs. scaling
27. Rocky Mountain Ruby 2024 Boulder 27 Imagine your server as a phone line: ☎ HTTP requests are like brief phone calls: you dial, get information, and hang up. 🌎 WebSocket connections are like the dial-up modem If the two are competing, WebSockets win all resources they need–as seen by our customers
28. Rocky Mountain Ruby 2024 Boulder 28 Realtime/WebSocket requests should be serviced and scaled independently from HTTP
29. Rocky Mountain Ruby 2024 Boulder 29 AnyCable learnings Big apps with scale reached out. For them, we needed tools: -xk6-cable for load testing -wsdirector for scenario-based system tests Ecosystem was missing
30. Rocky Mountain Ruby 2024 Boulder -GraphQL subscriptions -Fallback to long-polling -Voice applications (Twilio Media Streams) AnyCable next 30 What people wanted
31. Build it
32. Rocky Mountain Ruby 2024 Boulder 32 Open-source a communal garden Commercial Pro a professional farm
33. Rocky Mountain Ruby 2024 Boulder 2021 launching the Pro 33 Key Pro feature: 30 - 50% RAM savings (vs. OSS) Binary compression Apollo GraphQL integration Priority support
34. Rocky Mountain Ruby 2024 Boulder 34 – GitHub Container Registry – $990 per year fl at price – EULA – Typeform for signups – Manual emails, calls, invoices – No “license server” Keep it simple! 2021 launching the Pro
35. Rocky Mountain Ruby 2024 Boulder 🇫🇷 Callbell.eu, our first Pro customer 💙 35 Shared inbox for support: WhatsApp, Messenger, Instagram, and Telegram For Callbell low latency is crucial Callbell is 🔥
36. Rocky Mountain Ruby 2024 Boulder 💡Unexpectedly, paying customers turned out to be a lot more engaging and responsive than users of open-source 36
37. 2021 - 2024
38. Rocky Mountain Ruby 2024 Boulder 2021 38 Released the client library: -TypeScript support -works with any JS runtime: React Native, Ionic, etc.
39. Rocky Mountain Ruby 2024 Boulder 2021 39 Pushing backend-rendered templates over WebSocket to all connected clients
40. Rocky Mountain Ruby 2024 Boulder 2021 40 ✅ Standalone mode for apps only using WS for Hotwire: – no RPC server – only 2 components out of 3 We wanted to do something extra
41. Rocky Mountain Ruby 2024 Boulder 2021 results 41 Trials: 20 Paying customers: 6 End-year ARR: $6k Consulting revenue: $320k
42. Rocky Mountain Ruby 2024 Boulder 💡The results were not stellar, so we had to focus on other things… 42
43. Rocky Mountain Ruby 2024 Boulder 2022 43 RailsConf 2022 “The pitfalls of realtime-i fi cation” Recorded screencasts Launched newsletter Marketing all-in SUBSCRIBE blog.anycable.io
45. Rocky Mountain Ruby 2024 Boulder 45 On a real-time scale, connectivity is not that solid and smooth
46. Rocky Mountain Ruby 2024 Boulder 2022 results 46 Trials: 18 Paying customers: 14 End-year ARR: $12k Consulting revenue: $1M 🎉
47. Rocky Mountain Ruby 2024 Boulder 💡With $1M consulting revenue per year, AnyCable became vital for Evil Martians... 47
48. Rocky Mountain Ruby 2024 Boulder ...but the product itself didn't sky-rocket—marketing is not enough 🤔 48
49. Rocky Mountain Ruby 2024 Boulder 2023 49 The paradigm shift -Reliable communication -Simpli fi ed infra -More protocols (Twilio Media Streams, OCPP) -SSE support Move focus from performance to features and DX:
50. Rocky Mountain Ruby 2024 Boulder Exactly-once delivery in WebSockets with AnyCable 50 -Exactly-once delivery of real-time data -Resume WS sessions automatically on deployments (Pro)
51. Rocky Mountain Ruby 2024 Boulder 51 💡We now recommend using AnyCable from day 1 for reliable delivery PERFECT FOR REAL-TIME
52. Rocky Mountain Ruby 2024 Boulder Simplified setup with NATS 52 We added embedded NATS to replace Redis for multi-region deployments for Fly.io
53. Rocky Mountain Ruby 2024 Boulder EV-charging protocol support 53 Testing: UK’s leading EV charging provider Customer: Malaysia's leading EV charging provider 🔗docs.anycable.io/anycable-go/ocpp Use AnyCable to monitor and operate charging stations in real time
54. Rocky Mountain Ruby 2024 Boulder AnyCable: -Gets a WS voice stream from Twilio -Sends chunks it to real-time speech-to-text API -(Proxies other processing steps) -Noti fi es Rails Voice apps 54 Twilio media streams support 🔗 github.com/anycable/anycable-go-sca ff old used by
55. Rocky Mountain Ruby 2024 Boulder -Safari fi nally got support -LLMs (ChatGPT) popularized SSE for response streaming -Use AnyCable for LLM streaming over WS or SSE Server-sent events 55 LLMs' native realtime transport
56. Rocky Mountain Ruby 2024 Boulder AnyCable over SSE 56 No libs attached
57. Rocky Mountain Ruby 2024 Boulder 2023 results 57 Trials: 39 Paying customers: 23 End-year ARR: $21k Consulting revenue: $ 1M
58. Rocky Mountain Ruby 2024 Boulder 2024 58 The even bigger paradigm shift -Serverless JS and other vercels -Universal pub/sub interface (no channels attached) -Managed AnyCable Go beyond Ruby and Rails:
59. Rocky Mountain Ruby 2024 Boulder 59 Vercel Template
60. Rocky Mountain Ruby 2024 Boulder -No RPC component required -Only 1 component out of 3 -Whispering support (client- to-client broadcasting) Simplified pub/sub 60 AnyCable as one component
61. Rocky Mountain Ruby 2024 Boulder Whispering 61 Go to anycable.io now What to whisper 🔗anycable.io
62. Rocky Mountain Ruby 2024 Boulder 62 But what about Managed AnyCable?
63. Rocky Mountain Ruby 2024 Boulder 63 What’s the most e ff i cient way to build a managed service?🧐
64. Rocky Mountain Ruby 2024 Boulder 🔗plus.anycable.io 64 🔗go.anycable.io/gem fi le We launched Managed AnyCable in Alpha
65. Rocky Mountain Ruby 2024 Boulder 65 We added anonymous telemetry to AnyCable-go big open source servers big Pro servers people on old versions PostHog dropping our data Unique servers with over 1k concurrent connections
66. Rocky Mountain Ruby 2024 Boulder 2024 Jan-Aug results 66 Trials: 60 Paying customers: 29 ARR: $30k Consulting revenue: $480k
67. Rocky Mountain Ruby 2024 Boulder 67 💡 New trials are growing which means that our new approach works!
68. Rocky Mountain Ruby 2024 Boulder Today AnyCable is the critical infrastructure powering some of the largest Rails apps 68 $3B legal services SaaS Leading American transit SaaS Malaysia's Leading EV Charging Company communication platform used by 80% of US doctors marketing SaaS with $160M+ revenue
69. Rocky Mountain Ruby 2024 Boulder 💡 Our customers and big use cases give us the confidence to move forward 69
70. Rocky Mountain Ruby 2024 Boulder What we have 70 ✅ Solve a real problem ✅ And for real big use cases ✅ And new cases keep coming up We solved the backend and infra: - integration - scaling - dependability - reliability - no lock on cloud provider
71. Rocky Mountain Ruby 2024 Boulder What we don’t have 71
72. 2024-future
73. Rocky Mountain Ruby 2024 Boulder Higher-level abstractions 73 Common tasks must be easy to implement: – UI kits – Collaboration SDK UI-centric real-time
74. Rocky Mountain Ruby 2024 Boulder Simplify and simplify again 74 There’s a lot to be done to be AnyCable easier to reach for: – Guides & tutorials (incl. AI-powered) – Zero-con fi guration installs – Managed AnyCable for production Make it accessible for more engineers
75. Rocky Mountain Ruby 2024 Boulder -WebTransport is coming -Whatever’s the next new thing Future transports 75 AnyCable will integrate with the new realtime tech
76. Rocky Mountain Ruby 2024 Boulder Evolution of … myself 76 Manager ➡ co-founder Contributing to the product strategy A member of the Ruby community
77. Rocky Mountain Ruby 2024 Boulder Evolution of … myself 77 Thanks to the unwavering trust of
78. SF BAY AREA RUBY MEETUP Unwavering… almost!
79. Rocky Mountain Ruby 2024 Boulder 79 This is how we laid out the foundations of AnyCable
80. Thank you! in@evilmartians.com x.com/inazarova ✨lu.ma/sfruby✨