Refactoring a Project for Distributed Systems

Transcript

1. Refactoring a Project for Distributed Systems Murat Mirgün Ercan @Software Engineer
2. Topics 1 About Me 2 About Golang & Why I Chose 3 What is Distributed Systems 4 What Tech’s I Use 5 Final Q&A
3. Who Am I ? Software Engineer at @ OSS Maintainer @ Formerly: @Permify, @Getir, @VirtualMetric
4. Why GOlang Let’s Talk
5. Distributed Systems? A distributed system, also known as distributed computing, is a system with multiple components located on different machines that communicate and coordinate actions in order to appear as a single coherent system to the end-user.
6. Distributed != Microservice [D] involve interconnected software components running on independent computers. [M] is the practice of dividing a piece of software into small, independent, and functional services. [D] are difficult to update, they run on machines. [M] are easier because they are updated and deployed independently [D] the failure of one server may affect other servers. [M] the failure of one service can indirectly affect other services.
7. Timeline Let’s start the Journey 1 2 3 4 Read Project Structure Which Customer Reactions ??? Create New Structure implementing
8. Example Old Structure Redis & In-memory Example Req user:1 see document:2
9. Customer Reactions 1000 RPS %99 - 500 ms Core cache fails
10. Create New Structure Example Req user:1 see document:2 Consistent Hash Redis & In-memory
11. Keywords Consistent Hashring Deployments 1 3 Memberlist & Resolver Old Version Migrations 2 4
12. Consistent Hashing Consistent Hashing is a distributed hashing scheme that operates independently of the number of servers or objects in a distributed hash table by assigning them a position on an abstract circle, or hash ring. This allows servers and objects to scale without affecting the overall system. Consistent hashing facilitates the distribution of data across a set of nodes in such a way that minimizes the re-mapping/ reorganization of data when nodes are added or removed.
13. Improvments (5 replica 100 user) 400 300 200 100 0 Old New
14. Thank you! You can contact from all platforms @muratmirgun