Gossiping on node.js

A web application essentially is a distributed application, where a client communicate with one or multiple servers, and despite fullstack developers code it all the time, we don’t acknowledge the fact that we are working with a distributed system. I’d like to present some of the different options we have to work on distributed communications using node.js, by implementing a simple version of the gossip protocol and dividing the subject in three categories: P2P tools (peer.js/P/freedom.js), Message passing frameworks (zeromq, klyng), Mix (capataz.js, lateral.js). As a conclusion I’ll be explaining the importance of these tools and protocols, and how distributed systems as a topic can help your career, your performance at your job, and even your community by creating new ways of communication.

Presented in NodeJSConf 2016 - http://nodejsconf.it/talk/gossiping-node-js
Examples: https://github.com/p1nox/gossiping_on_node

Transcript

1. Gossiping on node.js Gentile introduction to distributed communications environments by Raul Pino Node.JS Conf Italy 2016 1
2. Who am I? • Born in Venezuela • Living in Chile • uBiome (we love bacteria) • Groupon Latam • <3 mortadella Github/Twitter: @p1nox 2
3. What about that title? Gossiping on node.js? Who's that guy? 3
4. "What Shakespeare is to drama, Bernini may be to sculpture..." 4
5. What about that title? Bernini - Baldinucci - Borromini Gossiping on node.js! The Gossiper/Biographer! The protocol! The cool title! Yeah right (ʭ✧Д✧))ʭ୴ˍʓˍ 5
6. Agenda • Gossip protocol • P2P libraries (demo) • Message passing frameworks (demo) • Mix implementations 6
7. Gossip protocol Multicast problem Protocol stages Notes 7
8. Gossip protocol Multicast problem 8
9. Gossip protocol Naive approach solving multicast 9
10. Gossip protocol Gossip first stage 10
11. Gossip protocol Gossip n stage 11
12. Gossip protocol Notes: • Same nodes can be picked multiple times. • Periods are not syncronised across nodes (so each node could have its own intervals). 12
13. Gossip protocol Implementations: • Is rumored that AWS EC2 and S3 uses it (postmortems refers to gossip messages). • Cassandra uses gossip to maintain membership lists in the system. • Usenet NNTP from the 70's (Network News Transport Protocol). 13
14. P2P libraries List of libraries Demo 14
15. P2P libraries • peer.js - http:/ /peerjs.com • freedom.js - http:/ /www.freedomjs.org • P - http:/ /unsetbit.com/p 15
16. P2P libraries Demo: • Simple example. • Gossip implementation. 16
17. Message passing frameworks List of frameworks Demo 17
18. Message passing frameworks • klyng - https:/ /github.com/Mostafa-Samir/klyng • zeromq - http:/ /zeromq.org/ (using zeromq.node package) 18
19. Message passing frameworks Demo: • Simple example. • Gossip implementation. 19
20. Mixed implementations capataz.js https:/ /github.com/LeonardoVal/capataz.js Lateralus ß https:/ /github.com/project-lateralus 20
21. Lateralus ß: Architecture 21
22. Lateralus ß: Architecture Gossip protocol variant 22
23. Lateralus ß: Architecture Membership protocol variant 23
24. Takeaways Hot topics: • Descentralized web. • Distributed computing. • P2P communications. • Blockchain. Ultimate goal: A decentralized web would give power back to the people online Matthew Hodgson (matrix.org in TC) 24