Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ZeroServices
Search
Boris Feld
October 27, 2013
Programming
0
99
ZeroServices
Présentation de ZeroServices, une libraire pour faire des services réseaux en P2P.
Boris Feld
October 27, 2013
Tweet
Share
More Decks by Boris Feld
See All by Boris Feld
BALTO, ONE TEST OUTPUT FORMAT TO UNITE THEM ALL
lothiraldan
0
38
Une révolution dans le monde des tests
lothiraldan
0
210
Mercurial changeset Evolution
lothiraldan
0
140
Python Unicode and Bytes Demystified
lothiraldan
0
180
Django 101
lothiraldan
0
220
Saltpad: A saltstack Web GUI
lothiraldan
5
26k
Mock considered harmful
lothiraldan
2
690
from Sync to Async Python, a AsyncIO migration
lothiraldan
2
700
Microservices késako
lothiraldan
0
110
Other Decks in Programming
See All in Programming
Android開発者のための Kotlin Multiplatform入門
ntaro
0
190
CSC307 Lecture 07
javiergs
PRO
0
220
しくじり先生 Image Matching Challenge 2024 編
goosehaaan
0
810
Play Billing Library 7.0.0 変更点まとめ@potatotips#88
kako351
0
160
開発部に不満を持っていたCSがエンジニアにジョブチェンしてわかった「勝手に諦めない」ことの大切さ
sakuraikotone
28
16k
「2024年版 Kotlin サーバーサイドプログラミング実践開発」の補講 〜O/Rマッパー編〜
n_takehata
2
260
How to use Macrobenchmark
veronikapj
0
160
スクラムマスターって孤独じゃないですか?
yoshitaroyoyo
1
140
Exploring the Gradually Lost Technical Skills in the Cloud Native Era
hwchiu
2
3.9k
はしめてのプログラミングとロボット制御
watawatavoltage
0
290
12年前の『型システム入門』翻訳の思い出話
mame
11
1.2k
CSC307 Lecture 05
javiergs
PRO
0
210
Featured
See All Featured
ParisWeb 2013: Learning to Love: Crash Course in Emotional UX Design
dotmariusz
105
6.8k
A better future with KSS
kneath
231
17k
Side Projects
sachag
451
42k
Making Projects Easy
brettharned
111
5.7k
Web development in the modern age
philhawksworth
203
10k
Making the Leap to Tech Lead
cromwellryan
127
8.7k
Web Components: a chance to create the future
zenorocha
307
41k
Become a Pro
speakerdeck
PRO
15
4.8k
BBQ
matthewcrist
82
9k
Code Reviewing Like a Champion
maltzj
517
39k
Six Lessons from altMBA
skipperchong
24
3.2k
From Idea to $5000 a Month in 5 Months
shpigford
377
46k
Transcript
ZeroServices FELD Boris - PyconFR 2013
[email protected]
/me • FELD Boris - DevTools • Tornado FTW •
@lothiraldan un peu partout sur le web • https://github.com/Lothiraldan/ ZeroServices
ZeroService • Librairie pour écrire des Services P2P • Python2.x
• Very Alpha
ZeroServices Pourquoi ?
Besoins • AutoDiscovery • Multicast / Unicast • Découverte des
pertes de pairs
Network is difficult
Peer To Peer is difficult
Choix technologiques
Pourquoi ØMQ ? • Sockets BSD trop bas niveau. •
RabbitMQ... NOPE. • ØMQ FTW. • L’ioloop est packagée dans PyZMQ.
AutoDiscovery UDP Multicast
Communication Unicast / Multicast ZeroMQ
Découverte des pertes Heartbeating (to do)
None
Retour d’expérience
L’asynchrone c’est difficile
Tester de l’asynchrone c’est douloureux
Quelques trucs • Isoler au maximum la partie asynchrone •
La tester avec des mocks • Mocker la partie asynchrone
Exemple class ZeroMQMediumTestCase(unittest.TestCase): def setUp(self): self.service = ServiceMock() self.ioloop =
IOLoop.instance() self.medium = ZeroMQMedium(self.service, ioloop=self.ioloop) def testRegister(self): self.medium.register() self.ioloop.start() self.assertEqual(self.service.on_registration_message.call_count, 1)
Exemple II class BaseServiceTestCase(unittest.TestCase): def setUp(self): self.medium = TestMedium() self.service
= BaseService(self.medium) def testOnRegistration(self): node_info = {'name': 'Service 1'} self.service.on_registration_message(node_info) self.assertEqual(self.medium.send_registration_answer.call_count, 1)
Les topologies réseaux est hétérogène
Vous allez toujours avoir des topologies de réseau tordues
Au choix • Firewall • NAT • VPN • DMZ
• Pas d’UDP Multicast
None
Traitez les quand ils arrivent
Pas de solutions magiques en P2P
Des techniques • Utiliser le port 443 ou 80 •
UDP Hole Punching • Encapsuler le traffic dans HTTP
Une solution ? • Avoir un pair central • Qui
forward le traffic
ZeroService is not perfect • Pas d’ack pour les messages
• Pas d’heartbeat • Une socket par message sortant • UDP Multicast / ZeroConf • Marche en LAN. Pas en WAN.
Exemple
Le service de chat class ChatService(BaseService): def __init__(self, username): self.username
= username super(ChatService, self).__init__(ZeroMQMedium(self, port_random=True)) def service_info(self): return {'name': self.username}
Le service de chat class ChatService(BaseService): def on_event(self, message_type, message):
"""Called when a multicast message is received """ msg = {'type': message_type} msg.update(message) self.send_to_all_clients(json.dumps(msg)) def on_message(self, message_type, **kwargs): """Called when an unicast message is received """ msg = {'type': message_type} msg.update(kwargs) self.send_to_all_clients(json.dumps(msg)) def on_new_node(self, node_info): """Called when a new peer joins """ msg = json.dumps({'type': 'user_join', 'id': node_info['node_id'], 'name': node_info['name']}) self.send_to_all_clients(msg) def on_node_close(self, node_info): """Called when a peer leaves """ msg = json.dumps({'type': 'user_leave', 'id': node_info['node_id'], 'name': node_info['name']}) self.send_to_all_clients(msg)
La partie Tornado class MainHandler(web.RequestHandler): def get(self): return self.render('chat.html', port=int(sys.argv[2]),
name=sys.argv[1])
La partie Tornado clients = [] class WebSocketHandler(websocket.WebSocketHandler): def open(self):
clients.append(self) for node_id, node in s.nodes_directory.items(): msg = json.dumps({'type': 'user_join', 'id': node_id, 'name': node['name']}) self.write_message(msg) def on_close(self): clients.remove(self) def on_message(self, message): message = json.loads(message) if message['type'] == 'message': msg = {'username': sys.argv[1], 'message': message['data']['message']} s.publish(str(message['type']), msg) elif message['type'] == 'direct_message': msg = {'from': sys.argv[1], 'message': message['data']['message']} s.send(message['data']['to'], msg, msg_type=str(message['type']))
Chat.py urls = [ (r"/", MainHandler), (r"/websocket", WebSocketHandler), (r"/static/(.*)", web.StaticFileHandler,
{"path": "."})] if __name__ == '__main__': application = web.Application(urls, debug=True) application.listen(int(sys.argv[2])) try: ioloop.IOLoop.instance().add_timeout(time() + 1, s.medium.register) ioloop.IOLoop.instance().start() except KeyboardInterrupt: s.close() for client in clients: client.close()
La demo chat • 69 lignes de python • Pas
de serveur central • API qui se veut simple
DEMO !
Questions ?