Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ZeroServices
Search
Boris Feld
October 27, 2013
Programming
0
110
ZeroServices
Présentation de ZeroServices, une libraire pour faire des services réseaux en P2P.
Boris Feld
October 27, 2013
Tweet
Share
More Decks by Boris Feld
See All by Boris Feld
BALTO, ONE TEST OUTPUT FORMAT TO UNITE THEM ALL
lothiraldan
0
52
Une révolution dans le monde des tests
lothiraldan
0
250
Mercurial changeset Evolution
lothiraldan
0
180
Python Unicode and Bytes Demystified
lothiraldan
0
230
Django 101
lothiraldan
0
250
Saltpad: A saltstack Web GUI
lothiraldan
5
27k
Mock considered harmful
lothiraldan
1
710
from Sync to Async Python, a AsyncIO migration
lothiraldan
2
740
Microservices késako
lothiraldan
0
130
Other Decks in Programming
See All in Programming
システム成長を止めない!本番無停止テーブル移行の全貌
sakawe_ee
1
150
アンドパッドの Go 勉強会「 gopher 会」とその内容の紹介
andpad
0
270
型付きアクターモデルがもたらす分散シミュレーションの未来
piyo7
0
810
Kotlin エンジニアへ送る:Swift 案件に参加させられる日に備えて~似てるけど色々違う Swift の仕様 / from Kotlin to Swift
lovee
1
260
deno-redisの紹介とJSRパッケージの運用について (toranoana.deno #21)
uki00a
0
150
既存デザインを変更せずにタップ領域を広げる方法
tahia910
1
240
Google Agent Development Kit でLINE Botを作ってみた
ymd65536
2
200
What Spring Developers Should Know About Jakarta EE
ivargrimstad
0
310
datadog dash 2025 LLM observability for reliability and stability
ivry_presentationmaterials
0
180
Team operations that are not burdened by SRE
kazatohiei
1
260
PostgreSQLのRow Level SecurityをPHPのORMで扱う Eloquent vs Doctrine #phpcon #track2
77web
2
400
Systèmes distribués, pour le meilleur et pour le pire - BreizhCamp 2025 - Conférence
slecache
0
110
Featured
See All Featured
We Have a Design System, Now What?
morganepeng
53
7.7k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Embracing the Ebb and Flow
colly
86
4.7k
Designing for humans not robots
tammielis
253
25k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
It's Worth the Effort
3n
185
28k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
130
19k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
Side Projects
sachag
455
42k
Measuring & Analyzing Core Web Vitals
bluesmoon
7
490
Why You Should Never Use an ORM
jnunemaker
PRO
58
9.4k
A Modern Web Designer's Workflow
chriscoyier
694
190k
Transcript
ZeroServices FELD Boris - PyconFR 2013
[email protected]
/me • FELD Boris - DevTools • Tornado FTW •
@lothiraldan un peu partout sur le web • https://github.com/Lothiraldan/ ZeroServices
ZeroService • Librairie pour écrire des Services P2P • Python2.x
• Very Alpha
ZeroServices Pourquoi ?
Besoins • AutoDiscovery • Multicast / Unicast • Découverte des
pertes de pairs
Network is difficult
Peer To Peer is difficult
Choix technologiques
Pourquoi ØMQ ? • Sockets BSD trop bas niveau. •
RabbitMQ... NOPE. • ØMQ FTW. • L’ioloop est packagée dans PyZMQ.
AutoDiscovery UDP Multicast
Communication Unicast / Multicast ZeroMQ
Découverte des pertes Heartbeating (to do)
None
Retour d’expérience
L’asynchrone c’est difficile
Tester de l’asynchrone c’est douloureux
Quelques trucs • Isoler au maximum la partie asynchrone •
La tester avec des mocks • Mocker la partie asynchrone
Exemple class ZeroMQMediumTestCase(unittest.TestCase): def setUp(self): self.service = ServiceMock() self.ioloop =
IOLoop.instance() self.medium = ZeroMQMedium(self.service, ioloop=self.ioloop) def testRegister(self): self.medium.register() self.ioloop.start() self.assertEqual(self.service.on_registration_message.call_count, 1)
Exemple II class BaseServiceTestCase(unittest.TestCase): def setUp(self): self.medium = TestMedium() self.service
= BaseService(self.medium) def testOnRegistration(self): node_info = {'name': 'Service 1'} self.service.on_registration_message(node_info) self.assertEqual(self.medium.send_registration_answer.call_count, 1)
Les topologies réseaux est hétérogène
Vous allez toujours avoir des topologies de réseau tordues
Au choix • Firewall • NAT • VPN • DMZ
• Pas d’UDP Multicast
None
Traitez les quand ils arrivent
Pas de solutions magiques en P2P
Des techniques • Utiliser le port 443 ou 80 •
UDP Hole Punching • Encapsuler le traffic dans HTTP
Une solution ? • Avoir un pair central • Qui
forward le traffic
ZeroService is not perfect • Pas d’ack pour les messages
• Pas d’heartbeat • Une socket par message sortant • UDP Multicast / ZeroConf • Marche en LAN. Pas en WAN.
Exemple
Le service de chat class ChatService(BaseService): def __init__(self, username): self.username
= username super(ChatService, self).__init__(ZeroMQMedium(self, port_random=True)) def service_info(self): return {'name': self.username}
Le service de chat class ChatService(BaseService): def on_event(self, message_type, message):
"""Called when a multicast message is received """ msg = {'type': message_type} msg.update(message) self.send_to_all_clients(json.dumps(msg)) def on_message(self, message_type, **kwargs): """Called when an unicast message is received """ msg = {'type': message_type} msg.update(kwargs) self.send_to_all_clients(json.dumps(msg)) def on_new_node(self, node_info): """Called when a new peer joins """ msg = json.dumps({'type': 'user_join', 'id': node_info['node_id'], 'name': node_info['name']}) self.send_to_all_clients(msg) def on_node_close(self, node_info): """Called when a peer leaves """ msg = json.dumps({'type': 'user_leave', 'id': node_info['node_id'], 'name': node_info['name']}) self.send_to_all_clients(msg)
La partie Tornado class MainHandler(web.RequestHandler): def get(self): return self.render('chat.html', port=int(sys.argv[2]),
name=sys.argv[1])
La partie Tornado clients = [] class WebSocketHandler(websocket.WebSocketHandler): def open(self):
clients.append(self) for node_id, node in s.nodes_directory.items(): msg = json.dumps({'type': 'user_join', 'id': node_id, 'name': node['name']}) self.write_message(msg) def on_close(self): clients.remove(self) def on_message(self, message): message = json.loads(message) if message['type'] == 'message': msg = {'username': sys.argv[1], 'message': message['data']['message']} s.publish(str(message['type']), msg) elif message['type'] == 'direct_message': msg = {'from': sys.argv[1], 'message': message['data']['message']} s.send(message['data']['to'], msg, msg_type=str(message['type']))
Chat.py urls = [ (r"/", MainHandler), (r"/websocket", WebSocketHandler), (r"/static/(.*)", web.StaticFileHandler,
{"path": "."})] if __name__ == '__main__': application = web.Application(urls, debug=True) application.listen(int(sys.argv[2])) try: ioloop.IOLoop.instance().add_timeout(time() + 1, s.medium.register) ioloop.IOLoop.instance().start() except KeyboardInterrupt: s.close() for client in clients: client.close()
La demo chat • 69 lignes de python • Pas
de serveur central • API qui se veut simple
DEMO !
Questions ?