summon_process - orchestrating processes

Presentation on Python library for orchestrating processes.
Fork it at: https://github.com/mlen/summon

Transcript

1. summon_process orchestrating processes Mateusz Lenik mlen@mlen.pl
2. desclaimer: this is a shameless ripoff of Ruby library called bbq-spawn
3. tests and processes
4. tests and processes •acceptance tests relying on other processes
5. tests and processes •acceptance tests relying on other processes •integration tests of multiple components in separate processes
6. problems
7. problems •the processes need to be started
8. problems •the processes need to be started •sometimes they rely on each other
9. problems •the processes need to be started •sometimes they rely on each other •they may need some time to boot
10. solutions
11. solutions •add time.sleep and pretend it works
12. solutions •add time.sleep and pretend it works •use some orchestration to do it for you
13. orchestrate |ˈɔːkɪstreɪt| verb [ with obj. ] 2 plan or coordinate the elements of (a situation) to produce a desired effect, especially surreptitiously: the situation has been orchestrated by a tiny minority.
14. summon_process
15. summon_process •my first Python library
16. summon_process •my first Python library •layer of orchestration for processes
17. summon_process •my first Python library •layer of orchestration for processes •simple interface
18. summon_process •my first Python library •layer of orchestration for processes •simple interface •provides executors and orchestrators
19. Interface
20. Interface •every executor takes the arguments via constructor
21. Interface •every executor takes the arguments via constructor •every execotor has start method
22. Interface •every executor takes the arguments via constructor •every execotor has start method •every executor has stop method
23. Interface •every executor takes the arguments via constructor •every execotor has start method •every executor has stop method •start method waits for the process to be ready
24. Interface •every executor takes the arguments via constructor •every execotor has start method •every executor has stop method •start method waits for the process to be ready •same goes for orchestrators
25. Executors
26. Executors •creates a process
27. Executors •creates a process •blocks until the process is ready
28. Executors •creates a process •blocks until the process is ready •multiple flavours
29. Executors •creates a process •blocks until the process is ready •multiple flavours •SimpleExecutor
30. Executors •creates a process •blocks until the process is ready •multiple flavours •SimpleExecutor •OutputCoordinatedExecutor
31. Executors •creates a process •blocks until the process is ready •multiple flavours •SimpleExecutor •OutputCoordinatedExecutor •TCPCoordinatedExecutor
32. Executors •creates a process •blocks until the process is ready •multiple flavours •SimpleExecutor •OutputCoordinatedExecutor •TCPCoordinatedExecutor •HTTPCoordinatedExecutor
33. Orchestrators
34. Orchestrators •orchestrate executors
35. Orchestrators •orchestrate executors •use the same interface as executors
36. Orchestrators •orchestrate executors •use the same interface as executors •orchestrated contextmanager as a bonus
37. examples
38. def test_something(self): executor = TCPCoordinatedExecutor( 'command_to_start', host='localhost', post=1234) with orchestrated(executor): # do something
39. def test_something_else(self): srv = TCPCoordinatedExecutor( 'command', host='...', port=...) cli = OutputCoordinatedExecutor( 'command', banner='...') with orchestrated(srv, cli): # do something
40. demo
41. How to add an executor
42. How to add an executor •create a class (optionally inherit from executor)
43. How to add an executor •create a class (optionally inherit from executor) •accept parameters via constructor
44. How to add an executor •create a class (optionally inherit from executor) •accept parameters via constructor •define start method that blocks
45. How to add an executor •create a class (optionally inherit from executor) •accept parameters via constructor •define start method that blocks •define stop method
46. How to add an executor •create a class (optionally inherit from executor) •accept parameters via constructor •define start method that blocks •define stop method •that's all
47. pip install summon_process try it
48. pip install summon_process try it please contribute if you like it github.com/mlen/summon
49. KTHXBYE Mateusz Lenik mlen@mlen.pl