Linux & Python

Transcript

1. © 2022 Bloomberg Finance L.P. All rights reserved. Finding Penguins with a Snake PyCon US 2022 April 29, 2022 Mario Corchero Senior Software Engineer & Team Lead, Python Infrastructure
2. © 2022 Bloomberg Finance L.P. All rights reserved. Talk to me! Open source
3. © 2022 Bloomberg Finance L.P. All rights reserved. Outline • Linux & Python • Processes • Signals • Files • IPC • Q&A
4. © 2022 Bloomberg Finance L.P. All rights reserved. Linux & Python What distributions does CPython build against?  https://buildbot.python.org/all/#/builders  https://peps.python.org/pep-0011/ CPython release managers only release a pre-built interpreter for macOS and Windows.
5. © 2022 Bloomberg Finance L.P. All rights reserved. Linux & Python How are Linux APIs exposed?
6. © 2022 Bloomberg Finance L.P. All rights reserved. Processes
7. © 2022 Bloomberg Finance L.P. All rights reserved. Processes – fork
8. © 2022 Bloomberg Finance L.P. All rights reserved. Processes – exec
9. © 2022 Bloomberg Finance L.P. All rights reserved. Processes – atfork handler
10. © 2022 Bloomberg Finance L.P. All rights reserved. Processes – subprocess
11. © 2022 Bloomberg Finance L.P. All rights reserved. Processes – subprocess
12. © 2022 Bloomberg Finance L.P. All rights reserved. Files “everything is a file descriptor or a process”
13. © 2022 Bloomberg Finance L.P. All rights reserved. Files File metadata
14. © 2022 Bloomberg Finance L.P. All rights reserved. locale
15. © 2022 Bloomberg Finance L.P. All rights reserved. time
16. © 2022 Bloomberg Finance L.P. All rights reserved. time
17. © 2022 Bloomberg Finance L.P. All rights reserved. Signals What are signals and how do they work in Unix?
18. © 2022 Bloomberg Finance L.P. All rights reserved. Signals What are signals and how they are handled in Python?
19. © 2022 Bloomberg Finance L.P. All rights reserved. Named pipes
20. © 2022 Bloomberg Finance L.P. All rights reserved. Unix domain sockets
21. © 2022 Bloomberg Finance L.P. All rights reserved. Unix domain sockets
23. © 2022 Bloomberg Finance L.P. All rights reserved. • New open source memory profiler for Python applications. • Traces every function call so it can accurately represent the call stack, unlike sampling profilers. • Handles native calls in C/C++ libraries so the entire call stack is present in the results. • Blazing fast! Profiling causes minimal slowdown in your applications. • Generates various reports about collected memory usage data, like flame graphs. • Works with Python threads and C++ threads in extensions. www.github.com/bloomberg/memray
24. © 2022 Bloomberg Finance L.P. All rights reserved.
25. © 2022 Bloomberg Finance L.P. All rights reserved. Thank you! We are hiring: bloomberg.com/engineering Learn more: TechAtBloomberg.com/python