Boost The Performance with Codon

The Xtreme Python Conferenceでの登壇資料です
(https://xtremepython.dev/2023/)

Transcript

1. Boost The Performance with Codon Ikko Eltociear Ashimine GitHub: @eltociear X: @eltociear 2024/4/16 The XtremePython Online Conference
2. 1. Introduction 2. About Codon 3. Comparison with other 4. Practical examples and Demo 5. Roadmap 6. Conclusion and Closing Agenda
3. 1. Introduction
4. Ikko Ashimine / 一功 安次嶺 I-Tecnology Co., Ltd. Ikko Ashimine has 10 years of engineering experience, having been involved in the development of websites, mobile apps, and consumer games. Currently, as a board member at I-Tecnology Co., Ltd., he is engaged in both management and development. He has an interest in open source and has contributed to various projects. GitHub: @eltociear FaceBook: IkkoEltociearAshimine X: @eltociear YouTube: @eltociear
5. My business card
6. 1. Introduction - About Python ・Simple and Readable Syntax ・Diverse Libraries and Frameworks ・Versatility ・Strong Community and Support ・Wide Range of Applications
7. So…
8. But… Python is very slow😭
9. Therefore… Let's look at how to speed up the process😎
10. 2. About Codon
11. https://docs.exaloop.io/codon 2. About Codon
12. https://docs.exaloop.io/codon/general/faq 2. About Codon ・Compiles Python code to native machine code without any runtime overhead ・Speedups over vanilla Python are on the order of 10-100x or more ・Supports native multithreading ・Extensible via a plugin infrastructure ・Free of charge
13. 2. About Codon - Syntax If you know Python, you already know 99% of Codon.
14. 2. About Codon - Differences with Python ・Codon's int is a 64-bit signed integer, whereas Python's (after version 3) can be arbitrarily large. ・Codon currently uses ASCII strings unlike Python's unicode strings. ・Since Codon performs static type checking ahead of time, a few of Python's dynamic features are disallowed. ・For performance reasons, some numeric operations use C semantics rather than Python semantics. ・While most of the commonly used builtin modules have Codon-native implementations, a few are not yet implemented. However these can still be used within Codon via from python import. https://docs.exaloop.io/codon/general/differences
15. 3. Comparison with other
16. https://docs.exaloop.io/codon/general/faq 3. Comparison - Cpython Codon tries to follow CPython's syntax, semantics and APIs as closely as possible, aside from a few cases where Codon differs from CPython for performance reasons (one example being Codon's 64-bit int vs. CPython's arbitrary- width int). Performance-wise, speedups over CPython are usually on the order of 10-100x.
17. https://docs.exaloop.io/codon/general/faq 3. Comparison - Numba While Codon does offer a JIT decorator similar to Numba's, Codon is in general an ahead-of-time compiler that compiles end-to-end programs to native code. It also supports compilation of a much broader set of Python constructs and libraries.
18. https://docs.exaloop.io/codon/general/faq 3. Comparison - PyPy PyPy strives to effectively be a drop-in replacement for CPython, whereas Codon differs in a few places in order to eliminate any dynamic runtime or virtual machine, and thereby attain much better performance.
19. https://docs.exaloop.io/codon/general/faq 3. Comparison - Cython Like Cython, Codon has a Python-extension build mode that compiles to Python extension modules, allowing Codon-compiled code to be imported and called from plain Python.
20. 4. Practical examples and Demo
21. 4. Install Codon Terminal: /bin/bash -c "$(curl -fsSL https://exaloop.io/install.sh)" Google Colaboratory: !echo "y" | /bin/bash -c "$(curl -fsSL https://exaloop.io/install.sh)" build from source: ->https://docs.exaloop.io/codon/advanced/build
22. 4. Use Codon Terminal: # debug mode codon run {YOUR_PYTHON_FILE} # release mode codon run -release {YOUR_PYTHON_FILE} Google Colaboratory: !/root/.codon/bin/codon run prime_number.py
23. Short demonstration (Google Colab) Demo URL: https://colab.research.google.com/drive/1QFndkV9YUp-6VVEBR_bBrVLxt3lAz12s?usp=sharing
24. 5. Roadmap
25. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap Codon's goal is to be as close to CPython as possible while still being fully statically compilable. While Codon already supports much of Python, there is still much to be done to fully realize its potential. Here is a high-level roadmap of the things we want to add, implement or explore.
26. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 💻 Core features 💻Type system improvements: ・First-class types and compile-time metaclasses ・Full class member deduction ・Implicit union types to support mixed-type collections ・Variadic type arguments (e.g. Foo[Bar, ...]) 💻Parallelism ・async/await support ・multiprocessing support ・Automatic locking in parallel code (e.g. if mutating a data structure shared between threads) ・Race detection
27. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 💻 Core features 💻Compatibility with Python 3.10+: ・Argument separators (/ and *) ・Constructor object matching in the match statement ・Support accessing various object properties (__dict__, __slots__ etc.) as much as possible in a static context 💻Better error messages ・Warning support ・Explain performance considerations ・Explain that a CPython feature is not supported 💻Modules and incremental compilation ・Cache compilation modules ・Fast generics compilation in debug mode for quick turnarounds
28. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 💻 Core features 💻Memory management ・Auto-tune GC ・Optional alternative memory management modes like reference counting 💻Optional automatic switching between Codon and CPython (i.e. compile only compatible functions and leave the rest to Python) 💻GPU support ・Target Apple, AMD and Intel GPUs ・GPU-specific compiler optimizations (e.g. for using various Python constructs on the GPU) 💻Interoperability with other languages ・Direct C++ interoperability via Clang ・R interoperability
29. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 📚 Libraries Currently, missing Python functionality can be easily accessed via a from python import foo statement, which is sufficient in most cases as many libraries are just thin wrappers around a C library and/or not performance-sensitive.
30. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 📚 Libraries However, in the near future, we would like to support the following modules natively: 📚Python's standard library ・Complete builtins support ・1-to-1 compatibility with existing Python functions and modules ・File modules: os, sys, struct, pathlib and so on ・Pretty much everything else on an as-needed basis 📚Native NumPy, Pandas, etc.: Having Codon-native versions of the most popular 3rd-party libraries would allow them to work with Codon's other features like multithreading and GPU. We're currently prioritizing NumPy and Pandas but aim to later target other popular libraries as well. 📚Unicode support 📚Python's testing infrastructure
31. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 🛠 Infrastructure & Tools 🛠Windows support 🛠A sane package manager similar to Rust's Cargo 🛠Auto-detection of installed Python libraries 🛠Improved codon.jit library support ・Better error messages ・Better installation flow 🛠Fully static binary support like Go ・Remove libcodonrt (runtime library) dependency if needed ・Remove libcpp dependency
32. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 🛠 Infrastructure & Tools 🛠Improved Jupyter support ・Auto-completion and code inspection ・Jupyter magic command support 🛠Plugins for Visual Studio Code, Vim, Emacs and so on
33. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 📝 Documentation 📝Fully document major differences with CPython 📝Document Codon IR API, with guides and tutorials 📝Document all supported modules
34. https://docs.exaloop.io/codon/general/roadmap 5. Roadmap - 👍 Nice to have 👍Implement Codon in Codon
35. 6. Conclusion and Closing
36. ・Can be compiled with few changes to regular python ・Codon is and will continue to be free of charge ・Codon can run 10-100 times faster in JIT mode ・Codon can output executables from source ・Many more updates are planned for Codon 6. Conclusion
37. Thank you for your attention🐈 mail: <eltociear @ gmail . com>