Boosting Python With Rust 🚀

RIIR makes much sense in the Python world. This session explores the development and distribution of Python apps written in Rust.

This point in time has seen the development of great toolings and major libraries switching to Rust runtimes. This provides concrete validation for adopting this approach.

The session also includes a case study of projects written in Rust as well as past approaches to the topic.

Transcript

1. Boosting
   Python
   with Rust (TM)
   

   View Slide

2. View Slide

3. View Slide

4. Python Mauritius Usergroup
   site
   fb
   linkedin
   mailing list
   4
   

   View Slide

5. url
   pymug.com site
   5
   

   View Slide

6. About me
   compileralchemy.com
   6
   

   View Slide

7. slides
   7
   

   View Slide

8. Boosting
   Python
   with Rust (TM)
   8
   

   View Slide

9. My relationship with Rust
   9
   

   View Slide

10. Read the Rust book twice
    Read the Google rust training guide
    Know only about releasing scope and returning ownership
    Still don't know 3/4 of rust
    10
    

    View Slide

11. View Slide

12. Python / Rust friendliness
    12
    

    View Slide

13. convention_of_methods
    readability
    emulates english
    13
    

    View Slide

14. uses toml as default - toml invented by pypa core dev
    14
    

    View Slide

15. build tool in py
    15
    

    View Slide

16. iterators
    >>> x = itertools.cycle([1,2,3])
    >>> next(x)
    1
    >>> next(x)
    2
    >>> next(x)
    3
    >>> dir([1])
    [..., '__iter__', ...]
    16
    

    View Slide

17. let nums = vec![1, 2, 3];
    for num in nums.iter() {
    println!("{}", num);
    }
    loop {
    match range.next() {
    Some(x) => {
    println!("{}", x);
    },
    None => { break }
    }
    }
    17
    

    View Slide

18. consumers
    py: yield
    rust: ex .collect
    18
    

    View Slide

19. string types
    b' '
    b' '
    19
    

    View Slide

20. for in loop
    20
    

    View Slide

21. for i, item in enumerate(bytes):
    if item == b' ':
    return i
    for (i, &item) in bytes.iter().enumerate() {
    if item == b' ' {
    return i;
    }
    }
    21
    

    View Slide

22. Methods
    len(nums)
    nums.len()
    22
    

    View Slide

23. -> return type
    def x() -> None: ...
    fn area(&self) -> u32 {
    self.width * self.height
    }
    23
    

    View Slide

24. Pattern matching
    24
    

    View Slide

25. def where_is(point):
    match point:
    case Point(x=0, y=0):
    print("Origin")
    case Point():
    print("Somewhere else")
    case _:
    print("Not a point")
    fn value_in_cents(coin: Coin) -> u8 {
    match coin {
    Coin::Penny => {
    println!("Lucky penny!");
    1
    }
    Coin::Nickel => 5,
    Coin::Dime => 10,
    Coin::Quarter => 25,
    }
    }
    25
    

    View Slide

26. generics
    26
    

    View Slide

27. from typing import Dict, Generic, TypeVar
    T = TypeVar("T")
    class Registry(Generic[T]):
    def __init__(self) -> None:
    self._store: Dict[str, T] = {}
    fn largest(list: &[T]) -> &T
    27
    

    View Slide

28. assert
    assert x == 1
    assert!(larger.can_hold(&smaller));
    28
    

    View Slide

29. Why Rust?
    29
    

    View Slide

30. performance
    30
    

    View Slide

31. threading (no GIL)
    31
    

    View Slide

32. use rust crates
    32
    

    View Slide

33. recursion
    33
    

    View Slide

34. Py-Rust projects
    34
    

    View Slide

35. Rustimport
    35
    

    View Slide

36. ./
    termprint.rs
    // rustimport:pyo3
    use pyo3::prelude::*;
    #[pyfunction]
    pub fn boxaround(s: &str){
    println!("{}", "-".repeat(s.chars().count()+4));
    println!("| {} |", s);
    println!("{}", "-".repeat(s.chars().count()+4));
    }
    36
    

    View Slide

37. $ python
    >>> import rustimport.import_hook
    >>> import termprint # This will pause for a moment to compile the module
    >>> termprint.boxaround('abc')
    -------
    | abc |
    -------
    37
    

    View Slide

38. Protypting
    38
    

    View Slide

39. $ python3 -m rustimport new my_single_file_extension.rs
    $ python3 -m rustimport new my_crate
    import my_crate
    39
    

    View Slide

40. https://github.com/mityax/rustimport#usage-in-production
    40
    

    View Slide

41. setuptools-rust
    41
    

    View Slide

42. Poor docs
    most people no longer use it
    fit for binaries as well as modules
    see demo
    42
    

    View Slide

43. Maturin
    43
    

    View Slide

44. .
    └── guessing-game
    ├── Cargo.lock
    ├── Cargo.toml
    ├── pyproject.toml
    └── src
    └── lib.rs
    44
    

    View Slide

45. $ maturing develop
    $ maturin build
    $ maturin publish
    45
    

    View Slide

46. https://github.com/indygreg/PyOxidizer
    Packaging python with Rust
    micro contrib
    46
    

    View Slide

47. https://github.com/RustPython/RustPython
    Py interp in rust
    47
    

    View Slide

48. https://github.com/PyO3/pyo3
    Rust bindings for python
    48
    

    View Slide

49. https://pyo3.rs/v0.19.1/python_from_rust.html
    Python::with_gil(|py| {
    let fun: Py = PyModule::from_code(
    py,
    "def example(*args, **kwargs):
    if args != ():
    print('called with args', args)
    if kwargs != {}:
    print('called with kwargs', kwargs)
    if args == () and kwargs == {}:
    print('called with no arguments')",
    "",
    "",
    )?
    .getattr("example")?
    .into();
    ...
    })
    49
    

    View Slide

50. use pyo3::prelude::*;
    Python::with_gil(|py| {
    let result = py
    .eval("[i * 10 for i in range(5)]", None, None)
    .map_err(|e| {
    e.print_and_set_sys_last_vars(py);
    })?;
    let res: Vec = result.extract().unwrap();
    assert_eq!(res, vec![0, 10, 20, 30, 40]);
    Ok(())
    })
    50
    

    View Slide

51. Common Gotchas
    51
    

    View Slide

52. slow
    dev mode, release
    wrong usage of rust
    52
    

    View Slide

53. integer overflow
    53
    

    View Slide

54. Python projects using Rust
    54
    

    View Slide

55. Pydantic
    Rewrote v2 in Rust
    55
    

    View Slide

56. View Slide

57. Polars
    The fast Pandas alternative
    57
    

    View Slide

58. Ruff
    The fastest py linter
    58
    

    View Slide

59. Robyn
    async web server in Rust
    59
    

    View Slide

60. compileralchemy.com
    arj.python+urgent@gmail.com
    @osdotsystem
    github.com/abdur-rahmaanj
    Thank you
    60
    

    View Slide