Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CuDF – Maybe faster Pandas on the GPU via RAPIDS (NVIDIA)

ianozsvald
February 06, 2024

CuDF – Maybe faster Pandas on the GPU via RAPIDS (NVIDIA)

PyDataLondon 2024-02 lightning talk on CuDF for faster Pandas (if you have a big enough GPU). There will be a write-up -> https://notanumber.email/

ianozsvald

February 06, 2024
Tweet

More Decks by ianozsvald

Other Decks in Science

Transcript

  1. CuDF – Maybe faster Pandas on
    the GPU via RAPIDS (NVIDIA)
    PyDataLondon 2024-02 lightning talk
    @IanOzsvald – ianozsvald.com

    View full-size slide

  2. NVIDIA tech built on CUDA
    – “100% Pandas compatible” GPU accelerat.
    Run your dataframes in VRAM
    Linux/Windows (WSL) only
    Will add to 3rd edition of our book + course->
    CuDF Pandas GPU Accelerator
    By [ian]@ianozsvald[.com] Ian Ozsvald

    View full-size slide

  3. Benchmark-winning?
    By [ian]@ianozsvald[.com] Ian Ozsvald
    Very hardware dependent – h2oai site has much weaker GPU and smaller machine

    View full-size slide

  4. Benchmark-winning?
    By [ian]@ianozsvald[.com] Ian Ozsvald

    View full-size slide

  5. RTX 3050 Ti (Laptop) 4GB VRAM vs 16 core i7 64GB
    Demo 10M rows 3 cols of ints <1GB df
    By [ian]@ianozsvald[.com] Ian Ozsvald
    On RTX 3090 (24GB VRAM) I get a 30x speed-up with 400M rows (9.6GB df)

    View full-size slide

  6. “Potential” for 10x-100x faster in production
    You need >>2X VRAM than your df ->
    Fiddly to setup, dev experience tricky
    – suspend, drvr updates, Pandas 2 2024?
    Let’s discuss in the break
    Summary
    By [ian]@ianozsvald[.com] Ian Ozsvald

    View full-size slide

  7. Let’s discuss in the break – what are you
    building?
    Summary
    By [ian]@ianozsvald[.com] Ian Ozsvald
    Pandas 1.5

    View full-size slide

  8. /home/ian/workspace/teaching/fast_pandas/scratch/pandas_cudf_202312
    sudo modprobe -r nvidia_uvm; sudo modprobe nvidia_uvm # maybe solves
    cudeaErrorUnknown after a suspend
    Appendix
    By [ian]@ianozsvald[.com] Ian Ozsvald

    View full-size slide