Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Python Profiling 101

Avatar for Nazar Kanaev Nazar Kanaev
September 22, 2020
Programming
140
0

Python Profiling 101

Avatar for Nazar Kanaev

Nazar Kanaev

September 22, 2020

More Decks by Nazar Kanaev

See All by Nazar Kanaev
Core Data
Avatar for Nazar Kanaev nkanaev
0
110

Other Decks in Programming

See All in Programming
SalesForceを内製化！？ ~ HR事業を支える顧客管理基盤のインフラを大公開 ~
Avatar for Kobujee_53 oku053
0
180
Next.js: The final boss of Web Performance
Avatar for Estela Franco guaca
0
250
ジョジョの世界をXRで再現する
Avatar for mofurune mofurune
0
160
RAG の “R” を Swift で覗いてみる 〜「意味から探す」検索の仕組み〜
Avatar for Nao-RandD nao_randd
0
160
コードで差別化できない時代の ソフトウェアエンジニアリング / Software Engineering in an Era Where Code Doesn’t Differentiate
Avatar for Naoki Kishida kishida
2
180
月間100万人のサービス刷新で、 技術選定をHonoに振り切った話
Avatar for bara yutobara
8
6.6k
UnityでSystem.Net.WebSocketsなWebSocketサーバが動かないのでUnity Monoのコードを覗いてみた / about implementing websocket server with unity mono
Avatar for にー兄さん drumath2237
1
610
作って学ぶSpring BootのAuto Configuration / JJUG Night Seminar 2026-10-19
Avatar for Ryo Shindo rshindo
0
140
Domain-Driven Transformation
Avatar for Henning Schwentner hschwentner
2
2.3k
Web Framework Benchmark Battle 2026, Any%
Avatar for Akira Matsuda a_matsuda
2
2k
AIで開発が速くなった先で、開発チームは何を目指すか
Avatar for Yuki Shiho shihochan
0
880
TechTown - Creating Composable Callables in Contemporary C++
Avatar for Björn Fahller rollbear
0
130

Featured

See All Featured
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
1
570
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
53k
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
500
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
1
490
Building Adaptive Systems
Avatar for Chris Keathley keathley
44
3.2k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
410
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
699
190k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
3
1.3k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
331
25k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.7k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k

Transcript

  1. Python Profiling 101

  2. None

  3. What is Profiling

  4. dynamic program analysis to measure usage / time / memory

    of function calls / instructions / etc.

  5. analyse the whole program / certain functions to find slowest

    / memory-consuming parts
  6. None

  7. How it works

  8. Python API PyEval_SetTrace / PyEval_SetProfile sys.settrace / threading.settrace

  9. OS-level API py-spy: process_vm_readv (linux) / vm_read (macos) / ReadProcessMemory

    (windows) fil: malloc/calloc/alloc/free (linux & macos)
  10. None

  11. Choosing the right tool

  12. deterministic vs. statistical/sampling pure-python vs. compiled call stack vs. line

    granularity time vs. memory

  13. built-in: profile/cProfile + pstats trace tracemalloc

  14. 3rd-party: vprof memory_profiler pprofile ...dozens of wrappers & custom solutions

  15. None

  16. Common advice

  17. pure-python profilers add more overhead than the compiled ones choose

    the latter if execution speed is more important

  18. deterministic profiling is accurate, but slower than sampling profiling for

    long-running tasks sampling profiling might be more preferred
  19. None

  20. The End