Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Python Profiling 101

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Nazar Kanaev Nazar Kanaev
September 22, 2020
Programming
0
120

Python Profiling 101

Avatar for Nazar Kanaev

Nazar Kanaev

September 22, 2020
Tweet

More Decks by Nazar Kanaev

See All by Nazar Kanaev
Core Data
Avatar for Nazar Kanaev nkanaev
0
100

Other Decks in Programming

See All in Programming
MDN Web Docs に日本語翻訳でコントリビュート
Avatar for uutan1108 ohmori_yusuke
0
640
フロントエンド開発の勘所 -複数事業を経験して見えた判断軸の違い-
Avatar for Yoichiro Kubo heimusu
7
2.8k
Oxlintはいいぞ
Avatar for Yuji Yamaguchi yug1224
5
1.3k
Smart Handoff/Pickup ガイド - Claude Code セッション管理
Avatar for rasshii yukiigarashi
0
130
AtCoder Conference 2025
Avatar for shindannin shindannin
0
1k
Lambda のコードストレージ容量に気をつけましょう
Avatar for tatsuki-yamada tattwan718
0
110
開発者から情シスまで - 多様なユーザー層に届けるAPI提供戦略 / Postman API Night Okinawa 2026 Winter
Avatar for tasshi tasshi
0
200
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
170
0→1 フロントエンド開発 Tips🚀 #レバテックMeetup
Avatar for 弁護士ドットコム bengo4com
0
550
AI Agent の開発と運用を支える Durable Execution #AgentsInProd
Avatar for izumin5210 izumin5210
7
2.3k
AgentCoreとHuman in the Loop
Avatar for Har1101 har1101
5
230
AIと一緒にレガシーに向き合ってみた
Avatar for nyafunta9858 nyafunta9858
0
180

Featured

See All Featured
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
54
8k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
410
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
エンジニアに許された特別な時間の終わり
Avatar for watany watany
106
230k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
3.9k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
100
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
Avatar for Mine Cetinkaya-Rundel minecr
0
140
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
0
230
So, you think you're a good person
Avatar for Per Axbom axbom
PRO
2
1.9k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
9.9k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.2k
B2B Lead Gen: Tactics, Traps & Triumph
Avatar for Sophie Logan marketingsoph
0
53

Transcript

  1. Python Profiling 101

  2. None

  3. What is Profiling

  4. dynamic program analysis to measure usage / time / memory

    of function calls / instructions / etc.

  5. analyse the whole program / certain functions to find slowest

    / memory-consuming parts
  6. None

  7. How it works

  8. Python API PyEval_SetTrace / PyEval_SetProfile sys.settrace / threading.settrace

  9. OS-level API py-spy: process_vm_readv (linux) / vm_read (macos) / ReadProcessMemory

    (windows) fil: malloc/calloc/alloc/free (linux & macos)
  10. None

  11. Choosing the right tool

  12. deterministic vs. statistical/sampling pure-python vs. compiled call stack vs. line

    granularity time vs. memory

  13. built-in: profile/cProfile + pstats trace tracemalloc

  14. 3rd-party: vprof memory_profiler pprofile ...dozens of wrappers & custom solutions

  15. None

  16. Common advice

  17. pure-python profilers add more overhead than the compiled ones choose

    the latter if execution speed is more important

  18. deterministic profiling is accurate, but slower than sampling profiling for

    long-running tasks sampling profiling might be more preferred
  19. None

  20. The End