Intro to FastAPI: Tips and Tricks for ML

Transcript

1. Intro to High performance, easy to learn, fast to code, ready for production Tips and Tricks for ML
2. Who am I? Sebastián Ramírez github.com/tiangolo linkedin.com/in/tiangolo twitter.com/tiangolo tiangolo.com Berlin, Germany I created:
3. • Python Web API framework • 50K+ GitHub stars (about 1K+ per month) • Used by Microsoft, Uber, Netflix, etc. • Performance in the top rank for Python • 3rd most used (Python Developers Survey) • Fastest growth (Python Developers Survey) • 3rd most loved (StackOverflow Developer Survey) @tiangolo
4. • OpenAPI • JSON Schema • OAuth2 🔄 Automatic data conversion ✨ ✅ Automatic data validation ✨ FastAPI is based on standards 📝 Automatic API docs ✨ • Standard type annotations @tiangolo
5. Based on standards - for free @tiangolo
6. Based on Python type hints • Autocompletion everywhere • Type checks and type errors @tiangolo
7. Types provide autocompletion @tiangolo
8. Easy and short @tiangolo
9. Less API code @tiangolo
10. Basic FastAPI app @tiangolo https://somedomain.com/items/5?q=some+query
11. Basic FastAPI app - docs @tiangolo https://somedomain.com/docs
12. Automatic docs @tiangolo
13. Basic FastAPI app with body @tiangolo
14. Basic FastAPI app with body - docs @tiangolo
15. Basic FastAPI app with body - docs @tiangolo
16. Basic FastAPI app with body @tiangolo
17. Basic FastAPI app with body and query @tiangolo
18. Basic FastAPI app with body and query - docs @tiangolo https://somedomain.com/food/?delivery=true
19. Basic FastAPI app with body and query @tiangolo
20. JSON array of objects in body @tiangolo
21. JSON array of objects in body - docs @tiangolo
22. JSON array of objects in body @tiangolo
23. JSON array of objects in body - invalid data @tiangolo
24. JSON array of objects in body - validation @tiangolo
25. Data validation @tiangolo
26. FastAPI auto-completion @tiangolo
27. Type checks @tiangolo
28. All based on standard Python types @tiangolo
29. FastAPI - Performance @tiangolo
30. FastAPI - Performance @tiangolo
31. FastAPI - Other features @tiangolo • Dependency Injection • Security - OAuth2 • WebSockets • Files • Background Tasks • Easy GraphQL integration • Templates • More...
32. Simple ML model and usage 🤖 @tiangolo
33. Load ML models - slow disk reads 🤖 @tiangolo ✨ Read from disk as few times as possible ✨
34. Load ML models - slow disk reads 🤖 @tiangolo
35. Simple ML model - only load 🤖 @tiangolo
36. ML model in FastAPI - simple - good ✅ @tiangolo
37. ML model in FastAPI - bad 🚨 @tiangolo
38. ML model in FastAPI - very bad 🚨 @tiangolo
39. ML model in FastAPI - very bad 🚨 @tiangolo
40. Load model and cache 😎 @tiangolo
41. FastAPI with cached model ⚡ @tiangolo
42. FastAPI with cached model ⚡ @tiangolo
43. FastAPI - preload cached model in healthcheck ⚡ @tiangolo
44. FastAPI - preload ⚡ @tiangolo
45. FastAPI - async and models - bad 🚨 @tiangolo
46. FastAPI - async and models - bad 🚨 @tiangolo
47. Blocking code in async blocks the event loop 😱 @tiangolo ✨ Don’t put blocking code directly in async functions ✨
48. FastAPI - non async and models - simple - good ✅ @tiangolo
49. FastAPI - non async and models - simple - good ✅ @tiangolo
50. FastAPI - async and models - good ✅ @tiangolo
51. FastAPI - async and models - good ✅ @tiangolo
52. FastAPI - model in dependency ✨ @tiangolo
53. FastAPI - model in dependency - testing ✅ @tiangolo
54. FastAPI - model in dependency - testing ✅ @tiangolo
55. FastAPI - squeeze performance 🚤 @tiangolo
56. FastAPI - squeeze performance 🚤 @tiangolo
58. Thank you! Sebastián Ramírez tiangolo.com fastapi.tiangolo.com github.com/tiangolo linkedin.com/in/tiangolo twitter.com/tiangolo