The hitchhiker’s guide to databases with Python (from web point of view)

The hitchhiker’s guide to databases with Python
(from web point of view)

Transcript

1. The hitchhiker’s guide to databases with Python (from web point of view) Volodymyr Hotsyk
2. Who am I • Sr Python developer in GetGoing, Inc • Previous: oDesk Inc, 42coffeecups, .. • In love with Python since 2007 • Organizer of PyCon Ukraine, KyivPy
3. Plan • Databases • NoSQL • SQL • ORM • SqlAlchemy • Django ORM
4. Databases • A database is an organized collection of data. • Database management systems (DBMSs) are specially designed software applications that interact with the user, other applications, and the database itself to capture and analyze data.
5. History • 1960s, navigational DBMS • 1970s, relational DBMS • Late 1970s, SQL DBMS • 1980s, on the desktop • 1980s, object-oriented • 2000s, NoSQL
6. NoSQL databases • BerkeleyDB • Redis • MongoDB
7. Berkeley DB • Designed for embedded systems • Records are (key, value) pairs. • Fast, reliable, transaction-protected record storage.
8. Berkeley DB • Only a few logical operations on records: • Insert a record in a table. • Delete a record from a table. • Find a record in a table by looking up its key. • Update a record that has already been found.
9. Python + BDB • bsddb (python 2.x) • bsddb3 (https:// pypi.python.org/pypi/bsddb3)
10. Python + BDB
11. Web + BDB
12. BDB deployment • Generate bdb file with data • Upload to all servers
13. Redis • Redis is an open source, BSD licensed, advanced key-value cache and store. • It is often referred to as a data structure server since keys can contain strings, hashes, lists, sets, sorted sets, bitmaps and hyperloglogs.
14. Python + Redis • https://pypi.python.org/pypi/redis/ • https://pypi.python.org/pypi/asyncio_redis (python 3.4)
15. Hot-Redis • https://pypi.python.org/pypi/hot-redis/ • Wrapper to redis-py library • Provides a wide range of data types that mimic many of the built-in data types provided by Python
16. Hot-Redis
17. Hot-Redis
18. Using for Web apps • Lightweight async workers • Fast, not reliable storage • Messaging (pubsub, queues) • Realtime data processing (logs) • Autocomplete • Cache, sessions
19. MongoDB • MongoDB is an open-source database built for scalability, performance and high availability, scaling from single server deployments to large, complex multi-site architectures.
20. Python + MongoDB • https://pypi.python.org/pypi/pymongo/ • https://pypi.python.org/pypi/asyncio_mongo/ (python 3.4)
21. Using in web • Main data storage • Big data storage and processing • Backend for mobile apps • Zero-downtime environments
22. SQL Databases • SQLite • MySQL • PostgreSQL
23. SQLite • SQLite is a software library that implements a self-contained, serverless, zero- configuration, transactional SQL database engine. • SQLite is the most widely deployed SQL database engine in the world.
24. Python + SQLite
25. Using in web • Dev environment • Read-only sites
26. MySQL • One of the most widely used open-source relational database management system • A broad subset of ANSI SQL 99 • Stored procedures • Triggers • Views
27. Python + MySQL • http://sourceforge.net/projects/mysql-python/ • https://github.com/clelland/MySQL-for-Python-3 • https://github.com/PyMySQL/PyMySQL
28. PostgreSQL • Object-relational database management system (ORDBMS) with an emphasis on extensibility and standards-compliance • Implements the majority of the SQL:2011 • Replication • Indexes • Foreign data wrappers
29. PostgreSQL • Procedural languages • Triggers • Asynchronous notifications • Views • Native JSON support • etc
30. PostgreSQL Areas where PostgreSQL is better than MongoDB: ☑ Being a database ☑ Being a JSON database
31. Python + PostgreSQL • https://pypi.python.org/pypi/psycopg2/ • https://github.com/aio-libs/aiopg (python 3.4)
32. Object-relational mapping • Converting data between incompatible type systems in object-oriented programming languages
33. SQLAlchemy • Open source SQL toolkit and object- relational mapper (ORM) for the Python programming language released under the MIT License.
34. SQLAlchemy
35. SQLAlchemy
36. SQLAlchemy
37. Use • Flask • Pyramid • Web2Py • Bottle • Django • other web apps
38. Django ORM • Django attempts to support as many features as possible on all database backends. • Port of code between different databases (???)
39. Django ORM
40. Use • Django apps
41. Questions?
42. Contacts hotsyk@hotsyk.com twitter: @hotsyk http://hotsyk.com