High load projects on Symfony

Transcript

1. High load projects on Symfony Maksym Moskvychev maksym.moskvychev@gmail.com

2. About speaker

3. Agenda Network design Framework abilities to increase performance Architecture principles

   & examples Cache abilities Tips to save memory

4. Network design

5. Network design of typical PHP application PHP node Session storage

   Database cluster MySQL node MySQL node MySQL node Load balancer PHP node Reverse proxy PHP node PHP node Internet Media storage

6. Master / slave database connection in Symfony Master node Slave

   node Slave node Slave node Load balancer Read/write connection Read connection Default entity manager Read entity manager

7. Session storage allows to share sessions between PHP nodes

8. Media storage allows to sha e use s’ files between

   PHP nodes

9. Reverse proxy is.. • Application firewall • Cache system •

   Load distributer • SSL encryption system

10. AppCache in Symfony • Can be turned on in app.php

    file • Lightweight alternative of Varnish • Useful for development only

11. Framework abilities to increase performance

12. Use ACP cache whenever it possible • Enable APC cache

    in PHP settings. • Cache class autoloader with APC. • Turn on Doctrine query cache with ACP

13. Architecture principles & examples

14. Storing logic in SQL queries Logic in PHP classes Logic

    in SQL queries + easy to implement + easy to maintain + complex logic could be split into classes + could be covered with unit test + fast for batch operations VS

15. Admin area Storing logic in SQL queries Product publication logic

    (method in repository) ->joinLeft(… Front end Rest API Query in SonataAdminBundle Query for frontend Rest controller

16. Pre-loading data in Doctrine • By default Doctrine loads data

    from related entities at the moment getter is used. • There is a possi ility to do load all relatio s data in one query. $query->joinLeft(‘product.category’);

17. Personalization & full page cache Full page cache adds some

    limitations, because most requests never reach real server - There is no user sessions There is JavaScript There are headers, cookies There are IFrames There are ESI tags

18. Personalization & full page cache Some page JavaScript Google analytics

    & another tracking systems Recently seen pages. Data stored in Cookies User menu in IFrame. Cached by private cache Page itself. Cached by public cache

19. Cache abilities

20. Caching in web application Http cache • Full page cache

    • Gateway cache • PHP accelerator • Reverse proxy Query result cache • APC • File system • Memory Other methods

21. Http cache Unified standard for caching, defined in HTTP protocol

    Cache communicates with application via HTTP headers and status codes Expiration and validation caching models Fully supported by Symfony HTTP Foundation component

22. Expiration model in HTTP cache Reverse proxy PHP node Internet

    Hey, this response would be OK for next 2 hours . Re uest to /contacts page Reverse proxy Internet 2. Re uest to /contacts page within hou s

23. Validation model in HTTP cache Reverse proxy PHP node Internet

    Hey, this response has ETag d54sd65yf6cytfrtfg7w4fgy . Re uest to /a ticle page MySQL node Reverse proxy PHP node Internet Gi e e /arti le1 FYI: I know response for ETag d54sd65yf6cytfrtfg7w4fgy 2. Re uest to /a ticle page MySQL node Yes, this is exactly d54sd65yf6cytfrtfg7w4fgy • Fetch only hash of article • Fetch all data for article • Fetch only hash of article

24. Caching query results in Symfony 1. Choose one of existing

    caching providers: APC, memory (arrays), file system, etc.. 2. “et result query cache provider duri g uildi g a query 3. Choose and set cache lifetime during building a query.

25. Tips to save memory

26. Turn off SQL logger. In debug mode it stores in

    memory information about all executed queries. 1

27. Clear entity manager from time to time $entityManager->clear() 2

28. Flush garbage collector inside of long loops gc_collect_cycles() 3

29. Use pagination to fetch huge amount of data Use few

    queries with limit/offset instead of one query for all data. 4

30. Typical scheme of console command in Symfony Turn off SQL

    logger Fetch batch of data Apply some logic to each data row Clear entity manager Flush garbage collector

31. Q & A Maksym Moskvychev maksym.moskvychev@gmail.com