NU.nl performance and our journey in the Django realm

These are the slides of my talk at the Django meetup hosted by Byte

Transcript

1. besma.bmcharek@sanoma.com NU.nl performance and our journey in the Django realm Besma Mcharek-Boussif
2. besma.bmcharek@sanoma.com Whoami @B35m4
3. besma.bmcharek@sanoma.com Who are we? • The biggest Dutch news platform – +1B pageviews
4. besma.bmcharek@sanoma.com Our platforms • Web – Desktop and mobile • Mobile – tablets, phones and smart watches
5. besma.bmcharek@sanoma.com Development teams • Mobile team – Android – iOs • Web/ApI and CMS team
6. besma.bmcharek@sanoma.com Development process • DeVops mind set team • Tools – Development: Jira, Bamboo, Hipchat – Monitoring: GA, New Relic
7. besma.bmcharek@sanoma.com How do we work • Work within layers, depending on the requirements
8. besma.bmcharek@sanoma.com The nu.nl ecosystem
9. besma.bmcharek@sanoma.com Web/Api team focus
10. besma.bmcharek@sanoma.com Our output as Web/API team • Serving static pages • Serve Push Notification for big news • Serve the raw data
11. besma.bmcharek@sanoma.com Microservices • Projects that serve a single purpose • Together projects create a microsystem that fits within the Sanoma ecosystem
12. besma.bmcharek@sanoma.com Evolution the nu.nl stack • Time line – Past – Current – Future...
13. besma.bmcharek@sanoma.com Past ecosystem • The entire stack used to be written in php • Development and maintenance by external party
14. besma.bmcharek@sanoma.com Current ecosystem • Most of the stack in Django • Development and maintenance by our team
15. besma.bmcharek@sanoma.com Near future ecosystem • All of the stack in Django • Development and maintenance by our team
16. besma.bmcharek@sanoma.com Block structure • Business and editors decide on the layout • Editors supply the blocks with content • Layout is served to FE and mobile
17. besma.bmcharek@sanoma.com Challenges in the current setup Scale speed API errors
18. besma.bmcharek@sanoma.com How do we deal with these challenges in general? • Django security solutions • DRF as dataprovider • Caching • Rigorous testing
19. besma.bmcharek@sanoma.com Performance sprint
20. besma.bmcharek@sanoma.com How? Webservers • Software updated and servers rebooted • Updated nu.nl stack to python 2.7 • Updated nu.nl stack from Apache to nginx • Disabled django.views.static.serve • Used Serpy as serializer
21. API server performance Before
22. API server performance After
23. besma.bmcharek@sanoma.com Future challenges Personalization
24. besma.bmcharek@sanoma.com Sanoma account
25. besma.bmcharek@sanoma.com Personalized nu.nl
26. besma.bmcharek@sanoma.com Other performance challenges • Pages are no longer static • API: serving blocks instead of layouts to mobile applications
27. besma.bmcharek@sanoma.com Challenges ahead
28. besma.bmcharek@sanoma.com Questions