Distribute the Workload. PHP UK 2012, day 2

Many services / applications now a day are ill equipped with handling a sudden rush of popularity, as is often the case on the internet now a days, to a point where the services either become unavailable or unbearably slow.
By taking a chapter from the ant colonies in the wild, where their strength lies in their numbers and the fact that everyone works together towards the same goal, we can apply the same principle to our service by using systems such as
- load balancers
- message queues
- gearman
- daemons
and a few others, you can achieve greater performance, more redundancy, higher availability and have the ability to scale your services up and down as required easily.

During this talk attendees will be lead through the world of distributed systems and scalability, and shown the how, where and what, of how to take the average application and splitting it into smaller more manageable pieces.

Transcript

1. Distribute the workload Helgi Þormar Þorbjörnsson PHP UK, London, 25 th of Feb. 2012 Monday, 27 February 12
2. Co-founded Orchestra.io Work at EngineYard PEAR Developer From Iceland @h on Twitter Helgi Monday, 27 February 12
3. Why Distribute? Budget Efficiency Perception Monday, 27 February 12
4. Efficiency 10 small servers > 1 big Monday, 27 February 12
5. Budget Spend wisely Commodity servers Cloud Computing (EC2) Monday, 27 February 12
6. Perception Defer intensive processes Give instant feedback Users keep on browsing Monday, 27 February 12
7. Monday, 27 February 12
8. Architect for Distribution Monday, 27 February 12
9. Characteristics Decoupling Elastic High Availability Concurrency Monday, 27 February 12
10. Decoupling Monday, 27 February 12
11. Application DB API Cache FE Monday, 27 February 12
12. Application DB API Cache FE Cache API API Monday, 27 February 12
13. Elastic Monday, 27 February 12
14. Cloud Computing Monday, 27 February 12
15. Load Balance Monday, 27 February 12
16. HA Proxy Nginx My Favourite Monday, 27 February 12
17. Virtual IPs Monday, 27 February 12
18. Monitoring Monday, 27 February 12
19. When do I need more servers? Monday, 27 February 12
20. Needs to be around from the start! Monday, 27 February 12
21. Keep records Monday, 27 February 12
22. Spot trends Monday, 27 February 12
23. Different types Hardware Performance Software Performance Availability Resourcing Monday, 27 February 12
24. Applications New Relic CloudKick ScoutApp Nagios Cacti Circonus Monday, 27 February 12
25. Automation Monday, 27 February 12
26. Plug into your monitoring Monday, 27 February 12
27. Bringing together Monitoring and Elastic behaviour into one beautiful whole! Monday, 27 February 12
28. Add some intelligence to add / remove servers as needed based on current information. Monday, 27 February 12
29. Just make sure it doesn’t turn into... Monday, 27 February 12
30. Skynet!! Monday, 27 February 12
31. High Availability Monday, 27 February 12
32. Remember, even Google has outages Monday, 27 February 12
33. What to avoid Monday, 27 February 12
34. Local Sessions Monday, 27 February 12
35. Store sessions in DB / Memcache Solution Monday, 27 February 12
36. Local Memory Monday, 27 February 12
37. Networked Memcache Solution Monday, 27 February 12
38. Local Files Monday, 27 February 12
39. Local Uploads Monday, 27 February 12
40. Writing to /tmp Monday, 27 February 12
41. Store on S3 or a networked FS Solution Monday, 27 February 12
42. Serve up static files from CDNs Solution Monday, 27 February 12
43. Servers can vanish at any given time Monday, 27 February 12
44. Internal APIs Monday, 27 February 12
45. Application S3 GFS FS Internal Storage API Monday, 27 February 12
46. Application MySQL Mongo Cache Internal DB API Monday, 27 February 12
47. Gearman Monday, 27 February 12
48. Your Client Code Gearman Client API (C, PHP, Perl, MySQL UDF, ...) Gearman Job Server gearmand Gearman Worker API (C, PHP, Perl, Python, ...) Your Worker Code Your App Gearman Monday, 27 February 12
49. pear.php.net/ net_gearman Monday, 27 February 12
50. A Story! Monday, 27 February 12
51. Financial Software Monday, 27 February 12
52. 3000+ Clients Monday, 27 February 12
53. Each one has 5 external data sources Monday, 27 February 12
54. Each data source is a web service Monday, 27 February 12
55. Ran every 6 hours every day Monday, 27 February 12
56. Cron Gearman Job 1 1 2 3 4 5 Web Services 1 4 3 2 5 Processing Monday, 27 February 12
57. But! That wasn’t enough Monday, 27 February 12
58. Job kicked off on login Monday, 27 February 12
59. Supervisord Monday, 27 February 12
60. phpadvent.org/2009/daemonize- your-php-by-sean-coates Monday, 27 February 12
61. Queue Systems Monday, 27 February 12
62. Good for Image Processing Distributed Logs Data Mining Mass Emails Intensive transformation Search Monday, 27 February 12
63. Common Tools Gearman Hadoop ZeroMQ RabbitMQ And many others! Monday, 27 February 12
64. Questions? Joind.in: https://joind.in/4966 @h helgi@engineyard.com Monday, 27 February 12