Kloud.pdf

Describes a highly customized private cloud from the ground up, Flipkart uses this cloud with thousands of machines to process tens of thousands orders a day

Transcript

1. Ops-ninjas@ kloud@ Kloud
2. Aim Provide a simple web service that allows you to obtain more capacity with minimal friction
3. Isolation Redundancy Super fast hardware allocation
4. Reduces the time required to obtain and boot new machines
5. Integrates seamlessly with the existing environment
7. for over a year Staging servers before Kloud 3
8. within one month Staging virtual servers after Kloud 150
9. time taken to allocate 60 servers 10 -15 days
10. time taken to allocate 60 servers 10 -15 mins
11. oldschool
12. gradschool
13. GUI DEMO
14. gradschool
15. gradschool
17. ldap puppet roles openvz containers automated dns
18. How?
19. How to kill?
20. Openvz Puppet Host Database daemontools Openvz-web-panel
21. Do the basics right
22. Standardize your hardware App class Database class
23. Standardize your hardware App class 32 Core 128G Ram Database class 24 Core 64 G Ram
24. source of truth Get a centralised host database
25. Must have details of all hosts that exist can store any type of info related to the host ability to tag hosts a simple remote API
28. data stored in key value pairs all hosts have an entry hosts can be tagged
29. tags can have propeties 3nd hosts based on tags source of truth
30. provide a simple API code around it
32. Kloud (fk-vz-maker) decides which physical machine to create a VM smart rules knows what machines are on which rack/switch e.g not more than two webservers on the same machine not more than one LB on the same switch
34. host comes up runs 3rst boot task: <ipkartify connects to puppet
35. puppet server runs a poll script on hostdb creates new nodes adds hosts to roles create roles
38. dns/nagios/munin/statsd/blah runs a poll script on hostdb does task based on the keys it's intrested in
42. Silverline Anyone can create three small hosts Can be used for anything User gets sudo No support from ops Anything happens: Destroy and Recreate
44. one more thing
45. HTTP API usage based on demand hosts based on puppet roles
46. credits Homescreen: AK/DK akdk.bandcamp.com Chainsaw girl: kooky love www.threadless.com/submission/190051/THE_RED open-vz-web-panel code.google.com/p/ovz-web-panel/
47. with lots of love from HostDB Abhishek Kona Anuj Mittal Krishnanarayanan V R Kloud Aadil Seshadri Burzin Engineer Kurian Cheeramelil Pankaj Kaushal
48. happy hacking