Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Webscale hosting infrastructure with Puppet

2745c78242fec52bd69ff276ce5ebe17?s=47 Andri Steiner
July 19, 2015
160

Webscale hosting infrastructure with Puppet

T3DD15, 19.07.2015, Nuremberg

2745c78242fec52bd69ff276ce5ebe17?s=128

Andri Steiner

July 19, 2015
Tweet

Transcript

  1. PUPPET MODULES TO BUILD A WEBSCALE HOSTING INFRASTRUCTURE

  2. > 2015 OpenVZ VMs (manual management) VMs managed by Puppet

    vHosts trough PHP based control panel
  3. PROBLEMS single server only given configuration doing it the control

    panel way vs. doing it the right way costs, sometimes
  4. 2015 > get rid of the control panel VMs and

    vHosts managed by Puppet REST API to manage configuration, simple Angular frontend
  5. WORK ACCOMPLISHED development started in April 2014 ~1500 hours, 134

    PR merged, 1620 Commmits documentation (CC BY-SA): https://snowflakehosting.ch/ Open Source release coming
  6. SESSION technical a few more slides only Live Demo find

    more interested parties who are interested in using and enhancing this stack
  7. LIGHTNING TALK < > SESSION

  8. PUPPET MODULES TO BUILD A WEBSCALE HOSTING INFRASTRUCTURE

  9. TECH INSIGHTS Nutanix: "Invisible infrastructure for enterprise computing" (our own

    private cloud, modules will run an any server) Debian 8 Jessie (PHP 5.6, MariaDB 10) small footprint (nginx, MSMTP, collectd, ...) Performance: 6.2 Quickstart: 2-4x faster than before
  10. MODULE STRUCTURE service (=wrapper module) added to server (Website, Database,

    Caching, ...) service options (name, env, type, ...) website types: typo3cms, magento, uwsgi, .. env: DEV, STAGE, PROD database types: mysql, postgres caching types: memcached, varnish, ...
  11. EXAMPLE service: website, type: typo3cms

  12. HIERA Hiera is a key/value lookup tool for configuration data,

    built to make Puppet better and let you set node-specific data without repeating yourself.
  13. BY NOW YAML files in GIT w e b s

    i t e : : s i t e s : " s t v h o c h d o r f " : " s e r v e r _ n a m e " : " s t v h o c h d o r f . c h w w w . s t v h o c h d o r f . c h " " e n v " : " L I V E " " t y p e " : " t y p o 3 c m s "
  14. UNDER DEVELOPMENT REST API, Angular frontend microrest.php: Silex, Doctrine

  15. DEMO

  16. NEXT STEPS finish API & frontend publish stack under a

    open source license (contact me for preview versions) find more interested parties who are interested in using and enhancing this setup
  17. THANK YOU https://twitter.com/andristeiner https://speakerdeck.com/andristeiner FEEDBACK WELCOME ☺