Scaling Python

Scaling Python

A talk I gave in November, 2015 at Pycon CA in Toronto, Canada

4ba4faf2fc5818d37c0aed6acb5b69a2?s=128

J Kenneth King

November 07, 2015
Tweet

Transcript

  1. SCALING PYTHON James King @agentultra

  2. • CPython • Openstack • Firefox • WebGL • Many,

    many more…
  3. None
  4. –Johnny Know-It-All “Dynamic languages do not scale to programming-in-the- large”

  5. –Super Enterprise Hacker “Scripting languages are great for toys, one-off

    jobs, and prototypes but do not scale for serious projects”
  6. –Armchair Academic “You cannot possibly ship software without a formal

    verification of correctness”
  7. POPPYCOCK! • 4+ million LOC • Python (2.7 for the

    most part, sigh) • 2,351 contributors to the Liberty release • 28,647 accepted contributions • HP, Redhat, Mirantis contributed over 13k commits to Liberty as the top 3 out of 165 companies Source: http://stackalytics.com http://activity.openstack.org/dash/browser/?release=liberty
  8. POPPYCOCK! • RackSpace • HP • DreamCompute • Internap •

    … and many more
  9. DREAMCOMPUTE • 2721.31 VMs running on average • 1.38 VCPU

    per VM on average • 1.65 GB of RAM per VM on average • 3755 VCPUs active • 4501 GB of RAM active
  10. IT WORKS PRETTY WELL

  11. IT WORKS PRETTY WELL … and it’s all powered by

    a wimpy toy-language with no static types or SAT-solving compilers…
  12. None
  13. BLUEPRINTS https://blueprints.launchpad.net/nova

  14. DEVSTACK http://docs.openstack.org/developer/devstack/

  15. CODE REVIEW https://review.openstack.org

  16. CODE REVIEW https://review.openstack.org

  17. CONTINUOUS INTEGRATION

  18. None
  19. THANK YOU