Fabric for fun and profit

Transcript

1. Fabric for fun and profit @ jairtrejo Pycon APAC 2013

2. @jairtrejo Operations Director at Vinco Orbis

3. We script everything

4. We ssh in and out servers all the time

5. Fabric is a Python tool for streamlining the use of

   SSH for systems administration

6. @hosts(staging, production) @task def publish(): local('./build') project.rsync_project( remote_dir=DEST_PATH, local_dir=DEPLOY_PATH.rstrip('/') +

   '/', delete=True ) run(‘./bin/restart-apache’)

7. Quick fabric introduction

8. $ pip install fabric

9. Tasks

10. # fabfile.py from fabric.api import task, local @task def hello():

    local('echo "Hello, world"')

11. $ fab hello Hello, world

12. multi-host

13. # fabfile.py from fabric.api import run, task @task def host_type():

    run('uname -s')

14. $ fab -H localhost,jair@jairtrejo.mx host_type Darwin Linux

15. Environment dictionary

16. # fabfile.py from fabric.api import run, task, env @task def

    development(): env.hosts = [ 'fake.jairtrejo.mx', 'demo.jairtrejo.mx'] @task def production(): env.hosts = ['jairtrejo.mx'] @task def host_type(): run('uname -s')

17. $ fab production host_type

18. Case study: Gift cards

19. Huge files

20. Download link

21. Random URLs

22. Environment configuration

23. @task def production(): """ Production server """ env.user = 'pdfs'

    env.hosts = ['example.com'] # Pdf’s storage env.pdf_base_dir = \ '/var/www/vhosts/example.com/httpdocs/PDFS/'

24. It is just Python

25. @task def find_and_rename(listing, source, destination): pdfs = [] with open(listing,

    'rb') as csvfile: reader = csv.DictReader(csvfile) for row in reader: name = ‘%s.pdf’ % row[“Client number”] if os.path.exists(os.path.join(source, name)): pdfs.append(name) else: logging.warning("Not found: %s" % name) import logging logging.basicConfig( filename='example.log', level=logging.DEBUG, format="%(asctime)s %(levelname)s: %(message)s", )

26. We can mix Python with system calls

27. rows = [] for original in pdfs: fname, ext =

    os.path.splitext(original) hashed, salt = hash_name(fname) hashed += ext hfname = os.path.join(destination, hashed) local( 'cp "%s" "%s"' % (os.path.join(source, original), hfname) ) rows.append( {'original': original, 'salt': salt, 'archivo': hfname}) rows.sort(key=lambda row: row['original'])

28. Case study Vagrant development

29. SSH integration

30. @task def vagrant(): """ Local dev environment (local Vagrant machine)

    """ env.user = "vagrant" env.hosts = ["127.0.0.1:2222"] # Vagrant machine's ssh key result = local( "vagrant ssh-config | grep IdentityFile", capture=True) env.key_filename = result.split()[1] # Project directory env.site_dir = "~/src" Via sysadminpy.com

31. @task def syncdb(): require("site_dir") with cd(env.site_dir): run("python manage.py syncdb --noinput")

    run("python manage.py migrate myapp --noinput")

32. $ fab vagrant syncdb

33. $ fab vagrant -- sudo service couchdb restart

34. Task composition

35. @task def resetdb(): require("site_dir") run('mysql -u root -pf5dd8Xo -e "DROP

    DATABASE mydb;" mydb') run('mysql -u root -pf5dd8Xo -e "CREATE DATABASE mydb;"') syncdb()

36. $ fab vagrant resetdb

37. Silly stuff

38. if result.failed: print red("Some tests failed", bold=True) bomb = r"""

    ,--.!, __/ -*- ,d08b. '|` 0088MM `9MMP' """ print red(bomb) else: print green("All tests passed", bold=True) owl = r""" ,___, [O.o] /)__) -"--"- """ print green(owl)

39. Fabric alternatives

40. Ansible Server configuration

41. Invoke Build tool

42. Image credits (1)http://www.flickr.com/photos/worldbank/5320646943/ (2)http://blog.trendmicro.com/trendlabs-security-intelligence/mehika-twitter-botnet- targets-twitter-users/ (3)http://junofitness.blogspot.jp/2012/11/jennifer-and-julie.html (4)http://favim.com/image/361336/ (5)http://projectwhy.blogspot.jp/2013/04/a-wonderful-gift-may-not-be-wrapped-as.html (6)http://www.marysrosaries.com/collaboration/index.php?title=File:Forklift_(PSF).png (7)http://commons.wikimedia.org/wiki/File:US_Navy_070207-

    N-4973A-044_Sailors_aboard_guided_missile_destroyer_USS_O'Kane_(DDG_77)_unload_foo d_stores_and_refrigerated_items_during_a_connected_replenishment_with_Military_Sea lift_Command_(MSC)_combat_stores_ship_USNS_Conco.jpg (8)http://www.casinocenter.com/helping-luck-along/ (9)http://python.sg/ (10)http://bailtruth.com/2012/09/12/steampunk-gears-and-cogwheels-brooch-2/ (11)http://www.giglig.com/food/how-to-make-mojito (12)http://cnx.org/content/m42117/latest/?collection=col11325/latest (13)http://mother-care.net/leisure/hobby/fugu-fish-deadly-delight.html (14)http://www.tumblr.com/tagged/tinker-toys (15)http://www.deviantart.com/?view_mode=2&order=24&q=by%3Ajam-star (16)http://www.vivianpartnership.co.uk/choices-choices-choices/ (17)http://faculty.indwes.edu/bcupp/lookback/hist-08.htm (18)http://www.thebedroom.com.au/manchester/character-bedding/bob-the-builder.html

43. Thank you! http://vincoorbis.com http://jairtrejo.mx