1-Up Your DevOps Workflow

At all points of the development cycle, there’s a story to take your application into running at Google scale easily with HashiCorp tools. You can easily use Vagrant to create reliable environments on Compute Engine, Packer to build up images that can then be used to spin up instances astonishingly rapidly, Terraform to manage the cluster so you can easily and quickly make changes.

One can easily see how Consul would fit into the example application, managing configuration between the different components of the application

We think it’s a pretty symbiotic relationship, and I highly recommend testing it out for yourself.

Transcript

1. @juliaferraioli ‹#› Julia Ferraioli Senior Fungi Advocate @juliaferraioli, google.com/+JuliaFerraioli 1-Up Your DevOps Workflow With Google Cloud Platform and Atlas
2. @juliaferraioli ‹#› Sneak peek 0 1 2 3 Demo Toolbox Cycle: Create, Build, Deploy Success! And Coping
3. @juliaferraioli ‹#› Demo? Demo. Demo!
4. @juliaferraioli ‹#›
5. @juliaferraioli ‹#› ‹#› Hyperspace
6. @juliaferraioli ‹#› ‹#› • Open source on GitHub Hyperspace
7. @juliaferraioli ‹#› ‹#› • Open source on GitHub • Written by @ken_pratt and @icco Hyperspace
8. @juliaferraioli ‹#› ‹#› • Open source on GitHub • Written by @ken_pratt and @icco • Javascript frontend, Go backend Hyperspace
9. @juliaferraioli ‹#› ‹#› • Open source on GitHub • Written by @ken_pratt and @icco • Javascript frontend, Go backend • Multiplayer game Hyperspace
10. @juliaferraioli ‹#› ‹#› • Open source on GitHub • Written by @ken_pratt and @icco • Javascript frontend, Go backend • Multiplayer game • Unlimited bounds Hyperspace
11. @juliaferraioli ‹#› ‹#› • Open source on GitHub • Written by @ken_pratt and @icco • Javascript frontend, Go backend • Multiplayer game • Unlimited bounds • Pretty fun Hyperspace
12. @juliaferraioli ‹#› What’s in my toolbox?
13. @juliaferraioli ‹#› Performance The Google Toolbox
14. @juliaferraioli ‹#› Performance The Google Toolbox
15. @juliaferraioli ‹#› Performance The Google & HashiCorp Toolbox
16. @juliaferraioli ‹#› Create
17. @juliaferraioli ‹#› Decisions, decisions...
18. @juliaferraioli ‹#› Decisions, decisions...
19. @juliaferraioli ‹#› Decisions, decisions...
20. @juliaferraioli ‹#› Decisions, decisions...
21. @juliaferraioli ‹#› A little Vagrant here, a little Vagrant there
22. @juliaferraioli ‹#› A little Vagrant here, a little Vagrant there
23. @juliaferraioli ‹#› The simplest of Vagrantfiles Vagrant.configure("2") do |config| config.vm.box = "ubuntu/trusty64" config.vm.network "forwarded_port", guest: 9393, host: 9393 config.vm.provision "shell", path: "bootstrap.sh" config.vm.provision "shell", path: "hyperspace-be.sh" config.vm.provision "shell", path: "hyperspace-fe.sh" end
24. @juliaferraioli ‹#› A little Vagrant here, a little Vagrant there
25. @juliaferraioli ‹#› A little Vagrant here, a little Vagrant there
26. @juliaferraioli ‹#› A little Vagrant here, a little Vagrant there
27. @juliaferraioli ‹#› Continuum of Computing
28. @juliaferraioli ‹#› Continuum of Computing Virtualized hardware Abstracted computing power
29. @juliaferraioli ‹#› Continuum of Computing Virtualized hardware Abstracted computing power Compute Engine Infrastructure 
 at Google speed
30. @juliaferraioli ‹#› Continuum of Computing Virtualized hardware Abstracted computing power Compute Engine Infrastructure 
 at Google speed App Engine Build your scalable app 
 faster
31. @juliaferraioli ‹#› Continuum of Computing Virtualized hardware Abstracted computing power Container Engine Manages your container cluster and actively schedules your containers Compute Engine Infrastructure 
 at Google speed App Engine Build your scalable app 
 faster
32. @juliaferraioli ‹#› Continuum of Computing Virtualized hardware Abstracted computing power Container Engine Manages your container cluster and actively schedules your containers Compute Engine Infrastructure 
 at Google speed App Engine Build your scalable app 
 faster
33. @juliaferraioli ‹#› [In a parallel universe…] $ vagrant plugin install vagrant-google
34. @juliaferraioli ‹#› [In a parallel universe…] Vagrant.configure("2") do |config| config.vm.box = "gce" config.vm.provider :google do |google, override| google.google_project_id = "<project id>" google.google_client_email = "<service account email>" google.google_json_key_location = "<account json file>" override.ssh.username = "<username>" override.ssh.private_key_path = "<path to key>/.ssh/google_compute_engine" google.machine_type = "n1-standard-1" google.image = "ubuntu-1404-trusty-v20150909a" google.zone = "us-central1-f" google.name = "hashiconf-gce-#{Time.now.to_i}" {...omitted script files for screen…} end end
35. @juliaferraioli ‹#› [In a parallel universe…] Vagrant.configure("2") do |config| config.vm.box = "gce" config.vm.provider :google do |google, override| google.google_project_id = "<project id>" google.google_client_email = "<service account email>" google.google_json_key_location = "<account json file>" override.ssh.username = "<username>" override.ssh.private_key_path = "<path to key>/.ssh/google_compute_engine" google.machine_type = "n1-standard-1" google.image = "ubuntu-1404-trusty-v20150909a" google.zone = "us-central1-f" google.name = "hashiconf-gce-#{Time.now.to_i}" {...omitted script files for screen…} end end
36. @juliaferraioli ‹#› [In a parallel universe…] Vagrant.configure("2") do |config| config.vm.box = "gce" config.vm.provider :google do |google, override| google.google_project_id = "<project id>" google.google_client_email = "<service account email>" google.google_json_key_location = "<account json file>" override.ssh.username = "<username>" override.ssh.private_key_path = "<path to key>/.ssh/google_compute_engine" google.machine_type = "n1-standard-1" google.image = "ubuntu-1404-trusty-v20150909a" google.zone = "us-central1-f" google.name = "hashiconf-gce-#{Time.now.to_i}" {...omitted script files for screen…} end end
37. @juliaferraioli ‹#› [In a parallel universe…] $ vagrant up --provider=google
38. @juliaferraioli ‹#›
39. @juliaferraioli ‹#› Build
40. @juliaferraioli ‹#› Creating a Compute Engine image with Packer hyperspace-[be/fe].json "builders": [ { "type": "googlecompute", "project_id": "{{user `project_id`}}", "account_file": "pkey.json", "zone": "us-central1-f", "source_image": "ubuntu-1404-trusty-v20150909a", "image_name": "hyperspace-[be/fe]-{{timestamp}}" } ], "provisioners": [... { "type": "shell", "script": "scripts/hyperspace-[be/fe].sh" }, ...]
41. @juliaferraioli ‹#› Creating a Compute Engine image with Packer hyperspace-[be/fe].json "builders": [ { "type": "googlecompute", "project_id": "{{user `project_id`}}", "account_file": "pkey.json", "zone": "us-central1-f", "source_image": "ubuntu-1404-trusty-v20150909a", "image_name": "hyperspace-[be/fe]-{{timestamp}}" } ], "provisioners": [... { "type": "shell", "script": "scripts/hyperspace-[be/fe].sh" }, ...]
42. @juliaferraioli ‹#› ‹#› hyperspace-[be/fe].sh
43. @juliaferraioli ‹#› ‹#› • Installs Go, NGINX • Clones & builds hyperspace • Adds hyperspace to NGINX config • Makes hyperspace start upon reboot • Restarts the NGINX server hyperspace-[be/fe].sh
44. @juliaferraioli ‹#› Creating a Compute Engine image with Packer hyperspace-[be/fe].json "post-processors": [ [ { "type": "atlas", "token": "{{user `atlas_token`}}", "artifact": "{{user `atlas_username`}}/hyperspace-[be/fe]", "artifact_type": "google.image", "metadata": { "created_at": "{{timestamp}}" } } ] ]
45. @juliaferraioli ‹#› Creating a Compute Engine image with Packer hyperspace-[be/fe].json "post-processors": [ [ { "type": "atlas", "token": "{{user `atlas_token`}}", "artifact": "{{user `atlas_username`}}/hyperspace-[be/fe]", "artifact_type": "google.image", "metadata": { "created_at": "{{timestamp}}" } } ] ]
46. @juliaferraioli ‹#› Building with Packer $ packer push -name <name>/hyperspace-fe hyperspace-fe.json $ packer push -name <name>/hyperspace-be hyperspace-be.json
47. @juliaferraioli ‹#› Deploy
48. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf provider "google" { account_file = "${file("pkey.json")}" project = "hashiconf-demo" region = "us-central1" } resource "atlas_artifact" "hyperspace-[be/fe]" { name = "${var.ATLAS_USERNAME}/hyperspace-[be/fe]" type = "google.image" }
49. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf provider "google" { account_file = "${file("pkey.json")}" project = "hashiconf-demo" region = "us-central1" } resource "atlas_artifact" "hyperspace-[be/fe]" { name = "${var.ATLAS_USERNAME}/hyperspace-[be/fe]" type = "google.image" }
50. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf provider "google" { account_file = "${file("pkey.json")}" project = "hashiconf-demo" region = "us-central1" } resource "atlas_artifact" "hyperspace-[be/fe]" { name = "${var.ATLAS_USERNAME}/hyperspace-[be/fe]" type = "google.image" }
51. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf provider "google" { account_file = "${file("pkey.json")}" project = "hashiconf-demo" region = "us-central1" } resource "atlas_artifact" "hyperspace-[be/fe]" { name = "${var.ATLAS_USERNAME}/hyperspace-[be/fe]" type = "google.image" }
52. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf resource "google_compute_instance" "hyperspace-be" { name = "hyperspace-be" machine_type = "n1-standard-1" zone = "us-central1-f" disk { image = "${atlas_artifact.hyperspace-be.id}" } ...
53. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf resource "google_compute_instance" "hyperspace-be" { name = "hyperspace-be" machine_type = "n1-standard-1" zone = "us-central1-f" disk { image = "${atlas_artifact.hyperspace-be.id}" } ...
54. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf resource "google_compute_instance" "hyperspace-be" { name = "hyperspace-be" machine_type = "n1-standard-1" zone = "us-central1-f" disk { image = "${atlas_artifact.hyperspace-be.id}" } ...
55. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf ... network_interface { network = "default" access_config { // Ephemeral IP } } count = 1 lifecycle = { create_before_destroy = true } }
56. @juliaferraioli ‹#› Deploy and configure with Terraform main.tf ... network_interface { network = "default" access_config { // Ephemeral IP } } count = 1 lifecycle = { create_before_destroy = true } }
57. @juliaferraioli ‹#› Deploy and configure with Terraform $ terraform apply
58. @juliaferraioli ‹#› Success! And Coping
59. @juliaferraioli ‹#› Using Terraform to adapt and update $ terraform apply
60. @juliaferraioli ‹#› HashiCorp + Google Cloud Platform = a great way to develop, deploy, & manage
61. @juliaferraioli ‹#› Resources 0 1 2 3 4 5 Google Cloud Platform: https://cloud.google.com/docs/ Code from the presentation: https://goo.gl/mqrw62 Consul & Google Cloud Platform: http://goo.gl/tC2KP1 Slides: https://speakerdeck.com/juliaferraioli/1-up-your-devops-workflow-1 Spaaaaaace: https://github.com/kenpratt/hyperspace Vagrant & GCE: https://github.com/mitchellh/vagrant-google
62. @juliaferraioli ‹#› https://cloud.google.com/free-trial/
63. @juliaferraioli ‹#› Creative Commons image by Feans