TerraformExtensibleProviderArchitecture.pdf

Transcript

1. Copyright © 2017 HashiCorp Terraform and the Extensible Provider Architecture
2. Clint (@catsby) Provider Team Lead, Terraform
3. Copyright © 2017 HashiCorp 1.Terraform 2.Provider Architecture 3.v0.10.0 4.Demo(s) Parts !3
4. s Copyright © 2017 HashiCorp Terraform !4 Part 1
5. Copyright © 2017 HashiCorp Terraform ▪ Provision, secure, connect, and run any infrastructure for any application !5 HashiCorp’s Mission
6. Copyright © 2017 HashiCorp Terraform ▪ Write, Plan, and Create Infrastructure as Code ▪ Provision on any infrastructure / service / cloud !6 Goals Amazon GitHub DigitalOcean Fastly Microsoft Azure Packet Heroku DNSimple Librato Google Cloud Docker VMWare Sphere Many more…
7. Copyright © 2017 HashiCorp Terraform ▪ Unified view of infrastructure ▪ Easily compose multiple tiers/services (IaaS to PaaS to SaaS) ▪ Safely change/iterate infrastructure over time ▪ Manage anything with an API ▪ One workflow, many clouds !7 Write, Plan, and Create Infrastructure as Code
8. Copyright © 2017 HashiCorp Terraform ▪ Open Source! ▪ HCL: human readable, machine editable JSON ▪ Dependency graph ▪ terraform plan shows you changes ▪ terraform apply executes those changes in order ▪ Collaboration, history, audit trail [Enterprise] !8 Key Features
9. Copyright © 2017 HashiCorp Terraform !9 Growth!
10. Copyright © 2017 HashiCorp Terraform ▪ Single binary written in Go, support for *nix, Windows ▪ Provider/Provisioner Plugins over RPC ▪ Split into Terraform Core and Terraform Providers (as of v0.10.0) ▪ Directed Acyclic Graph (DAG) !10 Architecture
11. Copyright © 2017 HashiCorp Terraform !11 Architecture
12. Copyright © 2017 HashiCorp Terraform ▪ Configuration, State ▪ Interpolation, translating configuration into a Dependency Graph ▪ Discovery, communication with Plugins ▪ plan and apply !12 Core Responsibilities
13. Copyright © 2017 HashiCorp Terraform !13 Core Responsibilities Core Providers Upstream APIs Plugins Terraform
14. Copyright © 2017 HashiCorp Terraform !14 Core Responsibilities Core Providers Upstream APIs Plugins Diff() Apply() Refresh() Terraform
15. Copyright © 2017 HashiCorp Terraform !15 Core Responsibilities dag config terraform reads makes
16. Copyright © 2017 HashiCorp Terraform !16 Core Responsibilities
17. s Copyright © 2017 HashiCorp Provider Architecture !17 Part 2
18. Copyright © 2017 HashiCorp Provider Architecture ▪ Write, Plan, and Create Infrastructure as Code ▪ Provision on any infrastructure / service / cloud !18 Goals Amazon GitHub DigitalOcean Fastly Microsoft Azure Packet Heroku DNSimple Librato Google Cloud Docker VMWare Sphere Many more…
19. Copyright © 2017 HashiCorp Provider Architecture ▪ Detailed knowledge of the specific Provider (API, SDK, Authentication) ▪ Define Resources that map to specific Services ▪ Resource: abstraction/lifecycle management for cloud units/ resources !19 Provider Responsibilities
20. Copyright © 2017 HashiCorp Provider Architecture !20 Provider Architecture Core Providers Upstream APIs Plugins Diff() Apply() Refresh() Terraform
21. Copyright © 2017 HashiCorp Provider Architecture !21 Provider Architecture Core Providers Upstream APIs Plugins Diff() Apply() Refresh() Create() Read() Update() Delete() Terraform
22. Copyright © 2017 HashiCorp Provider Architecture ▪ Providers are binary plugins ▪ Automatically discovered by Core ▪ Uses terraform/helper/schema framework to define lifecycle !22 Provider Architecture
23. Copyright © 2017 HashiCorp Provider Architecture !23 Provider layout - terraform-provider-supercloud/ ⌙ main.go ⌙ provider.go ⌙ resource_supercloud_instance.go ⌙ data_source_supercloud_instance.go ⌙ [...]
24. Copyright © 2017 HashiCorp Provider Architecture !24 Provider layout: provider.go package supercloud import ( "github.com/hashicorp/terraform/helper/schema" ) func Provider() *schema.Provider { return &schema.Provider{ Schema: map[string]*schema.Schema{ "access_key": { Type: schema.TypeString, Optional: true, Description: descriptions["access_key"], }, ResourcesMap: map[string]*schema.Resource{ "sc_cloud_instance": resourceSupercloudInstance(), }, }, } }
25. Copyright © 2017 HashiCorp Provider Architecture !25 Provider layout: resource_supercloud_instance.go package supercloud import ( "github.com/hashicorp/terraform/helper/schema" "github.com/supercloud/supercloud-sdk-go/supercloud" ) func resourceSupercloudInstance() *schema.Resource { return &schema.Resource{ Create: resourceSupercloudInstanceCreate, Read: resourceSupercloudInstanceRead, Update: resourceSupercloudInstanceUpdate, Delete: resourceSupercloudInstanceDelete, } }
26. Copyright © 2017 HashiCorp Provider Architecture !26 Provider layout: data_source_supercloud_instance.go package supercloud import ( "github.com/aws/aws-sdk-go/aws" "github.com/hashicorp/terraform/helper/schema" ) func dataSourceSupercloudInstance() *schema.Resource { return &schema.Resource{ Read: dataSourceSupercloudInstanceRead, Schema: map[string]*schema.Schema{ "id": { Type: schema.TypeString, }, }, } }
27. Copyright © 2017 HashiCorp Provider Architecture !27 Provider layout: main.go package main import ( "github.com/hashicorp/terraform/plugin" "github.com/hashicorp/terraform/terraform" ) func main() { plugin.Serve(&plugin.ServeOpts{ ProviderFunc: func() terraform.ResourceProvider { return supercloud.Provider() }, }) }
28. s Copyright © 2017 HashiCorp v0.10.0 !28 Part 3
29. Copyright © 2017 HashiCorp v0.10.0 !29 Recall: Terraform/Provider architecture Core Providers Upstream APIs Plugins Terraform
30. Copyright © 2017 HashiCorp v0.10.0 !30 Growth!
31. Copyright © 2017 HashiCorp v0.10.0 ▪ Everything in a single repo ▪ Tightly coupled ▪ Releases every ~2 weeks (v0.6.16, v0.7.13, v0.9.11) !31 Challenges
32. Copyright © 2017 HashiCorp v0.10.0 !32 The Core/Provider split Core Providers Upstream APIs Plugins Terraform
33. Copyright © 2017 HashiCorp v0.10.0 ▪ Separate core and provider versioning and release ▪ Enable the Provider community ▪ Per-project plugin management, version locking ▪ Minimal change to users !33 The Core/Provider split: Benefits
34. Copyright © 2017 HashiCorp Extending Terraform ▪ Users of Terraform are able to write new plugins in order to support new functionality in Terraform ▪ If it has an API, it can (probably) be managed by Terraform !34 Plugins
35. s Copyright © 2017 HashiCorp Demo(s) !35 Part 4
36. Copyright © 2017 HashiCorp Demo ▪ Provision, secure, connect, and run any infrastructure for any application !36 HashiCorp’s Mission
37. Copyright © 2017 HashiCorp Demo ▪ Setup a Heroku app ▪ Setup a Lambda function ▪ Get them to talk? !37 What shall we do..
38. Copyright © 2017 HashiCorp Demo ▪ I already wrote the Heroku app ▪ I already wrote the Lambda function ▪ Other things were already written (I’ll explain soon enough) ▪ Code is proof of concept, not production ready ▪ Live demos always contain dragons !38 DISCLAIMERS
39. Copyright © 2017 HashiCorp Demo ▪ Setup a Heroku app ▪ Setup a Lambda function ▪ Wrote a new Provider ▪ With 2 data sources ▪ Extended an existing Provider ▪ Added a new resource ▪ Installed locally ▪ Integrated and clicked a physical button (hopefully it worked) !39 What did we do..
40. s Copyright © 2017 HashiCorp Thank you! !40 Done!
41. Clint (@catsby) Provider Team Lead, Terraform