Slide 1
Slide 1 text
By Thijs Feryn
Build, provision & deploy
in the Cloud with
Packer, Ansible & Terraform
Slide 2
Slide 2 text
I’m so sick of Cloud!
Slide 3
Slide 3 text
Automation
Slide 4
Slide 4 text
Many platforms
Slide 5
Slide 5 text
No content
Slide 6
Slide 6 text
No content
Slide 7
Slide 7 text
✓ Less lock-in
✓ Faster deployments
✓ Better scalability
✓ Better reproducibility
✓ Less human error
✓ Lower cost
✓ Operational stability
Goals
Slide 8
Slide 8 text
Hi, I’m Thijs
Slide 9
Slide 9 text
I’m
@ThijsFeryn
on Twitter
Slide 10
Slide 10 text
I’m an
Evangelist
At
Slide 11
Slide 11 text
I’m an
Evangelist
At
Slide 12
Slide 12 text
No content
Slide 13
Slide 13 text
No content
Slide 14
Slide 14 text
✓ Alicloud ECS
✓ Amazon EC2
✓ Azure
✓ CloudStack
✓ DigitalOcean
✓ Docker
✓ File
✓ Google Cloud
✓ Hyper-V
✓ LXC
✓ LXD
✓ Null
✓ 1&1
✓ OpenStack
✓ Oracle OCI
✓ Parallels
✓ ProfitBricks
✓ QEMU
✓ Triton
✓ VirtualBox
✓ VMware
✓ Custom
Packer builders
Slide 15
Slide 15 text
No content
Slide 16
Slide 16 text
{
"builders": [
{
"type": "amazon-ebs",
"access_key": "",
"secret_key": "",
"region": "eu-west-2",
"instance_type": "t2.micro",
"ssh_username": "admin",
"associate_public_ip_address": true,
"subnet_id": “subnet-11d3d56a",
"source_ami": "ami-e1e8f085",
"ami_name": "thijsferyn_{{isotime \"2006_01_02__03_04_05\"}}"
}
],
"provisioners": [
{
"type": "shell",
"inline": ["apt-get update","apt-get install -y nginx"]
}
]
}
Slide 17
Slide 17 text
$ packer build packer.json
Slide 18
Slide 18 text
$ aws ec2 describe-images --owners=self --query "Images[*].
{ID:ImageId,Name:Name,Status:State}" --output=table
+--------------+-----------------------------------+-------------+
| ID | Name | Status |
+--------------+-----------------------------------+-------------+
| ami-82ccd6e6| thijsferyn_2018_01_31__02_26_27 | available |
+--------------+-----------------------------------+-------------+
Slide 19
Slide 19 text
No content
Slide 20
Slide 20 text
Configuration
management
system
Slide 21
Slide 21 text
No content
Slide 22
Slide 22 text
✓ Written in Python
✓ Agentless
✓ Standalone
✓ SSH-based
✓ Runs playbook (yml files)
✓ Groups playbook in roles
✓ Install software
✓ Configure your server
Ansible
Slide 23
Slide 23 text
---
- hosts: all
vars:
code_folders:
- "web"
become: true
tasks:
- name: update apt cache
apt: update_cache=yes cache_valid_time=86400
- name: install required packages
apt: name={{ item }} state=present
with_items:
- vim
- curl
- nginx
- php7.0-fpm
- rsync
- name: create /var/www/html/ folder
file:
path: /var/www/html/
state: directory
mode: 0755
owner: www-data
playbook.yml
Slide 24
Slide 24 text
- name: create /var/www/html/ folder
file:
path: /var/www/html/
state: directory
mode: 0755
owner: www-data
- name: Copy code
synchronize:
src: ../{{ item }}
dest: /var/www/html
delete: yes
recursive: yes
group: no
owner: no
perms: no
with_items: "{{code_folders}}"
- name: Chown code to www-data
file:
path: /var/www/html/{{ item }}
group: www-data
owner: www-data
mode: u=rwx,g=r,o=r
recurse: yes
playbook.yml
Slide 25
Slide 25 text
Organize
your
playbooks
Slide 26
Slide 26 text
.
!"" files
# $"" db.sql
!"" host_vars
# $"" default.yml
!"" group_vars
# $"" all.yml
!"" inventory
!"" playbook.yml
!"" roles
# $"" my-role
# !"" defaults
# # $"" main.yml
# !"" handlers
# # $"" main.yml
# !"" meta
# # $"" main.yml
# !"" tasks
# # $"" main.yml
# !"" templates
# # $"" template.j2
# $"" vars
# $"" vars.yml
!"" tasks
# !"" task1.yml
# !"" task2.yml
$"" templates
$"" template.j2
Slide 27
Slide 27 text
---
- hosts: all
tasks:
- include_tasks: task1.yml
- include_tasks: task2.yml
roles:
- my-role
Slide 28
Slide 28 text
{
"builders": [
{
"type": "openstack",
"identity_endpoint": "https://osp.combell.com:5000/v3",
"tenant_name": "18324-1",
"username": "18324",
"password": "",
"image_name": "MyBuild-{{isotime \"2006-01-02 03:04:05\"}}",
"source_image": "1b9fe43e-4cf2-4986-b7f2-51f5706b120b",
"ssh_username": "debian",
"domain_name" : "default",
"flavor": "m1.medium",
"networks": ["a1175c54-cb12-436d-ac7b-d327499dc39b"],
"floating_ip_pool" : "public"
}
],
"provisioners": [
{
"type": "ansible",
"playbook_file": "./ansible/playbook.yml"
}
]
}
Slide 29
Slide 29 text
"image_name": "MyBuild-{{isotime \"2006-01-02 03:04:05\"}}",
"source_image": "1b9fe43e-4cf2-4986-b7f2-51f5706b120b",
"ssh_username": "debian",
"domain_name" : "default",
"flavor": "m1.medium",
"networks": ["a1175c54-cb12-436d-ac7b-d327499dc39b"],
"floating_ip_pool" : "public"
}
],
"provisioners": [
{
"type": "ansible",
"playbook_file": "./ansible/playbook.yml"
}
],
"post-processors": [
{
"type": "manifest",
"output": "manifest.json"
}
]
}
Slide 30
Slide 30 text
{
"builds": [
{
"name": "amazon-ebs",
"builder_type": "amazon-ebs",
"build_time": 1517408990,
"files": null,
"artifact_id": "eu-west-2:ami-82ccd6e6",
"packer_run_uuid": "ba98283c-08ca-a9fc-ab10-e49502ce4ab6"
},
{
"name": "openstack",
"builder_type": "openstack",
"build_time": 1509053610,
"files": null,
"artifact_id": "ef90ad1c-ed64-4ae0-8283-e446e95c33e6",
"packer_run_uuid": "b6000539-f3e6-85dd-2733-9fb3ae443e9f"
}
],
"last_run_uuid": "b6000539-f3e6-85dd-2733-9fb3ae443e9f"
}
Slide 31
Slide 31 text
No content
Slide 32
Slide 32 text
Deploy
the VM
image
Slide 33
Slide 33 text
Orchestration
Slide 34
Slide 34 text
✓ Launch virtual network
✓ Boot up webservers
✓ Configure firewalls
✓ Assign loadbalancers
✓ Create DNS-records
✓ Assign SSH keys
✓ Create autoscaling group
Orchestration
Slide 35
Slide 35 text
✓ CloudFormation (AWS)
✓ Heat (OpenStack)
✓ Resource manager (Azure)
Vendor-specific orchestration tools
Slide 36
Slide 36 text
No content
Slide 37
Slide 37 text
✓ Infrastructure As Code
✓ Plan, graph, execute
✓ State management
✓ Multiple providers
✓ Incremental changes
✓ Interacts with Cloud vendor APIs
Terraform
Slide 38
Slide 38 text
✓ Alicloud
✓ Archive
✓ Arukas
✓ AWS
✓ Bitbucket
✓ CenturyLinkCloud
✓ Chef
✓ Circonus
✓ Cloudflare
✓ CloudStack
✓ Cobbler
✓ Consul
✓ Datadog
✓ DigitalOcean
✓ DNS
✓ DNSMadeEasy
✓ DNSimple
✓ Docker
✓ Dyn
✓ External
✓ Fastly
✓ GitHub
✓ Gitlab
✓ Google Cloud
✓ Grafana
✓ Heroku
✓ HTTP
✓ Icinga2
✓ Ignition
✓ InfluxDB
✓ Kubernetes
✓ Librato
✓ Local
✓ Logentries
✓ LogicMonitor
✓ Mailgun
✓ Microsoft Azure
✓ Microsoft Azure
(Legacy ASM)
✓ MySQL
✓ New Relic
✓ Nomad
✓ NS1
✓ 1&1
✓ Oracle Public Cloud
✓ OpenStack
✓ OpsGenie
✓ OVH
✓ Packet
✓ PagerDuty
✓ PostgreSQL
✓ PowerDNS
✓ ProfitBricks
✓ RabbitMQ
✓ Rancher
✓ Random
✓ Rundeck
✓ Scaleway
✓ SoftLayer
✓ StatusCake
✓ Spotinst
✓ Template
✓ Terraform
✓ Terraform Enterprise
✓ TLS
✓ Triton
✓ UltraDNS
✓ Vault
✓ VMware vCloud
Director
✓ VMware vSphere
Terraform providers
Slide 39
Slide 39 text
main.tf
Slide 40
Slide 40 text
variable "ami" {
type = "string"
default = "ami-e1e8f085" #Stock Debian Stretch
}
resource "aws_instance" "web" {
ami = "${var.ami}"
instance_type = "t2.micro"
security_groups = ["Web"]
tags {
Name = "web"
}
}
data "aws_route53_zone" "web" {
name = "aws.combell.com."
}
resource "aws_route53_record" "web" {
zone_id = "${data.aws_route53_zone.web.zone_id}"
name = "thijsferyn-web.${data.aws_route53_zone.web.name}"
type = "A"
ttl = "60"
records = ["${aws_instance.web.public_ip}"]
}
output "public_ip" {
value = "${aws_instance.web.public_ip}"
}
output "hostname" {
value = "${aws_route53_record.web.name}"
}
Slide 41
Slide 41 text
$ terraform init
Slide 42
Slide 42 text
$ terraform init
Initializing provider plugins...
- Checking for available provider plugins on https://releases.hashicorp.com...
- Downloading plugin for provider "aws" (1.8.0)...
The following providers do not have any version constraints in configuration,
so the latest version was installed.
To prevent automatic upgrades to new major versions that may contain breaking
changes, it is recommended to add version = "..." constraints to the
corresponding provider blocks in configuration, with the constraint strings
suggested below.
* provider.aws: version = "~> 1.8"
Terraform has been successfully initialized!
Slide 43
Slide 43 text
$ terraform plan
Slide 44
Slide 44 text
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
Terraform will perform the following actions:
+ aws_instance.web
id:
ami: "ami-e1e8f085"
associate_public_ip_address:
availability_zone:
ebs_block_device.#:
ephemeral_block_device.#:
instance_state:
instance_type: "t2.micro"
ipv6_address_count:
ipv6_addresses.#:
key_name:
network_interface.#:
network_interface_id:
placement_group:
primary_network_interface_id:
private_dns:
private_ip:
public_dns:
public_ip:
root_block_device.#:
security_groups.#: "1"
security_groups.2661672386: "Web"
source_dest_check: "true"
subnet_id:
tags.%: "1"
tags.Name: "web"
tenancy:
volume_tags.%:
vpc_security_group_ids.#:
Slide 45
Slide 45 text
+ aws_route53_record.web
id:
fqdn:
name: "thijsferyn-web.aws.combell.com"
records.#:
ttl: "60"
type: "A"
zone_id: "Z3K2HG3W48B0MR"
Plan: 2 to add, 0 to change, 0 to destroy.
Slide 46
Slide 46 text
$ terraform apply
Slide 47
Slide 47 text
$ terraform plan -out=bla
$ terraform apply bla
Slide 48
Slide 48 text
No content
Slide 49
Slide 49 text
$ terraform output
hostname = thijsferyn-web.aws.combell.com
public_ip = 35.178.38.182
Slide 50
Slide 50 text
$ terraform output -json
{
"hostname": {
"sensitive": false,
"type": "string",
"value": "thijsferyn-web.aws.combell.com"
},
"public_ip": {
"sensitive": false,
"type": "string",
"value": "35.178.38.182"
}
}
Slide 51
Slide 51 text
$ terraform show
Slide 52
Slide 52 text
$ terraform show
aws_instance.web:
id = i-0333e97ea6bdbc5ae
ami = ami-e1e8f085
associate_public_ip_address = true
availability_zone = eu-west-2a
disable_api_termination = false
ebs_block_device.# = 0
ebs_optimized = false
ephemeral_block_device.# = 0
iam_instance_profile =
instance_state = running
instance_type = t2.micro
ipv6_addresses.# = 0
key_name =
monitoring = false
network_interface.# = 0
network_interface_id = eni-c62e7193
placement_group =
primary_network_interface_id = eni-c62e7193
private_dns = ip-172-31-19-7.eu-west-2.compute.internal
Slide 53
Slide 53 text
network_interface_id = eni-c62e7193
placement_group =
primary_network_interface_id = eni-c62e7193
private_dns = ip-172-31-19-7.eu-west-2.compute.internal
private_ip = 172.31.19.7
public_dns = ec2-35-178-38-182.eu-west-2.compute.amazonaws.com
public_ip = 35.178.38.182
root_block_device.# = 1
root_block_device.0.delete_on_termination = true
root_block_device.0.iops = 100
root_block_device.0.volume_id = vol-0b9364527ec09549e
root_block_device.0.volume_size = 8
root_block_device.0.volume_type = gp2
security_groups.# = 1
security_groups.763657905 = Web
source_dest_check = true
subnet_id = subnet-11d3d56a
tags.% = 1
tags.Name = web
tenancy = default
volume_tags.% = 0
vpc_security_group_ids.# = 0
Slide 54
Slide 54 text
aws_route53_record.web:
id = Z3K2HG3W48B0MR_thijsferyn-web.aws.combell.com._A
fqdn = thijsferyn-web.aws.combell.com
health_check_id =
name = thijsferyn-web.aws.combell.com
records.# = 1
records.1088376871 = 35.178.38.182
set_identifier =
ttl = 60
type = A
zone_id = Z3K2HG3W48B0MR
data.aws_route53_zone.web:
id = Z3K2HG3W48B0MR
caller_reference = F7596F57-9ADE-9B0D-8F53-53DF42E03DB3
comment =
name = aws.combell.com.
private_zone = false
resource_record_set_count = 3
zone_id = Z3K2HG3W48B0MR
Outputs:
hostname = thijsferyn-web.aws.combell.com
public_ip = 35.178.38.182
Slide 55
Slide 55 text
State
Slide 56
Slide 56 text
terraform.tfstate
terraform.tfstate.backup
Slide 57
Slide 57 text
✓ Artifactory
✓ Azurerm
✓ Consul
✓ Etcd
✓ Gcs
✓ HTTP
✓ Manta
✓ S3
✓ Swift
✓ Terraform
Enterprise
Remote state
Slide 58
Slide 58 text
Changes
Slide 59
Slide 59 text
$ terraform plan -var 'ami=ami-20ccd644'
Slide 60
Slide 60 text
~ update in-place
-/+ destroy and then create replacement
Terraform will perform the following actions:
-/+ aws_instance.web (new resource required)
id: "i-0333e97ea6bdbc5ae" => (forces new
resource)
ami: "ami-e1e8f085" => "ami-20ccd644" (forces new
resource)
associate_public_ip_address: "true" =>
availability_zone: "eu-west-2a" =>
ebs_block_device.#: "0" =>
ephemeral_block_device.#: "0" =>
instance_state: "running" =>
instance_type: "t2.micro" => "t2.micro"
ipv6_address_count: "" =>
ipv6_addresses.#: "0" =>
key_name: "" =>
network_interface.#: "0" =>
network_interface_id: "eni-c62e7193" =>
placement_group: "" =>
primary_network_interface_id: "eni-c62e7193" =>
private_dns: "ip-172-31-19-7.eu-west-2.compute.internal" =>
private_ip: "172.31.19.7" =>
Slide 61
Slide 61 text
key_name: "" =>
network_interface.#: "0" =>
network_interface_id: "eni-c62e7193" =>
placement_group: "" =>
primary_network_interface_id: "eni-c62e7193" =>
private_dns: "ip-172-31-19-7.eu-west-2.compute.internal" =>
private_ip: "172.31.19.7" =>
public_dns: "ec2-35-178-38-182.eu-
west-2.compute.amazonaws.com" =>
public_ip: "35.178.38.182" =>
root_block_device.#: "1" =>
security_groups.#: "1" => "1"
security_groups.763657905: "Web" => "Web"
source_dest_check: "true" => "true"
subnet_id: "subnet-11d3d56a" =>
tags.%: "1" => "1"
tags.Name: "web" => "web"
tenancy: "default" =>
volume_tags.%: "0" =>
vpc_security_group_ids.#: "0" =>
~ aws_route53_record.web
records.#: "" =>
Plan: 1 to add, 1 to change, 1 to destroy.
Slide 62
Slide 62 text
$ terraform apply -var 'ami=ami-20ccd644'
Slide 63
Slide 63 text
Downtime
Slide 64
Slide 64 text
High availability plan
Slide 65
Slide 65 text
Workspace 1 Workspace 2
Internet
Entry
point
BLUE
GREEN
Slide 66
Slide 66 text
$ terraform init
$ terraform workspace new wsp1
$ terraform workspace new wsp2
$ terraform workspace select wsp1
$ terraform plan
$ terraform apply
$ terraform workspace select wsp2
$ terraform plan
$ terraform apply
Slide 67
Slide 67 text
variable "ami" {
type = "string"
default = "ami-e1e8f085" #Stock Debian Stretch
}
resource "aws_instance" "web" {
ami = "${var.ami}"
instance_type = "t2.micro"
security_groups = ["Web"]
tags {
Name = "web-${terraform.workspace}"
}
}
output "public_ip" {
value = "${aws_instance.web.public_ip}"
}
Remove DNS
resource
Interpolate
workspace
info
Slide 68
Slide 68 text
variable "ip" {
type = "string"
}
data "aws_route53_zone" "web" {
name = "aws.combell.com."
}
resource "aws_route53_record" "web" {
zone_id = "${data.aws_route53_zone.web.zone_id}"
name = "thijsferyn-web.${data.aws_route53_zone.web.name}"
type = "A"
ttl = "60"
records = ["${var.ip}"]
}
output "hostname" {
value = "${aws_route53_record.web.name}"
}
Separate
Terraform
project
Slide 69
Slide 69 text
$ terraform apply -var 'ip="35.176.171.168"'
Slide 70
Slide 70 text
Rolling
updates
Slide 71
Slide 71 text
Deployment B
Internet
Entry
point
Drain connections
and gradually switch
from deployment A
to deployment B
Deployment A
ROLLING
UPDATES
Slide 72
Slide 72 text
Autoscaling
group
Slide 73
Slide 73 text
resource "aws_vpc" "thijsferyn_terraform" {
cidr_block = "10.0.0.0/16"
tags {
Name = "thijsferyn_${terraform.workspace}_terraform"
}
}
resource "aws_subnet" "thijsferyn_terraform_public" {
availability_zone = "eu-west-2a"
vpc_id = "${aws_vpc.thijsferyn_terraform.id}"
cidr_block = "10.0.0.0/24"
tags {
Name = "thijsferyn_terraform_${terraform.workspace}_public"
}
}
resource "aws_subnet" "thijsferyn_terraform_private" {
availability_zone = "eu-west-2a"
vpc_id = "${aws_vpc.thijsferyn_terraform.id}"
cidr_block = "10.0.1.0/24"
tags {
Name = "thijsferyn_terraform_${terraform.workspace}_private"
}
}
Virtual
network
Slide 74
Slide 74 text
resource "aws_security_group" "thijsferyn_terraform" {
name = "thijsferyn-terraform-${terraform.workspace}"
description = "Allow HTTP(S) & SSH"
vpc_id = "${aws_vpc.thijsferyn_terraform.id}"
ingress {
from_port = 80
to_port = 80
protocol = "tcp"
cidr_blocks = ["0.0.0.0/0"]
}
ingress {
from_port = 443
to_port = 443
protocol = "tcp"
cidr_blocks = ["0.0.0.0/0"]
}
ingress {
from_port = 22
to_port = 22
protocol = "tcp"
cidr_blocks = ["0.0.0.0/0"]
}
egress {
from_port = 0
to_port = 0
protocol = "-1"
cidr_blocks = ["0.0.0.0/0"]
}
tags {
Name = "thijsferyn_terraform-${terraform.workspace}"
}
}
Firewall
Slide 75
Slide 75 text
data "aws_ami" "thijsferyn_terraform" {
most_recent = true
filter {
name = "name"
values = ["thijsferyn_*"]
}
filter {
name = "virtualization-type"
values = ["hvm"]
}
owners = ["826481595599"]
}
resource "aws_launch_configuration" "thijsferyn_terraform" {
image_id = "${data.aws_ami.thijsferyn_terraform.id}"
instance_type = "t2.micro"
security_groups = ["${aws_security_group.thijsferyn_terraform.id}"]
lifecycle {
create_before_destroy = true
}
}
Prepare
VMs
Slide 76
Slide 76 text
resource "aws_lb" "thijsferyn_terraform" {
name = "thijsferyn-terraform-${terraform.workspace}"
internal = false
security_groups = ["${aws_security_group.thijsferyn_terraform.id}"]
subnets = ["${aws_subnet.thijsferyn_terraform_public.*.id}","$
{aws_subnet.thijsferyn_terraform_public2.*.id}"]
}
resource "aws_lb_listener" "thijsferyn_terraform" {
load_balancer_arn = "${aws_lb.thijsferyn_terraform.arn}"
port = "80"
protocol = "HTTP"
default_action {
target_group_arn = "${aws_lb_target_group.thijsferyn_terraform.arn}"
type = "forward"
}
}
resource "aws_lb_target_group" "thijsferyn_terraform" {
name = "thijsferyn-terraform-${terraform.workspace}"
port = 80
protocol = "HTTP"
vpc_id = "${aws_vpc.thijsferyn_terraform.id}"
}
Load
balancing
Slide 77
Slide 77 text
resource "aws_autoscaling_group" "thijsferyn_terraform" {
availability_zones = ["eu-west-2a"]
name = "thijsferyn-terraform-${terraform.workspace}-$
{aws_launch_configuration.thijsferyn_terraform.name}"
max_size = 10
min_size = 3
launch_configuration = "${aws_launch_configuration.thijsferyn_terraform.name}"
target_group_arns = ["${aws_lb_target_group.thijsferyn_terraform.id}"]
health_check_grace_period = 10
health_check_type = "ELB"
vpc_zone_identifier = ["${aws_subnet.thijsferyn_terraform_private.id}"]
default_cooldown = 60
depends_on = ["aws_launch_configuration.thijsferyn_terraform"]
lifecycle {
create_before_destroy = true
}
tag {
key = "Name"
value = "thijsferyn-terraform-${terraform.workspace}-$
{aws_launch_configuration.thijsferyn_terraform.name}"
propagate_at_launch = true
}
}
Autoscaling
group
Slide 78
Slide 78 text
resource "aws_autoscaling_policy" "thijsferyn_terraform_high" {
name = "thijsferyn-terraform-${terraform.workspace}-high"
scaling_adjustment = 1
adjustment_type = "ChangeInCapacity"
cooldown = 10
autoscaling_group_name = "${aws_autoscaling_group.thijsferyn_terraform.name}"
}
resource "aws_autoscaling_policy" "thijsferyn_terraform_low" {
name = "thijsferyn-terraform-${terraform.workspace}low"
scaling_adjustment = -1
adjustment_type = "ChangeInCapacity"
cooldown = 10
autoscaling_group_name = "${aws_autoscaling_group.thijsferyn_terraform.name}"
}
Scale up
scale down
Slide 79
Slide 79 text
resource "aws_cloudwatch_metric_alarm" "thijsferyn_terraform_high" {
alarm_name = "thijsferyn-terraform-${terraform.workspace}-high"
comparison_operator = "GreaterThanOrEqualToThreshold"
evaluation_periods = "1"
metric_name = "RequestCountPerTarget"
namespace = "AWS/ApplicationELB"
period = "60"
statistic = "Sum"
threshold = "20"
dimensions {
TargetGroup = "${aws_lb_target_group.thijsferyn_terraform.name}"
LoadBalancer = "${aws_lb.thijsferyn_terraform.name}"
}
alarm_description = "More than 20 requests per target causes scaleout"
alarm_actions = ["${aws_autoscaling_policy.thijsferyn_terraform_high.arn}"]
}
High
water mark
Slide 80
Slide 80 text
$ terraform plan
$ terraform apply
Slide 81
Slide 81 text
$ terraform graph | dot -Tpng > graph.png
Slide 82
Slide 82 text
No content
Slide 83
Slide 83 text
No content
Slide 84
Slide 84 text
✓ vars.tf
✓ output.tf
✓ secgroup.tf
✓ keypair.tf
✓ compute.tf
✓ network.tf
✓ provider.tf
Organize Terraform files
Slide 85
Slide 85 text
Modules
Slide 86
Slide 86 text
!"" autoscaling
# !"" README.MD
# !"" main.tf
# !"" outputs.tf
# $"" variables.tf
!"" dns
# !"" README.MD
# !"" main.tf
# !"" outputs.tf
# $"" variables.tf
!"" launch
# !"" README.MD
# !"" main.tf
# !"" outputs.tf
# $"" variables.tf
!"" loadbalancing
# !"" README.MD
# !"" main.tf
# !"" outputs.tf
# $"" variables.tf
!"" main.tf
!"" networking
# !"" README.MD
# !"" main.tf
# !"" outputs.tf
# $"" variables.tf
Slide 87
Slide 87 text
variable "zone_name" {
default = "aws.combell.com."
}
variable "record_name" {
default = ""
}
variable "records" {
type = "list"
}
output "dns_endpoint" {
value = "${aws_route53_record.thijsferyn_terraform_aws_combell_com.fqdn}"
}
data "aws_route53_zone" "thijsferyn_terraform_aws_combell_com" {
name = "${var.zone_name}"
}
resource "aws_route53_record" "thijsferyn_terraform_aws_combell_com" {
zone_id = "${data.aws_route53_zone.thijsferyn_terraform_aws_combell_com.zone_id}"
name = "${var.record_name == "" ? "thijsferyn-terraform${terraform.workspace ==
"default" ? "" : "-${terraform.workspace}"}": var.record_name}.$
{data.aws_route53_zone.thijsferyn_terraform_aws_combell_com.name}"
type = "CNAME"
ttl = "60"
records = ["${var.records}"]
}
Variables.tf
module input
args
Output.tf
module
output
Main.tf
processing
Slide 88
Slide 88 text
module "dns" {
source = "./dns"
record_name = "www"
records = ["bla.domain.com"]
}
output "dns_endpoint" {
value = "${module.dns.dns_endpoint}"
}
Root
Terraform
file
Slide 89
Slide 89 text
module "networking" {
source = "./networking"
}
module "loadbalancing" {
source = "./loadbalancing"
security_groups = ["${module.networking.security_group_id}"]
vpc_id = "${module.networking.vpc_id}"
subnets = ["${module.networking.subnet_public1_id}","${module.networking.subnet_public2_id}"]
}
module "launch" {
source = "./launch"
instance_type = "t2.small"
security_groups = ["${module.networking.security_group_id}"]
}
module "autoscaling" {
source = "./autoscaling"
target_group = "${module.loadbalancing.target_group_name}"
loadbalancer = "${module.loadbalancing.loadbalancer_name}"
min_size = "4"
subnets = ["${module.networking.subnet_private1_id}","${module.networking.subnet_private2_id}"]
launch_configuration = "${module.launch.launch_configuration_name}"
target_group_arn = "${module.loadbalancing.target_group_id}"
}
module "dns" {
source = "./dns"
records = ["${module.loadbalancing.dns_name}"]
}
output "dns_endpoint" {
value = "${module.dns.dns_endpoint}"
}
Slide 90
Slide 90 text
https://registry.terraform.io
Slide 91
Slide 91 text
No content
Slide 92
Slide 92 text
module "consul" {
source = "hashicorp/consul/aws"
}
Slide 93
Slide 93 text
$ terraform init
Slide 94
Slide 94 text
Downloading modules...
Initializing provider plugins...
- Checking for available provider plugins on https://releases.hashicorp.com...
- Downloading plugin for provider "aws" (1.9.0)...
- Downloading plugin for provider "template" (1.0.0)...
The following providers do not have any version constraints in configuration,
so the latest version was installed.
To prevent automatic upgrades to new major versions that may contain breaking
changes, it is recommended to add version = "..." constraints to the
corresponding provider blocks in configuration, with the constraint strings
suggested below.
* provider.aws: version = "~> 1.9"
* provider.template: version = "~> 1.0"
Terraform has been successfully initialized!
You may now begin working with Terraform. Try running "terraform plan" to see
any changes that are required for your infrastructure. All Terraform commands
should now work.
If you ever set or change modules or backend configuration for Terraform,
rerun this command to reinitialize your working directory. If you forget, other
commands will detect it and remind you to do so if necessary.
Slide 95
Slide 95 text
module “example" {
source = "github.com/hashicorp/example"
}
module "consul" {
source = "git::https://hashicorp.com/consul.git"
}
module "ami" {
source = "git::ssh://[email protected]/owner/repo.git"
}
Slide 96
Slide 96 text
Remote state
Slide 97
Slide 97 text
No content
Slide 98
Slide 98 text
$ consul agent -data-dir=/tmp/consul \
-server -ui -dev
Slide 99
Slide 99 text
terraform {
backend "consul" {
address = "127.0.0.1:8500"
path = "example/terraform_state"
}
}
Slide 100
Slide 100 text
$ terraform apply
Error locking state: Error acquiring the state lock:
resource temporarily unavailable
Lock Info:
ID: d2c36deb-32c0-ecc7-b1f1-10068c2ed93b
Path: terraform.tfstate
Operation: OperationTypeApply
Who: [email protected]
Version: 0.10.7
Created: 2018-02-02 16:03:17.005327423 +0000 UTC
Info:
Terraform acquires a state lock to protect the state
from being written
by multiple users at the same time. Please resolve
the issue above and try
again. For most commands, you can disable locking
with the "-lock=false"
flag, but this is not recommended.
Slide 101
Slide 101 text
data "terraform_remote_state" "web" {
backend = "consul"
config {
address = "127.0.0.1:8500"
path = "thijsferyn/terraform/production"
}
}
data "aws_route53_zone" "web" {
name = "aws.combell.com."
}
resource "aws_route53_record" "web" {
zone_id = "${data.aws_route53_zone.web.zone_id}"
name = "thijsferyn-web.${data.aws_route53_zone.web.name}"
type = "A"
ttl = "60"
records = ["${data.terraform_remote_state.web.public_ip}"]
}
output "hostname" {
value = "${aws_route53_record.web.name}"
}
Slide 102
Slide 102 text
https://feryn.eu
https://twitter.com/ThijsFeryn
https://instagram.com/ThijsFeryn
Slide 103
Slide 103 text
No content