Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Automating AWS
Search
Andrew Best
July 19, 2016
Programming
2
360
Automating AWS
Using Octopus, Cloud Formation and Powershell DSC to build immutable phoenix environments in AWS
Andrew Best
July 19, 2016
Tweet
Share
More Decks by Andrew Best
See All by Andrew Best
The Surprising Truths Behind Good Mentoring
andrewabest
0
57
Learn Authentication The Hard Way
andrewabest
0
320
Finding The Sweet Spot BNE
andrewabest
1
220
Finding The Sweet Spot
andrewabest
0
430
Conventional Wisdom
andrewabest
1
420
DSC a-b-c's
andrewabest
0
130
AWS a-b-c's
andrewabest
3
150
What is Git?
andrewabest
0
210
Client Side Testing
andrewabest
0
62
Other Decks in Programming
See All in Programming
Hypervel - A Coroutine Framework for Laravel Artisans
albertcht
1
120
『自分のデータだけ見せたい!』を叶える──Laravel × Casbin で複雑権限をスッキリ解きほぐす 25 分
akitotsukahara
2
640
PHPでWebSocketサーバーを実装しよう2025
kubotak
0
280
AIともっと楽するE2Eテスト
myohei
6
2.6k
「Cursor/Devin全社導入の理想と現実」のその後
saitoryc
0
820
Blazing Fast UI Development with Compose Hot Reload (droidcon New York 2025)
zsmb
1
290
なぜ適用するか、移行して理解するClean Architecture 〜構造を超えて設計を継承する〜 / Why Apply, Migrate and Understand Clean Architecture - Inherit Design Beyond Structure
seike460
PRO
3
760
すべてのコンテキストを、 ユーザー価値に変える
applism118
3
1.3k
Railsアプリケーションと パフォーマンスチューニング ー 秒間5万リクエストの モバイルオーダーシステムを支える事例 ー Rubyセミナー 大阪
falcon8823
5
1.1k
今ならAmazon ECSのサービス間通信をどう選ぶか / Selection of ECS Interservice Communication 2025
tkikuc
21
4k
GitHub Copilot and GitHub Codespaces Hands-on
ymd65536
2
150
Google Agent Development Kit でLINE Botを作ってみた
ymd65536
2
250
Featured
See All Featured
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
35
2.4k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
740
Adopting Sorbet at Scale
ufuk
77
9.5k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
126
53k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Testing 201, or: Great Expectations
jmmastey
43
7.6k
Building Flexible Design Systems
yeseniaperezcruz
328
39k
The Cult of Friendly URLs
andyhume
79
6.5k
Rails Girls Zürich Keynote
gr2m
95
14k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.3k
Designing Experiences People Love
moore
142
24k
Transcript
Automating AWS
Part 1 Automating Infrastructure
Page Birds-eye view / Copyright ©2014 by Readify Pty Ltd
3 Step 1: Deploy infrastructure Step 2: Bootstrap instances Step 3: Deploy software
Page The infrastructure / Copyright ©2014 by Readify Pty Ltd
4
Page / Copyright ©2014 by Readify Pty Ltd 5 Deploy
Infrastructure Bootstrap Instances Register Tentacle Deploy Software Fire Project Trigger Nothing up my sleeve…
Page / Copyright ©2014 by Readify Pty Ltd 6 Deploy
Infrastructure Bootstrap Instances Register Tentacle Deploy Software Fire Project Trigger Nothing up my sleeve…
Page Step 1: Deploy infrastructure › Deploy.ps1 › Package and
upload bootstrapping resources to S3 › Package and upload configuration variables to S3 › Do we need to deploy a new stack? › Yes - New-CFNStack › No - New-CFNChangeSet › CloudFormation resource creation based on template / Copyright ©2014 by Readify Pty Ltd 7
Page / Copyright ©2014 by Readify Pty Ltd 8 Deploy
Infrastructure Bootstrap Instances Register Tentacle Deploy Software Fire Project Trigger Nothing up my sleeve…
Page Step 2: Bootstrap instances › EC2 userdata › cfn-init.exe
› AWS::CloudFormation::Init › Powershell DSC › Octopus tentacle › tentacle.exe --register-with / Copyright ©2014 by Readify Pty Ltd 9
Page / Copyright ©2014 by Readify Pty Ltd 10 Deploy
Infrastructure Bootstrap Instances Register Tentacle Deploy Software Fire Project Trigger Nothing up my sleeve…
Page Step 3: Deploy software › Prior to Octopus 3.4
=> DSC › Octopus 3.4 => Project Triggers › Software is deployed by Octopus via the Project Trigger › DSC polls a local health check endpoint › ASG waits to be signalled before completion › DSC => cfn-signal.exe › fin / Copyright ©2014 by Readify Pty Ltd 11
Page / Copyright ©2014 by Readify Pty Ltd 12 Deploy
Infrastructure Bootstrap Instances Register Tentacle Deploy Software Fire Project Trigger Nothing up my sleeve…
Part 2 Immutable infrastructure
Page Updating CF stacks What updating stacks used to be
like / Copyright ©2014 by Readify Pty Ltd 14 Are you feeling lucky?
Page / Copyright ©2014 by Readify Pty Ltd 15
Page CloudFormation Change Sets › Supply your updated template to
a Change Set via New-CFNChangeSet › AWS diffs the updated template against the current stack › A detailed list of what changes and what doesn’t is provided › Details the dependency chain and how it is effected / Copyright ©2014 by Readify Pty Ltd 16
Page Immutability › Rev infrastructure package => refresh instances ›
CI + CloudFormation can do this for us › Inject version into Launch configuration userdata › Triggers a replacement of the launch configuration › How do we stay HA while our infrastructure refreshes? / Copyright ©2014 by Readify Pty Ltd 17
Page AutoScaleGroup Update Policies › Allows an ASG to stay
HA while undergoing a refresh › Keeps a number of instances in service while terminating stale and creating fresh instances › Works with cfn-signal.exe to ensure updates are successful › Rolls back on failure / Copyright ©2014 by Readify Pty Ltd 18
Part 3 Phoenix environments The really really cool part!
Page Deploying feature branches › The Dream: › Developer checks
in code on a feature branch › The feature branch is built by our CI service of choice › Once complete, our CI service then invokes Octopus and triggers an isolated stack of hardware to be deployed for it › Once the hardware is ready, the feature branch’s payload is automatically deployed to it by Octopus › From check-in to our feature running on new, isolated compute. Ready to test and destroy when we are done / Copyright ©2014 by Readify Pty Ltd 20
Page Octopus 3.4 › Introduces new features that allow us
to work with a tonne more flexibility in elastic environments › Multi-tenancy › Project Triggers / Auto Deploy Overrides › Machine Policies / Copyright ©2014 by Readify Pty Ltd 21
Page Setup › We have built a new feature ryan
on an isolated feature branch! We push the code up to our repository › Our CI service notices this and creates a release for our feature branch package, with a semver version number 1.0.0-ryan0001 / Copyright ©2014 by Readify Pty Ltd 22
Page Octo 3.4 – Multi-tenancy › We created a tenant
ryan0001for our feature branch –we are using the semver from the built package as a naming convention › Allows us to isolate and group sets of machines within an environment › Allows us to configure projects with tenant-specific variables › Allows us to control what software gets deployed to what sets of machines via triggers within an environment / Copyright ©2014 by Readify Pty Ltd 23
Page Octo 3.4 – Auto Deploy Overrides › We created
an auto deploy override for our feature branch tenant ryan0001 for the feature branch package version 1.0.0-ryan0001 › Part of Project Triggers › Auto Deploy Overrides allow us to say ‘when a project trigger fires, and the machine that triggered it is for a given tenant, deploy an explicit version of the project to the machine, not the default’ / Copyright ©2014 by Readify Pty Ltd 24
Page Octo 3.4 – Machine Policies › When our instances
register with Octopus via tentacle.exe, they indicate a machine policy › When we clean up our CloudFormation, how do we ensure Octopus is cleaned up as well? › Old way: AWS Lambda › New way: Octopus Machine Policies › Healthchecks and unavailable machines › Cleanup unavailable machines / Copyright ©2014 by Readify Pty Ltd 25
Page Living The Dream 26
Thank you Andrew Best | @_andrewb |
[email protected]