Microservices infrastructure with Terraform, Consul and Vault

container-solutions.com | @containersoluti µservices with Terraform, Consul & Vault |
@mongrelion µservices With Terraform, Consul and Vault Carlos León September 2016, Napa HashiConf

@mongrelion About me 2 Carlos León Software Engineer @ Container Solutions Hang gliding pilot @mongrelion linkedin.com/in/mongrelion [email protected]

@mongrelion Agenda 3 Software development: Monolith to microservices Rise of the containers Challenges with microservices: Putting everything together (MANTL) Bringing the solution to the customers Q&A

@mongrelion Software development : pre-DevOps 4

@mongrelion Software development : DevOps 5

@mongrelion 6

@mongrelion 7

@mongrelion Software development : DevOps 8

@mongrelion Software development : Post-DevOps 9

@mongrelion 10 How to move to microservices?

@mongrelion 11

@mongrelion 12

@mongrelion 13

@mongrelion 14 Cluster Management?

@mongrelion 15 Orchestration? Cluster Management?

@mongrelion 16 Orchestration? Networking? Cluster Management?

@mongrelion 17 Security? Orchestration? Networking? Cluster Management?

@mongrelion 18 Security? Service discovery? Orchestration? Networking? Cluster Management?

@mongrelion 19 Security? Service discovery? Orchestration? Networking? Persistence? Cluster Management?

@mongrelion 20 Security? Service discovery? Orchestration? Networking? Persistence? Monitoring? Cluster Management?

@mongrelion 21 We start with Docker

@mongrelion 22 Maybe add some scheduling?

@mongrelion 23 And Consul for service discovery?

@mongrelion 24 And Project Calico (canal) for the networking?

@mongrelion 25 And ELK for the logs collection?

@mongrelion 26 … 6 months later … • Terraform & Ansible deployment to cloud providers • etcd distributed key-value store for Calico • Calico a new kind of virtual network • Mesos cluster manager • Marathon long running services • Consul for service discovery • Vault for managing secrets • Docker container runtime • collectd for metrics collection • Logstash for log forwarding • GlusterFS for container volume storage • Traefik for proxying external traffic

@mongrelion 27 Why are you building infrastructure and not your application?

@mongrelion 28

@mongrelion What is MANTL ? 29 • Mantl is a modern platform for rapidly deploying globally distributed microservices • Open source • Cloud agnostic • Available now: github.com/CiscoCloud/mantl

@mongrelion What problems does MANTL solve? 30 • Networking • Security • Service Discovery • Persistence • Monitoring • Orchestration • Cluster Management • And others...

@mongrelion What problems does MANTL solve? 31 • Networking • Security • Service Discovery • Persistence • Monitoring • Orchestration • Cluster Management • And others... • Supports easier migration to microservices • Solves integration conflicts • Lowers configuration time • More time for development • Runs anywhere • Avoid cloud locking • End-to-End platform • Customizable (open-source)

@mongrelion 32 MANTL Architecture 3 types of components: • Control • Edge • Resource

@mongrelion 33 MANTL Architecture

@mongrelion 36 Adding MANTL to your infrastructure

@mongrelion 37 Adding MANTL to your infrastructure

@mongrelion 38

@mongrelion 39

@mongrelion 40

@mongrelion 41 Security Service discovery Orchestration Networking Persistence Monitoring Cluster Management

@mongrelion 42 How to build them? Policies? How to run them? How to ship them? Cloud or on-premises? Infrastructure monitoring? Auto-scaling?

@mongrelion 43

@mongrelion 44 What is Shipped ? • Shipped is a continuous delivery platform for microservices (cloud native apps) • Commercial Cisco product • Runs on top of MANTL • Complements MANTL • In the cloud or on premises • In open Beta now: ciscoshipped.io

@mongrelion 45 What problems does Shipped solve ?

@mongrelion What problems does Shipped solve? 46 • CI/CD platform (build/deploy/run) • Application intent engine • Infrastructure monitoring • Contiv (Infra Policy Enforcement)

@mongrelion 47 Shipped overview

@mongrelion 48 Shipped overview Application Intent

@mongrelion Shipped - Implementing App Intent - Scaling

@mongrelion 52

@mongrelion 53 Security Service discovery Orchestration Networking Persistence Monitoring Cluster Management How to build them? How to run them? Infrastructure monitoring? Policies? How to ship them? Cloud or on-premises? Auto-scaling?

@mongrelion Thanks, links & more 54 MANTL: mantl.io (contribute on ) Shipped: ciscoshipped.io (open beta) Microservices: Applications & Microservices with Docker & Containers - thenewstack.io martinfowler.com/articles/microservices.html Docker : Using Docker - Adrian Mouat Blogs: blogs.cisco.com/cloud container-solutions.com/blog

Microservices infrastructure with Terraform, Co...

Microservices infrastructure with Terraform, Consul and Vault

More Decks by mongrelion

Other Decks in Technology

Featured

Transcript