Infrataster ~ Infra Behavior Testing Framework ~ Ryota Arai

Self Introduction

Ryota Arai ߥҪ ྑଠ Infrastructure Engineer ! 2013.04~ GREE, Inc 2014.03~ COOKPAD, Inc ! https://twitter.com/ryot_a_rai https://github.com/ryotarai

Infrataster tast‧er [countable] 1. someone whose job is to test the quality of foods, teas, wines etc by tasting them (Longman Dictionary)

Infrastructure as Code Automate building infra by code ! with Chef, Puppet, Ansible and also shell scripts # Example: Chef # install apache package 'apache2' do action :install end ! # start apache service 'apache2' do action :start end

What is Infrataster? Infrastructure Behavior Testing Framework ! It tests infrastructure's behavior from outside of servers.

What is Infrataster? describe server(:proxy) do describe http('http://app.example.com') do it "returns content including 'app'" do expect(response.body).to include('app') end end ! describe http('http://static.example.com') do it "returns content including 'static'" do expect(response.body).to include('static') end end end

What is Infrataster? $ rspec ! server 'proxy' http 'http://app.example.com' returns content including 'app' http 'http://static.example.com' returns content including 'static' ! Finished in 8.87 seconds 2 examples, 0 failures

Behavior Testing Framework? Apache MySQL Browser (User) Application server

Behavior Testing Framework? Apache MySQL Browser (User) ☓ Application ☓ server

Behavior Testing Framework? Apache MySQL Browser (User) Application iptables GRANT server

Behavior Testing Framework? ? Infrataster Check MySQL query response Check HTTP response target server

Behavior Testing Framework? Apache MySQL Config Check file content Is Apache running? Is port 80 opened? Is MySQL running? ? whitebox blackbox Infrataster Check MySQL query response Check HTTP response target server Serverspec

Test Driven Infrastructure RED GREEN RED GREEN Infrataster

Getting Started $ bundle install $ rspec --init # spec/spec_helper.rb require 'infrataster/rspec' # Gemfile source 'https://rubygems.org' gem 'infrataster'

Create VM with Vagrant # Vagrantfile Vagrant.configure("2") do |config| config.vm.box = "hashicorp/precise64" ! config.vm.define :proxy do |c| c.vm.network "private_network", ip: "192.168.33.10" c.vm.network "private_network", ip: "171.16.33.10", virtualbox__intnet: "infrataster-example" end ! config.vm.define :app do |c| c.vm.network "private_network", ip: "171.16.33.11", virtualbox__intnet: "infrataster-example" end end

Define Servers VM Host Proxy 192.168.33.10 (172.16.33.10) Infrataster::Server.define( :proxy, # name '192.168.0.0/16', # ip address vagrant: true # for vagrant VM )

Define Servers VM Host Proxy 192.168.33.10 (172.16.33.10) Infrataster::Server.define( :proxy, # name '192.168.0.0/16', # ip address vagrant: true # for vagrant VM ) Auto detect Auto SSH config

Define Servers VM Host Proxy 192.168.33.10 (172.16.33.10) App 172.16.33.11 SSH Port Forwarding Infrataster::Server.define( :proxy, # name '192.168.0.0/16', # ip address vagrant: true # for vagrant VM ) ! Infrataster::Server.define( :app, # name '172.16.0.0/16', # ip address vagrant: true, # for vagrant VM from: :proxy # test from proxy )

Define Servers VM Host Proxy 192.168.33.10 (172.16.33.10) App 172.16.33.11 SSH Port Forwarding Infrataster::Server.define( :proxy, # name '192.168.0.0/16', # ip address vagrant: true # for vagrant VM ) ! Infrataster::Server.define( :app, # name '172.16.0.0/16', # ip address vagrant: true, # for vagrant VM from: :proxy # test from proxy ) Access from proxy by SSH port forwarding

'http' resource describe server(:proxy) do # 192.168.33.10 describe http('http://app') do it "responds content including 'Hello Sinatra'" do expect(response.body).to include('Hello Sinatra') end end describe http('http://static') do it "responds content including 'Welcome to nginx!'" do expect(response.body).to include('Welcome to nginx!') end end end

'http'resource describe server(:proxy) do # 192.168.33.10 describe http('http://app') do it "responds content including 'Hello Sinatra'" do expect(response.body).to include('Hello Sinatra') end end describe http('http://static') do it "responds content including 'Welcome to nginx!'" do expect(response.body).to include('Welcome to nginx!') end end end Access from proxy by SSH port forwarding VirtualHost support (Host header manipulation) response is a Faraday::Response (You can check status, header too)

‘capybara' resource describe server(:app) do # Test from proxy server describe capybara('http://app') do it "responds content including 'Hello Sinatra'" do visit '/' expect(page).to have_content('Hello Sinatra') end end end

'capybara' resource PhantomJS (Poltergeist) SSH SSH (proxy) app Visit http://127.0.0.1:XXXX (with Host:app header) Forward from 127.0.0.1:XXXX to app:80 Listen 80 describe server(:app) do # Test from proxy server describe capybara('http://app') do it "responds content including 'Hello Sinatra'" do visit '/' expect(page).to have_content('Hello Sinatra') end end end

'capybara' resource (#2) describe server(:app) do describe capybara('http://app') do before { page.driver.clear_network_traffic } specify "all resources is loaded with success" do visit '/' page.driver.network_traffic.each do |req| req.response_parts.each do |res| expect(res.status).to be_between(200, 299) end end end end end

'mysql_query' resource describe server(:db) do describe mysql_query('SHOW STATUS') do it 'responds uptime' do row = results.find do |r| r['Variable_name'] == 'Uptime' end expect(row['Value'].to_i).to be > 0 end end end https://github.com/ryotarai/infrataster-plugin-mysql

Run Specs $ bundle exec rspec Run options: include {:focus=>true} ! All examples were filtered out; ignoring {:focus=>true} ! server 'app' from 'proxy' capybara 'http://app' responds content including 'Hello Sinatra' http 'http://app' responds content including 'Hello Sinatra' responds OK 200 responds as 'text/html' server 'proxy' http 'http://static' responds as 'text/html' responds content including 'Welcome to nginx!' … ! Finished in 17.92 seconds 11 examples, 0 failures ! Randomized with seed 12750

After Infrataster Test Passed $ curl http://server_tested_with_infrataster It always works!

infrataster.net