Automated-Dataload-UsingPuppet

Demonstrates puppet code to load data in a database

Transcript

1. Name: Nalini Patel Role: DevOps/Automation Engineer Tools: Puppet, Shell, Git, Stash, Bamboo, Jira Infrastructure Size: 9 Live dev & test environments per project for Agile dev teams 32 nodes/servers in each environment 288 total nodes provisioned using Puppet to enable CI/CD in a single project.
2.  Why it matters to automate data- load  Automation using Puppet & Atlassian tools  Quick Demo
3. 1. Is any system usable without Data? 2. Reduces dependency and bottle-neck over DBAs. DBAs can do more productive & innovative tasks. 3. Quick turn around time in delivering an environment in Agile development practise. 4. Empowers the development / DevOps team to make SQL changes themselves and rebuild the Database Server 5. “To err is human , to not is automation.”
4. 3. Spins up an instance in AWS/VCloud 1. Puppet manifests + Hiera Configs + SQL files to be executed. And server spec tests to validate DB objects 2. Git commit triggers the Bamboo Plan / Can schedule a periodic run of bamboo plan 4. Puppet installs & configures database, run SQL files to create schemas & inserts data 5. Runs server spec tests to validate all DB objects are created & data is loaded.
5. Init.pp
6. dataload.pp
7. Db.yaml
8. Running the bamboo job to provision the node
9. Sample Puppet logs
10. Server Spec Tests
11. nalinidpatel@yahoo.com