T3CON23: Breaking the knot between Deployment and Infrastructure

In this talk, I illustrate how the deployment processes of web applications and web infrastructures interact and depend on each other, and how the constant drive for automation has changed these fields over the years. I present a high-level view on different state-of-the-art methodologies and tools for defining your infrastructure requirements in a declarative way, and how to redesign your deployment processes to make infrastructure definition a part of them. You will also learn about the many new opportunities this unlocks for your software development process and how to make use of them.

Transcript

1. @oilman https://unsplash.com/photos/4jJM2C8d4Ao TYPO3 Conference, October 13th, 2023 MARTIN HELMICH @mittwald INFRASTRUCTURE DEPLOYMENT AND BREAKING THE KNOT BETWEEN
2. MARTIN HELMICH Head of Architecture & Chief Tech Evangelist Lecturer, Software Engineering & Cloud Computing Sci-Fi-Nerd, Metalhead, Amateur Woodworker
4. INFRASTRUCTURE YOUR STUFF ?
5. HISTORY LESSON A SHORT
6. mittwald OFFICE THE (ENTIRE) (Oct. 2003, colorized)
9. INSPIRING FLOW (Apr. 2013, potato quality) https://twitter.com/bitloftDE/status/325141017831542784
12. BORING THAT WAS TEN YEARS AGO! WHERE DO WE STAND NOW? Matthew Henry https://unsplash.com/photos/6x-hVXXiBxs
13. SEE https://github.com/mittwald/deployer-recipes
14. INFRASTRUCTURE YOUR STUFF ✓ YOUR PROBLEM YOUR PROBLEM NOT OR IS IT?
15. PROD PREPROD ACCEPTANCE INTEGRATION TEST ONE APP MANY ENVIRONMENTS DEVELOPER ALICE DEVELOPER BOB DEVELOPER CHARLIE YOUR STUFF
16. WORKS ON MY MACHINE pen_ash https://pixabay.com/photos/ostrich-flightless-bird-bird-avian-4366263/
17. pen_ash https://pixabay.com/photos/ostrich-flightless-bird-bird-avian-4366263/ LOOKS LIKE YOU’RE SUFFERING FROM AN EXTREME CASE OF… ENVIRONMENT DISPARITY
18. INFRASTRUCTURE YOUR STUFF ? YOUR PROBLEM YOUR PROBLEM NOT OR IS IT?
19. DEPLOYMENT INFRASTRUCTURE AND
20. GOALS FOR SOFTWARE DEPLOYMENTS AUTOMATION REPEATABILITY TRANSPARENCY
21. INFRASTRUCTURE AS CODE – Define the DESIRED STATE of your infrastructure in a declarative way – Put that code into your VERSION CONTROL, and apply your usual software development process (code reviews, static analysis, CI/CD/, …) – THE GOAL: Achieve the same AUTOMATION and REPEATABILITY that you'd have for your regular software deployments.
22. DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS RUNTIME APPLICATION DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS RUNTIME APPLICATION DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS RUNTIME APPLICATION ON PREMISE IaaS PaaS YOUR PROBLEM NOT YOUR PROBLEM MORE CONTROL MORE PROBLEMS LESS CONTROL LESS PROBLEMS
23. > ID=$(mw app install typo3 --version=12.4.4 -q) > mw app dependency update $ID \ --set 'php=^8.2' \ --set 'graphicsmagick=*' \ --set 'nodejs=^20' UNRELATED: https://github.com/mittwald/cli
24. SEE https://www.terraform.io or https://opentofu.org provider "aws" { region = "eu-central-1" } resource "aws_instance" "app_server" { ami = "ami-XYZ" instance_type = "t2.micro" tags = { Name = "MyProjectAppServer" } } TERRA FORM
25. provider "mittwald" { api_key = "…" } resource "mittwald_project" "foobar" { server = var.server_id } resource "mittwald_db" "my_app_db" { kind = "mysql" version = "8" user { password = var.database_password } } resource "mittwald_app" "my_app" { project = mittwald_project.foobar.id database = mittwald_db.my_app_db.id dependency "php" { version = "^8.2" update_policy = "minor" } } SEE (EXPERIMENTAL!) https://github.com/mittwald/terraform-provider-mittwald
26. DALL·E
27. CONTAINERS ARE EVERYWHERE Niklas9416, https://pixabay.com/de/photos/hamburg-hafen-schiff-container-6849995/
28. DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS RUNTIME APPLICATION ON PREMISE DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS RUNTIME APPLICATION IaaS DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS RUNTIME APPLICATION PaaS YOUR PROBLEM NOT YOUR PROBLEM CaaS DATA CENTER NETWORKING STORAGE VIRTUALIZATION OS CONTAINER RUNTIME CONTAINER OS RUNTIME APPLICATION MORE CONTROL MORE PROBLEMS LESS CONTROL LESS PROBLEMS
29. FROM ubuntu:22.04 RUN apt-get update -y RUN apt-get install -y apache2 php-fpm USER www-data COPY . /app … DOCKERFILE version: "3" services: app: build: . ports: - 80:80 db: image: mysql:8 env: {…} DOCKER-COMPOSE.YML This is INFRASTRUCTURE AS CODE… THIS TOO
30. ✓ phpunit ✓ container-build ✓ container-deploy
31. INFRASTRUCTURE YOUR STUFF ! YOUR PROBLEM YOUR PROBLEM ALSO CONTAINER IMAGE YOUR STUFF REQUIRED ENVIRONMENT
32. PLAN & DESIGN DEVELOP & BUILD TEST DEPLOY & RELEASE OPERATE HOW MUCH ATTENTION YOU SHOULD PAY TO SECURITY SHIFT LEFT HOW MUCH IT COSTS YOU TO FIX A SECURITY ISSUE
33. ✓ phpunit ✓ container-build ✓ container-deploy ✓ scan-image
35. DEV❤OPS
36. TREAT YOUR DEPLOYMENT AS SOFTWARE. MAKE IT EASILY REPEATABLE. FOR BOTH SOFTWARE AND YOUR INFRASTRUCTURE
37. CHOOSE YOUR TOOLS Kenny Eliason https://unsplash.com/photos/60krlMMeWxU
38. Johannes Plenio https://unsplash.com/photos/aWDgqexSxA0 WHAT’S NEXT?
39. HOOKED ON CONTAINERS? https://github.com/mittwald/feature-requests/issues/1
40. https://twitter.com/dengolius/status/1448971644828065809