A Brief History of Cloud Infrastructure

A semi-autobiographical story of how Cloud infrastructure has evolved. Presented at CodeMill in Leeds, November 2017

You can view a recording of this talk at https://www.youtube.com/watch?v=op-I2wn5F5E

Transcript

1. A BRIEF HISTORY OF CLOUD INFRASTRUCTURE_ JON TOPPER | @jtopper | he/him/his
2. 1999 THE BAD OLD DAYS_
8. INSTALLING A NEW SERVER_
23. 1999 Weeks 0 1 2 3 4 Procurement Racking Config
24. 2000 GROWING UP_
26. NETWORK INSTALLATION_
29. 1999 2000 Weeks 0 1 2 3 4 Procurement Racking Config
30. 2001 THE HYPERVISOR_
31. HARDWARE KERNEL APP NATIVE HOST_ APP APP APP
32. HARDWARE HYPERVISOR HYPERVISOR_ VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP
33. MACHINE TEMPLATES_
35. 1999 2000 2001 VM 2001 Hypervisor Weeks 0 1 2 3 4 Procurement Racking Config
36. SPLIT RESPONSIBILITY_
37. HARDWARE HYPERVISOR VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP Infrastructure Applications
38. 2004: INFRASTRUCTURE AS CODE_
41. user { 'jtopper': ensure => present, uid => '1000', gid => '1000', shell => '/bin/bash', home => '/home/jtopper' } service { 'httpd': ensure => 'running' }
42. BENEFITS_ Faster Repeatability Testing Version Control Collaboration
43. 2006: AWS EC2_
45. HARDWARE HYPERVISOR VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP Infrastructure Applications
46. HARDWARE HYPERVISOR VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP Somebody Else's Problem Applications
48. BENEFITS_ Provisioning using APIs (As well as web console) Elastic scalability On-demand pricing No capital expenditure
50. { "variables": { "aws_access_key": "", "aws_secret_key": "" }, "builders": [{ "type": "amazon-ebs", "access_key": "{{user `aws_access_key`}}", "secret_key": "{{user `aws_secret_key`}}", "region": "us-east-1", "source_ami_filter": { "filters": { "virtualization-type": "hvm", "name": "ubuntu/images/*ubuntu-xenial-16.04-amd64-server-*", "root-device-type": "ebs" }, "owners": ["099720109477"], "most_recent": true }, "instance_type": "t2.micro", "ssh_username": "ubuntu", "ami_name": "packer-example {{timestamp}}" }] }
51. resource "aws_instance" "web" { instance_type = "t2.micro" # Lookup the correct AMI based on the region # we specified ami = "${lookup(var.aws_amis, var.aws_region)}" # The name of our SSH keypair we created above. key_name = "${aws_key_pair.auth.id}" # Our Security group to allow HTTP and SSH access vpc_security_group_ids = ["${aws_security_group.default.id}"] subnet_id = "${aws_subnet.default.id}" provisioner "remote-exec" { inline = [ "sudo apt-get -y update", "sudo apt-get -y install nginx", "sudo service nginx start", ] } }
52. 2013: CONTAINERS_
53. HARDWARE HYPERVISOR HYPERVISOR_ VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP VM VIRTUAL HW KERNEL APP APP APP
54. HARDWARE KERNEL APP CONTAINER HOST_ CONTAINER ENGINE BIN / LIB APP BIN / LIB APP BIN / LIB APP BIN / LIB
55. HARDWARE KERNEL APP CONTAINER HOST_ CONTAINER ENGINE BIN / LIB APP BIN / LIB APP BIN / LIB APP BIN / LIB Somebody Else's Problem Applications
57. FROM busybox MAINTAINER Chris <c@crccheck.com> ADD index.html /www/index.html EXPOSE 8000 # Create a basic webserver and sleep forever CMD httpd -p 8000 -h /www; tail -f /dev/null
58. BENEFITS_ Improved resource usage Unit of deploy is "a container" ...people think it's cool, I guess?
59. 2015: ORCHESTRATION_
62. 2017: SERVERLESS_
63. FUNCTION SERVERLESS PLATFORM_ Somebody Else's Problem Applications FUNCTION FUNCTION FUNCTION IDGAF
64. BENEFITS_ No infrastructure to care about Almost everything is someone else's problem
66. TODAY_ On-premise VMWare basically dead Traditional config management losing favour Packer / Terraform in heavy use The cool kids are using Kubernetes (But, really, don't run it yourself) Consider Lambda for async workloads Serverless likely to increase in popularity
67. KEEP IN TOUCH_ http:/ /www.scalefactory.com/ https:/ /github.com/scalefactory @scalefactory jon@scalefactory.com