Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
HDC24: A Life without VMs: High-Scale Kubernete...
Search
Martin Helmich
August 30, 2024
Technology
94
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
HDC24: A Life without VMs: High-Scale Kubernetes on Bare Metal
Martin Helmich
August 30, 2024
Transcript
32 slides
VIKTOR ABRAMS @mittwald MARTIN HELMICH @mittwald A LIFE WITHOUT VMs
HIGH - SCALE KUBERNETES ON BARE METAL HELLMANN DEVELOPER & MAKER CONFERENCE August 30th, 2024
https://web.archive.org/web/20040829084706/http://www.espelkamper-nachrichten.de/ MY FIRST ( PAID ) WEBSITE
HOSTING BACK THEN
HOSTING BACK THEN
APACHE PHP MYSQL HOSTING BACK THEN
APACHE PHP MYSQL ... AND NOW OPENSEARCH KEYCLOAK MOBILE APP
...OR NODE.JS DOCKER PWA NGINX 💥 ...OR P CDN HOSTING BACK THEN BOOP VARNISH
None
MITTWALD CLOUD PLATFORM ARCHITECTURAL GOALS FLEXIBILITY RESOURCE EFFICIENCY ( INTERNAL
) EASE OF USE *) apart from obvious ones, like security, reliability and performance *
MITTWALD CLOUD PLATFORM ARCHITECTURAL GOALS FLEXIBILITY STANDARDS CONFORMANCE KUBERNETES/COE CONTAINERIZED
CUSTOMIZABLE OCI IMAGES QUALITY GOAL SOLUTION STRATEGY RESOURCE EFFICIENCY ELASTICITY OPTIMIZED SCHEDULING ( INTERNAL ) EASE OF USE DECLARATIVE APIS KUBERNETES OPERATORS
NODE BASIC KUBERNETES PRINCIPLES NODE NODE CLUSTER YEET USER POD
POD POD POD ( SLIGHTLY SIMPLIFIED ) POD
martin @ local $ mw app install typo3 -q --version=12.4.17
--install-mode composer [...] martin @ local $ kubectl get pods --all-namespaces \ --field-selector spec.nodeName=shoot--chp-prod--gestringen-pm-sps-3669c938-z1-797d7-gtfmz NAMESPACE NAME READY STATUS RESTARTS AGE kube-system node-local-dns-69btw 1/1 Running 0 36d kube-system node-problem-detector-2bq2z 1/1 Running 0 36d kube-system openstack-manila-csi-nodeplugin-sk8sm 2/2 Running 0 36d monitoring kube-prometheus-stack-prometheus-node-exporter-dnq9l 1/1 Running 0 36d monitoring loki-stack-promtail-mntw2 1/1 Running 0 36d pg-s-piryq0 mysql-default-80-low-latency-knlw2-0 1/1 Running 0 12s pg-s-piryq0 p-elfmx0-64db467d4b-qzmdv 2/2 Running 0 2d20h pg-s-piryq0 p-elfmx0-l2qzd-b79b7fdf6-qxjl4 2/2 Running 0 12s pg-s-piryq0 p-elfmx0-logrotation-28698480-47mvh 0/1 Completed 0 23h
DEPLOYMENT REPLICASET POD STATEFULSET DAEMONSET SERVICE INGRESS INGRESS CLASS PERSISTENT
VOLUME PERSISTENT VOLUMECLAIM STORAGE CLASS JOB CRON JOB CERTIFICATE SECRET CONFIG MAP NODE
None
ABSTRACTION
DEPLOYMENT REPLICASET POD STATEFULSET DAEMONSET SERVICE INGRESS INGRESS PERSISTENT VOLUME
PERSISTENT VOLUMECLAIM STORAGE CLASS JOB CRON JOB CERTIFICATE SECRET CONFIG MAP NODE KUBERNTES CORE CONCEPTS PROJECT CUSTOMER PROJECT GROUP APP DATABASE DOMAIN HOSTING DOMAIN MODEL
apiVersion: apphosting.mittwald.cloud/v1 kind: App metadata: name: a-XXXXX namespace: s-YYYYY spec:
app: typo3 version: 12.4.17 project: name: p-ZZZZZ requirements: - name: php version: ^8.3 - name: composer version: ^2 installPath: /my-typo3-site
CUSTOM RESOURCE CONTROLLER KUBERNETES API USER create / update watch
notify reconcile desired state control loop
None
PRODUCT SPECIFIC K8S OPERATORS K8S CORE COMPONENTS
MACRO ARCHITECTURE PRODUCT SPECIFIC MICROSERVICES PRODUCT SPECIFIC K8S OPERATORS K8S
CORE COMPONENTS IaaS CLOUD DATA CENTER
ORGANIZATIONAL STRUCTURE PRODUCT SPECIFIC MICROSERVICES PRODUCT SPECIFIC K8S OPERATORS K8S
CORE COMPONENTS IaaS CLOUD DATA CENTER PRODUCT DEV TEAMS CLOUD PLATFORM TEAM IaaS + NETWORK TEAM DATA CENTER OPERATIONS
UNDER THE HOOD
WHAT IS YOUR PRODUCT? AND WHAT DO YOU NEED TO
RUN IT?
m³ ( Pronunciation: "m-cubed") NATIVE KUBERNETES WEBHOSTING
m³ ( Pronunciation: "m-cubed") VISIBILITY RESOURCE MANAGEMENT BARE METAL PROVISIONING
VIRTUAL CLUSTERS ROUTE REFLECTION MAIN GOALS
/etc /mnt /srv httpd php-fpm sshd VISIBILITY NAMESPACES /home python
/mnt /var httpd /mnt /etc /srv httpd php-fpm MySQL 1. Processes 2. File system 3. Network
RESOURCE MANAGEMENT CONTROL GROUPS cpu1 cpu2 cpu3 httpd node php-fpm
1. Memory 2. Compute 3. I/O
BARE METAL PROVISIONING control- plane worker worker worker Rack 1
control - plane worker worker worker Rack 2 control - plane worker worker Rack 3 netbox Adapter dhcp bootp cloud- init CORE BGP EFI RAID EFI RAID LVM root Volume 1..n BGP worker cloud- image
VIRTUAL CLUSTERS systemd cri-o kubelet ... systemd cri-o kubelet ...
systemd cri-o kubelet ... systemd cri-o kubelet ... Control-Plane Worker 1 Worker 2 Worker N kluster.m3.services Cluster Workergroup Cluster-Operator
ROUTE REFLECTION vnode 1 vnode 2 vnode 3 vnode 5
vnode 4 SWITCH 1 SWITCH 2 frr frr NODE 1 NODE 2
MAIN GOALS _ IP DUAL STACK _ PERFORMANCE FIRST _
MANAGEABLE UNITS (no micromanagement) _ COMPLETE INVENTORY OVERVIEW (datacenter infrastructure management; DCIM ) _ COMPLEXITY REDUCTION i.e.: less abstraction (compute, network, ...)
https://github.com/mittwald https://github.com/martin-helmich https://www.mittwald.de https://www.linkedin.com/company/mittwald https://www.linkedin.com/in/martinhelmich
More Decks by Martin Helmich
See All by Martin Helmich
Contao Summit 26: AI is eating your CMS
martinhelmich
0
76
DrupalCon26: From Firefighting to Sleeping at Night
martinhelmich
0
20
T3DD26: From RAGs to Riches
martinhelmich
0
230
NEOSCon26: AI is eating your CMS
martinhelmich
0
82
CloudFest 2026: From Firefighting to Sleeping At Night
martinhelmich
0
55
WebCamp Venlo 26: AI is eating your CMS
martinhelmich
0
53
T3CON25: AI is eating your servers... and your CMS
martinhelmich
0
71
T3CB25: MCP – The Duct Tape of the AI era?
martinhelmich
0
110
T3CL25: Cloud-Native TYPO3
martinhelmich
0
110
Other Decks in Technology
See All in Technology
PHPで家庭用ゲーム機の専用コントローラーをMIDIデバイスとして扱ってみる
wind111
0
190
[関西Kaggler会 20261113] 続・コミュニティコンペのススメ
nejumi
0
190
[NW-JAWS DAY]「うちのAWS、インターネット出られないんで」― AWS外の自社サービスをPrivateLinkでシュッと公開する方法
ykimi
3
910
さようならSSH鍵、こんにちはゼロトラスト ― AIフレンドリーで快適な自宅鯖SSH
atalie2m
14
7.3k
Kansai WordPress Meetup@大阪『ブロックテーマを作る上で知っておくべきこと
torounit
0
260
現地速報! Microsoft Ignite アップデートレポート
kasada
1
420
自動計装なしでECSサービスをApplication Signalsに載せるまで
ota1022
2
460
Terraform 0 to 100:100個以上のリポジトリを常に最新にし続けるための自動化
sue445
3
1.3k
文書画像からの情報抽出を行うエージェントを、軌跡の正解データ無しで作れるか
sansantech
PRO
2
220
コピーオンライト型ファイルシステムと ランダム書き込み
sat
PRO
2
130
AWS Client VPNの設定でハマったポイントとその過程での気づき
amarelo_n24
1
430
メール到達性を支える、リンク先URLのドメイン評価の扱い方
wind111
0
190
Featured
See All Featured
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
46
3.1k
Data-driven link building: lessons from a $708K investment (BrightonSEO talk)
szymonslowik
1
1.4k
How to Grow Your eCommerce with AI & Automation
katarinadahlin
PRO
2
360
The Cost Of JavaScript in 2023
addyosmani
56
10k
Art, The Web, and Tiny UX
lynnandtonic
304
22k
The SEO Collaboration Effect
kristinabergwall1
1
620
Building an army of robots
kneath
307
47k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
kimpetersen
PRO
1
880
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
10
1.4k
Color Theory Basics | Prateek | Gurzu
gurzu
1
530
Faster Mobile Websites
deanohume
310
32k
For a Future-Friendly Web
brad_frost
184
11k