KubeCon 2024 - Building IT Green

In this session, we will explore Deutsche Bahn's ongoing efforts to monitor and minimize the ecological impact of our cloud-based applications. Central to this endeavor is collecting data on energy usage and empowering developers as agents of change to reduce the ecological costs of digitalization.

We will delve into how we enact this at three levels: 1) central platform operations to maximize node usage on K8s clusters; 2) providing tools for developers to ease workload scheduling and scaling; and 3) extending application monitoring for GreenOps with Kepler, Prometheus, and Grafana.

Furthermore, we will demonstrate how we integrate Kepler-exported metrics with Deutsche Bahn's data catalog and enterprise architecture management of thousands of cloud applications. These higher-level insights into our digital landscape are critical in enabling decision-makers to understand and optimize the financial and ecological impacts of the digitalization of our railways.

Transcript

1. Building IT Green A Journey of Platforms, Data and Developer Empowerment T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024
2. Politics: 1.5 ºC Climate change Ecological disasters 2 T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024
3. We need to shift traffic – on a massive scale – to a strong rail network, in order to achieve our climate targets T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 3 FOR THE CLIMATE. Strong Rail is critical to achieving the climate targets set by the German government and the two-degree target set globally. As such, Strong Rail is a source of hope in the fight against climate change. We must achieve those targets so that future generations can come of age in a livable world.
4. Global electricity demand from data centres, AI, and cryptocurrencies, 2019-2026 T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 4 0 200 400 600 800 1000 1200 2019 2020 2021 2022 2023 2024 2025 2026 Base case Low case High case the worst scenario: equivalent adding the electricity demand of Germany the best scenario: equivalent adding the electricity demand of Sweden Source: IEA, 2024
5. As part of our IT strategy work, we* asked ourselves: For which topics do we have to take a clear position and bear responsibility? Especially in the role of a publicly owned association? >16 companies that are regarded as one company by the customer. CEOs / CIOs Grassroots movement Green Digitalisation ... and founded the Group-wide Green Digitalisation initiative. Back in 2021/22, together with 16 DB CIOs, we defined 'Green IT' as a relevant topic T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 5
6. Can we measure our cloud footprint? T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 6 Assignment to Application (Tag Support) Granularity Actuality Energy use Emissions before compensation
7. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 7 Copyright © 2024 BBC
8. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 Source: Fischer, M. et al. (2023). The Concept of Sustainable Development. In: Sustainable Business. SpringerBriefs in Business. Springer, Cham. https://doi.org/10.1007/978-3-031-25397-3_2
9. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 9 Developers.
10. build IT: Deutsche Bahn‘s technology platforms T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 10
11. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 11 Kubernetes.
12. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 12 Scaling 70% is the average CPU utilization of our shared clusters only 15% of the CPU are effectively used by the applications
13. Once it runs, no one cares T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 13 Setting up a Vertical Pod Autoscaler (VPA) apiVersion: autoscaling.k8s.io/v1 kind: VerticalPodAutoscaler metadata: name: my-vpa spec: targetRef: apiVersion: apps/v1 kind: Deployment name: my-application updatePolicy: updateMode: Auto Defining requests & limits apiVersion: apps/v1 kind: Deployment metadata: name: my-application spec: template: spec: containers: - name: my-container image: my-container-image resources: requests: memory: "512Mi" cpu: "250m" limits: memory: "1Gi" cpu: "500m" Out with expensive guesswork VPA ftw!
14. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 14 Scheduling
15. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 kubectl annotate deployment example 'downscaler/uptime=Mon-Fri 09:00-17:00 Europe/Paris'
16. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 16 Visibility. Information.
17. Energy and CO2 -emissions in near-real-time Kepler (Kubernetes-based Efficient Power Level Exporter) and Grafana T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 17 Energy Mix Hourly mix and CO2 intensity per country eBPF energy stats eBPF tracepoints and perf counters Cluster Metrics Prometheus metrics, exported from Kubernetes Clusters Control Optimize DB Systel or DB Partner Power estimation Through kepler online learning model server Grafana Annotations Alerts Software Artefacts develops deploys watches Developer Observe Dashboard Platform user
18. Enterprise readiness? Security first! T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 18
19. Enterprise readiness? Prepare for scale! T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 19
20. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 20 Data.
21. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 21
22. Observability Green Dashboard T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 22
23. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 23
24. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 24 build IT Green Enterprise Architecture Management Prototypes provided by
25. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 25 Start.
26. T-Resort | DB Systel GmbH | Dr. Gualter Barbas Baptista | | KubeCon Paris | Mar 21st 2024 26 Empower.
27. Gualter Baptista Lead Consultant Platform Strategy and Enablement gualter.baptista@deutschebahn.com Let‘s stick together! Felix Becker Senior Manager Internal Developer Platforms felix.f.becker@deutschebahn.com Christian Berger Product Owner Developer Experience Platform christian.berger@deutschebahn.com Bastien Grasnick DevOps Engineer Kubernetes Platforms bastien.grasnick@deutschebahn.com