Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A One stop solution for Puppet and Openstack -...
Search
Daniel Lobato García
August 23, 2013
Programming
2
180
A One stop solution for Puppet and Openstack - PuppetConf 13'
Daniel Lobato García
August 23, 2013
Tweet
Share
More Decks by Daniel Lobato García
See All by Daniel Lobato García
Computational Photography portfolio
elobato
1
3.3k
Intro to Foreman 2017 (cfgmgmtcamp Gent)
elobato
0
140
20 tips to secure your Rails application
elobato
0
110
20 actionable tips to secure your Rails application - Rails Israel '15
elobato
3
360
Foreman in the last year - Puppet NYC at Spotify
elobato
0
140
Foreman - from git init to official plugin
elobato
0
210
Provision and manage Docker containers with Foreman
elobato
0
670
Contributing to Foreman: where and how
elobato
0
85
Provision and manage Docker containers with Foreman
elobato
3
3.9k
Other Decks in Programming
See All in Programming
NixOS + Kubernetesで構築する自宅サーバーのすべて
ichi_h3
0
530
あなたとKaigi on Rails / Kaigi on Rails + You
shimoju
0
120
Web Components で実現する Hotwire とフロントエンドフレームワークの橋渡し / Bridging with Web Components
da1chi
3
2k
2分台で1500examples完走!爆速CIを支える環境構築術 - Kaigi on Rails 2025
falcon8823
3
3.5k
Swift Concurrency - 状態監視の罠
objectiveaudio
2
510
複雑化したリポジトリをなんとかした話 pipenvからuvによるモノレポ構成への移行
satoshi256kbyte
1
1k
Cloudflare AgentsとAI SDKでAIエージェントを作ってみた
briete
0
140
SpecKitでどこまでできる? コストはどれくらい?
leveragestech
0
670
Signals & Resource API in Angular: 3 Effective Rules for Your Architecture @BASTA 2025 in Mainz
manfredsteyer
PRO
0
120
Web フロントエンドエンジニアに開かれる AI Agent プロダクト開発 - Vercel AI SDK を観察して AI Agent と仲良くなろう! #FEC余熱NIGHT
izumin5210
3
500
育てるアーキテクチャ:戦い抜くPythonマイクロサービスの設計と進化戦略
fujidomoe
1
170
CSC509 Lecture 05
javiergs
PRO
0
300
Featured
See All Featured
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Build your cross-platform service in a week with App Engine
jlugia
232
18k
Build The Right Thing And Hit Your Dates
maggiecrowley
37
2.9k
Six Lessons from altMBA
skipperchong
28
4k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.7k
How to Ace a Technical Interview
jacobian
280
24k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.7k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
15
1.7k
The Invisible Side of Design
smashingmag
301
51k
BBQ
matthewcrist
89
9.8k
A Modern Web Designer's Workflow
chriscoyier
697
190k
Thoughts on Productivity
jonyablonski
70
4.9k
Transcript
A one stop solution for Puppet and Openstack Daniel Lobato
Garcia daniel.lobato.garcia@cern,ch @eLobatoss
None
What is CERN Between Geneva and the Jura mountains, straddling
the Swiss- French border Mission: learn what is the universe made of and how does it work? 3
Fundamental questions in physics Why do particles have mass? What
is 96% of the universe made of? Why isn’t there anti-matter in the universe? What was the state of matter after the Big Bang? 4
8/12/2013 Document reference 5
8/12/2013 Document reference 6
8/12/2013 Document reference 7
8/12/2013 Document reference 8
Current status • 270 Openstack hypervisors • 2900 virtual machines
• 300 users • 14 Puppet masters • 6 Foreman backend nodes • Some production services migrating to our cloud – early birds 9
Goals • Ramp up to 15K hypervisors – 150-200K vms
in 2015 • Multi-site (Hungary) 10
8/12/2013 Document reference 11
8/12/2013 Document reference 12
Why? • Unnecessary homebrew stack of tools • Shift to
cloud standards with minimal customizations • High turnover – can’t teach new tools 13
Why? • Symbiotic relationship with the community 14
Openstack? • Modular IaaS free open source project • APIs
~compatible with those of Amazon 15
Openstack Nova (compute) Cloud fabric controller 16
Openstack Keystone (Identity) RBAC Integrated with LDAP Multiple auth* methods
17
Openstack Glance (Images) Discovery, registration, delivery of images 18
Openstack Horizon (Dashboard) 19
Modules • Puppet definitions for every use case you can
imagine. • Dynamic environments • Hadoop node • Openstack hypervisor • … you name it 20
21 Workflow..?
Modules and Git • Manifests and hieradata are version controlled
22
23 Git workflow Puppet masters
24 Easy cherry pick
25 Git workflow
26 Git workflow Jens ‘Puppetfiles’ Separate repositories Makes environments from
YAML config files Puppet master rsync
27 upstream.yaml --- default: production notifications:
[email protected]
overrides: modules: foreman:
upstream puppet: upstream ‘Puppetfiles’
Foreman • Lifecycle management tool for VMs and physical servers
• External Node Classifier – tells the puppet master what a node should look like 28
29
30
Power operations & Foreman 8/12/2013 Document reference 31 Foreman Proxy
Physical box IPMI Physical box IPMI Physical box IPMI VM VM VM Openstack Nova API
Openstack VM creation 8/12/2013 Document reference 32
Openstack VM creation 8/12/2013 Document reference 33
Openstack VM creation 8/12/2013 Document reference 34
Scalability experiences • Split up services • Puppet – critical
vs non critical 35 12 backend nodes Batch 4 backend nodes Interactive
Scalability experiences • Foreman – split into different services 36
ENC Reports processing UI/API Load balancer 9443 – UI/API 9444 – Reports 9445 – ENC …
Scalability experiences • Autoscale via alarms (Heat) • Define situations
(i.e: load threshold..) • Spin up VMs as needed 37
Scalability guidelines 38
github.com / cernops 39
40
None