Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Internship @ LSIIT
Search
Soulou
November 05, 2012
Research
0
49
Internship @ LSIIT
Creating an interface between SLURM and a AWS E2C-like IaaS Infrastructure
Soulou
November 05, 2012
Tweet
Share
More Decks by Soulou
See All by Soulou
How have we been building a containers-based PaaS these last 5 years?
soulou
0
110
Modern API Authentication 101
soulou
0
540
Logging in Go Microservices
soulou
0
190
Death to the Staging Environment
soulou
0
120
Mocking all the Things with Go
soulou
1
120
Docker, From utopia to reality
soulou
4
270
GoSXBGo! - Setup your environment
soulou
0
89
GoSXBGo! - Introduction to the language
soulou
0
140
Docker containers monitoring
soulou
8
13k
Other Decks in Research
See All in Research
VectorLLM: Human-like Extraction of Structured Building Contours via Multimodal LLMs
satai
4
190
問いを起点に、社会と共鳴する知を育む場へ
matsumoto_r
PRO
0
610
データxデジタルマップで拓く ミラノ発・地域共創最前線
mapconcierge4agu
0
210
[RSJ25] Enhancing VLA Performance in Understanding and Executing Free-form Instructions via Visual Prompt-based Paraphrasing
keio_smilab
PRO
0
100
MIRU2025 チュートリアル講演「ロボット基盤モデルの最前線」
haraduka
15
7.9k
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
ssii
PRO
4
4.2k
Google Agent Development Kit (ADK) 入門 🚀
mickey_kubo
2
1.7k
利用シーンを意識した推薦システム〜SpotifyとAmazonの事例から〜
kuri8ive
1
250
時系列データに対する解釈可能な 決定木クラスタリング
mickey_kubo
2
930
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
mickey_kubo
1
360
Type Theory as a Formal Basis of Natural Language Semantics
daikimatsuoka
1
290
電通総研の生成AI・エージェントの取り組みエンジニアリング業務向けAI活用事例紹介
isidaitc
1
940
Featured
See All Featured
Product Roadmaps are Hard
iamctodd
PRO
54
11k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
51
5.6k
Context Engineering - Making Every Token Count
addyosmani
1
23
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.7k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
8
520
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Statistics for Hackers
jakevdp
799
220k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.7k
Designing for humans not robots
tammielis
253
25k
Transcript
Stage @ LSIIT → ICPS Léo Unbekandt - 2012 -
ENSIIE
Comment et pourquoi ?
Contexte - calcul scientifique Cluster physique
Contexte - virtualisation Calcul parallèle Virtualisation
Contexte - cloud ✩ IaaS Infrastructure as a Service
Mon travail Créer un lien entre : ◦ Répartitions des
jobs
Mon travail Créer un lien entre : ◦ Répartitions des
jobs ◦ Gestion dynamique des machines virtuelles
Mon travail Créer un lien entre : ◦ Répartitions des
jobs ◦ Gestion dynamique des machines virtuelles ◦ Envoi des tâches
La répartition des tâches → Comment ?
La répartition des tâches Des stratégies : ✔ OneVM4All J1
J2 J3
La répartition des tâches Des stratégies : ✔ OneVM4All ✔
OneVMperJob J1 J2 J3 J2 J3 J1
La répartition des tâches Des stratégies : ✔ OneVM4All ✔
OneVMperJob J1 J2 J3 J2 J3 J1
Envoi des tâches Simple Linux Utility for Resource Management SLURM
Node 1 Node 2 Node 3 Node 4
Gestion des instances
Gestion des instances Compatibilité ?
Notre solution Perl SLURM Net::Amazon::EC2 Slurm API
Schlouder J'ai des calculs à faire ! Mes calculs ?
Schlouder - Stratégie - Script ... - VMs - États des jobs SLURM - Nouvelle VM - Éteindre VM - État VMs - Nouvelle tâche - État Nœud - État Job
Schlouder .----------------------------------------------------------------------------------------------------------------. | i-3B2606F6 - icps-vm-6 (19:09:49) + 58 |
+------+-------+-------------+------------+----------------------------+------------+----------------------------+ | ID | State | Name | Submission | Duration (real / in batch) | Start Date | End Date (real / in batch) | +------+-------+-------------+------------+----------------------------+------------+----------------------------+ | 3180 | F | all_466.mgf | 19:09:49 | (70 / 70) | 19:10:47 | (19:11:57 / 19:11:57) | | 3186 | F | all_467.mgf | 19:09:49 | (69 / 70) | 19:11:57 | (19:13:06 / 19:13:07) | | 3192 | F | all_468.mgf | 19:09:49 | (70 / 70) | 19:13:06 | (19:14:16 / 19:14:16) | | 3198 | F | all_469.mgf | 19:09:50 | (71 / 70) | 19:14:16 | (19:15:27 / 19:15:26) | | 3204 | F | all_46.mgf | 19:09:50 | (71 / 70) | 19:15:27 | (19:16:38 / 19:16:37) | | 3210 | F | all_470.mgf | 19:09:50 | (70 / 70) | 19:16:38 | (19:17:48 / 19:17:48) | | 3216 | F | all_471.mgf | 19:09:50 | (71 / 70) | 19:17:48 | (19:18:59 / 19:18:58) | | 3222 | F | all_472.mgf | 19:09:50 | (70 / 70) | 19:18:59 | (19:20:09 / 19:20:09) | | .... | . | ........... | ........ | ......... | ........ | ..................... | '------+-------+-------------+------------+----------------------------+------------+----------------------------'
Expérience acquise
Remerciements → Stéphane GENAUD → Julien GOSSA → Étienne MICHON
→ Vincent KHERBACHE ✽ Toute l'équipe ICPS