Upgrade to Pro — share decks privately, control downloads, hide ads and more …

從零開始導入 Singularity Container 歷程雜談

7b6c8d139f263f8435cd05c59bce0750?s=47 Frank Lin
January 13, 2021
Programming
1
85

從零開始導入 Singularity Container 歷程雜談

Cloud Native Taiwan 年末聚會 Lighting talks

7b6c8d139f263f8435cd05c59bce0750?s=128

Frank Lin

January 13, 2021
Tweet

More Decks by Frank Lin

See All by Frank Lin
DeepOps – An efficient way to deploy GPU cluster for computing
7b6c8d139f263f8435cd05c59bce0750?s=48 yylin1
0
240
Kubeflow 進行分散式深度學習訓練之作業排程瓶頸
7b6c8d139f263f8435cd05c59bce0750?s=48 yylin1
0
1k
Kubeflow 對於機器學習平台的願景
7b6c8d139f263f8435cd05c59bce0750?s=48 yylin1
1
840
kubeCon經驗分享-搭上KubeCon大船遇見 Kubeflow Community大牛們
7b6c8d139f263f8435cd05c59bce0750?s=48 yylin1
1
150
Kubeflow:容器機器學習實戰
7b6c8d139f263f8435cd05c59bce0750?s=48 yylin1
2
410

Other Decks in Programming

See All in Programming
Jetpack Compose, 어디까지 알고 있을까?
4d4d46ec84935e69f6f63b011873335d?s=48 jisungbin
0
120
こそこそアジャイル導入しようぜ！
08c43eecaeb20bad17d63e0e6964d9c2?s=48 ichimichi
0
1.3k
Licences open source : entre guerre de clochers et radicalité
323bb1cb39e6478e559b6e13d2fdf518?s=48 pylapp
2
510
Jetpack Composeでの画面遷移
A3799948f13d7633877b0eca0aa10333?s=48 iwata_n
0
190
Springin‘でみんなもクリエイターに！
000064025fd47aaaeda16b914f44cc79?s=48 ueponx
0
220
Get Ready for Jakarta EE 10
B489790e1a844284d7cd1fa2cd6e021f?s=48 ivargrimstad
0
1.1k
io22 extended What's new in app performance
82aa6e293e94bf37796f4ae50f583f6c?s=48 veronikapj
0
350
【Scrum Fest Osaka 2022】スクラムチームに放り込まれた若手エンジニアの皆さん、どのように技術のキャッチアップをしていくかイメージはついていますか？
70be36c6f5871b4f2d238f96587ffeb3?s=48 miiiki
0
120
短納期でローンチした新サービスをJavaで開発した話/launched new service using Java
B887cc104275187588fae7d58790563e?s=48 eichisanden
6
2k
Beyond Micro Frontends: Frontend Moduliths for the Enterprise @wad2022
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
PRO
0
140
オブジェクト指向で挫折する初学者へ
Dde759e35b9d62d448b3924502750a31?s=48 deepoil
0
190
NEWT.net: Frontend Technology Selection
A2040e0e2f7a6cabf81b54e4a401c0e8?s=48 xpromx
0
280

Featured

See All Featured
Fantastic passwords and where to find them - at NoRuKo
8ec1383b240b5ba15ffb9743fceb3c0e?s=48 philnash
27
1.5k
Automating Front-end Workflow
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1351
200k
Put a Button on it: Removing Barriers to Going Fast.
Bfd6b681ec6e8c9bef82ff0521c364f7?s=48 kastner
56
2.3k
Clear Off the Table
Ef32e0b1ac5082450dc8c1fca3a26b5c?s=48 cherdarchuk
79
280k
Art, The Web, and Tiny UX
D67fff74178013024d833b3eec6cf27f?s=48 lynnandtonic
280
17k
The Pragmatic Product Professional
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
19
3k
Designing with Data
F57e2136eb9895eb95ff5dc8a1c02677?s=48 zakiwarfel
91
3.9k
Agile that works and the tools we love
462dad0dd24c568a32dcdb0ae895ae1b?s=48 rasmusluckow
319
19k
Docker and Python
Ecdea9b9714877b86cee08458f085481?s=48 trallard
27
1.6k
jQuery: Nuts, Bolts and Bling
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
56
6.4k
Optimizing for Happiness
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
365
63k
Building Your Own Lightsaber
Fe6b81005d1553accd6b2a28f6a2bef1?s=48 phodgson
94
4.6k

Transcript

  1. 從零開始導入 Singularity Container 歷程雜談 Frank Lin

  2. Frank Lin 林義洋 • Infrastructure Engineer at Cadence • Co-organizer

    of Cloud Native Taiwan User Group

  3. 選擇 Contaienr Runtime • 安全性 • 效能減損問題 • Developer 對開發版本環境依賴性

  4. Singularity Container • 專門為HPC和深度學習(DL)工作負載開發，具備輕量資源開銷小、 啟動迅速、快速部署、方便遷移與擴展 • 無需 root 權限的特性廣受 HPC

    相關應用服務採用

  5. 選擇 Singularity Container • 限制容器使用者權限，使用者權限在容器內部和外部都是相同的 • 能直接在容器啟動目錄下切換環境, 無同步上問題，會有沒有進入容器的錯覺 • 授權

    fakeroot 就可以建立/修改自己需要的 image 環境, 無需 root 權限 • 可使用 Docker Hub / 的資源 • 簡單的 image / sandbox 概念設計 • 符合 OCI 標準, CRI 介面 • 單文件格式SIF增強環境遷徙

  6. Singularity 安利! - Linux Developer 都應該學習 Ref: https://champyen.blogspot.com/2020/10/linux-developer-container-singularity.html

  7. 可以一起從零開始 • 基本介紹 Ref: https://yylin.io/2020/06/16/singularity-introduction/

  8. k8s + singularity-cri

  9. Singularity CRI • Sylabs 供應商沒有計畫要持續支援 2019 !!!!!

  10. None

  11. k8s + singularity-cri

  12. 從零開始到放棄

  13. https://indico.cern.ch/event/757415/contributions/3421576/attachments/1856070/3048604/Solving_Problems_in_H PC_with_Singularity.pdf