$30 off During Our Annual Pro Sale. View Details »

從零開始導入 Singularity Container 歷程雜談

Avatar for Frank Lin Frank Lin
January 13, 2021
Programming
1
300

從零開始導入 Singularity Container 歷程雜談

Cloud Native Taiwan 年末聚會 Lighting talks

Avatar for Frank Lin

Frank Lin

January 13, 2021
Tweet

More Decks by Frank Lin

See All by Frank Lin
那些年我們在開源社群的日子 - Cloud Native Taiwan
Avatar for Frank Lin yylin1
0
270
DeepOps – An efficient way to deploy GPU cluster for computing
Avatar for Frank Lin yylin1
0
1.1k
Kubeflow 進行分散式深度學習訓練之作業排程瓶頸
Avatar for Frank Lin yylin1
0
1.4k
Kubeflow 對於機器學習平台的願景
Avatar for Frank Lin yylin1
1
1.2k
kubeCon經驗分享-搭上KubeCon大船遇見 Kubeflow Community大牛們
Avatar for Frank Lin yylin1
1
270
Kubeflow:容器機器學習實戰
Avatar for Frank Lin yylin1
2
590

Other Decks in Programming

See All in Programming
DSPy Meetup Tokyo #1 - はじめてのDSPy
Avatar for Masahiro Nishimi masahiro_nishimi
1
150
Evolving NEWT’s TypeScript Backend for the AI-Driven Era
Avatar for Rodrigo Ramirez xpromx
0
270
スタートアップを支える技術戦略と組織づくり
Avatar for pospome pospome
8
15k
tparseでgo testの出力を見やすくする
Avatar for utagawa kiki utgwkk
1
130
TypeScript 5.9 で使えるようになった import defer でパフォーマンス最適化を実現する
Avatar for おおいし bicstone
1
1k
Microservices Platforms: When Team Topologies Meets Microservices Patterns
Avatar for Chris Richardson cer
PRO
1
920
CSC305 Lecture 15
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
250
GeistFabrik and AI-augmented software development
Avatar for Ade Oshineye adewale
PRO
0
250
Navigation 3: 적응형 UI를 위한 앱 탐색
Avatar for Sungyong An fornewid
1
140
『実践MLOps』から学ぶ DevOps for ML
Avatar for Satsuki Nagae nsakki55
2
550
dotfiles 式年遷宮 令和最新版
Avatar for masawada masawada
1
680
[堅牢.py #1] テストを書かない研究者に送る、最初にテストを書く実験コード入門 / Let's start your ML project by writing tests
Avatar for Shunsuke KITADA shunk031
11
6.9k

Featured

See All Featured
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
230k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
127
17k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
697
190k
Fireside Chat
Avatar for paigeccino paigeccino
41
3.7k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
46
7.8k
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
24
3.8k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.6k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.5k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.4k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
120
20k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
54
7.9k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
162
23k

Transcript

  1. 從零開始導入 Singularity Container 歷程雜談 Frank Lin

  2. Frank Lin 林義洋 • Infrastructure Engineer at Cadence • Co-organizer

    of Cloud Native Taiwan User Group

  3. 選擇 Contaienr Runtime • 安全性 • 效能減損問題 • Developer 對開發版本環境依賴性

  4. Singularity Container • 專門為HPC和深度學習(DL)工作負載開發，具備輕量資源開銷小、 啟動迅速、快速部署、方便遷移與擴展 • 無需 root 權限的特性廣受 HPC

    相關應用服務採用

  5. 選擇 Singularity Container • 限制容器使用者權限，使用者權限在容器內部和外部都是相同的 • 能直接在容器啟動目錄下切換環境, 無同步上問題，會有沒有進入容器的錯覺 • 授權

    fakeroot 就可以建立/修改自己需要的 image 環境, 無需 root 權限 • 可使用 Docker Hub / 的資源 • 簡單的 image / sandbox 概念設計 • 符合 OCI 標準, CRI 介面 • 單文件格式SIF增強環境遷徙

  6. Singularity 安利! - Linux Developer 都應該學習 Ref: https://champyen.blogspot.com/2020/10/linux-developer-container-singularity.html

  7. 可以一起從零開始 • 基本介紹 Ref: https://yylin.io/2020/06/16/singularity-introduction/

  8. k8s + singularity-cri

  9. Singularity CRI • Sylabs 供應商沒有計畫要持續支援 2019 !!!!!

  10. None

  11. k8s + singularity-cri

  12. 從零開始到放棄

  13. https://indico.cern.ch/event/757415/contributions/3421576/attachments/1856070/3048604/Solving_Problems_in_H PC_with_Singularity.pdf