Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Argo workflow
Search
Surasit Liangpornrattana
December 19, 2019
Technology
1
100
Argo workflow
Surasit Liangpornrattana
December 19, 2019
Tweet
Share
More Decks by Surasit Liangpornrattana
See All by Surasit Liangpornrattana
Kafka Introduction
nengchakun
2
110
Data Engineering
nengchakun
2
1.2k
Other Decks in Technology
See All in Technology
コンテナセキュリティのためのLandlock入門
nullpo_head
2
320
あの日俺達が夢見たサーバレスアーキテクチャ/the-serverless-architecture-we-dreamed-of
tomoki10
0
450
kargoの魅力について伝える
magisystem0408
0
210
ゼロから創る横断SREチーム 挑戦と進化の軌跡
rvirus0817
2
270
NilAway による静的解析で「10 億ドル」を節約する #kyotogo / Kyoto Go 56th
ytaka23
3
380
宇宙ベンチャーにおける最近の情シス取り組みについて
axelmizu
0
110
オプトインカメラ:UWB測位を応用したオプトイン型のカメラ計測
matthewlujp
0
170
権威ドキュメントで振り返る2024 #年忘れセキュリティ2024
hirotomotaguchi
2
740
バクラクのドキュメント解析技術と実データにおける課題 / layerx-ccc-winter-2024
shimacos
2
1.1k
生成AIをより賢く エンジニアのための RAG入門 - Oracle AI Jam Session #20
kutsushitaneko
4
220
終了の危機にあった15年続くWebサービスを全力で存続させる - phpcon2024
yositosi
4
5.3k
PHPからGoへのマイグレーション for DMMアフィリエイト
yabakokobayashi
1
170
Featured
See All Featured
Unsuck your backbone
ammeep
669
57k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
28
2.1k
Building Better People: How to give real-time feedback that sticks.
wjessup
365
19k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
28
8.3k
Faster Mobile Websites
deanohume
305
30k
Raft: Consensus for Rubyists
vanstee
137
6.7k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
6.9k
Fashionably flexible responsive web design (full day workshop)
malarkey
405
66k
Six Lessons from altMBA
skipperchong
27
3.5k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
17
2.3k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
169
50k
Transcript
oueogfooeds.f.com BY SURASIT LIANGPORNRATTANA
WHAT IS THE PROBLEM? II En "E"
WORKFLOW # 㱺 ' 㱺 "E" A WORKFLOW CONSISTS of
AN ORCHESTRATED AND REPEATABLE PATTERN OF ACTIVITY - WIKIPEDIA
FLOW INPUT \ * Eq OUTPUT g { ^
DAG DIRECTED of D B - O EASES a A-cycle
o%% Igf) GRAPH of F
WORKFLOW MANAGERS
WHY NOT AIRFLOW ? ⾨t¥¥ TIME CONSTRAINT - INFRASTRUCTURE -
REDS - nxsal - MAINTAINABILITY
WHY ARGO ? IT 1185 CONTAINER- NATIVE - II Tta
- II PARALLEL JOBS
HOW ARGO WORKS ? > a.go submit task - /k"\
t.IE , CR D ET CONTROLLER
task . yaml -- CRD
HOW ARGO WORKS ? > argo submit task . yam
I - /k8SAP- IIE # ETCD CRD waackWh t ' CONTROLLER ⑦ - CREATES /EEEP3 PODS
DAGS A Bt § \ !
RESUBMIT > argo submit task . yaml PODS PODS /IsTEP/I
V i - - - - → /IsTEP/I ✓ I 1 ! i . . . . . . r - I Iv - - - f . - - - Hst3/ X > argo resubmit - - memorized workflow - name
ARTIFACTS 53 COMPATIBLE Igst/c- I - I
WHAT ABOUT SCHDULING ? less CRO N JOB d fz
← task . yami d) argo submit task . yaml
INTEGRATION & DEPLOYMENT f¥⊥o.]MANUALY BUILD EHR" " are CHECKOUT >
argo submit 11¥, task .yaml " I b d DOCKER - KUBECTLAPPLY PUSH DRONJOB
JOB MONITORING ARGO - U2 ENT HANDLER
ARGO VS AIRFLOW
GOOD PARTS VERY CAPABLE LIVE UI AND LOGGING UPDATE OFFER
TIMEOUT AND RETRIES CENTRALIZED LOADING ON less OPERATIONS VIA UI LANGUAGE - AGNOSTIC
BAD PARTS DEPLOYMENT K8S LEARNING CURVE PYTHON - ONLY STABILITY
OPERATIONS ONLY ON CLL
Q&A