Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Cloud Native Storage Meetup #1 Longhorn

5da4f70462de256a566e68adfbb3ca03?s=47 Wenhan Shi
September 17, 2021
Technology
1
140

Cloud Native Storage Meetup #1 Longhorn

5da4f70462de256a566e68adfbb3ca03?s=128

Wenhan Shi

September 17, 2021
Tweet

More Decks by Wenhan Shi

See All by Wenhan Shi
Using Kong ingress controller for K3s
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
41
Kong Academyを日本語でお届け！#3
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
28
Kong Academyを日本語でお届け!#2
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
1
86
Kong Gateway 入門編-101
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
130
Fleet アーキテクチャ Deep Dive
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
110
[CNDT2021]Kubernetes GitOps with Rancher Continuous Delivery
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
59
[CNDT2021]Kubernetes GitOps with Rancher Continuous Delivery - Hands-on
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
13
どこでもKubernetes
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
0
150
CloudNative時代の機械学習基盤をk3s+jetsonではじめよう
5da4f70462de256a566e68adfbb3ca03?s=48 xibuka
1
270

Other Decks in Technology

See All in Technology
Target SDK Versionを上げない Notification runtime permission対応
0c5e92294cc0cfba620641c589db9378?s=48 napplecomputer
0
140
アーキテクチャを明文化して開発に臨んだ話
903c7dbf16067d22e7b03ead7d8acdc5?s=48 akkie76
0
340
LINEのB2Bプラットフォームにおけるトラブルシューティング２選
A3966f193f4bef226a0d3e3c1f728d7f?s=48 line_developers
PRO
4
300
データエンジニアと作るデータ文化
465cba0ac1de7e490c6ea484da327572?s=48 yuki_saito
4
1.6k
Scrum Fest Osaka 2022 段階的スクラムマスターのススメ
68073cc248e24e0b94cc6895e5c4710f?s=48 orimomo
0
800
QiitaConference2022
0684ef0f8b92614508e0c323c3619462?s=48 fuwasegu
0
190
Custom AppをIP制限ありのままで審査に通す方法
Df8bc8c531e2c5c89c1a007db1cf79a3?s=48 yusuga
0
680
雑な攻撃からELBを守る一工夫 ＋おまけ / Know-how to protect servers from miscellaneous attacks
8e8410eb785755ae2cb485f85dbab6e8?s=48 hiroga
0
530
Security Hub のマルチアカウント 管理・運用をサーバレスでやってみる
640727b1a8120669de9b6d7f1d469893?s=48 ch6noota
0
850
JAWS-UG re:Habilitaion 報告 / JAWS-UG OITA rehabilitation
5acaf9241f1c2e50f3bff920050ae597?s=48 hiranofumio
0
130
機械学習システムのアーキテクチャとデザインパターン
Ab00369879507922677a971b56cec3ae?s=48 washizaki
1
290
What's new in Vision
53e2d354b3299d64a54af680865516d5?s=48 satotakeshi
0
210

Featured

See All Featured
Support Driven Design
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
86
8.5k
We Have a Design System, Now What?
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
35
3k
Robots, Beer and Maslow
9375a9529679f1b42b567a640d775e7d?s=48 schacon
152
7.1k
The Art of Programming - Codeland 2020
719435d98d452de7ac367c828266cf01?s=48 erikaheidi
32
11k
What's in a price? How to price your products and services
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
229
9.4k
Java REST API Framework Comparison - PWX 2021
72a2082c6a4dd79ad68befb3db911616?s=48 mraible
PRO
11
4.7k
Ruby is Unlike a Banana
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
91
9.2k
How GitHub (no longer) Works
78b475797a14c84799063c7cd073962f?s=48 holman
296
140k
Testing 201, or: Great Expectations
A9704266587836f7e784235e5073b93e?s=48 jmmastey
21
5.4k
The Success of Rails: Ensuring Growth for the Next 100 Years
C44e1f7e22c3f23cff7bc130871047ef?s=48 eileencodes
10
3.4k
The Mythical Team-Month
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
209
39k
Adopting Sorbet at Scale
2bb923c57a1fdc3a2eb484bb8d565fd2?s=48 ufuk
63
7.6k

Transcript

  1. © Copyright 2021 Rancher. All Rights Reserved. 1 © Copyright

    2021 Rancher. All Rights Reserved. 1 Cloud Native Storage Meetup #1 Longhorn 17th Sep 2021 Wenhan Shi Support Engineer

  2. © Copyright 2021 Rancher. All Rights Reserved. 2 ⾃⼰紹介 •

    施 ⽂翰 （シ ブンカン） Wenhan Shi • 経歴 • ⽇⽴製作所 - Linux カーネルモジュールの保守サポート • Red Hat K.K. - GlusterFS/OpenShift サポート • Canonical Japan K.K. - Ubuntu/OpenStack/Kubernetes サポート • Rancher Lab -> SUSE - Rancher及び周辺製品のサポート @shi_wenhan wenhan.shi@suse.com

  3. © Copyright 2021 Rancher. All Rights Reserved. 3 Open Source

    Distributed Block Storage Software for Kubernetes https://longhorn.io/

  4. © Copyright 2021 Rancher. All Rights Reserved. 4 Longhorn Web

    UI

  5. © Copyright 2021 Rancher. All Rights Reserved. 5 5 •

    volume rebuildの仕組み • v1.2.0の紹介

  6. © Copyright 2021 Rancher. All Rights Reserved. 6 6 •

    volume rebuildの仕組み • v1.2.0の紹介

  7. © Copyright 2021 Rancher. All Rights Reserved. 7 Longhorn Web

    UI • Volumeの各コピーのStatusが確認できる • データは各ノードの /var/lib/longhorn に保存

  8. © Copyright 2021 Rancher. All Rights Reserved. 8 アーキテクチャー

  9. © Copyright 2021 Rancher. All Rights Reserved. 9 アーキテクチャー Engine

    (Data Plane) Manager (Control Plane)

  10. © Copyright 2021 Rancher. All Rights Reserved. 10 アーキテクチャー Worker

    node Longhorn node Longhorn node Pod Engine manager pod Pod Replica Manager Pod Replica Manager Pod Engine Process Replica Process Engine Process Replica Process Ext4/xfs Ext4/xfs Replica Process Ext4/xfs Replica Process Ext4/xfs PVC/PV Volume PVC/PV Volume Longhorn Manager (DS) Longhorn Manager (DS) Longhorn Manager (DS)

  11. © Copyright 2021 Rancher. All Rights Reserved. 11 エラーが突然やってくる msg="pvc-c2a86740-04cb-4982-9d41-f86e07570d5e-e-254bed26:

    time="2021-08-22T22:13:30Z" level=error msg="Setting replica tcp://10.42.6.168:10075 to ERR due to: r/w timeout""

  12. © Copyright 2021 Rancher. All Rights Reserved. 12 アーキテクチャー Worker

    node Longhorn node Longhorn node Pod Engine manager pod Pod Replica Manager Pod Replica Manager Pod Engine Process Replica Process Engine Process Replica Process Ext4/xfs Ext4/xfs Replica Process Ext4/xfs Replica Process Ext4/xfs PVC/PV Volume PVC/PV Volume Longhorn Manager (DS) Longhorn Manager (DS) Longhorn Manager (DS) msg="Prepare to delete instance pvc-c2a86740- 04cb-4982-9d41- f86e07570d5e-r-cd767c21"

  13. © Copyright 2021 Rancher. All Rights Reserved. 13 その後は •

    ディスク上のDataはまだ利用可能 • 新しいプロセスを作成 • 差分だけコピー • dead -> online Longhorn node Replica Manager Pod Replica Process Replica Process Ext4/xfs Ext4/xfs Longhorn Manager (DS) Worker node Pod Engine manager pod Pod Engine Process Engine Process PVC/PV Volume PVC/PV Volume Longhorn Manager (DS) Replica Process

  14. © Copyright 2021 Rancher. All Rights Reserved. 14 その後は •

    replica-replenishment-wait-interval (600s) 後でも回復不可 • 新しいプロセスを作成 • 健康状態のレプリカからフルコピー • dead -> online Longhorn node Replica Manager Pod Replica Process Replica Process Ext4/xfs Ext4/xfs Longhorn Manager (DS) Worker node Pod Engine manager pod Pod Engine Process Engine Process PVC/PV Volume PVC/PV Volume Longhorn Manager (DS) Replica Process Ext4/xfs

  15. © Copyright 2021 Rancher. All Rights Reserved. 15 15 •

    volume rebuildの仕組み • v1.2.0の紹介

  16. © Copyright 2021 Rancher. All Rights Reserved. 16 https://github.com/longhorn/longhorn/releases/tag/v1.2.0 Latest

    release: Longhorn 1.2.0

  17. © Copyright 2021 Rancher. All Rights Reserved. 17 v1.2.0 Hightlight

    • #1815 - [FEATURE] Support CSI volume cloning • Cloning support for the longhorn CSI driver • #1859 Volume Encryption / #902 backup encryption • #587 automatic rebalance the replicas • automatically check if a new replica can be scheduled on the new node to restore the redundancy. • #2206 Enhance Longhorn data plane on low performance enviroment

  18. © Copyright 2021 Rancher. All Rights Reserved. 18 v1.2.0 knownissue

    • #2964 [BUG] Longhorn 1.2.0 - wrong volume permissions inside container / broken fsGroup • Issue: Will get a Permission denied when access the folder. • WA: Add a --default-fstype=ext4 to the csi-provisioner container • Will be fixed in v1.2.1, which is scheduled to be released at September 24, 2021 ... containers: - args: - --v=2 - --csi-address=$(ADDRESS) - --timeout=1m50s - --leader-election - --leader-election-namespace=$(POD_NAMESPACE) - --default-fstype=ext4 env: ...

  19. © Copyright 2021 Rancher. All Rights Reserved. 19 Information •

    Homepage • https://longhorn.io/ • Documentation • https://longhorn.io/docs/ • Roadmap • https://github.com/longhorn/longhorn/wiki/Roadmap • Development updates • https://github.com/longhorn/longhorn/milestones/

  20. © Copyright 2021 Rancher. All Rights Reserved. 20 20 Thank

    you