© Copyright 2021 Rancher. All Rights Reserved. 1© Copyright 2021 Rancher. All Rights Reserved. 1Cloud Native Storage Meetup #1Longhorn17th Sep 2021Wenhan ShiSupport Engineer
View Slide
© Copyright 2021 Rancher. All Rights Reserved. 2⾃⼰紹介• 施 ⽂翰 (シ ブンカン) Wenhan Shi• 経歴• ⽇⽴製作所 - Linux カーネルモジュールの保守サポート• Red Hat K.K. - GlusterFS/OpenShift サポート• Canonical Japan K.K. - Ubuntu/OpenStack/Kubernetes サポート• Rancher Lab -> SUSE - Rancher及び周辺製品のサポート@shi_wenhan[email protected]
© Copyright 2021 Rancher. All Rights Reserved. 3Open SourceDistributed Block Storage Software for Kuberneteshttps://longhorn.io/
© Copyright 2021 Rancher. All Rights Reserved. 4Longhorn Web UI
© Copyright 2021 Rancher. All Rights Reserved. 5 5• volume rebuildの仕組み• v1.2.0の紹介
© Copyright 2021 Rancher. All Rights Reserved. 6 6• volume rebuildの仕組み• v1.2.0の紹介
© Copyright 2021 Rancher. All Rights Reserved. 7Longhorn Web UI• Volumeの各コピーのStatusが確認できる• データは各ノードの /var/lib/longhorn に保存
© Copyright 2021 Rancher. All Rights Reserved. 8アーキテクチャー
© Copyright 2021 Rancher. All Rights Reserved. 9アーキテクチャーEngine(Data Plane)Manager(Control Plane)
© Copyright 2021 Rancher. All Rights Reserved. 10アーキテクチャーWorkernodeLonghornnodeLonghornnodePodEnginemanager podPodReplicaManager PodReplicaManager PodEngineProcessReplicaProcessEngineProcessReplicaProcessExt4/xfs Ext4/xfsReplicaProcessExt4/xfsReplicaProcessExt4/xfsPVC/PVVolumePVC/PVVolumeLonghornManager(DS)LonghornManager(DS)LonghornManager(DS)
© Copyright 2021 Rancher. All Rights Reserved. 11エラーが突然やってくるmsg="pvc-c2a86740-04cb-4982-9d41-f86e07570d5e-e-254bed26:time="2021-08-22T22:13:30Z" level=error msg="Setting replicatcp://10.42.6.168:10075 to ERR due to: r/w timeout""
© Copyright 2021 Rancher. All Rights Reserved. 12アーキテクチャーWorkernodeLonghornnodeLonghornnodePodEnginemanager podPodReplicaManager PodReplicaManager PodEngineProcessReplicaProcessEngineProcessReplicaProcessExt4/xfs Ext4/xfsReplicaProcessExt4/xfsReplicaProcessExt4/xfsPVC/PVVolumePVC/PVVolumeLonghornManager(DS)LonghornManager(DS)LonghornManager(DS)msg="Prepare to deleteinstance pvc-c2a86740-04cb-4982-9d41-f86e07570d5e-r-cd767c21"
© Copyright 2021 Rancher. All Rights Reserved. 13その後は• ディスク上のDataはまだ利用可能• 新しいプロセスを作成• 差分だけコピー• dead -> onlineLonghornnodeReplicaManager PodReplicaProcessReplicaProcessExt4/xfs Ext4/xfsLonghornManager(DS)WorkernodePodEnginemanager podPodEngineProcessEngineProcessPVC/PVVolumePVC/PVVolumeLonghornManager(DS)ReplicaProcess
© Copyright 2021 Rancher. All Rights Reserved. 14その後は• replica-replenishment-wait-interval (600s)後でも回復不可• 新しいプロセスを作成• 健康状態のレプリカからフルコピー• dead -> onlineLonghornnodeReplicaManager PodReplicaProcessReplicaProcessExt4/xfs Ext4/xfsLonghornManager(DS)WorkernodePodEnginemanager podPodEngineProcessEngineProcessPVC/PVVolumePVC/PVVolumeLonghornManager(DS)ReplicaProcessExt4/xfs
© Copyright 2021 Rancher. All Rights Reserved. 15 15• volume rebuildの仕組み• v1.2.0の紹介
© Copyright 2021 Rancher. All Rights Reserved. 16https://github.com/longhorn/longhorn/releases/tag/v1.2.0Latest release: Longhorn 1.2.0
© Copyright 2021 Rancher. All Rights Reserved. 17v1.2.0 Hightlight• #1815 - [FEATURE] Support CSI volume cloning• Cloning support for the longhorn CSI driver• #1859 Volume Encryption / #902 backup encryption• #587 automatic rebalance the replicas• automatically check if a new replica can be scheduled on the new node to restore the redundancy.• #2206 Enhance Longhorn data plane on low performance enviroment
© Copyright 2021 Rancher. All Rights Reserved. 18v1.2.0 knownissue• #2964 [BUG] Longhorn 1.2.0 - wrong volume permissions inside container / broken fsGroup• Issue: Will get a Permission denied when access the folder.• WA: Add a --default-fstype=ext4 to the csi-provisioner container• Will be fixed in v1.2.1, which is scheduled to be released at September 24, 2021...containers:- args:- --v=2- --csi-address=$(ADDRESS)- --timeout=1m50s- --leader-election- --leader-election-namespace=$(POD_NAMESPACE)- --default-fstype=ext4env:...
© Copyright 2021 Rancher. All Rights Reserved. 19Information• Homepage• https://longhorn.io/• Documentation• https://longhorn.io/docs/• Roadmap• https://github.com/longhorn/longhorn/wiki/Roadmap• Development updates• https://github.com/longhorn/longhorn/milestones/
© Copyright 2021 Rancher. All Rights Reserved. 20 20Thank you