Share
Embed
失敗しない!Kubernetes向けストレージ選び5つのポイント
DBのようなデータを抱えるStatefulアプリケーションを動かすためには、Kubernetesと連携したストレージが必要不可欠です。特にプライベートクラウドでは、Kubernetesと相性の良いストレージを選ぶことが重要になります。本講演では、弊社で取り組んでいるStatefulアプリケーション向けKubernetesにおけるストレージ選びの5つのポイントについて紹介します。
Yukinori Sakashita
July 22, 2019
Transcript
58 slides
-
ࣗݾհ ‣ٕज़ݚڀΤϦΞ ӡ༻ཧٕज़ Ϋϥυ αʔόετϨʔδ ࣗಈࣗίϯϐϡʔςΟϯά
"*.- // ).. #BZFTJBO/FUXPSL ‣৬ྺ ૯߹ిػϝʔΧʔ 㾎ݚڀॴ ओݚڀһ 㾎ւ֎ݚڀॴ!γϦίϯόϨʔ ϥϘ αʔόϕϯμʔ ςΫχΧϧ4& !2 ࡔԼಙ ത࢜ :VLJOPSJ4BLBTIJUB 1I% ‣ ϠϑʔגࣜձࣾθοτϥϘגࣜձࣾ ‣ 4/*"ຊࢧ෦ٕज़ҕһձ෭ҕһ -
!4 σʔλอূ ίετ ӡ༻ମ੍ εΩϧ ΞϓϥΠΞϯε ηΩϡϦςΟ 4%4 044ετϨʔδ ੑೳ
%3#$1 όοΫΞοϓ ɹඪ४༷ 44%)%% -
:BIPP+"1"/ ‣ Ҏ্ͷ8FCαʔϏε χϡʔε ϠϑΦΫɺఱؾͳͲ Λఏڙ ‣ 8FCαʔϏεΛࢧ͑ΔΠϯϑϥڥ
,VCFSOFUFTΫϥελ ίϯςφ !8 ˞݄࣌ -
,VCFSOFUFTBTB4FSWJDF ‣ :BIPP+"1"/ͷ8FCαʔϏεͷҰ෦,VCFSOFUFT্ͰՔಇ ‣ Ϛωʔδυ,VCFSOFUFTαʔϏε ,VCFSOFUFTBTB4FSWJDF Λ։ൃ Ќ
(" ‣ ,VCFSOFUFTBTB4FSWJDF $BB4 ʹΑΓ1SPEVDUJWJUZͱ4VTUBJOBCJMJUZ্͕ ‣ ,VCFSOFUFTΫϥελΛӡ༻த !9 -
εςʔτϑϧڥͷࣄྫ ‣ $BB4͚ʹεςʔτϑϧڥΛߏங ‣ ;-BCʹͯӡ༻தͷ.Z42-Λ7.͔Β,VCFSOFUFTҠߦ ‣ ಈ࡞ͳ͠ɻεέʔϧΞτΞοϓσʔτͷཧੑ্͕ !13 4UPSFTSFDPSETUP%# 7.
TUPSBHF 7. 7 . ,VCFSOFUFT $*$% ;-BCQSJWBUFDMPVE -
εέʔϧ͢Δ.Z42-ͷҰྫ ‣ .Z42- .BTUFS4MBWFߏ ͷ4MBWFՃ࣌ͷߏஙεςοϓΛ࣮ ‣ .Z42-ͷߏஙεςοϓͷ͕ࣝͳ͍ཧऀͰεέʔϧՄೳ FHLVCFDUMTDBMFSFQMJDBTTUTNZTRM 7PMVNF
.BTUFS 4MBWF .BTUFS /FX .BTUFS /FX #BDLVQ%BUB -PH1PTJUJPO .BTUFS *NQPSUCBDLVQUPOFXOPEF /FX #BDLVQ%BUB -PH1PTJUJPO .BTUFS 4UBSU4MBWF 4MBWF 3FBE42- 8SJUF42- .Z42-$MJFOUT .Z42-.BTUFS4MBWF !14 %FQMPZOFXOPEF (FUCBDLVQGSPN.BTUFS 4DBMJOHQSPDFTT -
ίϯςφͰͷσʔλӬଓԽͱ !16 bin/lib Container App Logic Data bin/lib Container App
Logic Data ‣ աڈ ίϯςφεςʔτ σʔλ Λ࣋ͭ ΞϓϦ͕ۤख ίϯςφ͕σϓϩΠ͞ΕΔ σʔλ͕ॳظԽ ‣ ݱࡏ ࠒʙ ϩδοΫͱσʔλΛ σʔλΛ֎෦ετϨʔδʹอଘ ӬଓԽ -
,VCFSOFUFT !17 ‣ ίϯςφΦʔέετϨʔγϣϯͷ σϑΝΫτελϯμʔυ ‣ $/$'ͷΤίγεςϜͷத৺తଘࡏ $MPVE/BUJWF$PNQVUJOH'PVOEBUJPO ‣
ओͳػೳ 4FMGIFBMJOH )PSJ[POUBMTDBMJOH 4FSWJDFEJTDPWFSZBOEMPBECBMBODJOH "VUPNBUFESPMMPVUTBOESPMMCBDLT 4UPSBHFPSDIFTUSBUJPO -
‣ ,VCFSOFUFTW ` %ZOBNJD1SPWJTJPOJOH ‣ ,VCFSOFUFTW `
'MFY7PMVNF ‣ ,VCFSOFUFTW ` $4* "MQIB ‣ ,VCFSOFUFTW ` -PDBM7PMVNF #FUB ‣ ,VCFSOFUFTW ` 7PMVNF3FTJ[JOH !20 ‣ ,VCFSOFUFTW ` 7PMVNF4OBQTIPU "MQIB 5PQPMPHZ"XBSF7PMVNF 1SPWJTJPOJOH #FUB ‣ ,VCFSOFUFTW ` $4* (" ‣ ,VCFSOFUFTW ` -PDBM7PMVNF (" ‣ ,VCFSOFUFTW ` $4*7PMVNF$MPOJOH "MQIB ετϨʔδػೳͷαϙʔτཤྺ -
αϙʔτ͍ͯ͠Δ7PMVNFλΠϓ ‣ BXT&MBTUJD#MPDL4UPSF ‣ B[VSF%JTL ‣ B[VSF'JMF ‣ DFQIGT ‣
DJOEFS ‣ DPOpH.BQ ‣ DTJ ‣ EPXOXBSE"1* ‣ FNQUZ%JS ‣ GD pCSFDIBOOFM ‣ qFY7PMVNF ‣ qPDLFS ‣ HDF1FSTJTUFOU%JTL ‣ HJU3FQP EFQSFDBUFE !21 ‣ HMVTUFSGT ‣ IPTU1BUI ‣ JTDTJ ‣ MPDBM ‣ OGT ‣ QSPKFDUFE ‣ QPSUXPSY7PMVNF ‣ RVPCZUF ‣ SCE ‣ TDBMF*0 ‣ TFDSFU ‣ TUPSBHFT ‣ WTQIFSF7PMVNF ˞ݱࡏ -
0QFSBUPS)VCJP ‣ ,VCFSOFUFT0QFSBUPSͷύϒϦοΫϨδετϦ ‣ ެ։ !22 ΧςΰϦʔ ొ "*.BDIJOF-FBSOJOH
"QQMJDBUJPO3VOUJNF #JH%BUB $MPVE1SPWJEFS %BUBCBTF %FWFMPQFS5PPMT *OUFHSBUJPO%FMJWFSZ -PHHJOH5SBDJOH .POJUPSJOH /FUXPSLJOH 0QFO4IJGU0QUJPOBM 4FDVSJUZ 4UPSBHF 4USFBNJOH.FTTBHJOH ˞ݱࡏ -
ετϨʔδͷϞσϧ ‣ ϕϯμʔχϡʔτϥϧͳϞσϧ 1FSTJTUFOU7PMVNF$MBJN 1FSTJTUFOU7PMVNF 4UPSBHF$MBTT ‣
ཧऀͱϢʔβͷׂΛߟྀͨ͠Ϟσϧ ‣ ετϨʔδஔͷૢ࡞ͳ͠Ͱ7PMVNFΛ ίϯςφʹࣗಈͰϚϯτ !23 Ϣʔβ ཧऀ -
1FSTJTUFOU7PMVNF$MBJN 17$ ‣ 7PMVNFͷཁٻ༷Λද͢Ϧιʔε 4UPSBHFUZQF 4UPSBHF$MBTT໊ 7PMVNFTJ[F
"DDFTTNPEF !24 "DDFTT.PEF આ໌ 3FBE8SJUF0ODF ͭͷ/PEF͔Β3FBE8SJUFͰϚϯτͰ͖Δ 3FBE0OMZ.BOZ ෳͷ/PEF͔Β3FBE0OMZͰϚϯτͰ͖Δ 3FBE8SJUF.BOZ ෳͷ/PEF͔Β3FBE8SJUFͰϚϯτͰ͖Δ -
1FSTJTUFOU7PMVNF 17 ‣ 7PMVNFΛද͢Ϧιʔε 4UPSBHFUZQF 4UPSBHF$MBTT໊ 4J[F
"DDFTTNPEFT 3FDMBJNQPMJDZ w 3FUBJO w 3FDZDMF w %FMFUF !25 -
4UPSBHF$MBTT 4$ ‣ ετϨʔδϓʔϧΛද͢Ϟσϧ /BNF 3FDMBJNQPMJDZ 1SPWJTJPOFS
‣ 1SPWJTJPOFS͕ετϨʔδஔͷ "1*Λݺͼग़͠ !26 -
$4* $POUBJOFS4UPSBHF*OUFSGBDF ‣ ίϯςφΦʔέετϨʔγϣϯ͚ͷඪ४༷ ‣ ,VCFSOFUFTͰ4UPSBHF$MBTTͷ1SPWJTJPOFSͷΠϯλʔϑΣʔεͱͯ͠࠾༻ ‣ ݄ʹ࠷ॳͷύϒϦοΫϦϦʔε ‣ ओཁͳίϯςφΦʔέετϨʔγϣϯ͕࠾༻
,VCFSOFUFT $MPVE'PVOESZ .FTPT %PDLFS FUD ‣ ,VCFSOFUFTͷιʔεπϦʔ JOUSFF Ͱཧ͞Ε͍ͯͨετϨʔδஔʹ ؔ࿈͢Δ࣮͕ɺSEϕϯμͰಠࣗʹ։ൃఏڙ͢Δ͜ͱ͕Մೳ !27 -
$4*ͷΞʔΩςΫνϟ !28 $4*)FMQFS $POUBJOFS SE1BSUZ $4*7PMVNF %SJWFS$POUBJOFS /PEF1MVHJO %BFNPO4FU WBSMJCLVCFMFUQPET
ʜTPDLFUT FYUFSOBMBUUBDIFS FYUFSOBMQSPWJTJPOFS SE1BSUZ $4*7PMVNF %SJWFS$POUBJOFS $POUSPMMFS1MVHJO 4UBUFGVM4FU &NQUZ%JS7PMVNF /PEF ,VCFMFU $POUSPMMFS .BOBHFS "1* 4FSWFS .BTUFS FUDE H31$ 6%4 6%4 .PVOU 1SPQBHBUJPO 6%4 6%4 &YUFSOBM$PNQPOFOU$SFBUFECZSE1BSUZ7FOEPS &YUFSOBM$PNQPOFOU$SFBUFECZ,VCFSOFUFTUFBN 6%4 -
ετϨʔδͷ͍ํ ‣ 7PMVNFͷׂΓͯʹେ͖ͭ͘ͷํ๏ ‣ .BOVBM1SPWJTJPOJOH ཧऀ͕4UPSBHF$MBTTͱ1FSTJTUFOU7PMVNFΛࣄલʹσϓϩΠ Ϣʔβ1FSTJTUFOU7PMVNF$MBJNΛͬͯ1FSTJTUFOU7PMVNFΛબ ‣
%ZOBNJD1SPWJTJPOJOH ཧऀ4UPSBHF$MBTTͷΈࣄલʹ४උ Ϣʔβ͕1FSTJTUFOU7PMVNF$MBJNΛσϓϩΠ͢Δͱ 1FSTJTUFOU7PMVNF͕ࣗಈੜ !29 -
%ZOBNJD1SPWJTJPOJOH !30 ʜ TQFD DPOUBJOFST OBNFNZTRM JNBHFNZTRM ʜ WPMVNF.PVOUT OBNFNZTRMEBUB
NPVOU1BUIWBSMJCNZTRM WPMVNF$MBJN5FNQMBUFT NFUBEBUB OBNFNZTRMEBUB TQFD BDDFTT.PEFT<3FBE8SJUF0ODF> TUPSBHF$MBTT/BNFHPME SFTPVSDFT SFRVFTUT TUPSBHF(J %FQMPZ -
%ZOBNJD1SPWJTJPOJOH !31 ʜ TQFD DPOUBJOFST OBNFNZTRM JNBHFNZTRM ʜ WPMVNF.PVOUT OBNFNZTRMEBUB
NPVOU1BUIWBSMJCNZTRM WPMVNF$MBJN5FNQMBUFT NFUBEBUB OBNFNZTRMEBUB TQFD BDDFTT.PEFT<3FBE8SJUF0ODF> TUPSBHF$MBTT/BNFHPME SFTPVSDFT SFRVFTUT TUPSBHF(J $SFBUF17$ -
%ZOBNJD1SPWJTJPOJOH !32 ʜ TQFD DPOUBJOFST OBNFNZTRM JNBHFNZTRM ʜ WPMVNF.PVOUT OBNFNZTRMEBUB
NPVOU1BUIWBSMJCNZTRM WPMVNF$MBJN5FNQMBUFT NFUBEBUB OBNFNZTRMEBUB TQFD BDDFTT.PEFT<3FBE8SJUF0ODF> TUPSBHF$MBTT/BNFHPME SFTPVSDFT SFRVFTUT TUPSBHF(J 4FMFDU4$ -
%ZOBNJD1SPWJTJPOJOH !33 ʜ TQFD DPOUBJOFST OBNFNZTRM JNBHFNZTRM ʜ WPMVNF.PVOUT OBNFNZTRMEBUB
NPVOU1BUIWBSMJCNZTRM WPMVNF$MBJN5FNQMBUFT NFUBEBUB OBNFNZTRMEBUB TQFD BDDFTT.PEFT<3FBE8SJUF0ODF> TUPSBHF$MBTT/BNFHPME SFTPVSDFT SFRVFTUT TUPSBHF(J Storage $SFBUF7PMVNF QSPWJTJPOFS -
%ZOBNJD1SPWJTJPOJOH !34 ʜ TQFD DPOUBJOFST OBNFNZTRM JNBHFNZTRM ʜ WPMVNF.PVOUT OBNFNZTRMEBUB
NPVOU1BUIWBSMJCNZTRM WPMVNF$MBJN5FNQMBUFT NFUBEBUB OBNFNZTRMEBUB TQFD BDDFTT.PEFT<3FBE8SJUF0ODF> TUPSBHF$MBTT/BNFHPME SFTPVSDFT SFRVFTUT TUPSBHF(J Storage OS "TTJHO $SFBUF 17 -
%ZOBNJD1SPWJTJPOJOH !35 ʜ TQFD DPOUBJOFST OBNFNZTRM JNBHFNZTRM ʜ WPMVNF.PVOUT OBNFNZTRMEBUB
NPVOU1BUIWBSMJCNZTRM WPMVNF$MBJN5FNQMBUFT NFUBEBUB OBNFNZTRMEBUB TQFD BDDFTT.PEFT<3FBE8SJUF0ODF> TUPSBHF$MBTT/BNFHPME SFTPVSDFT SFRVFTUT TUPSBHF(J Storage OS Container Runtime Container .PVOU ɹ17 -
৽ػೳ-PDBM7PMVNF ‣ ,VCFSOFUFTWͰ(" ‣ /PEFͷଂ%JTLͷσΟϨΫτϦΛ 1PE͔ΒϚϯτ ‣ ֎෦ετϨʔδͷ߹ͱಉ༷ʹ 4$ 17
17$Λͬͨૢ࡞ ‣ /PEFোআͳͲͰอଘͨ͠σʔ λ͕আ͞ΕΔ͜ͱʹҙ ‣ 1PEͷ/PEFҠಈରԠෆՄ ‣ %ZOBNJD1SPWJTJPOJOHະαϙʔτ !42 /PEF ଂ%JTL NOUWP NOUWP -
৽ػೳ7PMVNF4OBQTIPU ‣ ,VCFSOFUFTWʹͯ"MQIB ‣ 7PMVNF4OBQTIPU$MBTTɺ 7PMVNF4OBQTIPU͕৽ొ ‣ 7PMVNF4OBQTIPUΛσϓϩΠ͢Δ ͜ͱͰɺ1FSTJTUFOU7PMVNFͷσʔ λΛεφοϓγϣοτͱͯ͠อଘ
‣ ϦετΞ17$ʹͯ 7PMVNF4OBQTIPUΛEBUB4PVSDF ͱͯ͠ࢦఆ͠1FSTJTUFOU7PMVNFΛ ࡞ !43 1PE͔Β จࣈྻz)FMMPzΛॻ͖ࠐΈ 7PMVNF 4OBQTIPU 7PMVNF4OBQTIPUΛ ࡞ )FMMP )FMMP 8PSME 1PE͔Β จࣈྻz8PSMEzΛॻ͖ࠐΈ )FMMP ϦετΞ 5 7PMVNF 4OBQTIPU$MBTT ετϨʔδ TOBQTIPUUFS -
ετϨʔδͷγεςϜઃܭ ‣ 1VCMJD$MPVEͷαʔϏεͰετϨʔδαʔϏε͕ఏڙ "84/PMVNF "[VSF%JTL "[VSF'JMF ($&1FSTJTUFOU%JTLFUD ‣ 1SJWBUF$MPVEͰΠϯϑϥཧऀ͕ετϨʔδΛ४උ
‣ ϢʔβετϨʔδͷࣝͳ͠Ͱར༻ ‣ εςʔτϑϧͳΞϓϦέʔγϣϯΛ҆৺ɾ҆શʹ,VCFSOFUFT্Ͱ ಈ࡞ͤ͞ΔͨΊʹɺཧऀʹετϨʔδͷ͕ࣝඞཁ ,VCFSOFUFTͷࣝʴετϨʔδͷࣝ !45 -
3PMMJOH6QEBUF ‣ 1PE͕࠶࡞͢Δܖػ 3PMMJOHVQEBUF োFUD ‣ ࠶࡞͢Δॴ
ಉҰ/PEF ผ/PEF ‣ %FUBDI"UUBDIͷࣗಈ࣮ߦ !47 3PMMJOH6QEBUF "VUPNBUJD QBUITXJUDIJOH 7PMVNF -
ઃܭϙΠϯτ ‣ %FUBDI"UUBDIΦϖϨʔγϣϯͷੑೳ Ұʹଟྔͷ%FUBDI"UUBDIΦϖϨʔγϣϯݺͼग़͠ ྫ͑QPETOPEF͕7PMVNF͍࣋ͬͯΔͱʜ ैདྷߴͰ͋ͬͨ*O#BOEΦϖϨʔγϣϯͷ ϕϯμಠࣗϏοτʹΑΔύεΓସ͑
,VCFSOFUFTͰར༻ෆՄ FH4$4*71% ‣ Ϛϧνύεઃఆ /POEJTSVQUJWFͳΓସ͑Ͱඞཁ /PEFՃ࣌ʹཧऀͷૢ࡞ͳ͠Ͱύεઃఆ ͕Ͱ͖Εϕλʔ !48 /PEF /PEF 4UPSBHF 0VUPG#BOE *O#BOE -
-PDLJOH !49 ‣ αϙʔτ͍ͯ͠Δ"DDFTT.PEFT 3FBE8SJUF0ODF 3FBE0OMZ.BOZ 3FBE8SJUF.BOZ
‣ #MPDLετϨʔδ-PDLΛ࣋ͨͳ͍ ‣ ಉ࣌ʹͭͷ7PMVNFʹॻ͖ࠐΈΛ ߦ͏ͱσʔλഁଛͷةݥੑ͋Γ -
ઃܭϙΠϯτ ‣ αϙʔτ͢Δ"DDFTT.PEFTΛνΣοΫ -PDL੍ޚ͠ͳ͍ΞϓϦέʔγϣϯͰ3FBE8SJUF.BOZΛආ͚Δ͖ ‣ ϛυϧΣΞͷΞϓϦέʔγϣϯ FH3%# ͔ ϑϩϯτΤϯυͷΞϓϦέʔγϣϯ
FH8FCGSPOU ͷͲͪΒͰ-PDL੍ޚ ͞Ε͍ͯΔ͔ΛνΣοΫ ϑϩϯτΤϯυͷΞϓϦέʔγϣϯͰ-PDL੍ޚ͢ΔαʔϏεͷ߹ 3FBE8SJUF.BOZආ͚Δ͖ !50 -
!52 ઃܭϙΠϯτ ‣ ετϨʔδͷϚϧνςφϯτͰ,VCFSOFUFTຖͷΞΫηεΛίϯτϩʔϧ ίϯτϩʔϧͰ͖ΔϦιʔεΛ֬ೝ FHWPMVNF QPSU OPEF`T*1*2/
‣ ςφϯτͷ"$-ʹ/PEFͷ*1 PS*2/ ͕ࣗಈొͰ͖Εϕλʔ ,VCFSOFUFT ,VCFSOFUFT 5FOBOU" 5FOBOU# 4UPSBHF -
ઃܭϙΠϯτ !54 ‣ 2VPUBΛ͍͚ͯઃܭ ‣ ,VCFSOFUFTͷ2VPUB /BNFTQBDFຖͰͷ੍ݶ ‣ ετϨʔδͷ2VPUB
,VCFSOFUFTຖͰͷ੍ݶ 7PMVNF1PPMͷαΠζ੍ݶ 7PMVNFͷੜͷ੍ݶ ύϥϝʔλ આ໌ SFRVFTUTTUPSBHF /BNFTQBDFͷશͯ17$ͷ αΠζͷ߹ܭ QFSTJTUFOUWPMVNFDMBJNT /BNFTQBDFͷ17$ͷ TUPSBHFDMBTTOBNF TUPSBHFDMBTTTUPSBHFLTJP SFRVFTUTTUPSBHF ಛఆͷ4$͔ΒׂΓͯΒΕͨ /BNFTQBDFͷશͯͷ17$ͷ αΠζͷ߹ܭ TUPSBHFDMBTTOBNF TUPSBHFDMBTTTUPSBHFLTJP QFSTJTUFOUWPMVNFDMBJNT ಛఆͷ4$͔ΒׂΓͯΒΕͨ /BNFTQBDFͷ17$ͷ ,VCFSOFUFTͷ4UPSBHF3FTPVSDF2VPUB -
7BMVF !55 ‣ ετϨʔδʹ༷ʑͳλΠϓ͕ଘࡏ ΞϓϥΠΞϯε "4*$ར༻ 4%4
4PGUXBSF%FpOFE4UPSBHF $MPVE/BUJWF4UPSBHF ‣ ҰҰ ‣ શσʔλΛಛఆͷετϨʔδͷΈͰ αϙʔτ͢ΔͱՄ༻ੑԼ ίετ૿େͷϦεΫ͋Γ -
ઃܭϙΠϯτ ‣ อଘ͢ΔσʔλͷՁͷݟఆΊ ‣ σʔλͷՁʹԠ͡ɺෳͷ4UPSBHF$MBTTΛ ͍͚͕Φεεϝ ‣ ετϨʔδͷίετอݥͱಉ͡Α͏ͳͷ ʁ ൺֱ߲
ΞϓϥΠΞϯε 4%4 $MPVE/BUJWF4UPSBHF ػثίετ ηοτΞοϓͷ༰қ͞ ެ։ใͷଟ͞ εέʔϧΞτͷ͠қ͞ োͷൃੜ͠ʹ͘͞ σʔλ෮چͷ༰қ͞ ετϨʔδ৽ٕज़ͷ࠾༻ͷૣ͞ όʔδϣϯΞοϓͷස ˞ൃදऀͷओ؍ʹΑΔධՁͰ͢ $ kubectl get sc NAME PROVISIONER AGE Gold A/provisioner 26d Silver SDS/provisioner 26d Bronze CNS/provisioner 26d -
·ͱΊ !57 ‣ θοτϥϘͰͷࣄྫɺ,VCFSOFUFTͰͷετϨʔδΛհ ‣ ,VCFSOFUFT͚ετϨʔδબͼͭͷϙΠϯτ 3PMMJOH6QEBUF -PDLJOH
4FDVSJUZ 2VPUB 7BMVF ‣ 7.͕ొͨ࣌͠εςʔτϑϧΞϓϦͷ7.ͷҠߦ৻ॏͩͬͨ ‣ $POUBJOFSͰͷಈ࡞ࣄྫΑΓঃʑʹ૿͖͍͑ͯͯΔҹ