Frugalos で使われている Erasure Coding と Raft の軽い紹介

by SAKATA Sinji

Slide 1

Slide 1 text

'SVHBMPTͰ࢖ΘΕ͍ͯΔ &SBTVSF$PEJOHͱ 3BGUͷ͍ܰ঺հ LPTFOT-5  !ZTBLBTJO

Slide 2

Slide 2 text

LPTFOTTMBDLUFDIʹͯ

Slide 3

Slide 3 text

wυϫϯΰ੍͕࡞ 044 w#-0#༻ͷ෼ࢄΦϒδΣΫτετϨʔδ wχίੜͷόοΫΤϯυͰՔಇத w3VTUͰॻ͔Ε͍ͯΔ w IUUQTEXBOHPHJUIVCJPBSUJDMFTGSVHBMPT

Slide 4

Slide 4 text

෼ࢄΦϒδΣΫτετϨʔδ wෳ਺αʔόʔʹ·͕ͨͬͯϑΝΠϧΛอ؅͢Δ w4 Կ͍ͨ͠ͷʁ wσʔλΛࣦ͍ͨ͘ͳ͍ʢσΟεΫ͸յΕΔʣ wେྔʹσʔλΛอଘ͍ͨ͠ جຊͱͳΔૢ࡞ w(&5 165 %&-&5&

Slide 5

Slide 5 text

'SVHBMPTͷٕज़తಛ௃ w&SBTVSF$PSEJOH wσʔλফࣦ΁ͷର߅ࡦ w3BGU w෼ࢄ߹ҙΞϧΰϦζϜ

Slide 6

Slide 6 text

&SBTVSF$PEJOH ύϦςΟ σʔλϒϩοΫ ෼ׂ ܭࢉ ϦʔυɾιϩϞϯූ߸ͷ৔߹ w σʔλϒϩοΫOݸͱ  ύϦςΟLݸʹ෼ׂͯ͠อଘ w Oݸ࢒͍ͬͯΕ͹෮ݩՄೳ :BIPP+BQBO5FDI#MPHΑΓ  ը૾ΛҾ༻ɺৄࡉ͸௥هʹهࡌ

Slide 7

Slide 7 text

&SBTVSF$PEJOHಡΈࠐΈ ܭࢉ ඞཁͳ਺͚ͩऩू ݩͷσʔλϒϩοΫ਺

Slide 8

Slide 8 text

&SBTVSF$PEJOHಡΈࠐΈ ܭࢉ ඞཁͳ਺͚ͩऩू ݩͷσʔλϒϩοΫ਺

Slide 9

Slide 9 text

$"1ఆཧ ෼ࢄσʔλετΞ͸ɺ  ಉ࣌ʹԼهͷͭΛอূ͢Δ͜ͱ͸Ͱ͖ͳ͍ wҰ؏ੑ $POTJTUFODZ w ࠷৽ͷ஋͕ಡΊΔ͔ΤϥʔͷͲͪΒ͔ʹͳΔ wՄ༻ੑ "WBJMBCJMJUZ w Քಇதͷϊʔυ͸શͯͷϦΫΤετʹ  ΤϥʔͰͳ͍ϨεϙϯεΛฦ͢ w෼அମ੍ 1BSUJUJPOUPMFSBODF w ωοτϫʔΫ෼அ͕ىͬͯ͜΋γεςϜ͕ಈ࡞͠ଓ͚Δ

Slide 10

Slide 10 text

ωοτϫʔΫ෼அൃੜ࣌ 9 9 9 9 9 9 9 9 9

Slide 11

Slide 11 text

ΫϥΠΞϯτ͕165 9 9 9 9 9 9 9 9 9 165 9

Slide 12

Slide 12 text

9͕఻ΘΔ 165 9 9 9 9 9 9 9 9 9 9 ఻ΘΒͳ͍

Slide 13

Slide 13 text

͜ͷ࣌(&5ͨ͠Βʁ 9 9 9 9 9 9 9 9 9 (&5 9 165 9

Slide 14

Slide 14 text

γεςϜઃܭͷબ୒ 9 9 9 9 9 9 9 9 9 (&5 9 9 w ࣗ෼ͷ஌͍ͬͯΔ஋Λฦ͢ w Մ༻ੑΛબ୒ Τϥʔ w ෼அΛݕ஌ͯ͠Τϥʔͱ͢Δ w Ұ؏ੑΛબ୒

Slide 15

Slide 15 text

3BGU w෼ࢄ؀ڥͰ߹ҙΛಘΔΞϧΰϦζϜ wఏҊϦΫΤετʹରͯ͠౷ҰݟղΛ࡞Δ wFUDEͰ࢖ΘΕͯΔ w1BYPTͷπϥΈ͔Βੜ·Εͨ  γϯϓϧͳΞϧΰϦζϜ w౤ථͰϦʔμʔΛܾΊɺϦʔμʔ͕ଞϊʔυʹ  ৘ใΛෳ੡͢Δ͜ͱͰ߹ҙܗ੒Λߦ͏ɻ

Slide 16

Slide 16 text

1BYPTখൌ ϨεϦʔɾϥϯϙʔτ 1BYPT։ൃऀ -B5F9ݪ։ൃऀ Ϗβϯνϯক܉໰୊ఏএऀ ೥νϡʔϦϯά৆ड৆ IUUQTDPNNPOTXJLJNFEJBPSHXJLJ 'JMF-FTMJF@-BNQPSUKQH

Slide 17

Slide 17 text

1BYPTখൌ &DIPͱ͍͏ׂͱ৴པੑͷߴ͍ ෼ࢄϑΝΠϧγεςϜ͕͋ͬͨ ͍΍͍΍෼ࢄͰ  ߹ҙͱ͔ແཧͰ͠ΐ    ແཧͳͷূ໌ͨ͠Ζ ߹ҙΞϧΰϦζϜ  ͕Ͱ͖ͯ͠·ͬͨʜ IUUQTDPNNPOTXJLJNFEJBPSHXJLJ 'JMF-FTMJF@-BNQPSUKQH ग़య͸௥هʹهࡌ

Slide 18

Slide 18 text

3BGUΫϥελ Ϧʔμʔ w ΫϥελՔಇ࣌ʹ୆਺Λݻఆ w ա൒਺ͷαʔόʔ͕͍Ε͹  ՔಇΛଓ͚ΒΕΔ w ΫϥΠΞϯτ͸Ϧʔμʔʹ  ରͯ͠ϦΫΤετΛ౤͛Δ w Ϧʔμʔ͕μ΢ϯͯ͠΋  ৽͍͠Ϧʔμʔ͕બग़͞ΕΔ ϑΥϩϫʔ ϑΥϩϫʔ ϑΥϩϫʔ ϑΥϩϫʔ

Slide 19

Slide 19 text

3BGUͷ߹ҙ Ϧʔμʔ 165 9 ϦʔμʔʹϦΫΤετૹ৴

Slide 20

Slide 20 text

3BGUͷ߹ҙ Ϧʔμʔ ϦʔμʔʹϦΫΤετૹ৴ ϦΫΤετΛશମʹૹ৴

Slide 21

Slide 21 text

3BGUͷ߹ҙ Ϧʔμʔ 0, 0, 0, ϦʔμʔʹϦΫΤετૹ৴ ϦΫΤετΛશମʹૹ৴ ա൒਺͔ΒͷঝೝͰ׬ྃ

Slide 22

Slide 22 text

3BGUͷ߹ҙ Ϧʔμʔ 0, ϦʔμʔʹϦΫΤετૹ৴ ϦΫΤετΛશମʹૹ৴ ա൒਺͔ΒͷঝೝͰ׬ྃ 0, 0,

Slide 23

Slide 23 text

Ϧʔμʔ͕μ΢ϯͨ͠Β Ϧʔμʔ ϋʔτϏʔτ͕Ұఆ࣌ؒ  ૹΒΕͯདྷͳ͔ͬͨΒ  ৽ͨͳϦʔμʔʹཱީิ ཱީิͨ͜͠ͱΛશһʹ௨஌ ࠷ॳʹཱ͖ͨީิऀʹ౤ථ ա൒਺ͷ౤ථͰϦʔμʔܾఆ Ϧʔμʔ͸ఆظతʹ  ϋʔτϏʔτΛશһʹૹΔ

Slide 24

Slide 24 text

Ϧʔμʔ͕μ΢ϯͨ͠Β Ϧʔμʔ Ϧʔμʔ͕μ΢ϯͨ͠Β  ϋʔτϏʔτ͕ૹΒΕͳ͘ͳΔ ΩϟϯσΟσʔτ ϋʔτϏʔτ͕Ұఆ࣌ؒ  ૹΒΕͯདྷͳ͔ͬͨΒ  ৽ͨͳϦʔμʔʹཱީิ ཱީิͨ͜͠ͱΛશһʹ௨஌ ࠷ॳʹཱ͖ͨީิऀʹ౤ථ ա൒਺ͷ౤ථͰϦʔμʔܾఆ

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Ϧʔμʔ͕μ΢ϯͨ͠Β Ϧʔμʔ Ϧʔμʔ͕μ΢ϯͨ͠Β  ϋʔτϏʔτ͕ૹΒΕͳ͘ͳΔ ΩϟϯσΟσʔτ ౤ථ ౤ථ ϋʔτϏʔτ͕Ұఆ࣌ؒ  ૹΒΕͯདྷͳ͔ͬͨΒ  ৽ͨͳϦʔμʔʹཱީิ ཱީิͨ͜͠ͱΛશһʹ௨஌ ࠷ॳʹཱ͖ͨީิऀʹ౤ථ ա൒਺ͷ౤ථͰϦʔμʔܾఆ

Slide 27

Slide 27 text

Ϧʔμʔ͕μ΢ϯͨ͠Β Ϧʔμʔ͕μ΢ϯͨ͠Β  ϋʔτϏʔτ͕ૹΒΕͳ͘ͳΔ ౤ථ ౤ථ ϋʔτϏʔτ͕Ұఆ࣌ؒ  ૹΒΕͯདྷͳ͔ͬͨΒ  ৽ͨͳϦʔμʔʹཱީิ ཱީิͨ͜͠ͱΛશһʹ௨஌ ࠷ॳʹཱ͖ͨީิऀʹ౤ථ ա൒਺ͷ౤ථͰϦʔμʔܾఆ Ϧʔμʔ

Slide 28

Slide 28 text

ϊʔυͷ࠶ࢀՃ Ϧʔμʔ ϋʔτϏʔτͰ  ϦʔμʔΛೝࣝ ඇࢀՃظؒͷ  σʔλΛϦΫΤετ

Slide 29

Slide 29 text

ϊʔυͷ࠶ࢀՃ ϋʔτϏʔτͰ  ϦʔμʔΛೝࣝ ඇࢀՃظؒͷ  σʔλΛϦΫΤετ Ϧʔμʔ

Slide 30

Slide 30 text

'SVHBMPTͷϞσϧ #VDLFU

Slide 31

Slide 31 text

'SVHBMPTͷϞσϧ #VDLFU 4FHNFOU 0CKFDU

Slide 32

Slide 32 text

'SVHBMPTͷϞσϧ 4FHNFOU 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGUͰϝλσʔλ౳Λ߹ҙͯ͠  #-0#͸&SBTVSF$PEJOHͰ෼ׂ

Slide 33

Slide 33 text

'SVHBMPTͷϞσϧ 4FHNFOU 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGU  ϊʔυ 3BGUͰϝλσʔλ౳Λ߹ҙͯ͠  #-0#͸&SBTVSF$PEJOHͰ෼ׂ

Slide 34

Slide 34 text

·ͱΊ w&SBTVSF$PEJOH wෳ੡͠ͳͯ͘΋σʔλ෮ؼͰ͖Δ͍͢͝΍ͭ w3BGU w෼ࢄ߹ҙͰ͖Δ͍͢͝΍ͭ w1BYPY͸ࣄނ͔Βੜ·Εͨ w$"1ఆཧ wҰ؏ੑͱՄ༻ੑͱ෼அ଱ੑ͸ಉ࣌ʹຬͨͤ·ͤΜ w͜͜ΒลΛ࣮૷࣮ͯ͠༻ͯ͠Δͷ͍͢͝ʂʂʂ

Slide 35

Slide 35 text

௥ه 1BYPTখൌͷग़య w 0SBM)JTUPSZPG-FTMJF-BNQPSU $PNQVUFS)JTUPSZ .VTFVN w IUUQBSDIJWFDPNQVUFSIJTUPSZPSHSFTPVSDFT BDDFTTUFYUBDDQEG w Q ը૾Ҿ༻ w )%'4&SBTVSF$PEJOHͷ঺հͱ:BIPP+"1"/ʹ͓͚Δӡ ༻ࣄྫ w IUUQTUFDICMPHZBIPPDPKQJOGSBTUSVDUVSF IEGT@FSBTVSF@DPEJOH