Why Riak? Why SoftLayer?

Riakで何ができるのか？SoftLayer上で動かすと何がさらに嬉しいのか？という基本的な話から、Riakを構成する基本的な技術を解説します。

http://softlayer.connpass.com/event/6864/

Transcript

1. Why Riak?
   
   Why SoftLayer?
   2014/7/25 SoftLayerษڧձ #2
   
   @kuenishi
   

   View Slide

2. ࣗݾ঺հ
   •UENISHI Kota @ kuenishi
   •github, twitter, …
   •Erlangྺ5೥ɺ෼ࢄγεςϜྺ6೥
   •࠷ۙ͸ Riak CS ͷ։ൃ
   

   View Slide

3. Riak is Կ
   •ʮNoSQLσʔλϕʔεʯ
   •ErlangͰॻ͔Ε͍ͯΔΒ͍͠
   •…ͱ͍ΘΕ͍ͯΔ͕ৄ͍͠࿩͸ޙ΄Ͳ
   

   View Slide

4. What?
   

   View Slide

5. Yay!!
   

   View Slide

6. 1೥Ҏ্લ͔Β
   
   ࢖͑ͯ·ͨ͠
   

   View Slide

7. Why Riak?
   

   View Slide

8. Riak࢖͍υίϩ
   •Մ༻ੑ͕େࣄͳ৔໘
   •εέʔϧΞοϓɾμ΢ϯͳͲӡ༻
   •ϑΣΠϧΦʔόʔ is େม
   •ωοτϫʔΫ͕੾ΕͨΒ
   •ϊʔυ௥Ճɾ࡟আͷίετ
   

   View Slide

9. σʔλϕʔεͷ
   
   Մ༻ੑʹର͢ΔڴҖ
   •ϋʔυ΢ΣΞނোʢωοτϫʔΫ΋ʣ
   ʹΑΔϑΣΠϧΦʔόʔ
   •ΞοϓάϨʔυɺϝϯςφϯε
   •աෛՙ
   •όοΫΞοϓ
   

   View Slide

10. ϑΣΠϧΦʔόʔ
    1. ϚελʔͷނোΛݕग़ʢ>10s secondsʣ
    2. εϨʔϒʹ੾Γସ͑ʢ> ??ʣ
    3. ϚελʔΛम෮ (>hours)
    4. Ϛελʔʹ੾Γ໭͠ (> ??)
    ͏͠Ζ͕Shared DiskͩΖ͏͕ɺShared NothingͩΖ͏͕ɺ
    
    DBϓϩηεͷϑΟΤϧΦʔόʔத͸ΞΫηεͰ͖ͳ͍
    

    View Slide

11. ωοτϫʔΫނো
    •ಛผͳ޻෉Λ͠ͳ͍ݶΓɺϚϧνϚελ
    ʢSplit Brainʣঢ়ଶʹͳͬͯσʔλ͕ͣΕ
    ͯ͠·͏→म෮ෆೳ
    •ӡ༻Λ޻෉ͯ͠ͲͪΒ͔ΛϚελʹͯ͠΋ɺ
    ϚελͰͳ͍ํͷωοτϫʔΫͰ͸ɺσʔ
    λϕʔε͕࢖͑ͳ͘ͳΔ
    ?
    ?
    

    View Slide

12. ΞοϓάϨʔυ
    •σʔλϕʔεͷΞοϓάϨʔυ͸ϚΠφʔ
    όʔδϣϯͰ͋ͬͯ΋େม
    •Ͳ͜ΛͲ͏ࢭΊΔɺͲ͏ىಈ͢Δ
    1.↑
    2.↑
    

    View Slide

13. աෛՙ
    •جຊํ਑ɿ ෛՙΛԼ͛Δ
    BUSY!!!
    

    View Slide

14. όοΫΞοϓ
    •ࢭΊΕΔͱ΋ͷָ͘͢͝ͳΜ͚ͩͲ…
    1.→
    2.→
    

    View Slide

15. With Riak:
    

    View Slide

16. Quorum ϨϓϦέʔγϣϯ
    •NݸͷϊʔυʹσʔλΛෳ੡
    •ॻࠐ࣌͸ W ݸͷAck͕͋Ε͹Α͍
    •ʢ௨ৗɺN͸ح਺ʣ
    •ಡΈग़࣌͠͸ R ݸͷAck͕͋Ε͹Α͍
    • R + W > N ͱͳ͍ͬͯΕ͹Α͍
    σϑΥϧτ: (R, W, N) = (2, 2, 3)
    
    ͻͱΓ͘Β͍յΕ͍ͯͯ΋WriteՄೳ
    

    View Slide

17. Consistent Hashing
    • 160-bit Ωʔۭؒ
    • ۭؒΛ౳෼͢Δ
    • ύʔςΟγϣϯ͸ϊʔυ͕
    ݸผ؅ཧ
    • ϨϓϦΧ͸NݸͷύʔςΟ
    γϣϯʹίϐʔ͞ΕΔ
    OPEF
    OPEF
    OPEF
    OPEF
    hash(“meetups/spamham”)
    N=3
    

    View Slide

18. Ұ࣌ނোͷͱ͖
    • Ϧϯά্ͷ࣍ͷύʔςΟγϣ
    ϯʹͱΓ͋͑ͣॻ͖ࠐΜͰ
    ίϐʔΛ3ͭ࡞͓ͬͯ͘
    • ͋ͱͰ෮چͨ͠ͱ͖ʹίϐʔ
    Λฦ͢
    OPEF
    OPEF
    OPEF
    OPEF
    hash(“meetups/spamham”)
    N=3
    

    View Slide

19. ωοτϫʔΫނোͰ΋
    •ωοτϫʔΫ෼அ͕ى͖͍ͯͯ΋ͱΓ͋͑ͣॻ͖ࠐΈΛڐ͢
    Server2
    Server1 Server3
    PUT V=42
    PUT V=0
    Server4
    ෮چͨ͠Βॻ͖໭͢
    ྆ํ͓࣋ͬͯ͘
    

    View Slide

20. Write-write Conflict͕
    
    ى͖ͨΒʁ
    •҉໧ʹ্ॻ͖ͯ͠͠·Θͳ͍ͨΊͷ࢓૊Έ͕͋Δ
    •ώϯτ: Siblings & Vector Clocks
    Server2
    Server1 Server3
    PUT V=42
    PUT V=0
    V=?
    

    View Slide

21. ιϑτ΢ΣΞͷ
    
    ΞοϓάϨʔυ
    •ྡಉ࢜ͷόʔδϣϯͰͷແఀࢭɾϩʔ
    ϦϯάΞοϓάϨʔυͷಈ࡞อূ
    1.3.2 1.3.2 1.3.2 1.3.2 1.3.2 1.3.2 1.3.2
    1.4.10 1.4.10 1.4.10 1.4.10 1.4.10 1.4.10 1.4.10
    

    View Slide

22. ϋʔυ΢ΣΞͷ
    
    ΞοϓάϨʔυ
    •ͲͪΒ΋ແఀࢭͰͰ͖Δ
    •௕ظతʹੑೳΛ্͍͛ͨͱ͖
    •ϊʔυަ׵ͰεέʔϧΞοϓ
    •Ϧιʔεͷར༻ޮ཰͕Α͍
    •୹ظతʹੑೳΛ্͍͛ͨͱ͖
    •ϊʔυ௥ՃͰεέʔϧΞ΢τ
    •͙͢ʹ௥Ճͯ͠ΦϯϥΠϯʹͳΕΔ
    աෛՙʹͳΓͦ͏ͳ
    λΠϛϯάͰ…
    

    View Slide

23. Ϋϥελؒ
    
    ϨϓϦέʔγϣϯ
    

    View Slide

24. Ϋϥελؒ
    
    ϨϓϦέʔγϣϯ
    

    View Slide

25. Ϋϥελؒ
    
    ϨϓϦέʔγϣϯ
    

    View Slide

26. Ϋϥελؒ
    
    ϨϓϦέʔγϣϯ
    

    View Slide

27. Why Cloud?
    

    View Slide

28. Մ༻ੑɺӡ༻ੑ
    •σʔλϕʔεͳͲͷϛυ
    ϧ΢ΣΞ͕͍͘Β༏Εͯ
    ͍ͯ΋ҙຯ͕ͳ͍
    •ϋʔυ΢ΣΞ΍ωοτϫʔ
    Ϋ͕ਖ਼͘͠ઃܭɾӡ༻͞
    Ε͍ͯͳ͚Ε͹αʔϏε
    Λӡ༻Ͱ͖ͳ͍
    ݐ෺ɾిݯɾۭௐ
    ωοτϫʔΫ
    αʔόʔHW
    ϛυϧ΢ΣΞ
    αʔϏε
    

    View Slide

29. ͔ͩΒΫϥ΢υ
    

    View Slide

30. Why SoftLayer?
    

    View Slide

31. ϕΞϝλϧαʔόʔ
    
    why?
    

    View Slide

32. Ծ૝ԽͷΦʔόʔϔουʁ
    

    View Slide

33. one of
    
    ෼ࢄγεςϜͰେࣄͳ͜ͱ
    is
    
    ނোͷ୯Ґ
    

    View Slide

34. ނোͷ୯Ґ
    •1ͭͷσΟεΫ
    •1ͭͷNIC
    •1ͭͷαʔόʔ
    •1ͭͷεΠον
    Ծ૝Խͯ͠ɺͻͱͭͷ
    Ϛγϯ্ʹෳ਺ͷϊʔ
    υ͕ೖ͍ͬͯΔͱɺͻ
    ͱͭͷϚγϯނো͕ଟ
    ॏނোʹݟ͑ͯ͠·͏
    

    View Slide

35. ނোͷ୯Ґ
    ϕΞϝλϧαʔόʔ Ծ૝Խ͞ΕͨϚγϯ
    OS
    Riak
    OS
    Riak
    OS
    Riak
    OS
    Riak
    OS
    Riak
    OS
    Riak
    OS
    Riak
    OS
    Riak
    

    View Slide

36. ଞʹ΋
    •1୆ͷϚγϯͷϦιʔεΛ઎༗Ͱ͖Δ
    •σΟεΫυϥΠϒͷѻ͍͕೉͍͠
    •ڞ༗σΟεΫΛ੾Γग़ͯ͠Ϛ΢ϯτͯ͠࢖͏
    ελΠϧ
    •EphemeralσΟεΫ
    •RawσόΠε΋෼ࢄετϨʔδʹͯ͠͠·͏
    •Sheepdogతͳ΋ͷͬͯλΠϔϯ
    

    View Slide

37. ࣮ࡍɺੑೳ΋ҧ͏
    Bare Metal Virtual
    “Riak Performance Analysis: Bare Metal vs Virtual” July 16, 2013
    
    http://blog.softlayer.com/2013/riak-performance-analysis-bare-metal-v-virtual
    

    View Slide

38. ͔͠΋SoftLayerͳΒ…
    •Webϒϥ΢βͰRiakΛҰൃσϓϩΠͰ
    ͖ͯ͠·͏
    •DCؒϨϓϦέʔγϣϯͷઃఆʢ͜Ε͕
    ׂͱ೉͍͠ʣ΋͠ͳ͍͍ͯ͘
    •ΤϯλʔϓϥΠζ൛ɺBasho͔ΒϥΠη
    ϯεΛങ͏ඞཁ͢Βͳ͍
    

    View Slide

39. ·ͱΊ
    •αʔϏεͷՄ༻ੑɺӡ༻ੑ͸ϑϧελοΫͰߟ͑
    Δ΂͖
    •Riak͸෼ࢄγεςϜͷ೉͍͠໰୊Λղ͍ͯ͘ΕΔ
    •DC~NW~OSͷ೉͍͠໰୊͸SoftLayerͰ
    •RiakͷΫϥελؒϨϓϦέʔγϣϯͰσʔληϯ
    λʔΛލ͝͏
    

    View Slide

40. Questions?
    @BashoJapan
    
    riak-users-jp@lists.basho.com
    
    http://basho.co.jp/riak
    
    http://github.com/basho/riak
    

    View Slide