Riak Intro && RICON2012 参加報告

Riak Intro && RICON2012 参加報告

Riak Meetup Tokyoでのスライドです。

E1923013dacab39eb231a2fffbf7b33c?s=128

UENISHI Kota

March 12, 2013
Tweet

Transcript

  1. Riak intro RICON 2012 report 2013/3/12 Riak Meetup Tokyo @

    Roppongi Midtown Yahoo!JAPAN #riakjp
  2. •্੢߁ଠ @kuenishi •Bashoδϟύϯגࣜձࣾ •෼ࢄγεςϜͷݚڀ΍։ൃΛ5೥͘Β͍ •೔ຊ๏ਓ͕9݄ʹͰ͖ͨ ͓લɺ୭Α

  3. ۓٸΞϯέʔτ • RiakΛฉ͍ͨ͜ͱ͕͋Δ [Y/y]? • RiakΛ͢Ͱʹ࢖͍ͬͯΔ [y/n]? • ϗϯτʹ࢖͑Δͷʁͱٙ໰ʹࢥ͍ͬͯΔ [Y/n]?

  4. • DynamoʹΠϯεύΠϠ͞Εͨ • Consistent HashingʹΑΓਫฏ෼ࢄ͢Δ • Vector ClocksΛ༻͍ͯϨϓϦέʔγϣϯ͠ • Erlang/OTPͰಈ࡞͢Δ

    • ෼ࢄKVSͰ͋Δ WikiPedia: Vector Clocks
  5. Consistent Hashing and Replicas / Vector Clocks Link Walking Gossiping

    Append-only stores Virtual Nodes / Handoff and Rebalancing HTTP / Protocol Buffers Secondary Index / MapReduce
  6. None
  7. None
  8. None
  9. • Riakͷ্Ͱಈ࡞͢Δ • εέʔϧΞ΢τՄೳͰ • AWS S3ޓ׵ͷAPIΛ࣋ͪ • Erlang/OTPͰಈ࡞͢Δ •

    Ϋϥ΢υετϨʔδ Clouds and Storages by cowlishaw, on Flickr
  10. • ෼ࢄγεςϜɺ෼ࢄDBͷΠϯμετϦΞϧͳ ΧϯϑΝϨϯε • Bashoओ࠵ͳͷͰRiak੒෼ଟΊ • Riak͚ͩ͡Όͳ͍ˍRiakҎ֎ͷਓ΋Welcome • ࣄྫ΋ଟ͍

  11. None
  12. None
  13. None
  14. େ͖͘෼ྨ͢Δͱ… • Riakͷࣄྫͷ࿩ by αʔϏεΛ࡞͍ͬͯΔਓ • Riakʹؔ܎͢Δ࿩ by αʔϏεΛ࡞͍ͬͯΔਓ •

    Riakͷத਎ͷ࿩ by Basho Eng. • ෼ࢄγεςϜͷࣄྫɾ঺հɾྺ࢙ͳͲ
  15. Riakࣄྫͷ࿩

  16. Building a Transaction Logs-based Protocol on Riak (Will Moss and

    Tim Douglas) • BumpͰ͸2010ʙ2012ʹ͔͚ͯɺMongoDBΛ ΍ΊͯRiakʹͨ͠ • FlockͰ͸΋ͪΖΜRiak • ෳ਺ͷϨίʔυʢϢʔβɺΠϕϯτʣΛߋ৽͢ ΔͨΊʹLocking͢ΔϚγϯΛ1୆͚ͩ༻ҙ • Conflict resolution͸montage http://vimeo.com/53550624
  17. Pattern of Innovation: Riak Usage at Best Buy (Joel Crabb)

    • Amazon, Walmartʹ͙࣍શถୈ3Ґͷখച • Product CatalogΛRiakͰ • RiakͷΑ͏ͳ৽͍͠ϞϊΛଞࣾʹઌۦ͚ͯͲ ͏΍ͬͯಋೖ͢Δ͔ɺ·ͨ͸Πϊϕʔγϣϯ Λى͜͢ํ๏ http://vimeo.com/54384814
  18. Migrating from MySQL to Riak (George Resse) • enStratus •

    ෳ਺ͷΫϥ΢υΛ੾Γସ͑ͨΓ૊Έ߹Θͤͯ ࢖͑ΔΑ͏ʹ͢ΔαʔϏε • Ϋϥ΢υͷσʔλΛΩϟογϡͨ͠Γ͢Δͷ ͰɺMySQLͰ͸εέʔϧ͠ͳ͍ • Dasein Persistence as “ORM” • 2i+MapReduceΘΓͱΑ͍Α http://vimeo.com/54887751
  19. Big Data in the Small (Michael Bevilacqua-Linn) • xfinity.com at

    Comcast • NetflixΈ͍ͨͳαʔϏεʢຊՈʁݩ૆ʁʣ • Ϋϥ΢υͷσʔλΛΩϟογϡͨ͠Γ͢Δͷ ͰɺMySQLͰ͸εέʔϧ͠ͳ͍ • http://vimeo.com/54270121
  20. Riak at OpenX (Anthony Molinaro) • AdϓϥοτϑΥʔϜɺRTBͳͲ • MySQL ->

    Cassandra -> Riak • MySQL -> CouchDB -> riak_core ͷࣗલΞϓϦ • 1T ads in 2011 ~> 4T ads in 2012 (estm.) • ͋ͱ͸ֆͰ http://bit.ly/YWYJW5
  21. None
  22. None
  23. 2013?

  24. 2013?

  25. Riak at Voxer (Matt Ranney) • ೔ຊͰ͍͏LINEΈ͍ͨͳαʔϏε • LAMP?→CouchDB→Riak+node.js •

    ͪΌΜͱಈ͘ • put/getҎ֎͸஗͍ http://vimeo.com/52827773
  26. Riak for All Storage: Voxer

  27. Voxer: Initial Stats • 11 Riak nodes (switched from CouchDB

    • 500GB Data set • ~20k Peak Concurrent Users • ~4MM Daily Request
  28. Voxer: Post Growth • ~60 Nodes • 100s of TBs

    of data (>1TB daily) • ~400k Concurrent Users • >2B Daily Requests
  29. Riakͷத਎ͷ࿩

  30. Talks by Basho Engineers • Riak Pipe - Riaks’s Distributed

    Processing Framework by Bryan Fink • Introducing Yokozuna - Searching Riak With Solr by Ryan Zezeski • Building Riak CS on Riak by Reid Draper and Kelly McLaughlin • Cloning the Cloud - Riak and Multi Data Center Replication by Andrew Thompson • Bringing Consistency to Riak by Joseph Blomstedt
  31. ͦͷଞ

  32. Keep CALM and Query On (Joseph Hellerstein) • ίϯϐϡʔλʔ΍σʔλ ϕʔεͷྺ࢙΍ੑ࣭Λӳ

    ࠃʹͳͧΒ͑ͯղઆ • CALM - Consistency and Logical Monotonicity • Boom http://vimeo.com/53904989
  33. ଞʹ΋ • Advancing Distributed Systems(Eric Brewer) • Using Chef to

    Manage Distributed Systems(Mandi Walls) • Rebuilding a Bird in Flight(Dana Contreras) • Modern Radiology for Distributed Systems(Dietrich Featherston) • Immutability Changes Everything(Pat Helland) •
  34. Q&A •basho.co.jp / github.com/basho/riak •@BashoJapan #riakjp •೔ຊޠML riak-users-jp@lists.basho.com