Riak Intro && RICON2012 参加報告

Riak Meetup Tokyoでのスライドです。

Transcript

1. Riak intro RICON 2012 report 2013/3/12 Riak Meetup Tokyo @ Roppongi Midtown Yahoo!JAPAN #riakjp
2. •্੢߁ଠ @kuenishi •Bashoδϟύϯגࣜձࣾ •෼ࢄγεςϜͷݚڀ΍։ൃΛ5೥͘Β͍ •೔ຊ๏ਓ͕9݄ʹͰ͖ͨ ͓લɺ୭Α
3. ۓٸΞϯέʔτ • RiakΛฉ͍ͨ͜ͱ͕͋Δ [Y/y]? • RiakΛ͢Ͱʹ࢖͍ͬͯΔ [y/n]? • ϗϯτʹ࢖͑Δͷʁͱٙ໰ʹࢥ͍ͬͯΔ [Y/n]?
4. • DynamoʹΠϯεύΠϠ͞Εͨ • Consistent HashingʹΑΓਫฏ෼ࢄ͢Δ • Vector ClocksΛ༻͍ͯϨϓϦέʔγϣϯ͠ • Erlang/OTPͰಈ࡞͢Δ • ෼ࢄKVSͰ͋Δ WikiPedia: Vector Clocks
5. Consistent Hashing and Replicas / Vector Clocks Link Walking Gossiping Append-only stores Virtual Nodes / Handoff and Rebalancing HTTP / Protocol Buffers Secondary Index / MapReduce
9. • Riakͷ্Ͱಈ࡞͢Δ • εέʔϧΞ΢τՄೳͰ • AWS S3ޓ׵ͷAPIΛ࣋ͪ • Erlang/OTPͰಈ࡞͢Δ • Ϋϥ΢υετϨʔδ Clouds and Storages by cowlishaw, on Flickr
10. • ෼ࢄγεςϜɺ෼ࢄDBͷΠϯμετϦΞϧͳ ΧϯϑΝϨϯε • Bashoओ࠵ͳͷͰRiak੒෼ଟΊ • Riak͚ͩ͡Όͳ͍ˍRiakҎ֎ͷਓ΋Welcome • ࣄྫ΋ଟ͍
14. େ͖͘෼ྨ͢Δͱ… • Riakͷࣄྫͷ࿩ by αʔϏεΛ࡞͍ͬͯΔਓ • Riakʹؔ܎͢Δ࿩ by αʔϏεΛ࡞͍ͬͯΔਓ • Riakͷத਎ͷ࿩ by Basho Eng. • ෼ࢄγεςϜͷࣄྫɾ঺հɾྺ࢙ͳͲ
15. Riakࣄྫͷ࿩
16. Building a Transaction Logs-based Protocol on Riak (Will Moss and Tim Douglas) • BumpͰ͸2010ʙ2012ʹ͔͚ͯɺMongoDBΛ ΍ΊͯRiakʹͨ͠ • FlockͰ͸΋ͪΖΜRiak • ෳ਺ͷϨίʔυʢϢʔβɺΠϕϯτʣΛߋ৽͢ ΔͨΊʹLocking͢ΔϚγϯΛ1୆͚ͩ༻ҙ • Conflict resolution͸montage http://vimeo.com/53550624
17. Pattern of Innovation: Riak Usage at Best Buy (Joel Crabb) • Amazon, Walmartʹ͙࣍શถୈ3Ґͷখച • Product CatalogΛRiakͰ • RiakͷΑ͏ͳ৽͍͠ϞϊΛଞࣾʹઌۦ͚ͯͲ ͏΍ͬͯಋೖ͢Δ͔ɺ·ͨ͸Πϊϕʔγϣϯ Λى͜͢ํ๏ http://vimeo.com/54384814
18. Migrating from MySQL to Riak (George Resse) • enStratus • ෳ਺ͷΫϥ΢υΛ੾Γସ͑ͨΓ૊Έ߹Θͤͯ ࢖͑ΔΑ͏ʹ͢ΔαʔϏε • Ϋϥ΢υͷσʔλΛΩϟογϡͨ͠Γ͢Δͷ ͰɺMySQLͰ͸εέʔϧ͠ͳ͍ • Dasein Persistence as “ORM” • 2i+MapReduceΘΓͱΑ͍Α http://vimeo.com/54887751
19. Big Data in the Small (Michael Bevilacqua-Linn) • xfinity.com at Comcast • NetflixΈ͍ͨͳαʔϏεʢຊՈʁݩ૆ʁʣ • Ϋϥ΢υͷσʔλΛΩϟογϡͨ͠Γ͢Δͷ ͰɺMySQLͰ͸εέʔϧ͠ͳ͍ • http://vimeo.com/54270121
20. Riak at OpenX (Anthony Molinaro) • AdϓϥοτϑΥʔϜɺRTBͳͲ • MySQL -> Cassandra -> Riak • MySQL -> CouchDB -> riak_core ͷࣗલΞϓϦ • 1T ads in 2011 ~> 4T ads in 2012 (estm.) • ͋ͱ͸ֆͰ http://bit.ly/YWYJW5
23. 2013?
24. 2013?
25. Riak at Voxer (Matt Ranney) • ೔ຊͰ͍͏LINEΈ͍ͨͳαʔϏε • LAMP?→CouchDB→Riak+node.js • ͪΌΜͱಈ͘ • put/getҎ֎͸஗͍ http://vimeo.com/52827773
26. Riak for All Storage: Voxer
27. Voxer: Initial Stats • 11 Riak nodes (switched from CouchDB • 500GB Data set • ~20k Peak Concurrent Users • ~4MM Daily Request
28. Voxer: Post Growth • ~60 Nodes • 100s of TBs of data (>1TB daily) • ~400k Concurrent Users • >2B Daily Requests
29. Riakͷத਎ͷ࿩
30. Talks by Basho Engineers • Riak Pipe - Riaks’s Distributed Processing Framework by Bryan Fink • Introducing Yokozuna - Searching Riak With Solr by Ryan Zezeski • Building Riak CS on Riak by Reid Draper and Kelly McLaughlin • Cloning the Cloud - Riak and Multi Data Center Replication by Andrew Thompson • Bringing Consistency to Riak by Joseph Blomstedt
31. ͦͷଞ
32. Keep CALM and Query On (Joseph Hellerstein) • ίϯϐϡʔλʔ΍σʔλ ϕʔεͷྺ࢙΍ੑ࣭Λӳ ࠃʹͳͧΒ͑ͯղઆ • CALM - Consistency and Logical Monotonicity • Boom http://vimeo.com/53904989
33. ଞʹ΋ • Advancing Distributed Systems(Eric Brewer) • Using Chef to Manage Distributed Systems(Mandi Walls) • Rebuilding a Bird in Flight(Dana Contreras) • Modern Radiology for Distributed Systems(Dietrich Featherston) • Immutability Changes Everything(Pat Helland) •
34. Q&A •basho.co.jp / github.com/basho/riak •@BashoJapan #riakjp •೔ຊޠML riak-users-jp@lists.basho.com