Riak intro RICON 2012 report 2013/3/12 Riak Meetup Tokyo @ Roppongi Midtown Yahoo!JAPAN #riakjp

•্੢߁ଠ @kuenishi •Bashoδϟύϯגࣜձࣾ •෼ࢄγεςϜͷݚڀ΍։ൃΛ5೥͘Β͍ •೔ຊ๏ਓ͕9݄ʹͰ͖ͨ ͓લɺ୭Α

ۓٸΞϯέʔτ • RiakΛฉ͍ͨ͜ͱ͕͋Δ [Y/y]? • RiakΛ͢Ͱʹ࢖͍ͬͯΔ [y/n]? • ϗϯτʹ࢖͑Δͷʁͱٙ໰ʹࢥ͍ͬͯΔ [Y/n]?

• DynamoʹΠϯεύΠϠ͞Εͨ • Consistent HashingʹΑΓਫฏ෼ࢄ͢Δ • Vector ClocksΛ༻͍ͯϨϓϦέʔγϣϯ͠ • Erlang/OTPͰಈ࡞͢Δ • ෼ࢄKVSͰ͋Δ WikiPedia: Vector Clocks

Consistent Hashing and Replicas / Vector Clocks Link Walking Gossiping Append-only stores Virtual Nodes / Handoff and Rebalancing HTTP / Protocol Buffers Secondary Index / MapReduce

No content

No content

No content

• Riakͷ্Ͱಈ࡞͢Δ • εέʔϧΞ΢τՄೳͰ • AWS S3ޓ׵ͷAPIΛ࣋ͪ • Erlang/OTPͰಈ࡞͢Δ • Ϋϥ΢υετϨʔδ Clouds and Storages by cowlishaw, on Flickr

• ෼ࢄγεςϜɺ෼ࢄDBͷΠϯμετϦΞϧͳ ΧϯϑΝϨϯε • Bashoओ࠵ͳͷͰRiak੒෼ଟΊ • Riak͚ͩ͡Όͳ͍ˍRiakҎ֎ͷਓ΋Welcome • ࣄྫ΋ଟ͍

No content

No content

No content

େ͖͘෼ྨ͢Δͱ… • Riakͷࣄྫͷ࿩ by αʔϏεΛ࡞͍ͬͯΔਓ • Riakʹؔ܎͢Δ࿩ by αʔϏεΛ࡞͍ͬͯΔਓ • Riakͷத਎ͷ࿩ by Basho Eng. • ෼ࢄγεςϜͷࣄྫɾ঺հɾྺ࢙ͳͲ

Riakࣄྫͷ࿩

Building a Transaction Logs-based Protocol on Riak (Will Moss and Tim Douglas) • BumpͰ͸2010ʙ2012ʹ͔͚ͯɺMongoDBΛ ΍ΊͯRiakʹͨ͠ • FlockͰ͸΋ͪΖΜRiak • ෳ਺ͷϨίʔυʢϢʔβɺΠϕϯτʣΛߋ৽͢ ΔͨΊʹLocking͢ΔϚγϯΛ1୆͚ͩ༻ҙ • Conflict resolution͸montage http://vimeo.com/53550624

Pattern of Innovation: Riak Usage at Best Buy (Joel Crabb) • Amazon, Walmartʹ͙࣍શถୈ3Ґͷখച • Product CatalogΛRiakͰ • RiakͷΑ͏ͳ৽͍͠ϞϊΛଞࣾʹઌۦ͚ͯͲ ͏΍ͬͯಋೖ͢Δ͔ɺ·ͨ͸Πϊϕʔγϣϯ Λى͜͢ํ๏ http://vimeo.com/54384814

Migrating from MySQL to Riak (George Resse) • enStratus • ෳ਺ͷΫϥ΢υΛ੾Γସ͑ͨΓ૊Έ߹Θͤͯ ࢖͑ΔΑ͏ʹ͢ΔαʔϏε • Ϋϥ΢υͷσʔλΛΩϟογϡͨ͠Γ͢Δͷ ͰɺMySQLͰ͸εέʔϧ͠ͳ͍ • Dasein Persistence as “ORM” • 2i+MapReduceΘΓͱΑ͍Α http://vimeo.com/54887751

Big Data in the Small (Michael Bevilacqua-Linn) • xfinity.com at Comcast • NetflixΈ͍ͨͳαʔϏεʢຊՈʁݩ૆ʁʣ • Ϋϥ΢υͷσʔλΛΩϟογϡͨ͠Γ͢Δͷ ͰɺMySQLͰ͸εέʔϧ͠ͳ͍ • http://vimeo.com/54270121

Riak at OpenX (Anthony Molinaro) • AdϓϥοτϑΥʔϜɺRTBͳͲ • MySQL -> Cassandra -> Riak • MySQL -> CouchDB -> riak_core ͷࣗલΞϓϦ • 1T ads in 2011 ~> 4T ads in 2012 (estm.) • ͋ͱ͸ֆͰ http://bit.ly/YWYJW5

No content

No content

2013?

2013?

Riak at Voxer (Matt Ranney) • ೔ຊͰ͍͏LINEΈ͍ͨͳαʔϏε • LAMP?→CouchDB→Riak+node.js • ͪΌΜͱಈ͘ • put/getҎ֎͸஗͍ http://vimeo.com/52827773

Riak for All Storage: Voxer

Voxer: Initial Stats • 11 Riak nodes (switched from CouchDB • 500GB Data set • ~20k Peak Concurrent Users • ~4MM Daily Request

Voxer: Post Growth • ~60 Nodes • 100s of TBs of data (>1TB daily) • ~400k Concurrent Users • >2B Daily Requests

Riakͷத਎ͷ࿩

Talks by Basho Engineers • Riak Pipe - Riaks’s Distributed Processing Framework by Bryan Fink • Introducing Yokozuna - Searching Riak With Solr by Ryan Zezeski • Building Riak CS on Riak by Reid Draper and Kelly McLaughlin • Cloning the Cloud - Riak and Multi Data Center Replication by Andrew Thompson • Bringing Consistency to Riak by Joseph Blomstedt

ͦͷଞ

Keep CALM and Query On (Joseph Hellerstein) • ίϯϐϡʔλʔ΍σʔλ ϕʔεͷྺ࢙΍ੑ࣭Λӳ ࠃʹͳͧΒ͑ͯղઆ • CALM - Consistency and Logical Monotonicity • Boom http://vimeo.com/53904989

ଞʹ΋ • Advancing Distributed Systems(Eric Brewer) • Using Chef to Manage Distributed Systems(Mandi Walls) • Rebuilding a Bird in Flight(Dana Contreras) • Modern Radiology for Distributed Systems(Dietrich Featherston) • Immutability Changes Everything(Pat Helland) •

Q&A •basho.co.jp / github.com/basho/riak •@BashoJapan #riakjp •೔ຊޠML [email protected]