Share
Embed
Transcript
42 slides
-
ࢄKVSͱ ΫϥυετϨʔδ Riak & Riak CS Bashoδϟύϯגࣜձࣾ Senior Software Engineer
্߁ଠ 2013/5/25 ΦʔϓϯιʔεΧϯϑΝϨϯε 2013.Cloud @େࡕ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Φʔϓϯιʔε൛ ༻൛ Ϛϧνσʔληϯλʔؒ
ϨϓϦέʔγϣϯͳͲ Riakͱ͍͏໊લ͕͍͍ͭͯΔͷ Enterprise ࢄܕΫϥυετϨʔδ ࢄσʔλϕʔε -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. • ߴՄ༻ੑ
• ϨΠςϯγʔ • ਫฏ֦ுੑ • োੑ • ӡ༻ͷ༰қ͞ • ༧ଌՄೳੑ Riakͷࢦ͢ͱ͜Ζ • Մ༻ੑΛ࠷༏ઌ • σʔλҰ؏ੑͷ Ϩϕϧνϡʔ χϯάՄೳ CAPఆཧ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Ωʔίϯηϓτ ϚελʔϨε •
ϚϧνϊʔυͷϚελʔϨεΫϥελ KEY VALUE KEY VALUE KEY VALUE bucket • Key/valueͷϖΞΛbucketsʹอଘ • ͲͷΑ͏ͳσʔλλΠϓɺΦϒδΣΫτ όΠφϦͱͯ͠อଘ Object/keyΦϖϨʔγϣϯ node node node node node -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ίϯγεςϯτϋογϡ •
160-‐bitΩʔྖҬ • RingΛִؒͰύʔςγϣϯʹׂ • ύʔςγϣϯΛΫϥελͷ֤ϊʔυ ʹׂΓͯΔ • σʔλͷbucket/KeyͷhashʹΑΓ อଘ͢ΔύʔςγϣϯͷҐஔΛܾఆ ͠ɺ࿈ଓ͢ΔύʔςγϣϯʹϨϓϦ έʔγϣϯσʔλΛอଘ node 0 node 1 node 2 node 3 hash(“bucket/key”) -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Ұ࣌োൃੜ࣌ •
Ұ࣌తͳϊʔυোʢnode 2ʣ͕ൃੜ • PUT, GET, DELETEͷϦΫΤετɺϑΥʔ ϧόοΫϊʔυʢnode 0ʣ node 0 node 1 node 2 node 3 hash(“bucket/key”) -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Ұ࣌ো͔Βͷ෮چ࣌ •
Ұ࣌తͳϊʔυোʢnode 2ʣ͕ൃੜ • PUT, GET, DELETEϦΫΤετɺϑΥʔϧ όοΫϊʔυʢnode 0ʣ • োϊʔυͷ෮چʢnode 2ʣ • “Handoff”ʹΑΓɺσʔλΛϑΥʔϧόο Ϋϊʔυʢnode 0ʣ͔Β෮چϊʔυ ʢnode 2ʣҠߦ • ௨ৗӡ༻Λ࠶։ node 0 node 1 node 2 node 3 hash(“bucket/key”) -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. • ಛఆͷbucket /
keyΛࢦఆ͠ɺඥ͍ͮͨΦϒδΣΫτΛऔಘ • ಛఆͷbucketsʹඥ͍͍ͮͯΔશͯͷkeyΛऔಘ Object/KeyΛࢦఆͯ͠ ɹɹΦϒδΣΫτΛऔಘ • ؆୯ͳΫΤϦݴޠʢHTTPʣΛαϙʔτͨ͠શจݕࡧ • JSON, plain text, XML and ErlangͳͲͷmime-‐typeΛαϙʔτ • ·ͩβ yokozuna • ΫΤϦʔʹ༻Ͱ͖ΔλάɺΛΦϒδΣΫτอଘ࣌ʹઃఆ • ΦϒδΣΫτͷλά໊͓ΑͼΛࢦఆͯ͠ΦϒδΣΫτΛ औಘ Secondary Index (2i) • σʔλͷ͍߹ΘͤɺϑΟϧλϦϯάͷࢄɺղੳͱूܭ • Javascript ͱErlang MapReduce RiakͷσʔλͷΞΫηε -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϚϧνσʔληϯλʔϨϓϦέʔγϣϯ ʢMDCϨϓϦέʔγϣϯʣ
• ෳαΠτؒͷσʔλϨϓϦέʔγϣϯ • σʔλϩʔΧϦςΟ • ॏେࡂԼͰαʔϏεΛܧଓ • ΞΫςΟϒόοΫΞοϓ • ยํ·ͨ྆ํͷಉظ • ProducUonΫϥελʔͱStage༻Ϋϥελʔ ʹΑΓݕূڥΛߏங Primary Cluster (DC#1) Secondary Cluster (DC#2) Secondary Cluster (DC#3) Client Update -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϨϓϦέʔγϣϯϞʔυ
#3 #4,6 Secondary Cluster #3 Primary Cluster #5 #1 TCP connecUon #1) Client͕persistent TCP connecUonΛ։ઃ #2) Client͕Full-‐syncͷىಈΛཁٻ #3) ServerͱClientͷ྆ํͰࣗͷ࣋ͭobjectͷHashΛܭࢉ #4) Client͕ܭࢉ݁ՌΛServerʹ͢ #5) ServerClient͔Βͷ݁ՌΛൺֱࠩ͠Λૹ৴ #6) Clientड৴ͨ͠ObjectΛΞοϓσʔτ #6 #3 #4 #1) Primary Cluster͕UpdateϦΫΤετΛड৴ #2) ϨϓϦέʔγϣϯΛ࡞ #3) ACKड৴ʹΑΓॻࠐΈޭͱஅ #4) ॻࠐΈޭޙɺMDC serverϦΫΤετૹ৴ #5) ServerClientObjectΛૹ৴ #6) Secondary ClusterͰϨϓϦέʔγϣϯΛ։࢝ #1 #2 Primary Cluster Secondary Cluster #5 TCP Connection Real-‐Ume sync Full-‐sync Client update -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ͦͷଞͷػೳ~1.3
• ΞΫςΟϒɾΞϯνΤϯτϩϐʔʢAAEʣͷՃ • ো࣌ɺಉ࣌Ξοϓσʔτͦͯ͠ཧతͳσʔλܽམഁյͳͲʹΑΓൃੜͨ͠σʔλͷඇ Ұ؏ੑͷܧଓతͳम෮Λࣗಈతʹ࣮ߦɻ • ϚϧνσʔληϯλʔϨϓϦέʔγϣϯͷAdvanced modeͷՃ • ৽͘͠Advanced modeʢύΦʔϚϯε্ɺෳTCPίωΫγϣϯͱ؆୯ͳઃఆʣΛՃɻ • IPv6αϙʔτͷ֦ு -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Riak1.4ͷ৽نػೳ(2013.June?)
• ϦϯάαΠζͷมߋ • ༰ྔޮͷ্ • 2i Ͱͷ͍߹ΘͤޮԽ • MDCϨϓϦέʔγϣϯAdvanced mode ʹSSLɼNAT, ϓϩΩγՃ • Riak ControlͷGUIվળ What’s new on Riak1.4 -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Πϯετʔϧ 1. yum
/ apt ͳͲʹbasho ͷϨϙδτϦΛՃ 2. $ sudo apt-get install riak! 3. $ sudo riak start! 4. $ curl http://localhost:8098/ ! -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϊʔυՃ 1. Ճ͢ΔϚγϯΛىಈ
2. $ riak-admin cluster \! join [email protected]! 1. $ riak-admin cluster plan! 2. $ riak-admin cluster commit! ͢Ͱʹىಈͯ͠ ͍ΔΫϥελͷ ͏ͪ୭͔ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϊʔυ 1. $ riak-admin
cluster leave! 2. $ riak-admin cluster plan! 3. $ riak-admin cluster commit! -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ঢ়ଶ֬ೝίϚϯυ 1. $ riak-admin
member-status! 2. $ riak-admin ring-status! 3. $ riak-admin transfers! -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. • Riakࢄܕσʔλϕʔεͷ্ʹ࣮
• γϯϓϧʹར༻ՄೳͳΫϥυετϨʔδ • S3ޓAPI • Ϛϧνςφϯτ • ϚϧναΠτϨϓϦέʔγϣϯ • ςφϯτຖͷωοτϫʔΫͱετϨʔδ ༻ྔͷใࠂػೳ • 24h x 7 daysαϙʔτ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ΫϥΠΞϯτ͔ΒRiak CS API
Λར༻͠ϑΝΠϧΛΞοϓϩ ʔυ Riak CSϑΝΠϧΛ1MBͷν ϟϯΫʹׂ Riak CSνϟϯΫΛRiakϊʔ υʹྲྀ͢ RiakϊʔυνϟϯΫΛϦϓ Ϧέʔγϣϯ͠อଘ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Riak CS ͷϢʔεέʔε
ύϒϦοΫ ΫϥυεετϨʔδ AWSҎ֎ͷS3४ڌͷ ετϨʔδ ΫϥυυϥΠϒ (ҰൠతͳίϯςϯπετϨʔδ) Backup-‐as-‐a-‐Service ΞʔΧΠϒετϨʔ δ ࣾһͱࣾ෦ͷͨ ΊͷετϨʔδ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. APIͱΠϯλϑΣʔε
• Amazon S3 REST API४ڌ • ҰൠతͳS3 libraries / toolsΛར༻Մೳ • REST GET, PUTͱDELETEΦϖϨʔγϣϯ • S3-‐style ACLs Storage API -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. APIͱΠϯλϑΣʔε
• ϢʔβΞΧϯτ࡞ɺΞΧϯτແ ޮԽͱཧ༻ͷΠϯλϑΣʔε • ඪ४ͷS3ೝূεΩʔϚʢϔομͱΫΤ ϦʔύϥϝʔλೝূΛαϙʔτʣ • ཧऀͷΈ͕ϢʔβΞΧϯτͷ࡞ ΛͰ͖ΔΑ͏ʹઃఆՄೳ AdministraUon, Users and AuthenUcaUon -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϚϧνσʔληϯλʔϨϓϦέʔγϣϯ •
ϢʔβؒͰάϩʔόϧͳใʢόέοτͱ ϚχϑΣετʣɺϦΞϧλΠϜʹϨϓϦ έʔγϣϯ • ΦϒδΣΫτใͷϨϓϦέʔγϣϯɺ ϑϧಉظ(Full-‐sync)·ͨϦΞϧλΠϜಉظ (Real Ume)Λબ • Ϣʔβ͕ΦϒδΣΫτͷGETΛཁٻͨ͠ࡍ ʹɺΞΫηεͨ͠αΠτʹΦϒδΣΫτ Λߏ͢ΔϒϩοΫͷҰ෦͕ϨϓϦέʔγ ϣϯ͞Ε͍ͯͳ͔ͬͨ߹ɺΓͳ͍ϒϩ οΫΛ”ΦϦδϯ”ͷΫϥελʔଆ͔Βऔಘɺ ࠶ߏ How It Works -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Riak CS 1.4
ͷ৽ػೳ(2013. June) • OpenStack API Ճ • ରԠ S3 API ͷՃ • Ϣʔβʔཧͷ֦ॆ What’s new! -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Riak ͷద༻γφϦΦ
• Ad Networks • Digital Media • On-‐Line Games • Social Networks • Social Analysis • Cloud Operators • Messaging Services • Product Catalogs • Document Management • Health Care InformaUon Management -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ใͷอ •
֦ுੑͱϢʔβΤΫεϖϦΤϯεͷύϑΥ ʔϚϯεվળ • bestbuy.comͱখചΓళฯͰ༻͢ΔΦϯ ϥΠϯΧλϩάɺϨʔςΟϯάʹRiak Λબɻ • Holiday ShoppingʢΫϦεϚεηʔϧͳ Ͳʣ࣌ʹ߹ΘͤͯϊʔυՃɻ • Bestbuy.comͷϗʔϜϖʔδϨϯμϦϯά ͷSLA̍ඵҎɻ • 2013ͷHoliday seasonʹɺSKUͰ26ඦ ສ͔Β500ඦສ֦ுΛఆɻ • Amazon AWSͷෳAvailability Zone্ʹRiak ΫϥελʔΛߏங -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϝχϡʔγεςϜ • ॳAmazon
S3Λ༻; On demandϝχϡʔͷϥϯ υτϦοϓϨΠςϯγʔͷݮΛୡ • ߴͳಡΈग़͠/ॻࠐΈͷͨΊRiakΛબ • Video On demandϝχϡʔͷΞάϦήʔτʹඞཁͳ σʔλΛอଘ • ϚʔέςΟϯάΩϟϯϖʔϯʹকདྷ༻͢ΔͰ͋Ζ ͏Ϣʔβؔ࿈ͷใΛอଘ • ຖɺϦϞʔτίϯτϩʔϥ͔Βͷ25MΫϦοΫ Λॲཧ • On demandϝχϡʔͷͨΊʹ̏ΧॴͷDCʹRiakΫϥ ελʔΛߏஙɻ • ϚʔέςΟϯά༻ʹ̐ͭͷΫϥελʔΛߏங -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ϔϧεέΞใཧ • HealthσʔλΛγΣΞɺΞΫηε͢ΔͨΊͷHIPAA४
ڌͷWebͱܞଳిͷϓϥοτϑΥʔϜΛߏங • ίετݮͱߴՄ༻ੑɾ֦ுੑͷཱ྆ • ߴͳಡΈग़͠/ॻࠐΈͷͨΊRiakΛબ • mHealthɺܞଳిɺαʔϏε͓Αͼҩྍػث͔ ΒͷσʔλΛऩूʢױऀ͕औಘσʔλΛঝೝʣ • 2015ʹ500M appsΛఆɻ • ̏ΧॴͷDCʹRiakΫϥελʔΛߏஙɻ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Πϕϯτཧ • ϥΠηϯείετͷݮ͓Αͼӡ༻ͷ༰қ͞
• Ϣʔβొใ͓ΑͼϢʔβΠϕϯτϩάͷอଘɻ ʢϢʔβ͕Webར༻ঢ়گϞχλʔΛޙ͔ΒνΣο Ϋʣ • Πϕϯτ௨αʔϏεʹͯ৽نใΞοϓσʔτ௨ Λ৴͢ΔͨΊͷΫΤϦ༻DBʹ༻ • 14,000 read request/sec • 2013தʹ3ՕॴͷDCϔ֦ு༧ఆ • Πϕϯτ௨αʔϏεɺ50ඦສίωΫγϣϯ/ Λఆɻ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. ΦϯϥΠϯࠂ • DCϨϓϦέʔγϣϯͱ֦ுੑͷඞཁ͔Β
MySQL → Cassandra → Riak ͱϦϓϨʔε • ϢʔβΞΫςΟϏςΟσʔλ͓ΑͼτϥϑΟο ΫσʔλΛอଘ • τϥϑΟοΫσʔλMySQL͔ΒҠߦʢෳDC ؒͷσʔλϨϓϦέʔγϣϯ͕ඞཁʣ • ϢʔβσʔλCassandra͔ΒҠߦʢbackward compaUbility͕֬อͰ͖͍ͯͳ͍͜ͱ͕աڈͷ ϦϦʔεʹ͋Γɺ৴༻Ͱ͖ͳ͍ͨΊܾஅʣ • 5ΧॴͷDCؒͰσʔλϨϓϦέʔγϣϯ • 2011ʹ4 trillionͷadσʔλΛѻ͏ɻ advertising conomic potential of uding OpenX mpTime) provide a bining ad serving, an ad exchange, a Supply Side Platform, and ach year. OpenX uses Riak for user and trafficking data behind its data services API. They selected Riak due to its highly available, low-latency, redundant architecture. OpenX also uses Riak’s multi- datacenter replication across several data centers, providing up-to-date data throughout its global infrastructure. For more details about how OpenX uses Riak, check out the video of Anthony Molinaro, OpenX engineer, speaking at RICON2012, Basho’s 2012 developer conference. ng technology provider. gencies, mobile operators, active and measurable obile devices. In 2009, rly all of the broadcasters le operators. With the dly, they needed to move to an architecture that could gracefully new platform because it is distributed, scalable, and highly mes of traffic. they opted to build two geographically separated, mirrored sites ation feature. As Marcus Kern, VP of Technology at Velti, ver 140 customers. We cannot afford a single minute of d exceed our requirements for scale, data durability, and 2009࣌ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. υΩϡϝϯτετϨʔδ • ΦϒδΣΫτετΞΛMySQL͔ΒRiakϦϓ
Ϩʔε • ΞϓϦέʔγϣϯ͕ѻ͑ΔΦϒδΣΫτϑΝ ΠϧͷαΠζ֦େԽΛ࣮ࢪ • HRΞϓϦέʔγϣϯ͕ऩू͢ΔΦϒδΣΫτ ϑΝΠϧΛอଘ • ΦϒδΣΫτϑΝΠϧΛෳͷDCͷΫϥελ ʹϨϓϦέʔγϣϯɻ • ·ͨQA࣍ظϦϦʔεͷͨΊͷStage༻Ϋϥε λϨϓϦέʔγϣϯɻ • ̕ΧॴͷΫϥελʢStage༻ΫϥελΛؚΉʣ Workday DRIVERS 1. Replace MySQL object store. 2. Implement ability to dramatically increase the size of attachments accepted by the Workday application. STATS 1. Nine 5 node clusters spread across 3 data centers and 3 application zones. FACTOIDS 1. At Workday IPO in October 2012, Workday shares opened at $48.05 USE CASE 1. Host and store attachments collected by the Workday HR application. 2. Replicate attachments across several clusters including initial customer setup, ongoing production, and QA for upcoming releases. Workday Application! Riak! Workday Blobitory! Real Ume replicaUon Prod#1 (Dublin) Prod#2 (Ams) Stage (Dublin) BidirecUonal replicaUon Real Ume DirecUonal ReplicaUon -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. :BIPP+"1"/ • ΠϯλʔωοτγϣοϐϯάαΠτͷϓ
ϥοτϑΥʔϜΛYahoo!δϟύϯ͕ఏڙ • γϣοϐϯάαΠτͷը૾σʔλΛRiak CSʹετΞ • ొΦϒδΣΫτɿ20ສ݅ʢ2012 ࣌ʣ • ϦΫΤετɿ450 req/sec • Ϩεϙϯεɿ10ms – 80ms • ߏஙɿ1ɻ • S3ޓΫϥυετϨʔδαʔϏεΛఏڙ • 2ΧॴͷDCؒͰσʔλϨϓϦέʔγϣϯ -
©2013 BASHO TECHNOLOGIES INC. ALL RIGHTS RESERVED. Questions? • Twitter
@BashoJapan • Me [email protected] • ML [email protected] • Basho/TED @ లࣔϒʔε