Share
Embed
NSDI'16: Distributed Systems
NSDI2016論文読み会 (http://system-reading.connpass.com/event/31207/ ) 、Distributed Systems Session の論文紹介で使用した資料です。
disktnk
May 29, 2016
Transcript
37 slides
-
CONTENTS • Consensus in a Box: Inexpensive Coordination in Hardware
(ETH Zürich) • StreamScope: Continuous Reliable Distributed Processing of Big Data Streams (Microsoft, Microsoft Research) • Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks (Facebook) • The Design and Implementation of the Warp Transactional Filesystem (Cornell University) • BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores (University of California, Berkeley) հ͢Δจ https://www.usenix.org/conference/nsdi16/technical-sessions -
CONTENTS • Consensus in a Box: Inexpensive Coordination in Hardware
• StreamScope: Continuous Reliable Distributed Processing of Big Data Streams • Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks • The Design and Implementation of the Warp Transactional Filesystem • BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores հ͢Δจ -
ͲΜͳ՝Λղܾ͠Α͏ͱ͍ͯ͠Δͷ͔ Consensus in a Box: Inexpensive Coordination in Hardware •
γεςϜ߹ҙίετ (࣮ͷෳࡶ͞ɾॲཧ࣌ؒ) ͕େ͖͍ • γεςϜ߹ҙͱجຊతʹҎԼͷ4ͭΛຬͨ͢ඞཁ͕͋Δ • Termination (Liveness) / Validity / Integrity / Agreement • PAXOS, RAFT ͳͲ • ݫີͳworkload͕ඞཁͱ͞Ε͍ͯΔγεςϜͰ߹ҙ͕ඞਢͩ ͕ɺύϑΥʔϚϯεεέʔϥϏϦςΟͷ੍ʹͳΔ͜ͱ͕ଟ͍ -
Ͳ͏ͬͯղܾͨ͠ͷ͔ • Zookeeperͷ atomic broadcast (ZAB) Λ FPGA ʹ࣮ͯͨ͠ Consensus
in a Box: Inexpensive Coordination in Hardware -
CONTENTS • Consensus in a Box: Inexpensive Coordination in Hardware
• StreamScope: Continuous Reliable Distributed Processing of Big Data Streams • Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks • The Design and Implementation of the Warp Transactional Filesystem • BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores հ͢Δจ -
ͲΜͳ՝Λղܾ͠Α͏ͱ͍ͯ͠Δͷ͔ StreamScope: Continuous Reliable Distributed Processing of Big Data Streams
• ϏοάσʔλͰετϦʔϜॲཧ͕Γ͍ͨ • ෳࡶੑɺεέʔϥϏϦςΟɺfault tolerance (ނোੑ) ͕ٻΊΒ ΕΔ • ετϦʔϜॲཧͷσʔλϑϩʔͷ෮چ • ೖྗΠϕϯτͷ࠶ૹɺεςʔτ (ঢ়ଶ) ͷ෮چ ˠΠϕϯτͷϩετ͋Δ͍ॏෳΠϕϯτΛ͍͗ͨ -
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams •
σʔλϑϩʔΛ DAG ͱͯ͠දݱ͠ɺϊʔυͱΤοδͷґଘΛ rStream / rVertex ͱͯ͠நԽ • recoveryͷ࣮ݱ • SCOPE ͱ͍͏ Parallel Map Reduce ࣮ͷ֦ு Ͳ͏ͬͯղܾͨ͠ͷ͔ http://www.vldb.org/pvldb/1/1454166.pdf -
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams •
STREAM SCOPE (StreamS) ͷ࣮ߦ Ͳ͏ͬͯղܾͨ͠ͷ͔ -
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams •
STREAM SCOPE (StreamS) ͷ࣮ߦ Ͳ͏ͬͯղܾͨ͠ͷ͔ rStream rVertex -
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams •
rStream • vertex (ΠϕϯτΛॲཧ͢Δϊʔυͷ૯শ) ͷґଘΛɾந Խͨ͠ඇಉظίϛϡχέʔγϣϯνϟϯωϧ • seq Λ࣋ͭɻಉ͡ seq Λ࣋ͭ event ͷॻ͖ࠐΈ͕ޭ͢Δ·Ͱ ಡΈࠐΈऴΘΒͳ͍ɻ • φΠʔϒʹ࣮͢ΔͱಉظϞσϧʹͳΔͷͰ GC ϞσϧΛ࠾༻ Ͳ͏ͬͯղܾͨ͠ͷ͔ -
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams •
rVertex • vertex Ͱͷܭࢉʹରͯ͠γϯϓϧͳεφοϓγϣοτΛऔΔɻ • εςʔτͷ restart ٴͼ failure recovery Λ࣮ Ͳ͏ͬͯղܾͨ͠ͷ͔ -
StreamScope: Continuous Reliable Distributed Processing of Big Data Streams •
νΣοΫϙΠϯτͷִؒӬଓԽͷλΠϛϯάʹΑͬͯෳͷނো ෮چϞσϧΛ࠷খ͢Δ͜ͱ͕Ͱ͖Δ • strict model / relaxed model … • Ͳ͜Ͱނোͨ͠ͷ͔σόοά͢Δͷ͕؆୯ • σϓϩΠٴͼ (rStream / rVertex) Ҏ֎ͷ࣮طଘࢿ࢈ (ओʹ SCOPE) Λྲྀ༻͢Δ͜ͱ͕Ͱ͖Δ ݕূ -
CONTENTS • Consensus in a Box: Inexpensive Coordination in Hardware
• StreamScope: Continuous Reliable Distributed Processing of Big Data Streams • Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks • The Design and Implementation of the Warp Transactional Filesystem • BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores հ͢Δจ -
ͲΜͳ՝Λղܾ͠Α͏ͱ͍ͯ͠Δͷ͔ • େྔͷHTTPϦΫΤετΛͲͷΑ͏ʹࡹ͖ɺΩϟογϡΛ֤Ϋϥελ ຖʹͲ͏ͬͯࢄͤ͞Δ͔ɻޮతͳࢄΛߦ͍͍ͨ • balanced / adaptive / stable
/ fast decision Λຬ͍ͨͨ͠ Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks -
• ιʔγϟϧάϥϑΛ੩తʹஔͰ͖Δ “object” ͱ ಈతʹஔ͢Δ “group” ʹ໌ࣔతʹ • Facebook ͷ
TAO (ιʔγϟϧάϥϑ͚ࢄDB) Λ༻ • static assignment • ࣅͨάϥϑͷ object ΛूΊΔɻσʔλΞΫηεύλʔϯΛάϥϑ ͱͯ͠දݱ͠ɺׂɻσʔλ͕େ͖͍ͱ͍ɻ Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks Ͳ͏ͬͯղܾͨ͠ͷ͔ -
• dynamic assignment • มԽ͢Δใʹରͯ͠ಈతʹόϥϯγϯάɻݕূͰ bipartite graph partitioning Λ༻ Social
Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks Ͳ͏ͬͯղܾͨ͠ͷ͔ -
Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations
on Social Networks ݕূ -
Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations
on Social Networks ݕূ -
CONTENTS • Consensus in a Box: Inexpensive Coordination in Hardware
• StreamScope: Continuous Reliable Distributed Processing of Big Data Streams • Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks • The Design and Implementation of the Warp Transactional Filesystem • BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores հ͢Δจ -
ͲΜͳ՝Λղܾ͠Α͏ͱ͍ͯ͠Δͷ͔ • ͜Ε·ͰͷࢄϑΝΠϧγεςϜ • ෆेͳอূ / ੍ͷଟ͍ΠϯλʔϑΣʔε / εέʔϧ͠ͳ͍ •
ࢄϑΝΠϧγεςϜͷϓϩτίϧͷ֦ுɻུͯ͠ WTF • PAXOS API + new zero-copy API The Design and Implementation of the Warp Transactional Filesystem -
• file slicing API The Design and Implementation of the
Warp Transactional Filesystem Ͳ͏ͬͯղܾͨ͠ͷ͔ -
• file slicing API • metadata strage ͕ slice ͷϙΠϯλΛ࣋ͭ
• file offset ͢Δɻoverwrite ͨ͠߹ compaction ͕Δɻmeta data compaction • Θͳ͍෦ GC ͞ΕΔ • fragmentation ͕ى͜ΔͷͰɺܧଓతʹ locality-aware slice placement Λ༻ The Design and Implementation of the Warp Transactional Filesystem Ͳ͏ͬͯղܾͨ͠ͷ͔ -
• Map Reduce Sort ࣌ͷ store ʹ༻ˠ࣮ߦ͕࣌ؒ 70min ͔Β 15min
• Videoฤूˠ࣌ܥྻιʔτ͕ૣ͘ͳͬͨ • ͦͷଞ2ͭհ The Design and Implementation of the Warp Transactional Filesystem Ԡ༻ΞϓϦέʔγϣϯ -
CONTENTS • Consensus in a Box: Inexpensive Coordination in Hardware
• StreamScope: Continuous Reliable Distributed Processing of Big Data Streams • Social Hash: An Assignment Framework for Optimizing Distributed Systems Operations on Social Networks • The Design and Implementation of the Warp Transactional Filesystem • BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores հ͢Δจ -
ͲΜͳ՝Λղܾ͠Α͏ͱ͍ͯ͠Δͷ͔ • σʔλετΞʹஔ͍ͯɺϥϯμϜΞΫηεͱݕࡧͷ2͕ͭجຊతͳ ૢ࡞ • NoSQLେ͖ͳσʔλͷରԠ͕·ͣઌͰɺͦͷ࣍ʹ store Λ͍͔ ʹૣ͘͢Δ͔ͱ͍͏Ξϓϩʔν •
େ͖ͳσʔλʹରԠ͢ΔͨΊʹѹॖΛར༻͍ͯ͠Δ͕ɺεϧʔϓο τͱͷτϨʔυΦϑ͕ଘࡏ͢Δ BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores -
• Layered Sampled Array (LSA) ͱ͍͏৽͍͠σʔλߏΛఏҊ͠ɺτ ϨʔυΦϑۂઢΛಈతʹม͑ΒΕΔΑ͏ʹͨ͠ BlowFish: Dynamic Storage-Performance
Tradeoff in Data Stores Ͳ͏ͬͯղܾͨ͠ͷ͔ -
• Succinct store BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores
Ͳ͏ͬͯղܾͨ͠ͷ͔ https://www.usenix.org/conference/nsdi15/technical-sessions/presentation/agarwal -
• Succinct Λෳͷ sampling rate Ͱ store Ͱ͖ΔΑ͏ʹ֦ு BlowFish: Dynamic
Storage-Performance Tradeoff in Data Stores Ͳ͏ͬͯղܾͨ͠ͷ͔ -
• γϟʔσΟϯά࣌ʹͲ͏ͬͯ sampling rate Λௐઅ͢Δ͔ʁ ˠઌߦݚڀ: Back-pressure style scheduling BlowFish:
Dynamic Storage-Performance Tradeoff in Data Stores Ͳ͏ͬͯղܾͨ͠ͷ͔ http://dl.acm.org/citation.cfm?id=1285032 -
• FacebookͷΫϥελͰ 90% ͕ transient failure • 1ͭͷϨϓϦΧ͕ނোͨ࣌͠ͷϩʔυϦΧόϦ͕3ഒߴԽ BlowFish: Dynamic
Storage-Performance Tradeoff in Data Stores ධՁ