Share
Embed
超個体型データセンターを目指した分散協調クエリキャッシングの構想 / QuorumCache Architecture
https://www.iot.ipsj.or.jp/meeting/45-program/
第45回情報処理学会インターネットと運用技術研究会 (IOT)
(14) ◯坪内 佑樹,松本 亮介(さくらインターネット株式会社):超個体型データセンターを目指した分散協調クエリキャッシュ構想
Yuuki Tsubouchi (yuuk1)
May 24, 2019
Transcript
23 slides
-
͘͞ΒΠϯλʔωοτ גࣜձࣾ (C) Copyright 1996-2019 SAKURA Internet Inc ͘͞ΒΠϯλʔωοτ ݚڀॴ
ݸମܕσʔληϯλʔΛࢦͨ͠ ࢄڠௐΫΤϦΩϟογϯάͷߏ 2019/05/24 ݚڀһ ௶ ༎थ ௶༎थ, দຊ྄հ ୈ45ճΠϯλʔωοτͱӡ༻ٕज़ݚڀձ(IOT45) -
4 ɾWebαʔϏεͷԠ͕͍ͱར༻ऀ͔Βར༻͞Εͳ͘ͳΔͱ͍ ͏ใࠂ[1]͕͋ΓɼWebαʔϏεͷԠੑೳͷ্͕ॏཁͰ͋Δ ɾWebαʔϏεͷԠԆΛ࣍ͷΑ͏ʹղͰ͖Δ ɾ(1) ར༻ऀͷ্Ͱͷॲཧ ɾ(2) ͔Βσʔληϯλʔαʔό·ͰͷωοτϫʔΫసૹ ɾ(3) σʔληϯλʔͰͷॲཧ
ɾ(2)͕ࢧతͰ͋Δͱ͍͏ݚڀ[2]͕͋Δ(100msͷ͏ͪ80msΛΊΔ) ԠੑೳʹΊΔωοτϫʔΫసૹԆͷ [1] Forrester Consulting: eCommerce Web Site Performance Today: An Updated Look At Consumer Reaction To A Poor Online Shopping Experience 2009. [2] S Choy, B Wong, G Simon and C Rosenberg: The Brewing Storm in Cloud Gaming: A Measurement Study on Cloud to End-User Latency, 11th Annual Workshop on Network and Systems Support for Games, p. 2 2012. -
5 ݸମܕσʔληϯλʔ ɾதԝूݖͷΫϥυίϯϐϡʔςΟϯάͷΈͰղܾͰ͖ͳ͍ ɾར༻ऀͱσʔληϯλʔؒͷωοτϫʔΫԆ ɾதԝͷσʔληϯλʔͷ্ΓͱԼΓͷωοτϫʔΫτϥώοΫྔ ɾখɾதنͷσʔληϯλʔখܕͷϥοΫ܈Λཧతʹࢄͤ͞Δ ɾࢄ֤ͨ͠σʔληϯλʔಠཱͯ͠ػೳ͠ͳ͕Βɼ૯ମͱͯ͠ ౷͞Ε͍ͯΔΑ͏ʹݟ͑Δݸମతͳσʔληϯλʔ[12]Λࢦ͢ ɾ֤σʔληϯλʔͷॴنΛҙࣝͤͣʹɼಁաత͔ͭߴʹσʔ λΛಡΈॻ͖Ͱ͖Δඞཁ͕͋Δ
[12] দຊ྄հ, ௶༎थ, ٶԼ߶ี: ࢄܕσʔληϯλʔOSΛࢦͨ͠ϦΞΫςΟϒੑΛ࣋ͭίϯςφ࣮ߦج൫ٕज़ɼใॲཧֶձݚڀใࠂΠϯλʔωο τͱӡ༻ٕज़(IOT) ɼVol. 2019-IOT-44, No. 27, pp. 1–8 2019. -
6 ɾཁ݅1: ࢄͨ͠σʔληϯλʔಁաతʹΞΫηεՄೳ ɾ1.1: ΞΫηεͨ͠σʔληϯλʔʹΑΒͣσʔλΛߴࢀরՄೳ ɾશͯͷࢄσʔληϯλʔʹΩϟογϡͷෳΛஔ ɾ1.2: σʔληϯλʔؒͰҰ؏ͨ͠σʔλΛࢀরՄೳ ɾॻ͖ࠐΈʹରͯ͠ߋ৽༰Λ֤Ωϟογϡͷෳʹൖ ɾཁ݅2:
طଘͷΞϓϦέʔγϣϯΛมߋͤͣʹར༻Մೳ ɾڧ͍Ұ؏ੑͷͨΊʹॻ͖ࠐΈʹରͯ͠ಉظతʹΩϟογϡΛߋ৽ ɾΞϓϦέʔγϣϯͱσʔλϕʔεͷؒͰΫΤϦͷ݁ՌΛΩϟογϡ ݸମܕσʔληϯλʔDBͷཁ݅ είʔϓ: ಈతίϯςϯπͷ৴ͷߴԽͷͨΊʹಡΈࠐΈੑೳΛ্ -
7 ࢄσʔληϯλʔ্Ͱͷෳͷ՝ ɾಉظߋ৽࣌ʹωοτϫʔΫԆͷେ͖͍σʔληϯλʔʹ͞Εͯ Ԡੑೳ͕Լ͢Δ͜ͱ Replica Origin (1) ॻ͖ࠐΈཁٻ Replica Replica
(2) ಉظߋ৽ ຊൃදͰɼ͜ͷ՝Λղܾ͢Δ ΞʔΩςΫνϟΛఏҊ͢Δ Edge Datacenter Central Datacenter -
11 ࢄσʔληϯλʔͷσʔλஔͷ՝ Replica Origin (1) ॻ͖ࠐΈཁٻ Replica Replica (2) ಉظߋ৽
(a) ֤σʔληϯλʔͰಉҰσʔλΛ ෳஔ ← ಡΈࠐΈओମͳΒͪ͜Β (b) ಛఆͷσʔληϯλʔ্ʹͷΈ σʔλΛஔ Origin Shard ॻ͖ࠐΈ࣌ʹωοτϫʔΫ Ԇͷେ͖͍σʔληϯ λʔʹ͞ΕΔ ಡΈࠐΈ࣌ʹωοτϫʔΫ Ԇͷେ͖͍σʔληϯ λʔʹ͞ΕΔ (1) ಡΈࠐΈཁٻ Shard Shard (2) σʔλసૹ ཁٻ͢Δσʔλ͕ଘࡏ -
12 ࢄΫΤϦΩϟογϡͷઌߦख๏ ɾFerdinand[12]ࢄϋογϡςʔϒϧ ʹΑΓෳͷϊʔυؒͰΫΤϦϦβϧτ ΩϟογϡΛڞ༗͢Δ ɾϊʔυؒͷϨΠςϯγ͕େ͖͘ͳΔͱε ϧʔϓοτ͕Լ͢Δ࣮ݧใࠂ͕͋Δ ɾಛఆͷϊʔυʹΩϟογϡΛஔ͢Δͨ Ίʹύλʔϯ(b)ͱ͍͑Δ [12]
C Garrod, A Manjhi, A Ailamaki, B Maggs, T Mowry, O Christopher and T Anthony: Scalable Query Result Caching for Web Applications, VLDB Endowment, Vol. 1, No. 1, pp. 550–561 2008. จݙ[12] Figure 5ΑΓҾ༻ -
14 มԽʹԠͯ͡ੑೳΛ࠷େԽ͢Δج൫ 1. ಉظߋ৽ͷൣғΛωοτϫʔΫԆʹԠͯ͡ௐઅՄೳ ɾதԝσʔληϯλʔͱࢄσʔληϯλʔؒͷԆ࣌ؒΛڑʹݟ ཱͯɼಉظߋ৽ͷൣғΛʮۙωοτϫʔΫڑʯมͰදݱ ɾมͷΛௐઅ͢Δ͜ͱʹΑΓɼԠੑೳΛ࠷େԽ͢Δ 2. ΞϓϦέʔγϣϯͷಡΈॻ͖ൺʹԠͯ͡ಉظߋ৽ͷൣғΛదԠతʹ ܾఆՄೳ
ɾۙωοτϫʔΫڑͷ࠷దɼಡΈࠐΈճ͕ॻ͖ࠐΈճʹ ൺͯͲͷఔࢧత͔Ͱܾ·Δ -
16 QuorumCacheͷಈ࡞ϑϩʔ Central Datacenter Origin Replica Replica Replica Replica d:
ۙωοτϫʔΫڑ Edge Datacenter Replica Replica d (1) ॻ͖ࠐΈཁٻ (2) ॻ͖ࠐΈཁٻ సૹ (3) ಉظߋ৽ (i) ಡΈࠐΈཁٻ (ii) dҎͷσʔλ ηϯλʔ͔Β ಡΈࠐΈ Replica (4) ඇಉظߋ৽ -
20 γεςϜߏ HTTP Proxy Central Datacenter Web App DB Proxy
Database HTTP Request Caching ಡΈॻ͖ൺͷ ܭଌ(HTTP) ಡΈॻ͖ൺͷ ܭଌ(DBΫΤϦ) Ԡੑೳͷܭଌ Query Pinger Ping ωοτϫʔΫڑ ͷܭଌ DB Proxy Web App HTTP Proxy ɾ੍ޚϙΠϯτͱͯ͠HTTPͱDBͷʹϓϩΩγΛஔ Forward Edge Datacenter