Share
Embed
分散アプリケーションの高信頼化のための 運用技術に関する研究 / A Study on Operation Technology for High Reliability of Distributed Applications
京都大学大学院 情報学研究科 知能情報学専攻 中間発表(15min)。
Yuuki Tsubouchi (yuuk1)
August 05, 2021
Transcript
14 slides
-
ࢄΞϓϦέʔγϣϯͷߴ৴པԽͷͨΊͷ ӡ༻ٕज़ʹؔ͢Δݚڀ ɾΫϥυΛ༻ͨ͠ΞϓϦέʔγϣϯͷ৴པੑΛ্ͤ͞Δ ΞʔΩςΫνϟΛݚڀ͍ͯ͠Δɻ ɾಛʹɺγεςϜͷӡ༻ঢ়گΛࣔ͢σʔλΛޮతʹऩू͢Δख ๏ʹߩݙͨ͠ɻ ɾݱࡏɺऩू͞Εͨσʔλ͔ΒɺγεςϜʹൃੜ͢Δҟৗͷݪ ҼΛਝʹಛఆ͢ΔͨΊͷσʔλੳख๏Λݚڀ͍ͯ͠Δɻ ௶
༎थ ژେֶେֶӃ ใֶݚڀՊ ೳใֶઐ߈ ത࢜ޙظ՝ఔ 2 தؒൃද 20218݄5 -
2 1. Ϋϥυ্ͷࢄΞϓϦέʔγϣϯ Ϋϥυ্ͷࢄΞϓϦέʔγϣϯͷෳࡶԽ ৴པੑͷ՝: ӡ༻σʔλྔͷ૿Ճ 2. ݚڀख๏ ӡ༻σʔλͷऩूͷߴޮԽ
• [ݚڀՌ1] ଟͷ࣌ܥྻσʔλΛૠೖɾอଘ͢ΔͨΊͷσʔλϕʔε • [ݚڀՌ2] ωοτϫʔΫ௨৴ͷґଘؔͷΦʔόϔουऩू ӡ༻σʔλͷղੳ • [ݚڀՌ3] ࣌ܥྻσʔλͷத͔ΒݪҼஅʹ༗༻ͳܥྻΛநग़ 3. ·ͱΊ/ݚڀ࣮ ൃද༰ͷߏ -
3 Ϋϥυ্ͷࢄΞϓϦέʔγϣϯͷෳࡶԽ ɾ ɾ ɾ ΞΫηε૿Ճ εέʔϧΞτʹΑΔ ϗετͷ૿Ճ ػೳͷ૿Ճ ΑΓେنͳ
ࢄΞʔΩςΫνϟ ϛυϧΣΞͷ૿Ճ RDBαʔό Ωϟογϡ αʔό ݕࡧαʔό Webαʔό ωοτϫʔΫ αʔϏε TCP/UDP ɾ ɾ ɾ ϝσΟΞɺECαΠτɺSNSɺIoTͳͲΛߏ͢ΔࢄΞϓϦέʔγϣϯ -
5 ɾӡ༻σʔλͷऩूΛߴޮԽ͢Δ ܭࢉػͷෛՙΛݮ [ݚڀՌ1] ࣌ܥྻσʔλΛߴޮʹૠೖɾอଘ͢Δσʔλϕʔε [ݚڀՌ2] ωοτϫʔΫ௨৴ͷґଘؔͷΦʔόϔουऩू త: ӡ༻σʔλͷऩूͱղੳͷߴԽʹΑΓ৴པੑΛ্ ͍ͣΕ࣮ڥͷద༻༰қੑΛߟྀ͢Δ
ɾӡ༻σʔλΛղੳ͠ɺোରԠʹ༗༻ͳಎΛಘΔ ೝෛՙΛݮ [ݚڀՌ3] ࣌ܥྻσʔλͷத͔ΒݪҼஅʹ༗༻ͳܥྻΛநग़ ʢ↪จࢽߘதʣ ʢ↪จࢽ࠾ࡁʣ ʢ↪ࠃࡍձٞߘ४උதʣ -
6 ɾҰൠʹɺσΟεΫϕʔεDBɺࡧҾߏʹฏߧΛ༻͢Δ ɾ՝ɿܥྻ(n)ͷ૿Ճʹରͯ͠ɺܭࢉྔ͕O(log n)Ͱ૿Ճ͢Δ ɾཧͷෛ୲Λܰݮ͢ΔͨΊʹɺطଘͷDB্ʹߏ͍ͨ͠ [ݚڀՌ1] ࣌ܥྻσʔλͷऩूͷߴޮԽ ௶༎थ΄͔, HeteroTSDB: ҟछࢄKVSؒͷࣗಈ֊ԽʹΑΔߴੑೳͳ࣌ܥྻσʔλϕʔε,
ใॲཧֶձจࢽ, Vol.62, No.3, pp.818-828, 20213݄. ϝϞϦ ϕʔεDB σΟεΫ ϕʔεDB ϋογϡද O(k) ฏߧ O(log n) σʔλૠೖ dݸͷσʔλΛੵޙʹ ϑϥογϡॻ͖ࠐΈ ղܾɿϝϞϦϕʔεDBͱσΟεΫϕʔεDBͷ֊ԽΛఏҊ M (insertions/s) M / d (insertions/s) -
7 [ݚڀՌ1] ܥྻͷ૿Ճʹର͢ΔૠೖεϧʔϓοτมԽ ɾσΟεΫϕʔεDBͷΈͱൺֱ͠ɺ ࠷େͰ3.96ഒͷεϧʔϓοτ ɾεϧʔϓοτͷԼվળͨ͠ 0 20 40 60
80 100 100 1K 10K 100k 1M 0 20 40 60 Insertion throughput (kilo datapoints / sec) Throughput decrease rate (%) The number of series HeteroTSDB (Proposed) KairosDB HeteroTSDB (Proposed) KairosDB ϝϞϦDB → σΟεΫDBͷҠಈεϧʔ ϓοτͱϝϞϦDBͷεϧʔϓοτͱ ಉఔ 0 20 40 60 80 100 0 300 600 900 1200 1500 1800 0 500 1000 1500 2000 Insertion throughput (kilo datapoints / sec) Memory used size (MB) Elapsed time (sec) Flushed datapoints (/sec) Memory used size (MB) ௶༎थ΄͔, HeteroTSDB: ҟछࢄKVSؒͷࣗಈ֊ԽʹΑΔߴੑೳͳ࣌ܥྻσʔλϕʔε, ใॲཧֶձจࢽ, Vol.62, No.3, pp.818-828, 20213݄. -
(ߘத) Y. Tsubouchi, et al., Low Overhead TCP/UDP Socket-based Tracing
for Discovering Network Services Dependencies, Journal of Information Processing 2022. [ݚڀՌ2] ωοτϫʔΫ௨৴ͷґଘؔऔಘͷޮԽ . . . Kernel User Service Socket Tracing Process … Event Event Event ετϦʔϛϯά๏(Weave Scope) ϑϩʔू๏ ([Datadog], [SAC 20]) ϑϩʔूଋ๏ʢఏҊʣ . . . Kernel Service Socket Tracing Process . . . Event Flow Event Event Event … … . . . . . . User Service Socket Tracing Process . . . ✗ ΧʔωϧˠϢʔβۭؒؒ ͷΠϕϯτͷίϐʔίετ ✗ TCPଓϨʔτ͕૿Ճ͢Δ ͱɺίϐʔίετ͕૿Ճ ෳͷϑϩʔΛूଋ ϑϩʔ= ྆ͷΞυϨεͱϙʔτͷ ʢλϓϧʣ͕ಉҰͷ௨৴୯Ґ Event Event … … Event Event . . . Event Event … Event Event . . . Ұൠతʹ௨৴OSΧʔωϧͷTCP/UDPΛ༻͢Δ͜ͱ ʹண 8 -
9 ɾఏҊख๏ɺCPUར༻2.2%ҎԼɻ ɾϑϩʔͷ૿େʹରͯ͠ɺϑϩʔूଋʹΑΓɺ CPUར༻Λ͘ҡ͍࣋ͯ͠Δ [ݚڀՌ2] ϑϩʔͷ૿େʹର͢ΔCPU༻ྔͷมԽ ఏҊख๏ (ߘத) Y.
Tsubouchi, et al., Low Overhead TCP/UDP Socket-based Tracing for Discovering Network Services Dependencies, Journal of Information Processing 2022. 0 5 10 15 20 25 5 10 15 20 25 30 35 CPU usage / core (%) TCP round trips / sec (x103) Streaming(client) Streaming(server) In-Kernel-Aggr(client) In-Kernel-Aggr(server) In-Kernel-Bundling(client) In-Kernel-Bundling(server) -
εςοϓ1: ظؒதͷมಈͷ߹͍͕খ͍͞ܥྻΛআڈ εςοϓ2: άϥϑͷܗঢ়͕ྨࣅ͢Δͷ͔ΒදܥྻΛநग़ 10 ɾ՝: ίϯϙʔωϯτ͝ͱʹɺಛྔͱͯ͠ܥྻͷछผʢCPU༻ɺϝϞϦ ༻ɺωοτϫʔΫଳҬɺ…ʣΛࢦఆ͢Δඞཁ͋Γ ɾղܾ: ؔ࿈͢ΔશܥྻΛೖྗͱͯ͠༩͑ɺݪҼஅʹ༗༻ͳܥྻΛߴʹநग़
[ݚڀՌ3] ࣌ܥྻσʔλ͔ΒݪҼஅʹ༗༻ͳܥྻΛநग़ ҟৗ ݕ YES ࣌ܥྻσʔλͷऩू ݪҼஅ ҼՌάϥϑΛ ߏங [AutoMAP, Microscope,…] ఏҊ ࣌ܥྻσʔλͷ ࣍ݩݮ ௶༎थ΄͔, TSifter: ϚΠΫϩαʔϏεʹ͓͚Δੑೳҟৗͷਝͳஅʹ͍ͨ࣌ܥྻσʔλͷ࣍ݩݮख๏, Πϯλʔωοτͱӡ༻ٕज़γϯϙδϜจू, 2020. -
11 [ݚڀՌ3] ܥྻݮੑೳͱߴੑ ɾCPUίΞ4ɺܥྻ100k εςοϓ1 ܥྻ୯Ґͷআڈ εςοϓ2 ྨࣅܥྻͷू ߹ܭ
࣮ߦ࣌ؒ 54.41 (sec) 8.68 (sec) 63.09 (sec) ߴੑ ܥྻݮੑೳ ҟৗೖ ίϯϙʔωϯτ A ίϯϙʔωϯτ B CPUաෛՙ 1545/201/122 92.1% 1541/156/89 94.2% ωοτϫʔΫ Ԇ 1596/248/128 91.9% 1543/262/128 91.7% ɾܥྻݮੑೳ͕ɺߴ͍ਫ਼ͷݪҼ அͷͨΊʹे͔Ͳ͏͔ɺࠓ ޙݕূ༧ఆ ɾݱͷোରԠʹద༻͢Δ্Ͱɺ ेͳੑೳΛಘΒΕͨ ௶༎थ΄͔, TSifter: ϚΠΫϩαʔϏεʹ͓͚Δੑೳҟৗͷਝͳஅʹ͍ͨ࣌ܥྻσʔλͷ࣍ݩݮख๏, Πϯλʔωοτͱӡ༻ٕज़γϯϙδϜจू, 2020. -
14 ɾ Y. Tsubouchi, M. Furukawa, R. Matsumoto, Low Overhead
TCP/UDP Socket-based Tracing for Discovering Network Services Dependencies, Journal of Information Processing (JIP), 2022. ͜Ε·ͰͷݚڀՌ: ओͳࠪಡ͖จ δϟʔφϧจ ࠃࡍձٞ ɾ Y. Tsubouchi, M. Furukawa, R. Matsumoto, Transtracer: Socket-Based Tracing of Network Dependencies among Processes in Distributed Applications, The 1st IEEE International COMPSAC Workshop on Advanced IoT Computing (AIOT 2020), July 2020. ࠃγϯϙδϜ ɾ ௶༎थ, ࡔேਓ, ᖛా݈, দխ, খྛོߒ, Ѩ෦ത, দຊ྄հ, HeteroTSDB: ҟछࢄKVSؒͷࣗಈ֊Խ ʹΑΔߴੑೳͳ࣌ܥྻσʔλϕʔε, ใॲཧֶձจࢽ, Vol.62, No.3, pp.818-828, 20213݄. ʢߘதʣ ɾ Y. Tsubouchi, A. Wakisaka, K. Hamada, M. Matsuki, H. Abe, R. Matsumoto, HeteroTSDB: An Extensible Time Series Database for Automatically Tiering on Heterogeneous Key-Value Stores, The 43rd Annual IEEE International Computers, Software & Applications Conference (COMPSAC), pp. 264-269, July 2019. ɾ ௶༎थ, ాതจ, ݹխେ, TSifter: ϚΠΫϩαʔϏεʹ͓͚Δੑೳҟৗͷਝͳஅʹ͍ͨ࣌ܥྻσʔλ ͷ࣍ݩݮख๏, Πϯλʔωοτͱӡ༻ٕज़γϯϙδϜจू, 2020, 9-16 (2020-11-26), 202012݄. ɾ ௶༎थ, ҏจ, ஔాਅੜ, ࢁ૱, ദַ, ഡݪ݉Ұ, ॏෳഉআετϨʔδͷͨΊͷSHA-1ܭ ࢉγεςϜͷSSE໋ྩʹΑΔߴεϧʔϓοτԽ, ిࢠใ௨৴ֶձจࢽ D, 96(10), pp.2101-2109 201310݄. ʢຊൃදʹؚ·ͣʣ