Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
ゆううきの研究開発まとめ (2019年2月版) / The summary of yuuki's research and development in 02/2019
Yuuki Tsubouchi (yuuk1)
February 13, 2019
Research
1
3.4k
ゆううきの研究開発まとめ (2019年2月版) / The summary of yuuki's research and development in 02/2019
さくらインターネット研究所 研究会 2019.02.13
これまでの研究開発や開発運用について、さくらインターネット研究所内の研究会で話しました。
研究員 坪内佑樹
Yuuki Tsubouchi (yuuk1)
February 13, 2019
Tweet
Share
More Decks by Yuuki Tsubouchi (yuuk1)
See All by Yuuki Tsubouchi (yuuk1)
yuukit
4
1.4k
yuukit
1
650
yuukit
0
72
yuukit
0
1.2k
yuukit
0
860
yuukit
0
300
yuukit
5
800
yuukit
0
110
yuukit
0
48
Other Decks in Research
See All in Research
butsugiri
1
170
rkrokee
0
230
oshinko90yen
1
510
shinyorke
1
330
sei88888
0
230
aserg_ufmg
2
160
kumagallium
1
100
yuichiroh
0
110
ailaboocu
0
160
hagino3000
0
350
kamicup
0
150
pjamshidi
0
200
Featured
See All Featured
productmarketing
5
660
cromwellryan
101
5.9k
colly
187
14k
revolveconf
200
9.6k
yeseniaperezcruz
302
31k
sferik
610
54k
schacon
145
6.6k
hannesfritz
27
930
philhawksworth
190
17k
carmenhchung
26
1.3k
aarron
258
36k
colly
66
3k
Transcript
͘͞ΒΠϯλʔωοτ גࣜձࣾ (C) Copyright 1996-2019 SAKURA Internet Inc ͘͞ΒΠϯλʔωοτ ݚڀॴ
Ώ͏͏͖ͷݚڀ։ൃ·ͱΊ (20192݄൛) 2019/02/13 ݚڀһ ௶ ༎थ ͘͞ΒΠϯλʔωοτݚڀॴ ݚڀձ 2019.02.13 @yuuk1t / id:y_uuki
2 1. ݚڀςʔϚ 2. େֶɾେֶӃ࣌ͷݚڀ 3. ΤϯδχΞͱͯ͠ͷݚڀ։ൃ 4. ͘͞ΒͰͷݚڀ։ൃ͍͖ͬͯ 5.
·ͱΊ ΞδΣϯμ
1. ݚڀςʔϚ
4 ਓؒͱίϯϐϡʔλʔͷؔੑͱӡ༻ ίϯϐϡʔλʔ γεςϜ Ϣʔβʔ ։ൃӡ༻ऀ ӡ༻ ӡ༻ • ։ൃӡ༻ऀ͚ͷίϯϐϡʔλʔγεςϜଟ͋Γ
Ϣʔβʔͱ։ൃӡ༻ऀͷ۠ผᐆດʹͳ͍ͬͯΔ • ਓؒͱίϯϐϡʔλʔͷؔੑมԽͯ͠”ӡ༻”͕ ଘࡏ͢Δ͜ͱʹมΘΓͳ͍ “ӡ༻”: มߋ => ҭ => ର ݱ࣮ίϯϐϡʔλʔͷมߋ͕ ා͍
5 ݚڀςʔϚ: ӡ༻Λָ͘͢͠Δ ɾίϯϐϡʔλʔγεςϜͷڪාΛͳ͘͠ӡ༻Λָ͠ΊΔΑ͏ʹ͢ Δ ɾָ͘͠ͳ͍ͱਐ·ͳ͍ ɾίϯϐϡʔλʔ͕ਓͷࣄΛୣ͍ͬͯͬͨ͋ͱʹΔͷͷҰͭʹ ίϯϐϡʔλʔͷӡ༻Λָ͠Ή͜ͱͰͳ͍͔
6 ɾා͞ͷݪҼ৴པੑͷԼ ɾ৴པੑΛ੍ޚ͠ɺมߋΛ࠷େԽ͢Δ ɾมߋͰ͖Δ͜ͱָ͍͠ Site Reliability Engineering (SRE) https://blog.yuuk.io/entry/2019/thinking-sre
7 ɾ؍ଌͱ࣮ݧͷϧʔϓΛߴʹճ͠ɺ৴པੑΛ੍ޚͭͭ͠มߋΛ ߴΊΔγεςϜϏδϣϯ Experimentable Infrastructure
8 ɾมߋ͕͍͠ͷσʔλΛͭγεςϜ ɾ͜Ε͔Βਓ͕ؒੜ͢ΔίϯςϯπΑΓ ػց͕ੜ͢Δσʔλ͕ٸ૿ ɾOSϛυϧΣΞͷϨΠϠͷΈͰ͋ΒΏΔ ཁٻΛຬͨ͢ͷࠔ ɾΞϓϦέʔγϣϯӡ༻ٕज़·Ͱ౿ΈࠐΜ ͩਨ౷߹తͳΞϓϩʔν͕ඞཁ Data-Intensive Applications
2. ֶ෦ɾେֶӃ࣌ͷݚڀ
10 ɾେֶֶ෦࣌ ɾॏෳഉআετϨʔδͷͨΊͷSHA-1ܭࢉγεςϜͷSSE໋ྩʹΑΔߴ εϧʔϓοτԽ ɾେֶӃത࢜લظ՝ఔ࣌ ɾTCP/IPελοΫʹ͓͚ΔνΣοΫαϜܭࢉͷGPUΦϑϩʔσΟϯά 2011~2013
11 ϓϩηοαͷΩϟογϡϝϞϦͱSIMDԋࢉ
12 GPGPUͱLinuxΧʔωϧύέοτॲཧ ɾLinuxΧʔωϧͷTCP/IPελοΫॲཧͷ͏ͪɺTCPϔομͷνΣοΫα ϜܭࢉΛGPUʹ·͔ͤͯεϧʔϓοτΛ্ͤ͞Δ ɾGPUͷϝϞϦ্ʹରσʔλ͕ἧͬͯͳ͍ͱGPUͷ࣮ޮޮ͕͍ ɾύέοτ܊Λ1ͭͷετϦʔϜʹ٧ΊࠐΜͰɺGPU্Ͱ·ͱΊͯܭࢉ ͤ͞Δ ɾ1500όΠτఔͷύέοτͰੑೳ͕ͰͣɺJumbo Frame (7000ό
Πτ͙Β͍) ར༻࣌ʹطଘख๏ΑΓεϧʔϓοτ͕ߴ͘ͳΔ
13 ֶ෦ɾେֶӃ࣌ͷৼΓฦΓ ɾϓϩηοαɺฒྻॲཧɺLinuxΧʔωϧɺTCP/IPʹֶ͍ͭͯͨ ɾ͜ͷ͋ͨΓͷॲཧϞσϧͱ࣮ߦ࣌ؒɺϦιʔεফඅͷഽײ͕֮ͳΜͱ ͳ͘Θ͔͍ͬͯΔͱɺ্ҐͷWebαʔόσʔλϕʔεΛѻ͏্Ͱϒ ϥοΫϘοΫε͕গͳ͘ݟ͑ͨ ɾ࣮ࡍʹଘࡏ͠ͳ͍Λղ͍͍ͯΔΑ͏ͳؾ࣋ͪʹͳΔ͜ͱ͋ͬͨ ɾاۀʹೖͬͯɺ࣮ࣾձͷҙࣝΛ࣮ײ্ͨ͠ͰɺݚڀͰ͖ΔͱΑΓ Αͦ͞͏ͩͱߟ͑࢝Ίͨ
14 ͜ͷ͜Ζͷϒϩά ɾ΄ͦ΅ͦͱॻ͍͍ͯͨϒϩά͕ಡ·ΕΔΑ͏ʹ
3. ΤϯδχΞͱͯ͠ͷݚڀ։ൃ
16 ɾαʔόࢹαʔϏεͷߏஙͱӡ༻ ɾϒϩάαʔϏεͳͲɺ౷తͳWebαʔϏεͷߏஙͱӡ༻ ɾશαʔϏεͷΠϯϑϥج൫(ԾԽϓϩϏδϣχϯάͳͲ)ͷ։ൃ ͱӡ༻ ɾϓϩδΣΫτϚωδϝϯτɺνʔϜϏϧσΟϯάɺϝϯλϦϯά ɾγεςϜϏδϣϯ͔ΒΛղܾ͢ΔϙδςΟϒΞϓϩʔνͷ࣮ફ ܦݧͨ͠։ൃɾӡ༻
17 ࣌ܥྻσʔλϕʔεͷߏஙɾӡ༻ɾ։ൃ https://blog.yuuk.io/entry/high-performance-graphite https://blog.yuuk.io/entry/the-rebuild-of-tsdb-on-cloud
18 ϨΨγʔγεςϜͷӡ༻վળ
19 ݚڀ։ൃ࣮ 1.௶༎थ, TimeFuzeΞʔΩςΫνϟߏ - ॲཧͱσʔλͱλΠϚʔΛҰମԽͨ͠σʔ λύΠϓϥΠϯ, ΣϒγεςϜΞʔΩςΫνϟ(WSA)ݚڀձ ୈ1ճ, 201712݄23
2.௶༎थ, αʔόϨε࣌ʹ͓͚ΔϔςϩδχΞε࣌ܥྻσʔλϕʔεΞʔΩςΫ νϟ, ΣϒγεςϜΞʔΩςΫνϟ(WSA)ݚڀձ ୈ2ճ, 201805݄12 3.௶༎थ,ݹխେ, TCPଓͷʹΑΔ؆ུԽ͞ΕͨωοτϫʔΫґଘؔάϥϑ ͷՄࢹԽج൫, ୈ3ճΣϒγεςϜΞʔΩςΫνϟ(WSA)ݚڀձ, 201811݄17 ɾࠃࠪಡ͖จ ɾޱ಄ൃද ௶༎थ,ࡔேਓ,ᖛా݈,দխ,Ѩ෦ത,দຊ྄հ, HeteroTSDB: ҟछࠞ߹Ωʔό ϦϡʔετΞΛ༻͍ͨࣗಈ֊ԽͷͨΊͷ࣌ܥྻσʔλϕʔεΞʔΩςΫνϟ, Πϯ λʔωοτͱӡ༻ٕज़γϯϙδϜจू, 2018, 7-15 (2018-11-29), Dec 2018
20 ɾࠪಡ͖จ 1݅ ɾֶज़ߨԋ x 3݅ ɾࠃൃද x 34݅ ɾύωϧσΟεΧογϣϯ
x 4݅ ɾڝٕ ISUCON ຊઓग़ 2ճ ɾϒϩάଟ ࣮·ͱΊ
21 ɾ։ൃͨ͠༰Λݚڀͱͯ͠Έ͠ɺจߘݚڀձൃද ɾ࣮ࡍͷࣾձͷཁٻʹج͍ͮͨҙࣝΛѻ͑ɺϓϩμΫγϣϯͰಈ ࡞͍ͯ͠ΔͷΛจʹॻ͚Δ ɾҰํͰɺ࣮Ͱظతͳ༏ઌʹͳΓ͕ͪͳͨΊɺݚڀΛҭͯ ͍ͯ͘͜ͱ͍͠ ɾͰ։ൃͨ͠ͷͰϓϩμΫΫγϣϯڥͰීٴͤ͞Δʹɺ ୯Ґͷ͕͔͔࣌ؒͬͨ ΤϯδχΞͱͯ͠ͷݚڀ։ൃৼΓฦΓ
4. ͘͞ΒͰͷݚڀ։ൃ͍͖ͬͯ
23 ɾͱαʔόʔؒͷԆݮ ɾσʔληϯλʔͷτϥϑΟοΫϘϦϡʔϜͷݮ ϢϏΩλεσʔληϯλʔ ɾ౷తͳͷΣϒΞϓϦέʔγϣϯ ɾϦΞϧλΠϜͳ࣌ܥྻσʔλΛऩू͢ΔΞϓϦέʔγϣϯ Potentials ͕ࣗఆ͢ΔApplications Challenges ɾϢϏΩλεDCڥͰͷσʔλͷஔɺసૹԆɺނোΛಁա͢Δ
24 ɾϢϏΩλεσʔληϯλʔߏͷ͏ͪɺData-IntensiveྖҬΛ୲ ɾԆͷେ͖ͳࢄڥͰࢄγεςϜͱͯ͠ͷಁաੑΛ୲อ͢Δ͜ ͱ͕՝ ɾ͋ΒΏΔΞϓϦέʔγϣϯΛมߋͳ͘ϢϏΩλεDC্ͰޮՌతʹಈ ࡞ͤ͞Δ͜ͱ͍͠ ɾ·ͣɺΞϓϦέʔγϣϯΛԾఆͯ͠ɺঃʑʹҰൠԽ͍ͯ͘͠ ɾWordPressͳͲͷ౷తͳWebΞϓϦέʔγϣϯ ɾIoTͳͲͷϦΞϧλΠϜ࣌ܥྻσʔλऩूΞϓϦέʔγϣϯ ݚڀํ
25 ݚڀϚΠϧετʔϯ: จߘۦಈ จߘ ༰ ~4݄ IOT45 σʔλΠϯςϯγϒɾϢϏΩλεDCͷ ઃܭ ~5݄
IOT46 TimeFuzeΞʔΩςΫνϟ ~7݄ DICOMO2019 (COMPSAC 2019) ࣌ܥྻσʔλϕʔε ~8݄ FIT 2019 άϥϑߏՄࢹԽ ~9݄ IOTS2019(ࠪಡ) ↑ͷதͰࣗ৴ͷ͋Δͷ
26 ɾจͷʮ͡ΊʹʯΛॻ͚Δ͜ͱΛϚΠϧετʔϯͱͯ͠ɺ࠷ॳ͔ ΒετʔϦʔΛͭ͘Γͳ͕Βɺݚڀ։ൃ͍ͯ͘͠ ɾͻͱͭͷςʔϚΛҭͯΔ ɾݚڀձจɺࠃࠪಡ͖จɺࠃࡍձٞɺδϟʔφϧΛ௨ͨ͡ ࣭ͷ্ ɾจͷͨΊͷίʔυͰͳ͘ɺ࣮ફͰ͑ΔιϑτΣΞͱͯ͠࡞ ΓࠐΜͰ͍͘ ࠓޙͷల