ゆううきの研究開発まとめ (2019年2月版) / The summary of yuuki's research and development in 02/2019

by Yuuki Tsubouchi (yuuk1)

Slide 1

Slide 1 text

Slide 2

Slide 2 text

2 1. ݚڀςʔϚ 2. େֶɾେֶӃ࣌୅ͷݚڀ 3. ΤϯδχΞͱͯ͠ͷݚڀ։ൃ 4. ͘͞ΒͰͷݚڀ։ൃ΍͍͖ͬͯ 5. ·ͱΊ ΞδΣϯμ

Slide 3

Slide 3 text

1. ݚڀςʔϚ

Slide 4

Slide 4 text

4 ਓؒͱίϯϐϡʔλʔͷؔ܎ੑͱӡ༻ ίϯϐϡʔλʔ γεςϜ Ϣʔβʔ ։ൃӡ༻ऀ ӡ༻ ӡ༻ • ։ൃӡ༻ऀ޲͚ͷίϯϐϡʔλʔγεςϜ΋ଟ਺͋Γ Ϣʔβʔͱ։ൃӡ༻ऀͷ۠ผ΋ᐆດʹͳ͍ͬͯΔ • ਓؒͱίϯϐϡʔλʔͷؔ܎ੑ͸มԽͯ͠΋”ӡ༻”͕ ଘࡏ͢Δ͜ͱʹมΘΓ͸ͳ͍ “ӡ༻”: มߋ => ҭ੒ => ର࿩ ݱ࣮͸ίϯϐϡʔλʔͷมߋ͕ ා͍

Slide 5

Slide 5 text

5 ݚڀςʔϚ: ӡ༻Λָ͘͢͠Δ ɾίϯϐϡʔλʔγεςϜ΁ͷڪාΛͳ͘͠ӡ༻Λָ͠ΊΔΑ͏ʹ͢ Δ ɾָ͘͠ͳ͍ͱਐ·ͳ͍ ɾίϯϐϡʔλʔ͕ਓͷ࢓ࣄΛୣ͍ͬͯͬͨ͋ͱʹ࢒Δ΋ͷͷҰͭʹ ίϯϐϡʔλʔͷӡ༻Λָ͠Ή͜ͱͰ͸ͳ͍͔

Slide 6

Slide 6 text

6 ɾා͞ͷݪҼ͸৴པੑͷ௿Լ ɾ৴པੑΛ੍ޚ͠ɺมߋ଎౓Λ࠷େԽ͢Δ ɾมߋͰ͖Δ͜ͱ͸ָ͍͠ Site Reliability Engineering (SRE) https://blog.yuuk.io/entry/2019/thinking-sre

Slide 7

Slide 7 text

7 ɾ؍ଌͱ࣮ݧͷϧʔϓΛߴ଎ʹճ͠ɺ৴པੑΛ੍ޚͭͭ͠มߋ଎౓Λ ߴΊΔγεςϜϏδϣϯ Experimentable Infrastructure

Slide 8

Slide 8 text

8 ɾมߋ͕೉͍͠ͷ͸σʔλΛ΋ͭγεςϜ ɾ͜Ε͔Β͸ਓ͕ؒੜ੒͢ΔίϯςϯπΑΓ ΋ػց͕ੜ੒͢Δσʔλ͕ٸ૿ ɾOS΍ϛυϧ΢ΣΞͷϨΠϠͷΈͰ͋ΒΏΔ ཁٻΛຬͨ͢ͷ͸ࠔ೉ ɾΞϓϦέʔγϣϯ΍ӡ༻ٕज़·Ͱ౿ΈࠐΜ ͩਨ௚౷߹తͳΞϓϩʔν͕ඞཁ Data-Intensive Applications

Slide 9

Slide 9 text

2. ֶ෦ɾେֶӃ࣌୅ͷݚڀ

Slide 10

Slide 10 text

10 ɾେֶֶ෦࣌୅ ɾॏෳഉআετϨʔδͷͨΊͷSHA-1ܭࢉγεςϜͷSSE໋ྩʹΑΔߴ εϧʔϓοτԽ ɾେֶӃത࢜લظ՝ఔ࣌୅ ɾTCP/IPελοΫʹ͓͚ΔνΣοΫαϜܭࢉͷGPUΦϑϩʔσΟϯά 2011~2013೥

Slide 11

Slide 11 text

11 ϓϩηοαͷΩϟογϡϝϞϦͱSIMDԋࢉ

Slide 12

Slide 12 text

12 GPGPUͱLinuxΧʔωϧύέοτॲཧ ɾLinuxΧʔωϧͷTCP/IPελοΫॲཧͷ͏ͪɺTCPϔομͷνΣοΫα ϜܭࢉΛGPUʹ·͔ͤͯεϧʔϓοτΛ޲্ͤ͞Δ ɾGPUͷϝϞϦ্ʹର৅σʔλ͕ἧͬͯͳ͍ͱGPUͷ࣮ޮޮ཰͕௿͍ ɾύέοτ܊Λ1ͭͷετϦʔϜʹ٧ΊࠐΜͰɺGPU্Ͱ·ͱΊͯܭࢉ ͤ͞Δ ɾ1500όΠτఔ౓ͷύέοτͰ͸ੑೳ͕ͰͣɺJumbo Frame (7000ό Πτ͙Β͍) ར༻࣌ʹطଘख๏ΑΓ΋εϧʔϓοτ͕ߴ͘ͳΔ

Slide 13

Slide 13 text

13 ֶ෦ɾେֶӃ࣌୅ͷৼΓฦΓ ɾϓϩηοαɺฒྻॲཧɺLinuxΧʔωϧɺTCP/IPʹֶ͍ͭͯ΂ͨ ɾ͜ͷ͋ͨΓͷॲཧϞσϧͱ࣮ߦ࣌ؒɺϦιʔεফඅͷഽײ͕֮ͳΜͱ ͳ͘Θ͔͍ͬͯΔͱɺ্ҐͷWebαʔό΍σʔλϕʔεΛѻ͏্Ͱϒ ϥοΫϘοΫε͕গͳ͘ݟ͑ͨ ɾ࣮ࡍʹଘࡏ͠ͳ͍໰୊Λղ͍͍ͯΔΑ͏ͳؾ࣋ͪʹͳΔ͜ͱ΋͋ͬͨ ɾاۀʹೖͬͯɺ࣮ࣾձͷ໰୊ҙࣝΛ࣮ײ্ͨ͠ͰɺݚڀͰ͖ΔͱΑΓ Αͦ͞͏ͩͱߟ͑࢝Ίͨ

Slide 14

Slide 14 text

14 ͜ͷ͜Ζͷϒϩά ɾ΄ͦ΅ͦͱॻ͍͍ͯͨϒϩά͕ಡ·ΕΔΑ͏ʹ

Slide 15

Slide 15 text

3. ΤϯδχΞͱͯ͠ͷݚڀ։ൃ

Slide 16

Slide 16 text

16 ɾαʔό؂ࢹαʔϏεͷߏஙͱӡ༻ ɾϒϩάαʔϏεͳͲɺ఻౷తͳWebαʔϏεͷߏஙͱӡ༻ ɾશαʔϏεͷΠϯϑϥج൫(Ծ૝Խ΍ϓϩϏδϣχϯάͳͲ)ͷ։ൃ ͱӡ༻ ɾϓϩδΣΫτϚωδϝϯτɺνʔϜϏϧσΟϯάɺϝϯλϦϯά ɾγεςϜϏδϣϯ͔Β໰୊Λղܾ͢ΔϙδςΟϒΞϓϩʔνͷ࣮ફ ܦݧͨ͠։ൃɾӡ༻

Slide 17

Slide 17 text

17 ࣌ܥྻσʔλϕʔεͷߏஙɾӡ༻ɾ։ൃ https://blog.yuuk.io/entry/high-performance-graphite https://blog.yuuk.io/entry/the-rebuild-of-tsdb-on-cloud

Slide 18

Slide 18 text

18 ϨΨγʔγεςϜͷӡ༻վળ

Slide 19

Slide 19 text

19 ݚڀ։ൃ࣮੷ 1.௶಺༎थ, TimeFuzeΞʔΩςΫνϟߏ૝ - ॲཧͱσʔλͱλΠϚʔΛҰମԽͨ͠σʔ λύΠϓϥΠϯ, ΢ΣϒγεςϜΞʔΩςΫνϟ(WSA)ݚڀձ ୈ1ճ, 2017೥12݄23೔ 2.௶಺༎थ, αʔόϨε࣌୅ʹ͓͚ΔϔςϩδχΞε࣌ܥྻσʔλϕʔεΞʔΩςΫ νϟ, ΢ΣϒγεςϜΞʔΩςΫνϟ(WSA)ݚڀձ ୈ2ճ, 2018೥05݄12೔ 3.௶಺༎थ,ݹ઒խେ, TCP઀ଓͷ௥੻ʹΑΔ؆ུԽ͞ΕͨωοτϫʔΫґଘؔ܎άϥϑ ͷՄࢹԽج൫, ୈ3ճ΢ΣϒγεςϜΞʔΩςΫνϟ(WSA)ݚڀձ, 2018೥11݄17೔ ɾࠃ಺ࠪಡ෇͖࿦จ ɾޱ಄ൃද ௶಺༎थ,࿬ࡔேਓ,ᖛా݈,দ໦խ޾,Ѩ෦ത,দຊ྄հ, HeteroTSDB: ҟछࠞ߹Ωʔό ϦϡʔετΞΛ༻͍ͨࣗಈ֊૚ԽͷͨΊͷ࣌ܥྻσʔλϕʔεΞʔΩςΫνϟ, Πϯ λʔωοτͱӡ༻ٕज़γϯϙδ΢Ϝ࿦จू, 2018, 7-15 (2018-11-29), Dec 2018

Slide 20

Slide 20 text

20 ɾࠪಡ෇͖࿦จ 1݅ ɾֶज़ߨԋ x 3݅ ɾࠃ಺ൃද x 34݅ ɾύωϧσΟεΧογϣϯ x 4݅ ɾڝٕ ISUCON ຊઓग़৔ 2ճ ɾϒϩάଟ਺ ࣮੷·ͱΊ

Slide 21

Slide 21 text

21 ɾ։ൃͨ͠಺༰Λݚڀͱͯ͠૊Έ௚͠ɺ࿦จ౤ߘ΍ݚڀձൃද ɾ࣮ࡍͷࣾձͷཁٻʹج͍ͮͨ໰୊ҙࣝΛѻ͑ɺϓϩμΫγϣϯͰಈ ࡞͍ͯ͠Δ΋ͷΛ࿦จʹॻ͚Δ ɾҰํͰɺ࣮຿Ͱ͸୹ظతͳ଎౓༏ઌʹͳΓ͕ͪͳͨΊɺݚڀΛҭͯ ͍ͯ͘͜ͱ͸೉͍͠ ɾ਺೔Ͱ։ൃͨ͠΋ͷͰ΋ϓϩμΫΫγϣϯ؀ڥͰීٴͤ͞Δʹ͸ɺ ೥୯Ґͷ͕͔͔࣌ؒͬͨ ΤϯδχΞͱͯ͠ͷݚڀ։ൃৼΓฦΓ

Slide 22

Slide 22 text

4. ͘͞ΒͰͷݚڀ։ൃ΍͍͖ͬͯ

Slide 23

Slide 23 text

23 ɾ୺຤ͱαʔόʔؒͷ஗Ԇ࡟ݮ ɾσʔληϯλʔͷτϥϑΟοΫϘϦϡʔϜͷ࡟ݮ ϢϏΩλεσʔληϯλʔ ɾ఻౷తͳͷ΢ΣϒΞϓϦέʔγϣϯ ɾϦΞϧλΠϜͳ࣌ܥྻσʔλΛऩू͢ΔΞϓϦέʔγϣϯ Potentials ࣗ෼͕૝ఆ͢ΔApplications Challenges ɾϢϏΩλεDC؀ڥͰͷσʔλͷ഑ஔɺసૹ஗ԆɺނোΛಁա͢Δ

Slide 24

Slide 24 text

24 ɾϢϏΩλεσʔληϯλʔߏ૝ͷ͏ͪɺData-IntensiveྖҬΛ୲౰ ɾ஗Ԇͷେ͖ͳ෼ࢄ؀ڥͰ෼ࢄγεςϜͱͯ͠ͷಁաੑΛ୲อ͢Δ͜ ͱ͕՝୊ ɾ͋ΒΏΔΞϓϦέʔγϣϯΛมߋͳ͘ϢϏΩλεDC্ͰޮՌతʹಈ ࡞ͤ͞Δ͜ͱ͸೉͍͠ ɾ·ͣ͸ɺΞϓϦέʔγϣϯΛԾఆͯ͠ɺঃʑʹҰൠԽ͍ͯ͘͠ ɾWordPressͳͲͷ఻౷తͳWebΞϓϦέʔγϣϯ ɾIoTͳͲͷϦΞϧλΠϜ࣌ܥྻσʔλऩूΞϓϦέʔγϣϯ ݚڀํ਑

Slide 25

Slide 25 text

25 ݚڀϚΠϧετʔϯ: ࿦จ౤ߘۦಈ ࿦จ౤ߘ ಺༰ ~4݄ IOT45 σʔλΠϯςϯγϒɾϢϏΩλεDCͷ ઃܭ ~5݄ IOT46 TimeFuzeΞʔΩςΫνϟ ~7݄ DICOMO2019 (COMPSAC 2019) ࣌ܥྻσʔλϕʔε ~8݄ FIT 2019 άϥϑߏ଄ՄࢹԽ ~9݄ IOTS2019(ࠪಡ෇) ↑ͷதͰࣗ৴ͷ͋Δ΋ͷ

Slide 26

Slide 26 text

26 ɾ࿦จͷʮ͸͡ΊʹʯΛॻ͚Δ͜ͱΛϚΠϧετʔϯͱͯ͠ɺ࠷ॳ͔ ΒετʔϦʔΛͭ͘Γͳ͕Βɺݚڀ։ൃ͍ͯ͘͠ ɾͻͱͭͷςʔϚΛҭͯΔ ɾݚڀձ࿦จɺࠃ಺ࠪಡ෇͖࿦จɺࠃࡍձٞɺδϟʔφϧΛ௨ͨ͡ ࣭ͷ޲্ ɾ࿦จͷͨΊͷίʔυͰ͸ͳ͘ɺ࣮ફͰ࢖͑Διϑτ΢ΣΞͱͯ͠࡞ ΓࠐΜͰ͍͘ ࠓޙͷల๬