CEDEC 2018
εέʔϧՄೳͰӡ༻͍͢͠WebSocketαʔόઃܭͷ՝ͱCEDEC 2018໘ന๏ਓΧϠοΫɹ୩ ਅۏ
View Slide
͜ͷηογϣϯͰ͢͜ͱ• ैདྷͷWebΞϓϦέʔγϣϯͷ࡞ΓํͷԆઢ্Ͱ• ϛυϧΣΞΛ͚Ճ͑ΔܗͰWebSocketʹΑΔϦΞϧλΠϜ௨৴Λ༻͍Δ• ήʔϜαʔόΛ։ൃɾӡ༻ͯ͠Έͨͦͷ࣌ͷͱۤ࿑Λ͠·͢ɻ
͜ͷηογϣϯͰ͞ΕΔ͜ͱ౦ژϓϦζϯ1ͱ͍͏ϞόΠϧήʔϜͷࣄྫͰ͢1 https://tokyo-prison.kayac.com/
ήʔϜͷಛੑ• λʔϯ੍ɻλʔϯҰఆඵ͕ܦա͢Δͱऴྃ͢Δɻλʔϯ͋Δఔࣗ༝ʹಈ͚Δ
ήʔϜͷಛੑ• ϓϨΠϠʔ3ਓ vs ϓϨΠϠʔ3ਓ
ߨԋऀͷόοΫάϥϯυ• ໘ന๏ਓΧϠοΫ ιʔγϟϧήʔϜࣄۀ෦• αʔόαΠυΛઐͰ୲ɻΞϓϦέʔγϣϯίʔυΛॻ͕͘ΠϯϑϥߏஙΓɺӡ༻Δ• झຯPerlͱ3DϓϦϯλվͱϛυϧΣΞ։ൃ
ैདྷͷWebΞϓϦͰΞʔΩςΫνϟͰWebSocketΛ༻͍Δͱ͖ͷ՝
આ໌ͷॱ൪1. ैདྷͷWebΞϓϦͷߏ2. WebSocketΛ࢝Ίͱͨ͠ੜଘ࣌ؒͷ͍ηογϣϯΛѻ͏্Ͱͷ3. ղܾํ๏(kuiperbeltͷհ)
͜͜Ͱ͍͏WebΞϓϦͱ• ΠϯλʔωοτΛ௨ͬͯओʹHTTPΛ͏ΞϓϦέʔγϣϯ• HTTP·ͣϦΫΤετ͋Γ͖
ͳͥHTTPΛ͏ͷ͔• ͍͍ͩͨͷWebϑϨʔϜϫʔΫHTTPΛѻ͏ͨΊʹ࡞ΒΕ͍ͯΔ• curlΛ͡Ίͱͨ͠HTTPΛσόοά͢ΔͨΊͷπʔϧݟ͕ੈͷதʹ͋;Ε͍ͯΔ• HTTPεςʔτϨε͕લఏͷϓϩτίϧͳͷͰεέʔϧͤ͞Δͷʹ༗ར(ޙड़)
εςʔτϨε͔ͩΒԣʹ૿ͤΔKeep-AliveͰTCPଓ͍ճ͠Λߦ͏߹͋Δ͕ɺHTTPͷ͔ΒݟΕಉ͡
εςʔτϨε͔ͩΒԣʹ૿ͤΔ
Ϣʔβಉ࣌ʹϦΫΤετΛड͚͍ͯΔ͜ͱͳ͍
WebΞϓϦέʔγϣϯͷੈք• HTTP͕εςʔτϨεͳͷͰԣʹಉ͡ΞϓϦΛฒͯLBʹೖΕΔ• ෛՙࢄͱHAత• Lightweight Language(PHPRuby2ͳͲ)͕ΘΕΔ͜ͱ͕͋Δ• ͜ΕΒϚϧνϓϩηεϞσϧ͕ओྲྀ2 ͪΖΜJavaC#ͰΉͱ͜Ζ͋ΓɺͦΕΒϚϧνεϨου
ϦΞϧλΠϜ௨৴ΛWebͷԆͰΔબࢶ• Long Polling• WebSocket• WebRTC DataChannel• ͋Δ͍ੜιέοτ
ͳͥWebSocketΛ͏ͷ͔=> ͍ͷʹר͔Εͨ΄͏ָ͕͕Ͱ͖Δ• 2011ʹඪ४ࡦఆ͞Ε͔ͯΒ͕࣌ؒܦͪϥΠϒϥϦ͕ރΕ͍ͯΔ• ੜιέοτͱҧͬͯϥΠϒϥϦΛࣗͰॻ͔ͳͯ͘Α͍• wscatΛ࢝Ίͱͨ͠σόοάπʔϧ๛• TCPͳͷͰ࠶ૹͳͲͷ໘ݟͯ͘ΕΔ
ͦͦͳͥඪ४Webٕज़ʹͩ͜ΘΔͷ͔• Web։ൃऀίϛϡχςΟʹ͔ͬΕΔ• ϥΠϒϥϦݟΛٵऩͰ͖Δ• (͜ΕޙͰ͕͢)PWAήʔϜΞϓϦ࣌Λݟਾ͑ͯͷબ• ϒϥβ͑Δϓϩτίϧ͕ݶΒΕΔ
WebSocketεςʔτϑϧ௨৴• ΫϥΠΞϯτWebAppʹରͯ͠ܨ͗ͬͺͳ͠ͷঢ়ଶʹͳΔ• WebSocketηογϣϯͷੜଘ͕͍࣌ؒͨΊͦͷؒϦιʔεΛઐ༗͢Δ
WebSocketଓΛҡ࣋͠ଓ͚Δඞཁ͕͋Δ
ϦΞϧλΠϜ௨৴εςʔτϑϧ௨৴• 1ͭͷΫϥΠΞϯτ͕1WebAppΠϯελϯεͱີ݁߹͢Δ• গͳ͘ͱ1ηογϣϯͷؒॊೈͳεέʔϧΞτ(Λԣʹ૿͢)ϦΞϧλΠϜ௨৴͕ߦΘΕ͍ͯΔؒͷίʔυߋ৽(σϓϩΠ)͕͍͠
ϦΞϧλΠϜ௨৴εςʔτϑϧ௨৴• εςʔτϑϧ௨৴ͱಉظܕPreforkͷ૬ੑͷѱ͞• 1ݸͷϓϩηε͕1ͭͷϦΫΤετΛಉظతʹॲཧ• 1ϦΫΤετͷॲཧ͕͍࣌ؒ(ʙ1sec)͜ͱ͕લఏ• 1ϓϩηεͰ1WebSocketηογϣϯΛѲΔͱϓϩηε͔͠ΫϥΠΞϯτΛऩ༰Ͱ͖ͳ͍
٧·Δਤ
ࠓ·ͰͷWebΞϓϦ͕ͦͷ··WebSocketΛΔ͜ͱ͍͜͠ͱ͕Θ͔ͬͨ
͍͔ʹͯ͠զʑϦΞϧλΠϜ௨৴ʹཱ͔͍͍ͪ͑ͷ͔• ָͰ• Θ͔Γͯ͘͢ɺγϯϓϧͰ• εέʔϧՄೳͰ• ӡ༻͍͢͠ͷ͕΄͍͠
ͦΜͳ͏·͍ιϦϡʔγϣϯ͋Δͷ͔
ैདྷͷWebΞʔΩςΫνϟ͕WebSocketΛѻ͏ͱ͖ͷ͍͠Λཧ• ࣌ؒੜ͖ଓ͚Δ௨৴ηογϣϯΛҡ࣋͢Δͷ͕͍͠• ௨৴ͱϢʔβΛඥ͚Δͷ͕͍͠=> ͜ͷลϛυϧΣΞʹͤΔͷͲ͏͔֎ʹग़͢ͷϚΠΫϩαʔϏεͷߟ͑ํʹ͍͔ۙ͠Εͳ͍
WebSocketηογϣϯΛҡ࣋͢Δ͚ͩͷϛυϧΣΞkuiperbeltͷ։ൃͱಋೖ
kuiperbeltͱ• OSSͰ͢3• WebSocketͷηογϣϯΛड͚ͯҡ࣋͢Δ͚ͩͷ௨৴σʔϞϯ• ࠷ॳݸਓϓϩδΣΫτͰ͕ͨ͠ɺձࣾͰ͔ͳΓΘΕ͍ͯ·͢• ձࣾͷਓʹίϛοτͯ͠Β͍ͬͯ·͢3 https://github.com/kuiperbelt/kuiperbelt
໊લͷ༝དྷఱจֶͷΤοδϫʔεɾΧΠύʔϕϧτ*͔Β* photo by NASA
kuiperbelt͕ग़དྷΔ͜ͱ• WebSocketηογϣϯͷҡ࣋• HTTP-APIͰͷಛఆηογϣϯͷϝοηʔδͷྲྀ͠ࠐΈ• ্Γ(ΫϥΠΞϯτ->αʔό)ඇରԠ77 ରԠ༧ఆ͋Γ
͢͜ͱͷྲྀΕ1. ౦ژϓϦζϯͰͷαʔόߏͷུ֓2. kuiperbeltΛͬͨWebSocketηογϣϯͷೝূɾϝοηʔδ৴3. ઃܭࢥ4. ࣮ࡍͷӡ༻ࣄྫ5. ౦ژϓϦζϯͰͷ࣮ࡍͷΘΕํ
౦ژϓϦζϯͷαʔόߏ88 ຊ17:50ΑΓฐࣾ౻ݪͷৄ͍͠ߏͷղઆ͕͋Γ·͢
HTTPͷதͷΈͷதͰೝূΛ͢Δ• ೝূWebSocketͷΞοϓάϨʔυલʹWebAppଆʹϓϩΩγΛߦ͏• ϓϩΩγ࣌ʹkuiperbeltࣗͷղܾՄೳͳϗετ໊ΛՃ͢Δ -> εέʔϧΞτʹ༻͍Δ• WebAppଆϨεϙϯεͷϔομʹࣝผࢠΛՃ͑Δ
HTTPͷதͷΈͷதͰೝূΛ͢Δ
HTTPͷதͷΈͷதͰϝοηʔδ৴Λ͢Δ• ΫϥΠΞϯτͷϝοηʔδϔομͰࣝผࢠΛࢦఆͯ͠ɺϘσΟͷ༰ͦͬ͘Γͦͷ··WebSocketͷηογϣϯʹྲྀ͠ࠐΉ• தͷϝοηʔδͷܗࣜkuiperbeltؔ༩͠ͳ͍• ౦ژϓϦζϯόΠφϦΛྲྀͯ͠·͢
HTTPͷதͷΈͷதͰϝοηʔδ৴Λ͢Δ
kuiperbeltࣗͷઃܭࢥ• ୯७ͳ͜ͱ͔͠Βͳ͍ͷͰམͪͳ͍ɾ࠶ىಈ͠ͳͯ͘ྑ͍• ήʔϜϩδοΫΒͳ͍ͷͰσϓϩΠ͕ඞཁͳ͍• Ҏ্ӡ༻͍ͯ͠Δ͕ϝϞϦϦʔΫى͖͍ͯͳ͍• ಛఆϓϩτίϧɾϛυϧΣΞʹґଘ͠ͳ͍
ผλΠτϧͰͷোࣄྫ͏͔ͬΓHTTP/2ࣄ݅ݱࡏҰఆִؒͰίωΫγϣϯΛഁغ͢Δ࣮͕ೖ͍ͬͯ·͢
kuiperbeltࣗͷઃܭࢥ• GoͰॻ͔Ε͍ͯΔͷͰίΞ͚ͩͪΌΜͱεέʔϧ͢Δ• 1ίΞ͋ͨΓඵؒ10,000ϝοηʔδ͙Β͍(1ϝοηʔδ͋ͨΓฏۉ150bytes)• ϝϞϦྔΫϥΠΞϯτʹൺྫ͠ɺϝοηʔδͷ༰ͳͲʹࠨӈ͞ΕΔ͕1ສଓͰ1GBʙ1.8GB
࣮ࡍͷӡ༻Ͱ• ࣮ෛՙࢼݧͰϝοηʔδྲྀྔͱϝοηʔδαΠζ͕େ͖͍͜ͱ͕໌ͨͨ͠Ίɺ1Πϯελϯε5000ଓఔʹ͑ͨ• m3.large4ͱr4.large5ͷspot fleetʹ͍ͯͨ͠Βm3.largeͷpps্ݶ͕ͯ͘ภΓ͕ग़ͨͷͰr4.largeͷΈͷӡ༻ʹ͍ͯ͠Δ5 2core 15.25GBϝϞϦ4 2core 7.5GBϝϞϦ
ύέοτ٧·ΓΛىͯ͜͠࠶ૹ͕ߦΘΕ͍ͯΔϩά21:00:47 plack.1 | 1019.259 ms [Furl::HTTP] POST http://XX.XX.XX.XX:9180/send | Furl:4021:00:47 plack.1 | 3017.341 ms [Furl::HTTP] POST http://XX.XX.XX.XX:9180/send | Furl:4021:00:47 plack.1 | 1017.801 ms [Furl::HTTP] POST http://XX.XX.XX.XX:9180/send | Furl:4021:00:47 plack.1 | 7174.359 ms [Furl::HTTP] POST http://XX.XX.XX.XX:9180/send | Furl:4021:00:47 plack.1 | 1025.966 ms [Furl::HTTP] POST http://XX.XX.XX.XX:9180/send | Furl:4021:00:47 plack.1 | 10010.330 ms [Furl::HTTP] POST http://XX.XX.XX.XX:9180/send | Furl:401, 3, 7, 10...ͱԆ͍ͯ͠ΔͷͰ࠶ૹͰ٧·͍ͬͯΔͷͰʁ ͱͳͬͨ
͍ͬͯΔ͜ͱ͕γϯϓϧͳͷͰ༷ʑͳΞʔΩςΫνϟʹରԠͰ͖ΔMO͖ͷதܧ͚ͩߦ͏ΞʔΩςΫνϟ
͍ͬͯΔ͜ͱ͕γϯϓϧͳͷͰ༷ʑͳΞʔΩςΫνϟʹରԠͰ͖ΔMMOϚονϯά͖ͷαʔόͰήʔϜϩδοΫΛ࣮ߦ͢ΔΞʔΩςΫνϟ
ϦΞϧλΠϜ௨৴αʔόΛϩʔυόϥϯαʔʹΈࠐΉQ: ෳͷαʔόΛܦ༝͢Δ͔ΒϨΠςϯγ͕ݫ͍͠ͷͰʁA1: ϞόΠϧʹ͓͍ͯͦͷݶΓͰͳ͍A2: λʔϯ੍ͳΒ͋Δఔڐ༰Ͱ͖Δ
A1: ϞόΠϧʹ͓͍ͯͦͷݶΓͰͳ͍HTTP-APIΛଧ͔ͬͯΒWebSocketͰԠ͕͔͑ͬͯ͘Δ·ͰͷRTTΛܭଌ66 JavaScriptͳͷͰspectreͷӨڹͰ2msఔͷؙΊ͕ଘࡏ͍ͯ͠Δͷཹҙ
A1: ϞόΠϧʹ͓͍ͯͦͷݶΓͰͳ͍• લ͕ݻఆޫճઢܦ༝ͷWiFi, ޙ͕4G• WiFiͩͱ20 ʙ 30ms, 4Gͩͱ75msʙ• LBΛܦ༝͢Δ͜ͱʹΑΔϨΠςϯγ1ܻmsఔ• ϞόΠϧʹ͓͍ͯLBʹΑΔϨΠςϯγࢧతͰͳ͍
A2: λʔϯ੍ͳΒ͋Δఔڐ༰Ͱ͖Δ• ͜Ε͕PCίϯγϡʔϚͰΔΑ͏ͳFPS֨ήʔͰ͋Ε1ܻmsͷԆͰ͢Βॖ͍ͨ͠• ڐ༰͞ΕΔԆ෯ήʔϜγεςϜʹΑͬͯมΘΔ• ཁ݅ʹΑͬͯૹΓͬͺͳ͠ʹͰ͖Δ/Φʔόʔϔου͕গͳ͍UDPͳͲΛબ͢Δ
ݱঢ়LBʹೖΕΔϝϦοτ͕Ͱ͔͍• TLS TerminationΛͤΔ͜ͱ͕ग़དྷΔ• ݸผʹTerminationΛ͍ͬͯΔͱূ໌ॻͷཧ͕໘• ࠷ۙ௨Βͳ͍ϑΥϫʔυϓϩΩγ͕ݮͬͨͱ͍͑ੜWebSocketૄ௨͢Δ͔Ͳ͏͔ͷϦεΫ͕͋Δ
ݱঢ়LBʹೖΕΔϝϦοτ͕Ͱ͔͍• ࣗಈͰ༙͍ͨԾϚγϯ/ίϯςφʹ౸ୡՄೳͳIPΞυϨε/ϗετΛͲ͏ͬͯΫϥΠΞϯτʹ௨͢Δ͔• ैདྷಉ͡ϧʔϜΛݻΊΔΑ͏ʹϚονϯά࣌ʹଓ͖͢ΞυϨεΛࣔͨ͠Γ• LBͳΒೖΕΔ͚ͩͰ౸ୡՄೳʹͳΔɺϧʔϜͰݻΊΔΈ͍ͨͳͷग़དྷͳ͍͕
࣮ࡍʹΈࠐΜͰΈͯ౦ژϓϦζϯͲͷΑ͏ʹήʔϜΛਐߦ͍ͯ͠Δ͔
kuiperbeltΛΈࠐΜͩ౦ژϓϦζϯͷॲཧ
ήʔϜϩδοΫ͕αʔόଆʹ͋Δ͜ͱͷϝϦοτ• ήʔϜϩδοΫͷมߋ͕͋Δఔ༰қ ετΞਃ͕ཁΒͳ͍• ΫϥΠΞϯτੑೳʹҾͬுΒΕͳ͍• ΫϥΠΞϯτ։ൃऀֆΛग़͢͜ͱʹूதͰ͖Δ• νʔτ͞Εʹ͍͘• ϩΪϯά༰қͳͷͰղੳͳͲͰ͖Δ
ήʔϜϩδοΫ͕αʔόଆʹ͋Δ͜ͱͷσϝϦοτ• ΫϥΠΞϯτ͕αʔόͷॲཧΛͭͨΊϨεϙϯγϏϦςΟ͕ѱ͍• αʔόͷϨεϙϯεΛͨͳ͍ͳͲͷରࡦΛߨ͍ͯ͡Δ(ඇಉظԽ)
ήʔϜϩδοΫ͕αʔόଆʹ͋Δ͜ͱͷσϝϦοτ• αʔόͷෛՙରࡦΛेʹߦ͏ඞཁ͕͋ΔɹϦιʔε֬อ͢Δඞཁ͕͋Δ• ఆ࣮ෛՙࢼݧͱνϡʔχϯάΛ܁Γฦ͠·͕ͨ͠ඇৗʹۤ࿑͠·ͨ͠
ͦͷଞkuiperbeltΛಋೖͨ͜͠ͱͰݟ͖͑ͯͨ1. ϝοηʔδ౸ୡॱ2. αʔόؒϝοηʔδܽଛ
ϝοηʔδ౸ୡॱkuiperbeltͷதͰϩοΫऔΕͨॱ൪ʹྲྀΕΔ
ϝοηʔδ౸ୡॱղ๏• γʔέϯε൪߸Λ্ͨͤͨͰ1. ΫϥΠΞϯτଆͰόοϑΝϦϯάͭͭ͠ฒ͢2. kuiperbeltଆͰόοϑΝϦϯάͭͭ͠ฒ͢
ϝοηʔδ౸ୡॱΫϥΠΞϯτଆͰฒ͢ͷΛ࠾༻• kuiperbeltͰΔͱϝϞϦ༻ྔ͕૿͑Δ, ঢ়ଶ͕૿͑ͯίϯςφ͕མͪͨͱ͖ʹϝοηʔδܽଛ͕૿͑Δ• ඈͦ͏ͱͨ͠ϝοηʔδͬ͞͞ͱૹͬͯঢ়ଶΛͳ͘͢• kuiperbeltதʹྲྀΕΔσʔλʹؔ༩͠ͳ͍ϧʔϧ
αʔόؒϝοηʔδܽଛ• HTTPͰૹΔͱܽଛ͢ΔΜ͡Όͳ͍ʁʁʁ• DC௨৴, Ϧʔδϣϯ௨৴ͳͷͰܦ࿏ͰམͪΔ͜ͱͳ͔ͳ͔ͳ͍• ϦτϥΠ&ΫϥΠΞϯτଆͰͷॏෳݕͳͲೖΕ͍ͯΔ• ࠓޙcircuit breakerೖΕΔ
ͦͯ͠ӡ༻͍ͯ͠Δࠓ• αʔόͷਓ͕͋Μ·ΓWebSocketͷ͜ͱΛߟ͑ͣʹࠓ·ͰͲ͓ΓίʔυΛॻ͚Δ• WebSocketαʔό͕ίϯςφͱϩʔυόϥϯαʔʹΑͬͯϊʔϝϯςͰಈ͍͍ͯΔ• ͍ͭͰίϚϯυҰൃͰεέʔϧΞτՄೳ• WebSocketͷ͜ͱΛ͋·Γߟ͑ͣʹσϓϩΠ͕ग़དྷΔ
εέʔϧՄೳͰӡ༻͍͢͠WebSocketαʔό͕ಈ͍͍ͯΔ
·ͱΊ• ैདྷͷWebΞϓϦέʔγϣϯΞʔΩςΫνϟʹൺֱత༰қʹಋೖͰ͖ΔϦΞϧλΠϜ௨৴༻ϛυϧΣΞΛ࡞࣮ͬͯࡍʹຊ൪ಋೖ͠·ͨ͠• ଞͷطʹӡ༻தͷήʔϜʹಋೖ͢Δχʔζ͕͋ΔΑ͏ͳͷͰ͜Ε͔Β͍͖ͬͯ·͢• ຊ൪ӡ༻ͯ͠ΈͯɺղܾՄೳͰ͋Δ͕ɺͦͦ͜͜ͷ͍͔ͭ͘߹ͬͨͷͰڞ༗͍͖ͤͯͨͩ͞·ͨ͠
Any Questions?
mackee
productmarketing
trishagee
paigeccino
dougneiner
quramy
morganepeng
jonrohan
yeseniaperezcruz
mthomps
garrettdimon
keithpitt
bluesmoon