Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
クラウドデータセンターネットワークの “いま”と “これから”
Search
Masayuki Kobayashi
June 12, 2023
Technology
5
2.2k
クラウドデータセンターネットワークの “いま”と “これから”
Masayuki Kobayashi
June 12, 2023
Tweet
Share
More Decks by Masayuki Kobayashi
See All by Masayuki Kobayashi
GPUネットワーク設計・運用 基礎勉強会 Lossless Ethernet – PFC/ECN編
markunet
3
100
HPCネットワーク基礎(RDMA/Infiniband/RoCE編)
markunet
17
3.5k
Clos Network Topology 再入門
markunet
18
6.4k
RIFT A new routing protocol for IP fabrics
markunet
0
450
大規模DCのネットワークデザイン
markunet
2
1.1k
閉域網接続の技術入門
markunet
1
260
Other Decks in Technology
See All in Technology
Amazon S3 Tablesと外部分析基盤連携について / Amazon S3 Tables and External Data Analytics Platform
nttcom
0
130
【Developers Summit 2025】プロダクトエンジニアから学ぶ、 ユーザーにより高い価値を届ける技術
niwatakeru
2
1.4k
君も受託系GISエンジニアにならないか
sudataka
2
430
利用終了したドメイン名の最強終活〜観測環境を育てて、分析・供養している件〜 / The Ultimate End-of-Life Preparation for Discontinued Domain Names
nttcom
2
190
Helm , Kustomize に代わる !? 次世代 k8s パッケージマネージャー Glasskube 入門 / glasskube-entry
parupappa2929
0
250
スタートアップ1人目QAエンジニアが QAチームを立ち上げ、“個”からチーム、 そして“組織”に成長するまで / How to set up QA team at reiwatravel
mii3king
2
1.5k
Tech Blogを書きやすい環境づくり
lycorptech_jp
PRO
1
240
転生CISOサバイバル・ガイド / CISO Career Transition Survival Guide
kanny
3
980
The Future of SEO: The Impact of AI on Search
badams
0
190
個人開発から公式機能へ: PlaywrightとRailsをつなげた3年の軌跡
yusukeiwaki
11
3k
データ資産をシームレスに伝達するためのイベント駆動型アーキテクチャ
kakehashi
PRO
2
530
Developers Summit 2025 浅野卓也(13-B-7 LegalOn Technologies)
legalontechnologies
PRO
0
710
Featured
See All Featured
Statistics for Hackers
jakevdp
797
220k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
28
9.3k
A designer walks into a library…
pauljervisheath
205
24k
Docker and Python
trallard
44
3.3k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
33
2.1k
Being A Developer After 40
akosma
89
590k
How to Think Like a Performance Engineer
csswizardry
22
1.3k
Designing for Performance
lara
604
68k
How GitHub (no longer) Works
holman
314
140k
Building Applications with DynamoDB
mza
93
6.2k
Large-scale JavaScript Application Architecture
addyosmani
511
110k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
40
2k
Transcript
ΫϥυσʔληϯλʔωοτϫʔΫͷ l͍·zͱ l͜Ε͔Βz "*.-)1$ωοτϫʔΫՊձ .BTBZVLJ,PCBZBTIJ
ωοτϫʔΫΛਐԽͤ͞ΔΩʔϑΝΫλʔԿ͔ $PNQVUJOH*OOPWBUJPO 4UPSBHF*OOPWBUJPO /FUXPSLJOH*OOPWBUJPO • ࢄػցֶश • "*$IJQͷߴԽ ίϯϐϡʔςΟϯάͱετϨʔδͷٕज़ֵ৽͕ωοτϫʔΫʹਐԽѹΛ͔͚Δ •
ࢄετϨʔδ • /7.F 4$. 1.&. • +PC$PNQMFUJPO5JNFݮ • Ϟσϧ։ൃͰͷϨΠςϯγݮ
͜Ε·ͰͷίϯϐϡʔςΟϯάͱσʔληϯλʔωοτϫʔΫ ϞϊϦε͔ΒϚΠΫϩαʔϏε ϕΞϝλϧ͔Β7.ɺͦͯ͠ίϯςφ ίϯϐϡʔςΟϯάͷਐԽγεςϜϦιʔεͷࢄஔΛՄೳʹͨ͠ɻ ωοτϫʔΫͷੑೳ͕γεςϜશମͷύϑΥʔϚϯεʹେ͖͘Өڹ͢Δɻ
͜Ε·ͰͷίϯϐϡʔςΟϯάͱσʔληϯλʔωοτϫʔΫ $MPVE/BUJWF%$/FUXPSL 8FC4DBMF యܕతͳ l'BCSJDz l$MPTzͱݺΕΔϨΨγʔτϙϩδ ίϞσΟςΟ&UIFSOFUσόΠεʹΑΔεέʔϧΞτ *1ϕʔεͷύεࢄʹΑΔ#JTFDUJPO #BOEXJEUIར༻ ଟ༷ͳϑϩʔͷࠞࡏ
$PNQVUJOH 4UPSBHF FUD $16r$FOUSJD"SDIJUFDUVSF
͍·զʑΛऔΓר͘ঢ়گͱ՝ େنݴޠϞσϧ ੜ"* ࣗવݴޠॲཧ 5SBOTGPSNFSϞσϧ ࢄػցֶश ͖ଇʹΑΔೖϞσϧͷେنԽ ˠ ઐ༻ΞΫηϥϨʔλ
(16 ͱΫϥελؒ௨৴ͷ֬อ ޫి༥߹ ΦʔϧϑΥτχΫε Ԇͱফඅిྗͷݮ ߴେ༰ྔ௨৴ ˠ ಋମ։ൃ ઐ֎ͷͨΊຊࢿྉͷείʔϓ֎
$16 ͜Ε·ͰͷίϯϐϡʔςΟϯάͱσʔληϯλʔ جຊతʹ͕ͯ͢ $16Ͱ࣮ߦ͞Ε͍ͯͨ )ZQFSWJTPST *01SPDFTT /FUXPSL4UBDL ςφϯτίʔυ ΞϓϦέʔγϣϯ /*$
"QQ LT *0 )7 /FUXPSL େྔͷσʔλసૹΛ͏ϫʔΫϩʔυͳͲͰɺ $16͕ϘτϧωοΫʹͳΔ ςφϯτॲཧʹׯব $16ϦιʔεՄೳͳݶΓ"QQ ςφϯτ Ͱར༻͍ͨ͠ 1$*F
%16*16 ͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ %JTUSJCVUFE%JTBHHSFHBUFE$PNQVUJOH $16 /*$ "QQ LT *0 )7 /FUXPSL
1$*F $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F (1(16 "*.- 1$*F 1$ *F
͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ %JTUSJCVUFE%JTBHHSFHBUFE$PNQVUJOH $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F
(1(16 "*.- 1$*F %16*16 $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F 4UPSBHF /7.F 1$*F 8FC4DBMF'BCSJD 'SPOUFOE/FUXPSL 4DIFEVMFE'BCSJD "*.- #BDLFOE/FUXPSL $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F 1$*F 1$*F
͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ 3%."#BTFE*OUFSDPOFDU $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F
(1(16 "*.- 1$*F %16*16 $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F 4UPSBHF /7.F 1$*F 4DIFEVMFE'BCSJD "*.- #BDLFOE/FUXPSL $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F $16 /*$ "QQ LT *0 )7 /FUXPSL 1$*F 1$*F 1$*F 8FC4DBMF'BCSJD 'SPOUFOE/FUXPSL
͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ $PNQVUJOH 4UPSBHF 3%."/FUXPSL
͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ )PU$IJQT5FTMBجௐߨԋ l#FZPOE$PNQVUF&OBCMJOH"*5ISPVHI4ZTUFN*OUFHSBUJPOzΑΓ
͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ l'VUVSFEBUBDFOUFSTPGBMMLJOETXJMMCFCVJMUMJLFIJHIQFSGPSNBODFDPNQVUFST z /WJEJB$&0 +FOTFO)VBOH
͜Ε͔ΒͷίϯϐϡʔςΟϯάͱσʔληϯλʔ
֤ϫʔΫϩʔυ͕ωοτϫʔΫʹٻΊΔ͜ͱ )1$ ԆͷӨڹΛඇৗʹड͚͍͢ΞϓϦέʔγϣϯͰδολճආ͍ͨ͠ ԆΛ࣮ݱ͢ΔͨΊʹɺେྔͷύέοτΛΩϡʔʹೖΕΔ͜ͱආ͚Δ %$2$/ʹ͓͚ΔύέοτϚʔΩϯάʹΑΔΞάϨογϒίϯτϩʔϧඞਢ "*.- )1$ͱରۃʹ͋Δػցֶशͷ(16ΞϓϦέʔγϣϯ ϨΠςϯγ͕·͍͕͠ɺͦΕΑΓ༻Մೳͳ࠷େεϧʔϓοτ͕ཁٻ͞ΕΔ %$2$/ͷύέοτϚʔΩϯάϥϯμϜͰঃʑʹ૿Ճͤ͞Δ
8FC4DBMF/FUXPSLͱ "*.-/FUXPSLͷҧ͍ 8FC4DBMF/FUXPSL ଟ༷ͰෆۉҰͳଟͷϑϩʔ͕ࠞࡏ͠ɺݸผͷϑϩʔͷτϥϑΟοΫখ͍͞ ΄ͱΜͲͷϑϩϯτΤϯυ௨৴5$1ʹґଘͰ͖ΔͨΊύέοτϩεʹඇৗʹ༰ "*.-/FUXPSL ଟͷδϣϒ͕ಉظ͠ͳ͕Βू߹ԋࢉΛߦ͍ɺߴଳҬ෯ͷ௨৴͕ඞཁʹͳΔ ͯ͢ͷδϣϒ͕࠷͍δϣϒʹΑͬͯ͞ΕΔ 3%."ΧʔωϧόΠύεͷͨΊ5$1ʹґଘͰ͖ͣɺύέοτϩεʹහײ "*.-Ͱඇৗʹ৴པੑͷߴ͍ύέοτసૹΛߦ͏ωοτϫʔΫΛ֬อ͢Δ͕ඞཁ͋Δ
8FC4DBMF/FUXPSLͷ՝ $PNQVUF 4UPSBHF "*.- /POTDIFEVMFE'BCSJD "*.-ϫʔΫϩʔυʹ࠷దԽ͞Ε͍ͯͳ͍ ϑϩʔΛ۠ผ͠ͳ͍ͨΊ3%."ΛࢧԉͰ͖ͳ͍ ड৴Ωϡʔͷঢ়ଶΛݩʹͨ͠ϑϩʔࢄ͕ߦΘΕͳ͍ͨΊಛఆͷΩϡʔ͕ڝ߹͢Δ ϚϧνςφϯτΛఏڙ͢ΔΫϥυඇৗʹl-PTTZzͳωοτϫʔΫ
8FC4DBMF/FUXPSLͷ՝ 3%."ͱύέοτଛࣦͷ՝ ௨ৗͷ*1ωοτϫʔΫͰ͋ΕύέοτυϩοϓΛ5$1ͷΈͳͲͰճ෮ͤ͞Δ 3%."ͷΩϡʔͰͦΕෆՄೳͰ͋ΓɺύέοτଛࣦʹΑΔੑೳԼ͕ஶ͍͠ • 3%."ͷ࠶ૹϋʔυΣΞ࣮ • (P#BDL/͕ύϑΥʔϚϯεͷԼΛট͘ • 3%."ϩεϨεωοτϫʔΫΛલఏͱͯ͠ߟҊ͞Εͨख๏
#VJMEJOHB'VUVSF1SPPG$MPVE*OGSBTUSVDUVSF"6OJGJFE"SDIJUFDUVSFGPS/FUXPSL 4FDVSJUZ BOE4UPSBHF4FSWJDFT
"*.-ϫʔΫϩʔυʹඞཁͳωοτϫʔΫ *OUFSDPOOFDUJPO/FUXPSL #BDLFOE/FUXPSL 'VMM#JTFDUJPO #BOEXJEUI -PTT-FTT'MPX$POUSPM %ZOBNJD-PBE#BMBODJOH ಠཱͨ͠Ϋϥελؒ௨৴༻ͷཪ໘ωοτϫʔΫ (16ؒͷಉظ "MMUP"MMͳͲͷू߹ԋࢉ
"*.- 8FC
ݱࡏ࠾༻͍ͯ͠Δ (16*OUFSDPOOFDU/FUXPSL5PQPMPHZ 3BJM0QUJNJ[FE5PQPMPHZ ಉ͡)$"/*$ಉ͡-FBGTXJUDIʹଓ ௨ৗ࠷ύεͰͷ௨৴͕Մೳɺঢ়گʹԠͯ͡ΞϓϦέʔγϣϯ͕࠷దͳ/*$Λબ Leaf Rail 1 Leaf Rail
2 Leaf Rail 3 Leaf Rail 4 Leaf Rail 5 Leaf Rail 6 Leaf Rail 7 Leaf Rail 8 GPU Server GPU Server GPU Server GPU Server
ϥοΫσβΠϯͷมߋ 5P3 5PQPG3BDL ͔Β &P3 &OEPG3PX ిݯͷ੍ͰεΠονωοτϫʔΫϥοΫʹू͢Δඞཁ͕͋Δ 5P3 TXJUDIͷΘΓʹύονύωϧΛஔ͢Δઃܭ
αʔόϥοΫ(16ͱ$PPMJOH&RVJQNFOUͰ༗ GPU Server Patch Panel GPU Server GPU Server Patch Panel GPU Server GPU Server Patch Panel GPU Server GPU Server Patch Panel GPU Server NW Switch Patch Panel NW Switch NW Switch Patch Panel NW Switch
*OUFSDPOOFDUJPO/FUXPSL )1$501 ʹ͓͚Δ*OUFSDPOOFDU'BNJMZ4IBSF *OGJOJCBOE &UIFSOFU IUUQTEPDTOWJEJBDPNEHYEHYIVTFSHVJEFJOUSPEVDUJPOUPEHYIIUNM
&UIFSOFUWT*OGJOJCBOE IUUQTQDOBOPHPSHTUBUJDQVCMJTIFENFFUJOHT/"/0(@$BSEPOB@5PXBSET@)ZQFSTDBMF@)JHI@WQEG
"*.-ʹ͓͚Δ*OUFSDPOOFDUͷબج४ʢҰྫʣ *OGJOJCBOE ͱʹ͔͘ԆͰͷੑೳΛٻΊΔ શʹดͨ͡ΫϥελڥͰͳ͍ 'BUUSFFͰͳ͍τϙϩδΛ࠾༻͢Δ %SBHPOGMZͳͲ 3P$&W طଘͷࢿ࢈Λ׆༻͠ɺઐ༻ϋʔυΣΞͷೋॏࢿΛճආ͍ͨ͠ ΫϥυڥͰͷϚϧνςφϯγʔ͕ཁ݅ʹ͋Δ ωοτϫʔΫͦͷͷΛεέʔϧΞτ͍ͤͨ͞
*OGJOJCBOE 3P$& ٕज़ղઆ *OGJOJCBOE3P$&ษڧձͰղઆࡁΈ աڈࢿྉΛࢀর
ϩεϨεΠʔαωοτͰඞཁͳνϡʔχϯά %$2$/ &$/ͷύϥϝʔλௐ ϓϥΠϕʔτΫϥυڥͰϢʔβ ςφϯτ ͷϫʔΫϩʔυʹ߹Θͤͯௐ͢Δ ߴͳࣝͱܦݧ͕ඞཁ ,NJO ,NBY 1NBY
,NJO 1NBY )1$8PSLMPBET (168PSLMPBET (FOFSBM8PSLMPBET ,NBY
'SPOUFOEͱ #BDLFOEͷωοτϫʔΫڞ௨Ͱྑ͍ͷ͔ʁ 3%."ωοτϫʔΫͱඇ3%."ωοτϫʔΫ໌֬ʹ͢Δ͖ ߏஙͱཧίετ্͕Δ͕τϨʔυΦϑ͕େ͖͍ ڞ௨ͷωοτϫʔΫͰेͳΩϡʔΛ֬อͰ͖ͳ͍߹͕͋Δ ඞཁͳͷ'Ϛγϯͱͦͷઐ༻ίʔεͰ͋ͬͯɺҰൠंͱߴಓ࿏Ͱͳ͍ "*.- 8FC IUUQTXXXVTFOJYPSHDPOGFSFODFOTEJQSFTFOUBUJPOCBJ
࣮ࡍͷ3P$&WϩεϨενϡʔχϯά ඇެ։
&UIFSOFU4XJUDIJOH"4*$ͷಈ • 5CQT 'MPXMFU %-#ػೳαϙʔτ ͷDIJQ͕ଓʑొ • (16(*OUFSDPOOFDUͷੈք ඇެ։
((CQTͷ՝ ඇެ։
ϨΠςϯγͱεέʔϧΞττϨʔυΦϑ ωοτϫʔΫͷαΠζͱԆͷτϨʔυΦϑ͕ଘࡏ͢Δ $MPT5PQPMPHZ *OEJSFDU5PQPMPHZ ͷආ͚ΒΕͳ͍՝ Ѽઌϊʔυ·Ͱͷϗοϓ͕૿Ճ͢ΕϨΠςϯγ૿͑Δ ͕ɺ΄ͱΜͲͷϢʔεέʔεͰʹͳΒͳ͍ ඇৗʹେنͳ)1$(16ڥͰɺ͜ΕΒʹηϯγςΟϒͳέʔεʹͲ͏ରԠ͢Δ͔
$MPTͰͳ͍τϙϩδͷݕ౼ https://pc.nanog.org/static/published/meetings/NANOG74/1763/20181003_Martin_Routing_In_Dense_v1.pdf
%SBHPOGMZ 5PQPMPHZ IUUQTEBUBUSBDLFSJFUGPSHNFFUJOHNBUFSJBMTTMJEFTSUHXHSPVUJOHJOESBHPOGMZUPQPMPHJFT
%SBHPOGMZ 5PQPMPHZ IUUQTJFFFYQMPSFJFFFPSHEPDVNFOU MMFBGSPVUFST QIPTUTQFSMFBGSPVUFST T ITQJOFSPVUFST LSPVUFSSBEJY /HSPVQ OVNCFSPGIPTUTJOUIFHSPVQ
QMTI QIL /HSPVQ QM L L
%SBHPOGMZ 5PQPMPHZݕূڥ ඇެ։
Կ͕Γ͍ͯͳ͍ͷ͔ʁ ͍·զʑʹඞཁͳςΫϊϩδʔ "EBQUJWF3PVUJOH &$.1ͷภΓΛແ͘͢%-#ͷػೳ͚ͩͰෆे .JOJNBMͱ /PONJOJNBMΛಉ࣌ʹར༻͢Δࢄํࣜ 6("-ͷΑ͏ͳΞϓϩʔνΛ*13PVUJOHͰཱࣗࢄతʹߦ͍͍ͨ IUUQTJFFFYQMPSFJFFFPSHEPDVNFOU
"*.-ωοτϫʔΫઃܭɾӡ༻ͷ͠͞ • ిݯɾۭௐઃඋͷݶք ਫྫྷઃඋͷసʹ͍Δ • ωοτϫʔΫΛৗʹ࠷େߏͰઃܭ͢Δඞཁ͕͋Δ • ܭࢉίετͱΠϯϑϥߏஙͷܦࡁ߹ཧੑ • ߴੑೳڥ͚ͷߴͳϑϩʔ੍ޚΛ͢Δඞཁ͕͋Δ
• ϢʔβͷϫʔΫϩʔυ͝ͱͷಛੑΛཧղ͠ͳ͚ΕͳΒͳ͍ • ϋʔυΣΞϦιʔεͷநԽͱϚϧνςφϯγʔͷ͠͞ • ωοτϫʔΫͱίϯϐϡʔςΟϯάͷ໌֬ͳઢҾͰ͖ͳ͍
͜͜Ͱ͍ٞͨ͜͠ͱ • ʹΈͳ͞ΜͲ͏ͯ͠·͔͢ʁ