Research Paper Introduction #90 "The Latency Characteristics of GTP-U and SRv6 Stateless Translation on VPP Software Router”

IEEE ’21 COMPSAC (Computers, Software, and Application Conference)
https://ieeexplore.ieee.org/document/9529919

Transcript

1. Research Paper Introduction #32 “The Latency Characteristics of GTP-U and SRv6 Stateless Translation on VPP Software Router” ௨ࢉ#90 @cafenero_777 2022/01/06 1
2. Agenda •ର৅࿦จ •֓ཁͱಡ΋͏ͱͨ͠ཧ༝ 1. INTRODUCTION 2. RELATED WORK 3. MEASUREMENT OVERVIEW 4. DETAILED ANALYSIS OF TRANSLATION ON VPP 5. CONCLUSION 2
3. ର৅࿦จ •The Latency Characteristics of GTP-U and SRv6 Stateless Translation on VPP Software Router • Chunghan Lee∗ Naoyuki Mori† Yasuhiro Ohara‡ Tetsuya Murakami§ Shogo Asaba¶ Satoru Matsushima∥ • ∗Toyota Motor Corporation †Intel Corporation ‡NTT Communications Corporation §Arrcus, Inc.
 ¶NEC Corporation ∥SoftBank Corp. • IEEE ’21 COMPSAC (Computers, Software, and Application Conference) • https://ieeexplore.ieee.org/document/9529919 • ࢀߟɿ • https://wiki.fd.io/images/7/79/The_Latency_Characteristics_of_GTP- U_and_SRv6_Stateless_Translation_on_VPP_Software_Router.pdf 3
4. ֓ཁͱಡ΋͏ͱͨ͠ཧ༝ •֓ཁ • GTP-U/SRv6 translation@VPP (software router) latencyΛଌఆ • 3-30usʹແࣄऩ·Δ͜ͱΛ֬ೝ • ιϑτ΢ΣΞ࣮૷Ͱͷlatencyͷಛ௃Λ·ͱΊΔ •ಡ΋͏ͱͨ͠ཧ༝ • SRv6/beyond-5Gͷ֓ཁΛ஌Γ͍ͨ • Software RouterʢVPPͳͲʣͷ࣮૷ͷಛ௃ʢ஗ԆʣΛ஌Γ͍ͨ • ஶऀͷ໊લʹݟ͕֮͑͋ͬͨͷͰɻ 4 https://www.softbank.jp/mobile/special/softbank-5g/
5. 1. INTRODUCTION •5GͰSDN/NFV, MECͷ࣮ݱͱSW࣮૷ੑೳ޲্ • OvS, Kamuee, VPP, w/ DPDK •MEC server relocation͕ඇಉظʹى͖Δ: αʔϏεܧଓ͕ࠔ೉ • SRv6 mobile user plane: relocation͞Εͯ΋pathΛ֬อ͢Δɺͱ͍͏NFVతͳʢSWతͳʣํ๏͕ఏҊ • GPRS tunnel (GTP-U) <->SRv6 stateless૬ޓม׵ •஗Ԇʹ͍ͭͯͷɺಛʹMobile U-plane஗Ԇʹ͍ͭͯͷݚڀ͕ແ͍ʂ • P4 εΠον্ͰnsecΦʔλʔͰ஗Ԇଌఆ • VPP஗Ԇ෼ੳɺτϥϑΟοΫɾ஗Ԇ૬ؔɻHz/TB, όϧΫɾόονͱ஗Ԇͷಛ௃ɺhashؔ਺ͱੑೳ 5 •eMBB: enhanced Mobile Broadband -> େ༰ྔʂ •mMTC: Massive Machine Type Communications -> ߴີ౓ʂ •uRLLC: Ultra Reliable Low Latency Communications -> ௿஗Ԇʂ Multi-access Edge Computing
6. 2. RELATED WORK •طଘݚڀ • zero-lossͰͷL2/L3ͷpps (packet/sec), cpp(cycle/packet) • MoonGen w/ PTP • DPDK, NetMap • SRPerf (test framework) • P4εΠονͰGTP-U/SRv6ม׵ •ຊݚڀ • VPP (Software Router)ͷGTP-U/SRv6ม׵ͷੑೳଌఆ w/ P4εΠονTimeStamp 6 https://ieeexplore.ieee.org/abstract/document/9012725
7. 3. MEASUREMENT OVERVIEW A. nsec orderͷଌఆ •ύέοτੜ੒͸IXIA • SWͰ͸GTP-U/SRv6Λఆৗੜ੒͕ࠔ೉ •ͳͥP4/ASICͰTS෇༩ʁ -> ߴਫ਼౓ & ม׵Λ൐͏ͨΊ • ૹ৴ݩMACΞυϨεʹTSΛinject & mirror͢Δ • inner ѼઌIPΞυϨεΛม׵ϖΞͷΩʔͱ͢Δɻouter header͸ fi xed •VPPαʔό • Xeon Gold 6126 * 2socket (2.6GHz, 19.25MB L3), CX4 (40Gbps), Ubuntu 18.04 • isol/PMDઃఆͳͲ͸͍ͭ΋௨Γɻͨͩ͠ɺ1core/1NIC portͱͯ͠core scale͸ͤ͞ͳ͍ • 1-5Mpps, Short/Middle/Long (࠷େͰ40Gbps) • प೾਺ӨڹΛௐ΂ΔͨΊʹTB༗ޮԽ (~3.3GHz) 7
8. 3. MEASUREMENT OVERVIEW B. GTP-U/SRv6 stateless translation •GTP-U ͱSRv6ͷ૬ޓม׵ • T.M.GTP4.D • GTP-U over IPv4 to SRv6 • End.M.GTP4.E • SRv6 to GTP-U over IPv4 • SIDʹTEIDͱѼઌIPΛอ࣋ • stale-lessͰrelocationཁ݅Λղܾ 8 https://wiki.fd.io/view/File:The_Latency_Characteristics_of_GTP-U_and_SRv6_Stateless_Translation_on_VPP_Software_Router.pdf
9. 4. DETAILED ANALYSIS OF TRANSLATION ON VPP A/B, VPP & throughput impact •VPP • vector & nodeॲཧͰߴ଎Խ • Vectors/Call͕ࢦඪ • ม׵͸pluginͰ࣮૷ •pluginͦͷ΋ͷͷੑೳӨڹ • L3FWDͱൺֱͯ͠80%ఔ౓ʹ௿Լ 9 6.7Mpps 5.3Mpps
10. 4. DETAILED ANALYSIS OF TRANSLATION ON VPP C. translation latency •packet size͕૿ՃͰ஗Ԇඍ૿ •ೖྗෛՙ૿Ͱ஗Ԇ૿Ճ • 5MppsͰ஗Ԇര૿ɺSD2ഒ •ߴෛՙ࣌͸CDF͕؇΍͔ (%ile͕ѱԽ) • vectorαΠζ͕૿͑ͯॲཧ͕࣌ؒ૿Ճ •3-30usʹऩ·Δ (beyond-5Gͷλʔήοτ) •99%ile͕௕͍ɻi.e. 23000ns@5Mpps • “migration/n”͕͔ᷮʹPMD coreͰಈ͍͍ͯͨ • ্هhousekeeping threadͷ͍ͤͰίϯςΩετεΠονൃੜ 10
11. 4. DETAILED ANALYSIS OF TRANSLATION ON VPP D. VPP batch processing model •ϞσϧԽ • ఆظతʹpktདྷΔ • batchͰinputॲཧ • batchͰoutputॲཧ • batch sizeΛ૿΍͢ͱmin, maxͱ΋ʹ஗Ԇ૿Ճ • ఆٛɿJitter = Latency_max - Latency_min •࣮ࡍʹVPPίϚϯυͰVectors/CallΛऔಘͯ֬͠ೝ • p95Λlatency_max, p5Λlatency_minͱͨ͠ • Vectors/CallͱLatency, jitter͸ڧ͍ਖ਼ͷ૬ؔ 11
12. 4. DETAILED ANALYSIS OF TRANSLATION ON VPP E. Contributing factors of Vectors/Call 12 https://wiki.fd.io/view/File:The_Latency_Characteristics_of_GTP-U_and_SRv6_Stateless_Translation_on_VPP_Software_Router.pdf 1. Input load • v/c, latencyͱ΋ʹࢦ਺ؔ਺తʹ૿Ճ • ڧ͍ਖ਼ͷ૬ؔ 2. CPUप೾਺ • ڧ͍ෛͷ૬ؔ • Hz૿Ճ -> ॲཧ࣌ؒ୹ॖ ->
 όονॲཧ࣌ͷύέοτ਺ݮ (v/cݮ) -> ஗Ԇݮ 3. Translation function • ஗Ԇ͸ॲཧ಺༰ (ෳࡶ͞)ʹґଘ • GTP-U -> SRv6ͷํ͕ॏ͍
13. 4. DETAILED ANALYSIS OF TRANSLATION ON VPP G. Experience: effect of hash spaces •per-packet ECMPͩͱreorderingൃੜ • 5 tuple hashͰసૹϦϯΫΛݻఆ͍ͨ͠ •GTP-U͸outer header͕ಉͨ͡Ίɺ5 tuple hash͕ແҙຯ • inner 5 tuple hash݁ՌΛouter UDP header (src port)ʹೖΕΔ࣮૷ • ϑϧʹinner headerΛಡΉͱlong packetͰ͸ੑೳܹݮ • 40byte (IPv4+TCP header) ݻఆ௕Λࢀর͢ΔΑ͏ʹͯ͠ղܾ • v20.05.1ʹupstreamࡁΈ 13 https://wiki.fd.io/view/File:The_Latency_Characteristics_of_GTP-U_and_SRv6_Stateless_Translation_on_VPP_Software_Router.pdf $ git clone https://gerrit.fd.io/r/vpp $ git show 9e722bd
14. 4. DETAILED ANALYSIS OF TRANSLATION ON VPP H. ࣔࠦ •batchॲཧ • HWͷજࡏೳྗΛҾ͖ग़͠ɺεϧʔϓοτ޲্ • latency, jitterʹӨڹ͢ΔՄೳੑ • burst (૝ఆҎ্ͷinput load)͸ύέϩεʹͳΔՄೳੑɺ஫ҙ •ίετύϑΥʔϚϯεͱ஫ҙ఺ • CPUίΞ౰ͨΓͷτϥϑΟοΫෛՙͷόϥϯεʹ஫ҙ 14
15. 5. CONCLUSION •ιϑτ΢ΣΞ࣮૷ͷSRv6 mobile User PlaneͷϨΠςϯγಛੑΛௐࠪ • beyond-5Gʹద͍ͯ͠Δ͔ •P4εΠονΛ༻͍ͨnsΦʔμʔͷଌఆ • CPUίΞลΓͷtranslator latency͸3-30us • translator functionͷlatencyৄࡉ • batchॲཧͷlatencyͷݪҼಛఆ •ΑΓෳࡶͳέʔεʢෳ਺routing entry, ෳ਺CPU coreͳͲʣΛධՁ༧ఆ 15
16. ࡾߦ·ͱΊ •ιϑτ΢ΣΞ࣮૷ (VPP)ͷMobile U-plane༻translatorͷ஗ԆΛߴਫ਼౓ʹධՁ •beyond-5Gͷڐ༰ൣғ಺ͷ஗Ԇʢ3-30usʣͰΫϦΞ •VPPͷ஗Ԇཁૉ͸3ͭ͋ΔɻͦΕͧΕʹ஫ҙͯ͠ઃܭɾӡ༻ͯ͠Ͷ 16
17. ׬૸ͨ͠ײ૝ •਎ۙͳOSSͳͷͰཧղ͠΍͍͢ʢؾ͕ͨ͠ʣ •5Gɺͱ͍͏͔ϞόΠϧNWͳʹ΋Θ͔ΒΜ •ʢͲ͏ͯ͠΋஌Γ͍ͨ࣌͸ʣஶऀʹ௚઀ฉ͚Δ҆৺ײ΍͹͍ 17
18. ࢀߟจݙ •https://www.docomo-bmec.com/archives/50/ •https://qiita.com/osaphex/items/99f673924a8f236a10f7 18
19. EoP 19