Netty Chicago Java User Group 2024-04-17

Netty
Chicago Java User Group
2024-04-17

Transcript

2. Chicago
3. Agenda 📍 About me 📍 Netty project 📍 Netty in action
4. About me Portland Oregon Java since 1996 open source contributor
5. Netty contributor
6. ✅ async-http-client ✅ reactor-netty ✅ Netflix Zuul ✅ Apache Pinot
7. Netty is open source
8. Netty at Netflix Netty Zuul AWS Cassandra Netty
9. Zuul is built on Netty
10. Zuul: Server.java
11. Zuul server channel initializer
12. Zuul channel handlers
13. Zuul push messaging
14. Zuul push messaging
15. Zuul: sendPushMessage
16. Cassandra is built on Netty
17. Cassandra: SocketFactory.java
18. “Netty is an asynchronous event-driven network application framework”
19. 📍 Apache ActiveMQ Artemis 📍 Apache Bookkeeper 📍 Apache Camel 📍 Apache Cassandra 📍 Apache CXF 📍 Apache Druid
20. 📍 Apache Flink 📍 Apache NiFi 📍 Apache Pinot 📍 Apache Pulsar 📍 Apache Spark 📍 Apache Zookeeper
21. 📍 Armeria 📍 Micronaut 📍 Netflix Zuul 📍 OpenSearch
22. And many others… 📍 Apple Servicetalk 📍 Azure SDK for Java 📍 AWS SDK for Java (v2) 📍 async-http-client 📍 grpc-java 📍 Expedia Styx 📍 Play Framework 📍 reactor-netty 📍 vert.x 📍 gatling
23. blocking I/O non blocking I/O
24. JDK 1.0 socket API
25. JDK NIO
27. Netty core concepts ✅ io.netty.channel.Channel A nexus to a network socket or a component which is capable of I/O operations such as read, write, connect, and bind
28. Netty core concepts ✅ io.netty.channel.ChannelPipeline A list of ChannelHandlers which handles or intercepts inbound events and outbound operations of a Channel
29. Netty core concepts ✅ io.netty.channel.ChannelHandler Handles an I/O event or intercepts an I/O operation, and forwards it to its next handler in its ChannelPipeline
30. Netty core concepts ✅ io.netty.buffer.ByteBuf A random and sequential accessible sequence of zero or more bytes
31. High performance buffer pool Netty 4 introduces a high-performance buffer pool which is a variant of jemalloc https://netty.io/wiki/new-and-noteworthy-in-4.0.html
32. High performance buffer pool ✅ Reduced GC pressure incurred by frequent allocation and deallocation of the buffers ✅ Reduced memory bandwidth consumption incurred when creating a new buffer which inevitably has to be filled with zeroes ✅ Timely deallocation of direct buffers https://netty.io/wiki/new-and-noteworthy-in-4.0.html
33. Netty uses native code
34. Netty transports Core 🟢 JDK NIO Native transports 🟢 epoll 🟢 io_uring 🟢 kqueue
35. Netty optional libraries Native transports 📍 epoll transport 📍 io_uring transport 📍 kqueue transport Other 📍 tcnative boringssl 📍 brotli4j 📍 zstd-jni
36. Netty io_uring
37. io_uring support in Netflix Zuul ✅ https://github.com/Netflix/zuul/pull/1146
38. HTTP content compression
39. Netty compression support ✅ gzip ✅ snappy ✅ brotli ✅ zstd
40. HttpContentCompressor
41. zuul-integration-test
42. Netty pitfalls
43. Cookie class io.netty.handler.codec.http.Cookie io.netty.handler.codec.http.cookie.Cookie
44. Content compressor new HttpContentCompressor() new HttpContentCompressor((CompressorOptions[]) null)
45. Aborted (core dumped) Netty 4.1.98 + Epoll transport + Linux Netty and Java 21
46. https://netty.io/news/index.html Netty and Java 21
47. Netty resource leaks
48. https://netty.io/wiki/reference-counted-objects.html
49. https://netty.io/wiki/reference-counted-objects.html Since Netty version 4, the life cycle of certain objects are managed by their reference counts, so that Netty can return them (or their shared resources) to an object pool (or an object allocator) as soon as it is not used anymore.
50. “The disadvantage of reference counting is that it is easy to leak the reference-counted objects” source: Netty wiki
51. Resource leaks are extremely difficult to debug
52. Netflix Zuul 2.x September 2017
53. Netty resource leak detector Leak Detector levels: - DISABLED - SIMPLE - ADVANCED - PARANOID
54. Best practices to avoid leaks “Run your unit tests and integration tests at PARANOID leak detection level” https://netty.io/wiki/reference-counted-objects.html
55. run Zuul integration test with PARANOID leak detection?
56. Netflix Zuul leak detection
57. Netflix Zuul leak detection assertZeroLeaks()
58. Netflix Zuul leak detection IntegrationTest.java
59. Netflix Zuul leak detection
60. maybe we could implement a JUnit 5 Extension class?
61. https://github.com/nettyplus/netty-leak-detector-junit-extension
63. JUnit 5 example pom.xml
64. JUnit 5 example
65. NettyLeakDetectorExtension
66. ✅ https://github.com/AsyncHttpClient/async-http-client/pull/1932
67. https://github.com/reactor/reactor-netty/pull/3064
68. Let’s talk about Apache Pinot
69. Pinot uses Netty
70. Pinot: QueryServer.java
71. Leak detection ✅ https://github.com/apache/pinot/pull/12483
72. https://github.com/apache/pinot/pull/12577 Native transports
73. Let’s talk about security
74. CVE-2023-44487 “HTTP 2 Rapid Reset” October 2023
75. October 2023 cloudflare.com
76. October 2023 cloudflare.com
77. Netty and HTTP 2 Rapid Reset October 10, 2023
78. Spring Boot and Netty
79. Spring Boot web servers 🔷 JettyWebServer 🔷 NettyWebServer 🔷 UndertowWebServer 🔷 TomcatWebServer
80. Spring Boot with Netty
81. Spring Boot example https://github.com/sullis/spring-boot-netty-playground
82. Learning Netty
83. 📘 published December 2015 🤓 covers Netty 4.x
84. Stéphane Landelle @ Devoxx Belgium 2023
85. Trustin Lee @ Devoxx Belgium 2023
86. Norman Maurer @ Devoxx Belgium 2016
87. Final thoughts ✅ Netty is everywhere ✅ Netty is extensible ✅ Netty is awesome
88. Questions?
89. The End