[SnowOne 2024] Григорий Кошелев: Undertow — андер...что?

Undertow — веб-сервер, который находится под капотом у сервера приложений WildFly, а также один из трёх веб-серверов в Spring Boot.

Разберёмся, как устроен Undertow и нужно ли его тащить в свой проект.

Transcript

1. Undertow Григорий Кошелев Контур SnowOne 2024, Новосибирск
2. План — Историческая справка — Архитектура Undertow — IO-intensive приложения — Undertow + XNIO — Производительность и оптимизации 2
3. Историческая справка 2009 3 наши дни
4. Историческая справка Undertow 1.0 — 10 февраля 2014 2009 4 наши дни Undertow 1.0 — 10.02.2014
5. Историческая справка Undertow 1.0 — 10 февраля 2014 2009 5 март 2013 наши дни Undertow 1.0 — 10.02.2014
6. Историческая справка WildFly 8.0 — 12 февраля 2014 2009 наши дни https://www.wildfly.org/news/2014/02/12/WildFly8-Final-Released/ 6 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014
7. WildFly 8.0 Undertow, the new cutting-edge web server in WildFly 8, is designed for maximum throughput and scalability, including environments with over a million connections. It supports non-blocking and blocking handlers, traditional and asynchronous servlets, and JSR-356 web socket handlers. It is highly customizable, with the ability for applications to implement nearly anything from dynamic request routing to custom protocols. It can also function as a very efficient, pure non-blocking reverse proxy, allowing WildFly to delegate to other web servers with minimal impact to running applications. This release adds numerous improvements including greater extensibility and enhanced security capabilities. https://www.wildfly.org/news/2014/02/12/WildFly8-Final-Released/ 7
8. WildFly 8.0 Undertow, the new cutting-edge web server in WildFly 8, is designed for maximum throughput and scalability, including environments with over a million connections. It supports non-blocking and blocking handlers, traditional and asynchronous servlets, and JSR-356 web socket handlers. It is highly customizable, with the ability for applications to implement nearly anything from dynamic request routing to custom protocols. It can also function as a very efficient, pure non-blocking reverse proxy, allowing WildFly to delegate to other web servers with minimal impact to running applications. This release adds numerous improvements including greater extensibility and enhanced security capabilities. https://www.wildfly.org/news/2014/02/12/WildFly8-Final-Released/ 8
9. WildFly 8.0 Undertow, the new cutting-edge web server in WildFly 8, is designed for maximum throughput and scalability, including environments with over a million connections. It supports non-blocking and blocking handlers, traditional and asynchronous servlets, and JSR-356 web socket handlers. It is highly customizable, with the ability for applications to implement nearly anything from dynamic request routing to custom protocols. It can also function as a very efficient, pure non-blocking reverse proxy, allowing WildFly to delegate to other web servers with minimal impact to running applications. This release adds numerous improvements including greater extensibility and enhanced security capabilities. https://www.wildfly.org/news/2014/02/12/WildFly8-Final-Released/ 9
10. WildFly 8.0 Undertow, the new cutting-edge web server in WildFly 8, is designed for maximum throughput and scalability, including environments with over a million connections. It supports non-blocking and blocking handlers, traditional and asynchronous servlets, and JSR-356 web socket handlers. It is highly customizable, with the ability for applications to implement nearly anything from dynamic request routing to custom protocols. It can also function as a very efficient, pure non-blocking reverse proxy, allowing WildFly to delegate to other web servers with minimal impact to running applications. This release adds numerous improvements including greater extensibility and enhanced security capabilities. https://www.wildfly.org/news/2014/02/12/WildFly8-Final-Released/ 10
11. WildFly 8.0 Undertow, the new cutting-edge web server in WildFly 8, is designed for maximum throughput and scalability, including environments with over a million connections. It supports non-blocking and blocking handlers, traditional and asynchronous servlets, and JSR-356 web socket handlers. It is highly customizable, with the ability for applications to implement nearly anything from dynamic request routing to custom protocols. It can also function as a very efficient, pure non-blocking reverse proxy, allowing WildFly to delegate to other web servers with minimal impact to running applications. This release adds numerous improvements including greater extensibility and enhanced security capabilities. https://www.wildfly.org/news/2014/02/12/WildFly8-Final-Released/ 11
13. Историческая справка WildFly 8.0 — 12 февраля 2014 2009 наши дни 13 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014
14. Историческая справка Spring Boot 1.2.0 — 11 декабря 2014 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 2009 наши дни https://spring.io/blog/2014/12/11/spring-boot-1-2-0-released/ 14 Spring Boot 1.2.0 — 11.12.2014
15. Историческая справка Vostok Hercules — апрель 2018 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 наши дни https://github.com/vostok/hercules 15 Spring Boot 1.2.0 — 11.12.2014
16. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15 16
17. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 17
18. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 18
19. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 19
20. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 20
21. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 21
22. Rapidoid «Высокопроизводительное Java-приложение в сердце стриминговой архитектуры» Алексей Кирпичников, Контур java.ural.Meetup@1 https://www.youtube.com/watch?v=Birt7ctlLTM 22
23. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 23
24. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=plaintext 24
25. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=query 25
26. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=query 26
27. Web Framework Benchmarks https://www.techempower.com/benchmarks/#section=data-r15&hw=ph&test=query 27
28. Независимое тестирование 1. Undertow 2. Jetty 3. Tomcat 28
29. Независимое тестирование 1. Undertow 2. Jetty 3. Tomcat 29
30. Историческая справка Vostok Hercules — апрель 2018 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 наши дни 30 Spring Boot 1.2.0 — 11.12.2014
31. Историческая справка Анонс Undertow 3.0 — апрель 2019 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 апрель 2019 наши дни https://undertow.io/blog/2019/04/15/Undertow-3.html 31 Spring Boot 1.2.0 — 11.12.2014
32. Историческая справка Анонс Undertow 3.0 — апрель 2019 * XNIO –> Netty https://undertow.io/blog/2019/04/15/Undertow-3.html 32 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 апрель 2019 наши дни Spring Boot 1.2.0 — 11.12.2014
33. Историческая справка Анонс Undertow 3.0 — апрель 2019 * XNIO –> Netty * Смена лидера проекта https://undertow.io/blog/2019/04/15/Undertow-3.html 33 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 апрель 2019 наши дни Spring Boot 1.2.0 — 11.12.2014
34. Историческая справка Анонс Undertow 3.0 — апрель 2019 * XNIO –> Netty * Смена лидера проекта https://undertow.io/blog/2019/04/15/Undertow-3.html 34 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 апрель 2019 наши дни Spring Boot 1.2.0 — 11.12.2014 Stuart Douglas -> Flavia Rainone
35. Историческая справка ??? 35 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 март 2019 наши дни Spring Boot 1.2.0 — 11.12.2014
36. Историческая справка Supersonic Subatomic Java 36 Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 март 2019 наши дни Spring Boot 1.2.0 — 11.12.2014
37. Историческая справка Supersonic Subatomic Java — Quarkus Undertow 1.0 — 10.02.2014 WildFly 8.0 — 12.02.2014 апрель 2018 2009 Quarkus — март 2019 наши дни https://developers.redhat.com/blog/2019/03/07/quarkus-next-generation-kubernetes-native-java-framework 37 Spring Boot 1.2.0 — 11.12.2014
38. https://github.com/undertow-io/undertow/tree/3.x 38
39. https://github.com/undertow-io/undertow/tree/3.x 39
40. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
41. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
42. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
43. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
44. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
45. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
46. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
47. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
48. Архитектура Undertow undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
49. IO-intensive приложения 49
50. IO-intensive приложения Что это такое? 50
51. IO-intensive приложения Что это такое? — Много входящего трафика — Много исходящего трафика 51
52. IO-intensive приложения Что это такое? — Много входящего трафика — Много исходящего трафика Количество HTTP-запросов 52
53. IO-intensive приложения Что это такое? — Много входящего трафика — Много исходящего трафика Количество HTTP-запросов x размер запросов 53
54. IO-intensive приложения HTTP API HTTP API Kafka 54
55. IO-intensive приложения HTTP API HTTP API Kafka 55
56. IO-intensive приложения HTTP API HTTP API Kafka 56
57. IO-intensive приложения HTTP API HTTP API Kafka 57
58. IO-intensive приложения HTTP API HTTP API Kafka 58
59. IO-intensive приложения HTTP API HTTP API Kafka 59
60. IO-intensive приложения HTTP API HTTP API Kafka 60
61. IO-intensive приложения HTTP API HTTP API Kafka 61
62. IO-intensive приложения HTTP API HTTP API Kafka 62 «Интересные» места?
63. IO-intensive приложения HTTP API HTTP API Kafka 63 «Интересные» места? Эффективная работа с тысячами коннекций
64. IO-intensive приложения HTTP API HTTP API Kafka 64 «Интересные» места? Обработка медленных клиентов Эффективная работа с тысячами коннекций
65. IO-intensive приложения HTTP API HTTP API Kafka 65 «Интересные» места? Эффективная работа с тысячами коннекций Обработка медленных клиентов Снижение нагрузки на GC
66. IO-intensive приложения HTTP API HTTP API Kafka 66 «Интересные» места? Эффективная работа с тысячами коннекций Снижение нагрузки на GC Обработка медленных клиентов Эффективная отправка
67. Undertow + XNIO undertow-servlet Servlet 3.1+ undertow-websockets-jsr JSR-356 (Java API for websockets) undertow-core XNIO Java NIO EPoll (Linux) KQueue (Mac, BSD)
68. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 68
69. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 69
70. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 70 1
71. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 71 2 1
72. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 72 1 2 3
73. Undertow + XNIO 73
74. Undertow + XNIO 74 java.nio.channels.spi. SelectorProvider
75. Undertow + XNIO 75 java.nio.channels.spi. SelectorProvider sun.nio.ch.EPollSelectorProvider
76. Undertow + XNIO 76 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread sun.nio.ch.EPollSelectorProvider
77. Undertow + XNIO 77 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread sun.nio.ch.EPollSelectorProvider openSelector()
78. Undertow + XNIO 78 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread sun.nio.ch.EPollSelectorProvider openSelector()
79. Undertow + XNIO 79 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() sun.nio.ch.EPollSelectorProvider openSelector()
80. Undertow + XNIO 80 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() sun.nio.ch.EPollSelectorProvider openSelector() openSelector()
81. Undertow + XNIO 81 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() sun.nio.ch.EPollSelectorProvider openSelector() openSelector() acceptQueue
82. Undertow + XNIO 82 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() java.nio.channels. ServerSocketChannel sun.nio.ch.EPollSelectorProvider openSelector() openSelector() acceptQueue
83. Undertow + XNIO 83 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() java.nio.channels. ServerSocketChannel sun.nio.ch.EPollSelectorProvider openSelector() openSelector() open() acceptQueue
84. Undertow + XNIO 84 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() java.nio.channels. ServerSocketChannel java.net. InetSocketAddress sun.nio.ch.EPollSelectorProvider openSelector() openSelector() open() acceptQueue
85. Undertow + XNIO 85 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() java.nio.channels. ServerSocketChannel java.net. InetSocketAddress sun.nio.ch.EPollSelectorProvider openSelector() openSelector() socket().bind() open() acceptQueue
86. Undertow + XNIO 86 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() java.nio.channels. ServerSocketChannel java.net. InetSocketAddress sun.nio.ch.EPollSelectorProvider openSelector() openSelector() registerChannel() socket().bind() open() acceptQueue
87. Undertow + XNIO 87 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() java.nio.channels. ServerSocketChannel java.net. InetSocketAddress sun.nio.ch.EPollSelectorProvider openSelector() openSelector() registerChannel() socket().bind() open() acceptQueue SelectionKey
88. Undertow + XNIO 88 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() org.xnio.nio. NioTcpServerHandle java.nio.channels. ServerSocketChannel java.net. InetSocketAddress sun.nio.ch.EPollSelectorProvider openSelector() openSelector() registerChannel() socket().bind() open() acceptQueue SelectionKey
89. Undertow + XNIO 89 java.nio.channels.spi. SelectorProvider acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() org.xnio.nio. NioTcpServerHandle java.nio.channels. ServerSocketChannel java.net. InetSocketAddress sun.nio.ch.EPollSelectorProvider openSelector() openSelector() registerChannel() socket().bind() open() acceptQueue SelectionKey attach()
90. Виды потоков 90 acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors()
91. Виды потоков 91 acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() taskPool j.u.c.ScheduledExecutorService
92. Виды потоков 92 acceptThread org.xnio.nio.WorkerThread ioThreads [] org.xnio.nio.WorkerThread Runtime.getRuntime().availableProcessors() taskPool j.u.c.ScheduledExecutorService ioThreads * 8
93. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 93 1 2 3
94. Undertow + XNIO Undertow server = Undertow.builder() .addHttpListener(8080, "localhost") .setHandler(Handlers.routing() .get("/hello/{any}", new MyHelloAnyHandler()) .post("/echo", new MyEchoHandler()) ).build(); server.start(); 94 1 2 3
95. Undertow + XNIO 95 acceptListener io.undertow.server.protocol.http. HttpOpenListener
96. Undertow + XNIO 96 acceptListener io.undertow.server.protocol.http. HttpOpenListener parser io.undertow.server.protocol.http. HttpRequestParser
97. Undertow + XNIO 97 acceptListener io.undertow.server.protocol.http. HttpOpenListener rootHandler io.undertow.server.HttpHandler parser io.undertow.server.protocol.http. HttpRequestParser
98. Обработка запроса acceptThread ioThread taskThread 98 java.nio.channels. SocketChannel
99. Обработка запроса acceptThread ioThread taskThread 99 ioThread java.nio.channels. SocketChannel
100. Обработка запроса acceptThread ioThread taskThread 100 ioThread java.nio.channels. SocketChannel registerChannel()
101. Обработка запроса acceptThread ioThread taskThread 101 connection org.xnio.nio. NioSocketStreamConnection ioThread java.nio.channels. SocketChannel registerChannel()
102. Обработка запроса acceptThread ioThread taskThread 102 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread java.nio.channels. SocketChannel registerChannel()
103. Обработка запроса acceptThread ioThread taskThread 103 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel()
104. Обработка запроса acceptThread ioThread taskThread 104 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel()
105. Обработка запроса acceptThread ioThread taskThread 105 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task
106. Обработка запроса acceptThread ioThread taskThread 106 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task
107. Обработка запроса acceptThread ioThread taskThread 107 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener
108. Обработка запроса acceptThread ioThread taskThread 108 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener
109. Обработка запроса acceptThread ioThread taskThread 109 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener parser
110. Обработка запроса acceptThread ioThread taskThread 110 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener rootHandler parser
111. HttpHandler public interface HttpHandler { /** * Handle the request. * * @param exchange the HTTP request/response exchange * */ void handleRequest(HttpServerExchange exchange) throws Exception; } 111
112. HttpServerExchange 112
113. HttpServerExchange public HttpServerExchange dispatch( final Runnable runnable) { /* ... */ } public HttpServerExchange dispatch( final Executor executor, final Runnable runnable) { /* ... */ } 113
114. Обработка запроса acceptThread ioThread taskThread 114 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener rootHandler parser
115. HttpServerExchange public Receiver getRequestReceiver() { /* ... */ return new AsyncReceiverImpl(this); } public Sender getResponseSender() { /* ... */ return new AsyncSenderImpl(this); } 115
116. HttpServerExchange public Receiver getRequestReceiver() { /* ... */ return new AsyncReceiverImpl(this); } public Sender getResponseSender() { /* ... */ return new AsyncSenderImpl(this); } 116
117. AsyncReceiverImpl 117
118. AsyncReceiverImpl public void receiveFullBytes( final FullBytesCallback callback, final ErrorCallback errorCallback) { /* ... */ } public void receivePartialBytes( final PartialBytesCallback callback, final ErrorCallback errorCallback) { /* ... */ } 118
119. AsyncReceiverImpl public void receiveFullBytes( final FullBytesCallback callback, final ErrorCallback errorCallback) { /* ... */ } public void receivePartialBytes( final PartialBytesCallback callback, final ErrorCallback errorCallback) { /* ... */ } 119
120. AsyncReceiverImpl exchange.getRequestReceiver().receiveFullBytes( (ex, bytes) -> { /* ioThread */ /* bytes -> runnable */ ex.dispatch(runnable); }, (ex, exception) -> { ex.setStatusCode(StatusCodes.INTERNAL_SERVER_ERROR); ex.endExchange(); } ); 120
121. AsyncReceiverImpl exchange.getRequestReceiver().receiveFullBytes( (ex, bytes) -> { /* ioThread */ /* bytes -> runnable */ ex.dispatch(runnable); }, (ex, exception) -> { ex.setStatusCode(StatusCodes.INTERNAL_SERVER_ERROR); ex.endExchange(); } ); 121
122. AsyncReceiverImpl exchange.getRequestReceiver().receiveFullBytes( (ex, bytes) -> { /* ioThread */ /* bytes -> runnable */ ex.dispatch(runnable); }, (ex, exception) -> { ex.setStatusCode(StatusCodes.INTERNAL_SERVER_ERROR); ex.endExchange(); } ); 122
123. AsyncReceiverImpl exchange.getRequestReceiver().receiveFullBytes( (ex, bytes) -> { /* ioThread */ /* bytes -> runnable */ ex.dispatch(runnable); }, (ex, exception) -> { ex.setStatusCode(StatusCodes.INTERNAL_SERVER_ERROR); ex.endExchange(); } ); 123
124. Производительность и оптимизации HTTP API Kafka HTTP API 124 Эффективная работа с тысячами коннекций Снижение нагрузки на GC Обработка медленных клиентов Эффективная отправка
125. HttpServerExchange public Receiver getRequestReceiver() { /* ... */ return new AsyncReceiverImpl(this); } public Sender getResponseSender() { /* ... */ return new AsyncSenderImpl(this); } 125
126. AsyncSenderImpl 126
127. AsyncSenderImpl public void send( final ByteBuffer buffer, final IoCallback callback) { /* ... */ } public void send( final ByteBuffer[] buffer, final IoCallback callback) { /* ... */ } 127
128. AsyncSenderImpl public void send( final ByteBuffer buffer, final IoCallback callback) { /* ... */ } public void send( final ByteBuffer[] buffer, final IoCallback callback) { /* ... */ } 128
129. AsyncSenderImpl public void send( final ByteBuffer buffer, final IoCallback callback) { /* ... */ } public void send( final ByteBuffer[] buffer, final IoCallback callback) { /* ... */ } 129
130. AsyncSenderImpl.send() do { long res = channel.write(buffer); written += res; if (res == 0) { this.buffer = buffer; this.callback = callback; /* ... */ channel.getWriteSetter().set(writeListener); channel.resumeWrites(); return; } } while (written < total); 130
131. AsyncSenderImpl.send() do { long res = channel.write(buffer); written += res; if (res == 0) { this.buffer = buffer; this.callback = callback; /* ... */ channel.getWriteSetter().set(writeListener); channel.resumeWrites(); return; } } while (written < total); 131
132. AsyncSenderImpl.send() do { long res = channel.write(buffer); written += res; if (res == 0) { this.buffer = buffer; this.callback = callback; /* ... */ channel.getWriteSetter().set(writeListener); channel.resumeWrites(); return; } } while (written < total); 132
133. AsyncSenderImpl.send() do { long res = channel.write(buffer); written += res; if (res == 0) { this.buffer = buffer; this.callback = callback; /* ... */ channel.getWriteSetter().set(writeListener); channel.resumeWrites(); return; } } while (written < total); 133
134. AsyncSenderImpl.writeListener public void handleEvent(final StreamSinkChannel ch) { try { long toWrite = Buffers.remaining(buffer); long written = 0; while (written < toWrite) { long res = ch.write(buffer, 0, buffer.length); written += res; if (res == 0) { return; } } /* ... */ } catch (IOException e) { /* ... */ } } 134
135. AsyncSenderImpl.writeListener public void handleEvent(final StreamSinkChannel ch) { try { long toWrite = Buffers.remaining(buffer); long written = 0; while (written < toWrite) { long res = ch.write(buffer, 0, buffer.length); written += res; if (res == 0) { return; } } /* ... */ } catch (IOException e) { /* ... */ } } 135 ByteBuffer[]
136. AsyncSenderImpl.writeListener public void handleEvent(final StreamSinkChannel ch) { try { long toWrite = Buffers.remaining(buffer); long written = 0; while (written < toWrite) { long res = ch.write(buffer, 0, buffer.length); written += res; if (res == 0) { return; } } /* ... */ } catch (IOException e) { /* ... */ } } 136
137. AsyncSenderImpl.send() do { long res = channel.write(buffer); written += res; if (res == 0) { this.buffer = buffer; this.callback = callback; /* ... */ channel.getWriteSetter().set(writeListener); channel.resumeWrites(); return; } } while (written < total); 137
138. AsyncSenderImpl.send() do { long res = channel.write(buffer); written += res; if (res == 0) { this.buffer = buffer; this.callback = callback; /* ... */ channel.getWriteSetter().set(writeListener); channel.resumeWrites(); return; } } while (written < total); 138
139. Обработка запроса acceptThread ioThread taskThread 139 selectorWorkQueue task writeListener sun.nio.ch. SocketChannelImpl
140. Обработка запроса acceptThread ioThread taskThread 140 task writeListener sun.nio.ch. SocketChannelImpl selectorWorkQueue
141. Обработка запроса acceptThread ioThread taskThread 141 selectorWorkQueue writeListener sun.nio.ch. SocketChannelImpl task
142. Обработка запроса acceptThread ioThread taskThread 142 selectorWorkQueue task sun.nio.ch. SocketChannelImpl writeListener
143. Обработка запроса acceptThread ioThread taskThread 143 selectorWorkQueue task writeListener sun.nio.ch. SocketChannelImpl ...
144. Обработка запроса acceptThread ioThread taskThread 144 selectorWorkQueue task writeListener sun.nio.ch. SocketChannelImpl ...
145. Производительность и оптимизации 145 Эффективная работа с тысячами коннекций Снижение нагрузки на GC Обработка медленных клиентов Эффективная отправка HTTP API Kafka HTTP API
146. Производительность и оптимизации HTTP API Kafka HTTP API 146 Эффективная работа с тысячами коннекций Снижение нагрузки на GC Обработка медленных клиентов Эффективная отправка
147. sun.nio.ch.SocketChannelImpl public long write( ByteBuffer[] srcs, int offset, int length) { /* ... */ IOUtil.write(fd, srcs, offset, length, nd); /* ... */ } 147
148. sun.nio.ch.IOUtil if (!(buf instanceof DirectBuffer)) { ByteBuffer shadow = Util.getTemporaryDirectBuffer(rem); shadow.put(buf); shadow.flip(); /* ... */ buf = shadow; /* ... */ } 148
149. sun.nio.ch.IOUtil if (!(buf instanceof DirectBuffer)) { ByteBuffer shadow = Util.getTemporaryDirectBuffer(rem); shadow.put(buf); shadow.flip(); /* ... */ buf = shadow; /* ... */ } 149
150. sun.nio.ch.IOUtil if (!(buf instanceof DirectBuffer)) { ByteBuffer shadow = Util.getTemporaryDirectBuffer(rem); shadow.put(buf); shadow.flip(); /* ... */ buf = shadow; /* ... */ } 150
151. ru.kontur.vostok.hercules.util. ByteBufferPool 151
152. ru.kontur.vostok.hercules.util. ByteBufferPool exchange.getResponseSender().send( buffer, new io.undertow.io.IoCallback() { @Override public void onComplete( HttpServerExchange exchange, Sender sender) { ByteBufferPool.release(buffer); exchange.endExchange(); } /* ... */ }); 152
153. ru.kontur.vostok.hercules.util. ByteBufferPool exchange.getResponseSender().send( buffer, new io.undertow.io.IoCallback() { @Override public void onComplete( HttpServerExchange exchange, Sender sender) { ByteBufferPool.release(buffer); exchange.endExchange(); } /* ... */ }); 153
154. ru.kontur.vostok.hercules.util. ByteBufferPool exchange.getResponseSender().send( buffer, new io.undertow.io.IoCallback() { @Override public void onComplete( HttpServerExchange exchange, Sender sender) { ByteBufferPool.release(buffer); exchange.endExchange(); } /* ... */ }); 154
155. Производительность и оптимизации 155
156. Производительность и оптимизации 156 — HttpRequestParser — HttpString
157. io.undertow.server.protocol.http. HttpRequestParser public abstract class HttpRequestParser 157
158. io.undertow.server.protocol.http. HttpRequestParser public abstract class HttpRequestParser public class HttpRequestParser$$generated extends HttpRequestParser 158
159. io.undertow.server.protocol.http. HttpRequestParser 159
160. io.undertow.util.HttpString /** * An HTTP case-insensitive Latin-1 string. */ public final class HttpString implements Comparable<HttpString>, Serializable { private final byte[] bytes; private final transient int hashCode; /** * For well known header to make comparison fast */ private final int orderInt; private transient String string; /* ... */ 160
161. io.undertow.util.HttpString /** * An HTTP case-insensitive Latin-1 string. */ public final class HttpString implements Comparable<HttpString>, Serializable { private final byte[] bytes; private final transient int hashCode; /** * For well known header to make comparison fast */ private final int orderInt; private transient String string; /* ... */ 161
162. io.undertow.util.HttpString /** * An HTTP case-insensitive Latin-1 string. */ public final class HttpString implements Comparable<HttpString>, Serializable { private final byte[] bytes; private final transient int hashCode; /** * For well known header to make comparison fast */ private final int orderInt; private transient String string; /* ... */ 162
163. io.undertow.util.HttpString 0x41 A 0x42 B 0x43 C 0x44 D 0x45 E 0x46 F ... 0x57 W 0x58 X 0x59 Y 0x5A Z 163
164. io.undertow.util.HttpString 0x41 A 0x61 a 0x42 B 0x62 b 0x43 C 0x63 c 0x44 D 0x64 d 0x45 E 0x65 e 0x46 F 0x66 f ... 0x57 W 0x77 w 0x58 X 0x78 x 0x59 Y 0x79 y 0x5A Z 0x7A z 164
165. io.undertow.util.HttpString 0x41 A 0x61 a 0x42 B 0x62 b 0x43 C 0x63 c 0x44 D 0x64 d 0x45 E 0x65 e 0x46 F 0x66 f ... 0x57 W 0x77 w 0x58 X 0x78 x 0x59 Y 0x79 y 0x5A Z 0x7A z 165 private static int higher(byte b) { return b & (b >= 'a' && b <= 'z' ? 0xDF : 0xFF); }
166. io.undertow.util.HttpString 0x41 A 0x61 a 0x42 B 0x62 b 0x43 C 0x63 c 0x44 D 0x64 d 0x45 E 0x65 e 0x46 F 0x66 f ... 0x57 W 0x77 w 0x58 X 0x78 x 0x59 Y 0x79 y 0x5A Z 0x7A z 166 private static int higher(byte b) { return b & (b >= 'a' && b <= 'z' ? 0xDF : 0xFF); }
167. io.undertow.util.HttpString /** * An HTTP case-insensitive Latin-1 string. */ public final class HttpString implements Comparable<HttpString>, Serializable { private final byte[] bytes; private final transient int hashCode; /** * For well known header to make comparison fast */ private final int orderInt; private transient String string; /* ... */ 167
168. io.undertow.util.HttpString /** * An HTTP case-insensitive Latin-1 string. */ public final class HttpString implements Comparable<HttpString>, Serializable { private final byte[] bytes; private final transient int hashCode; /** * For well known header to make comparison fast */ private final int orderInt; private transient String string; /* ... */ 168
169. io.undertow.util.HttpString public static final HttpString ACCEPT = new HttpString(ACCEPT_STRING, 1); public static final HttpString ACCEPT_CHARSET = new HttpString(ACCEPT_CHARSET_STRING, 2); public static final HttpString ACCEPT_ENCODING = new HttpString(ACCEPT_ENCODING_STRING, 3); 169
170. io.undertow.util.HttpString public static final HttpString ACCEPT = new HttpString(ACCEPT_STRING, 1); public static final HttpString ACCEPT_CHARSET = new HttpString(ACCEPT_CHARSET_STRING, 2); public static final HttpString ACCEPT_ENCODING = new HttpString(ACCEPT_ENCODING_STRING, 3); 170 HttpString.orderInt
171. Коварный трединг 171
172. Коварный трединг acceptThread ioThread taskThread 172 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener rootHandler parser
173. Коварный трединг acceptThread ioThread taskThread 173 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener rootHandler parser
174. Коварный трединг acceptThread ioThread taskThread 174 connection org.xnio.nio. NioSocketStreamConnection acceptQueue ioThread selectorWorkQueue java.nio.channels. SocketChannel registerChannel() task acceptListener io.undertow.server. protocol.http. HttpReadListener rootHandler parser
175. Выводы 175
176. Выводы Kafka HTTP API HTTP API 176 Эффективная работа с тысячами коннекций Снижение нагрузки на GC Обработка медленных клиентов Эффективная отправка
177. Q/A Другие доклады и материалы: https://tg.me/chnl_GregoryKoshelev https://tg.me/chnl_GregoryKoshelev 177