kernel offload with complete host kernel functionalities/netdev0x17-kernel-offload

https://netdevconf.info/0x17/sessions/talk/kernel-offload-with-complete-host-kernel-functionalities.html

Transcript

1. kernel offload with complete host kernel offload with complete host kernel functionalities kernel functionalities  1
2. TCP Offload Engine (ToE) TCP Offload Engine (ToE) 2
3. TCP Offload Engine (ToE) TCP Offload Engine (ToE) 2
4. attempt to upstream ToE in Linux attempt to upstream ToE in Linux 3
5. why ToE was rejected ? why ToE was rejected ? 4
6. reasons of ToE rejected reasons of ToE rejected 5
7. what can we do ? what can we do ? 6
8. our attempt: kernel offload our attempt: kernel offload 7
9. internals internals 8
10. Host part: minoc Host part: minoc 9
11. NIC part: minod NIC part: minod copy_from_user() copy_to_user() 10
12. multiple implementations of NIC multiple implementations of NIC side side 11
13. alternatives alternatives 12
14. alternatives alternatives 13
15. Demo Demo 14
16. benchmark setup benchmark setup 15
17. 1. netperf 1. netperf time 16
18. 1. netperf (cont'd) 1. netperf (cont'd) 17
19. 2. nginx/wrk2, non-TLS/kTLS 2. nginx/wrk2, non-TLS/kTLS --with-openssl-opt=enable-ktls sendfile on; 18
20. 2. nginx/wrk2, non-TLS/kTLS 2. nginx/wrk2, non-TLS/kTLS 19
21. 2. nginx/wrk2, non-TLS/kTLS 2. nginx/wrk2, non-TLS/kTLS 19
22. 2. nginx/wrk2, non-TLS/kTLS 2. nginx/wrk2, non-TLS/kTLS 19
23. 2. nginw/wrk2 flamegraph (nginx) 2. nginw/wrk2 flamegraph (nginx) Flame Graph Search ic direct_splice_actor __nanosleep crypto_aes_encrypt [unknown] inet_sendpage [.. crypto_gcm_encrypt clock_nanosleep@@G.. bpf_exec_tx_verdict ghash_update g.. gcm_encrypt_continue minod_client_thread __crypto.. minod_lkl_syscall [unknown] tls_sw_sendpage gcm_hash_init_continue e.. [unkno.. __splice_from_pipe crypto_skcipher_encrypt kernel_sendpage [unknown] tls_sw_do_sendpage shash_ahash_update [unknown] g.. gf128mul_4k_lle r.. splice_direct_to_actor m.. sock_sendpage s.. dpdkio_rx_poll_thread f.. f.. lkl_syscall [unknown] crypto_ctr_crypt minod [unkno.. pipe_to_sendpage gcm_hash_assoc_remain_continue generic_splice_sendpage [un.. crypto_aead_encrypt gcm_hash gcm_hash_assoc_continue [unk.. splice_from_pipe rte_delay_us_sleep d.. minod_process_rsyscall thread_start sys_sendfile64 [unknown] gf128mul_x8_lle [unknown] do_splice_direct shash_async_update do_sendfile d.. crypto_shash_update __crypto_xor start_thread tls_push_record crypto_aead_encrypt 20
24. What we saw ? What we saw ? 21
25. Observations Observations 22
26. To move forward... To move forward... 23
27. Summary Summary 24
28. kernel offload with complete host kernel offload with complete host kernel functionalities kernel functionalities 25