Michael Nitschinger on State of the art JVM networking with Netty

Slide 1

Slide 1 text

1 State Of The Art JVM Networking with Ne6y Michael Nitschinger, SDK Engineer

Slide 2

Slide 2 text

2 “Ne#y is an asynchronous and event-‐driven network applica0on framework for rapid development of maintainable high performance protocol servers & clients.“

Slide 3

Slide 3 text

3 PragmaAsm Enthusiasm Encouragement Simplicity

Slide 4

Slide 4 text

4 PragmaAsm Enthusiasm Encouragement Simplicity

Slide 5

Slide 5 text

5 CommunicaAon

Slide 6

Slide 6 text

6 Half-‐Duplex (HTTP) Full-‐Duplex (Websockets)

Slide 7

Slide 7 text

Slide 8

Slide 8 text

Slide 9

Slide 9 text

9 Pipelines

Slide 10

Slide 10 text

10 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 11

Slide 11 text

11 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 12

Slide 12 text

12 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 13

Slide 13 text

13 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 14

Slide 14 text

14 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 15

Slide 15 text

15 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 16

Slide 16 text

16 Encoder Encoder Ne4y Writes Ne4y Reads Decoder Decoder

Slide 17

Slide 17 text

17 Outbound Handler Outbound Handler Ne4y Writes Ne4y Reads Inbound Handler Inbound Handler

Slide 18

Slide 18 text

Slide 19

Slide 19 text

19 ChannelHandlers

Slide 20

Slide 20 text

20 Handlers are your Workers Each handler receives messages and poten;ally emits messages. •  Use them for   Encoding & Decoding („Codec“)   Business-‐Logic   State Changes   Event NoPﬁcaPons

Slide 21

Slide 21 text

21 Handler Hierachy ChannelHandler ChannelInboundHandler ChannelInboundHandlerAdapter ChannelOutboundHandler ChannelOutboundHandlerAdapter

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Slide 24

Slide 24 text

Slide 25

Slide 25 text

25 Handler Types •  Encoder   MessageToByte   MessageToMessage •  Decoder   ByteToMessage   MessageToMessage •  Hybrid Codecs   ByteToByte   ByteToMessage   MessageToMessage •  Useful Decoders   Replay   FixedLengthFrame   LengthFieldBasedFrame   LineBasedFrame   DelimiterBasedFrame

Slide 26

Slide 26 text

26 Handler Types •  Encoder   MessageToByte   MessageToMessage •  Decoder   ByteToMessage   MessageToMessage •  Hybrid Codecs   ByteToByte   ByteToMessage   MessageToMessage •  Useful Decoders   Replay   FixedLengthFrame   LengthFieldBasedFrame   LineBasedFrame   DelimiterBasedFrame

Slide 27

Slide 27 text

27 Provided Codecs •  HTTP •  HTTP2 •  Websockets •  SPDY •  Memcache •  SerializaAon •  Socks •  JBoss Marshaling •  Protobuf •  SSL •  Zlib

Slide 28

Slide 28 text

28 Provided Codecs •  HTTP •  HTTP2 •  Websockets •  SPDY •  Memcache •  SerializaAon •  Socks •  JBoss Marshaling •  Protobuf •  SSL •  Zlib

Slide 29

Slide 29 text

29 Bootstrap

Slide 30

Slide 30 text

30 PragmaAsm Enthusiasm Encouragement Simplicity

Slide 31

Slide 31 text

31 Performance

Slide 32

Slide 32 text

32 Couchbase & Ne6y

Slide 33

Slide 33 text

33 Techempower Round 9 Plaintext i7

Slide 34

Slide 34 text

34 Why? •  Eﬃcient EventLoop/Socket MulAplexing •  GC opAmized   Less allocaPons   Caching/Pooling   StaPc Instances   Selected use of sun.misc.Unsafe •  Lots of „Mechanical Sympathy“

Slide 35

Slide 35 text

35 ByteBufs •  java.nio.ByteBuﬀer replacement   Simpler API   Feature rich   Embraces reusability   CompositeByteBuf Reader Index Writer Index Capacity

Slide 36

Slide 36 text

36 The extra mile

Slide 37

Slide 37 text

Slide 38

Slide 38 text

38 NaAve Epoll Transport •  JNI based wrapper around Linux Epoll for TCP and UDP •  GC opAmized •  Support for: TCP_CORK and SO_REUSEADDR   TCP_CORK: Helps with data batching   SO_REUSEADDR: UDP MulPcast

Slide 39

Slide 39 text

39 NaAve Bootstrap

Slide 40

Slide 40 text

40 PrimiAve CollecAons

Slide 41

Slide 41 text

41 ByteBuf Pooling h6ps://blog.twi6er.com/2013/ne6y-‐4-‐at-‐twi6er-‐reduced-‐gc-‐overhead

Slide 42

Slide 42 text

42 PragmaAsm Enthusiasm Encouragement Simplicity

Slide 43

Slide 43 text

43 Reusability

Slide 44

Slide 44 text

44 Regular Releases

Slide 45

Slide 45 text

45 •  Based on:   Akka‘s AbstractNodeQueue   h4p://www.1024cores.net/home/lock-‐free-‐algorithms/queues/non-‐ intrusive-‐mpsc-‐node-‐based-‐queue

Slide 46

Slide 46 text

46 PragmaAsm Enthusiasm Encouragement Simplicity

Slide 47

Slide 47 text

Slide 48

Slide 48 text

Slide 49

Slide 49 text

49 Jestan Nirojan, Cruz Julian Bishop, Frédéric Brégier, Jeff Pinner, Veebs, Michael Nitschinger, vibul, Craig P. Motlin, Daniel Bevenius, Vibul Imtarnasan, Luke Wood, Cruz Bishop, Bill Gallagher, ab, alepar, bgallagher, Andy Taylor, Ngoc Dao, John Fallows, Jakob Buchgraber, Andrei PozoloPn, Frederic Bregier, Shawn Silverman, Evan Meagher, iainmcgin, Prajwal Tuladhar, Derek Troy-‐West, ursa, dantran, alexey, kerr, Aaron Riekenberg, Andrei.PozoloPn, kxbmap, Courtney Robinson, Sun Ning, zhen9ao, Alex Petrov, Bruce Mitchener, Chris Mowforth, Edwin Mol, Evans Yang, Guido García, James Abley, Jeff Griffith, Jeff Smick, Leonardo Freitas Gomes, Mike Heath, Mike Schore, Mirko Caserta, Roman Stoffel

Slide 50

Slide 50 text

50 Vladimir Schafer, alain, fredericBregier, izstas, radimch, Greg SolPs, Michael Grove, George Cao, MiddleBen, nibin, Andrew Cox, pfisterer, Felix Trepanier, Eric Charles, Olaf Bergner, Phillip Schichtel, Dennis Boldt, Rogie Sulzbach, Adam Vandenberg, Ryan Shelley, Sasha Zverev, David Dossot, Stephane Landelle, Dao Ngoc, Sunng, Tony Rice, CoNDoRip, ValenPn Kovalenko, Carl Byström, Brian Roach, Vladimir Krivosheev, shreyharia, Will, William Kemper, Wolfgang Profer, Brendt Lucas, tsingxu, Bourne, Geoff, Benoit Sigoure, Atsuhiko Yamanaka, bk1te, cmcmaugh, coltnz, AtKaaZ, Andrej Golovnin, hepin1989, Artur Dryomov, irelandKen, Alexey Diomin, jwilson, Arron Norwell, Jamie Furness, JaPnder, Andrew Gaul, James Roper, marius a. eriksen, Ionuț G. Stan, Johan Rask, Ian Barfield, Josh Wilson, JusPn Santa Barbara, milenkovicm, Ma4hias Wessendorf,..... ...you?

Slide 51

Slide 51 text

51 Geing Help •  Start here: ne6y.io •  IRC: #ne6y on Freenode •  Mailing List: h6ps://groups.google.com/forum/#!forum/ne6y •  Stackoverﬂow: „ne6y“ tag •  Bugtracker: h6ps://github.com/ne6y/ne6y/issues

Slide 52

Slide 52 text

52 Ne6y in AcAon by Norman Maurer manning.com/maurer

Slide 53

Slide 53 text

53 ContribuAng 1.  Read: h6p://ne6y.io/wiki/developer-‐guide.html 2.  Fork: h6ps://github.com/ne6y/ne6y 3.  Submit PR: h6ps://github.com/ne6y/ne6y/pulls 4.  Be prepared for some feedback/improvement cycles! 5.  Get menAoned in the release notes

Slide 54

Slide 54 text

54 QuesAons?