Structured Concurrency in Java: The what and the why

Transcript

1. Alignment indicator 29 June 2023 Balkrishna Rawool Structured Concurrency in Java The what and the why
2. 2 Balkrishna Rawool IT Chapter Lead, ING Bank @BalaRawool
3. 3 Project Loom Purpose: Ø Supporting easy-to-use, high-throughput lightweight concurrency and new programming models for it Features: Ø Virtual Threads: It will be finalized in Java 21 JEP - 444 Ø Structured Concurrency: Preview – JEP - 453 Ø Scoped Values: Preview – JEP - 446
4. 4 (Platform) Threads JVM OS Platform Threads Platform Threads: Ø Abstraction over OS threads Ø Limited scalability (when using thread-per-request model) Ø Need for pooling
5. 5 Virtual Threads JVM OS Platform Threads Virtual Threads: Ø Lightweight user threads Ø Highly scalable Ø No need for pooling Virtual Threads
6. Alignment indicator How to create virtual threads? Demo
7. 7 Virtual Thread Scheduler Platform Thread Virtual Threads
8. 8 Virtual Threads continued… PT 1 VT 1 VT 2 VT 3 VT 4 VT 1 VT 1 VT 2 VT 2 VT 3 VT 3 VT 4 VT 4 VT 1 VT 2 VT 3 VT 1 VT 2 VT 4 VT 3 VT 4
9. 9 Use virtual threads to model (business) tasks.
10. 10 Virtual threads enable Structured Concurrency
11. 11 Programs → Structured Programming Concurrent programs → Structured Concurrency
12. 12 Structured Concurrency: Continued Principle: Ø When flow of execution splits into multiple concurrent flows, they rejoin in the same code block Benefits: Ø Error handling with short-circuiting Ø Cancellation propagation Ø Clarity Ø Observability
13. 13 Structured Concurrency: Examples All these can be modelled using StructuredTaskScope.
14. 14 CompletableFuture Ø Provides API for asynchronous processing Ø Chain multiple stages to create pipeline Ø Callbacks
15. Alignment indicator CompletableFuture API vs Structured Concurrency API Demo
16. 16 Use case 1: Event Management Reserve Venue Book Hotel Buy Supplies
17. 17 Use case 2: Weather Service Get Weather From Source 1 Get Weather From Source 2 Get Weather From Source 3
18. 18 Use case 1: Banking Portal Get Savings Data Get Loans Data Get Customer Data Calculate Offer
19. Shutdown policies Ø ShutdownOnFailure Stops when one of the tasks “fail” Cancels other tasks Useful when you want that all tasks must complete successfully Ø ShutdownOnSuccess Stops when one of the tasks “succeed” Cancels other tasks Useful when you want any one of the tasks to complete successfully Ø Custom Extend StructuredTaskScope Override handleComplete() Useful when you want custom logic/ some tasks to complete successfully 19
20. Be aware of Pinning! 20 Ø When virtual thread is executing a synchronized code-block or method, it gets pinned Ø Problem if you’re doing long-running/ blocking operations inside synchronized Ø Identify cases with JFR (JDK Flight Recorder) Ø Use re-entrant lock
21. Join us at 21 ing.jobs/tech
22. Questions and Feedback 22 ? Contact points: @ balkrishna.rawool@ing.com @BalaRawool in/balkrishnarawool /balkrishnarawool