Share
Embed
Session 2 - Java Concurrency II
Speakers: Alex Vazquez and Guillermo Muñoz
Topics:
- Task management approach in JCF
- The Executor framework: thread pools (examples)
- Callable and Future
- Fork & Join (example)
javatroopers
August 30, 2012
Transcript
37 slides
-
Tasks management • Reusing threads, less is better: startup and
teardown cost is cheaper. • Number of threads is limited, don’t do this: class UnreliableWebServer { public static void main(String[] args) { ServerSocket socket = new ServerSocket(80); while (true) { final Socket connection = socket.accept(); Runnable r = new Runnable() { public void run() { handleRequest(connection); } }; new Thread(r).start(); } } } • Scenarios: web server, database server, communication server ,etc. -
Thread pools • Useful for tasks with high creation frequency
& short duration & predictable small size. • Ideal solution: work queue + thread pool = startup delay eliminated & immediate serviced. That’s what JCF uses!!! • The Executor’s implementation define different execution policies: • When and in what thread a task will run • Level of resource consumption (number of threads, etc) • Action when executor is overloaded. • Considerations: • Thread pool deadlock: i.e. newFixedThreadPool() • Tuning thread pool: ThreadFactory, RejectedExecutionHandler, Amdahl's law, etc. -
Executor implementations • Available through Executors factory Factory Execution Policy
newCachedThreadPool() Unbounded work queue, unlimited threads, expire not reused threads after 60 secs. newFixedThreadPool(int n) Unbounded work queue, maximum n threads, if a thread fails is replaced by a new thread. newSingleThreadExecutor() Unbounded work queue, single thread, execution sequentially, one task at the time. newScheduledThreadPool(int n) Unbounded work queue, maximum n threads, new thread per schedule. -
• Highly customizable using ThreadPoolExecutor constructor: Customizable Impact int corePoolSize
# threads to keep in the pool, even if they are idle. int maximumPoolSize max # of threads to allow in the pool long keepAliveTime when # current threads > corePoolSize, maximum time that excess idle threads will wait for new tasks before terminating BlockingQueue<Runnable> workQueue queue to use for holding tasks before they are executed ThreadFactory threadFactory thread factory to use when the executor creates a new thread RejectedExecutionHandler handler the handler to use when execution is blocked because the thread bounds and queue capacities are reached -
Using Thread pool... class ReliableWebServer { Executor pool = Executors.newFixedThreadPool(7);
public static void main(String[] args) { ServerSocket socket = new ServerSocket(80); while (true) { final Socket connection = socket.accept(); Runnable r = new Runnable() { public void run() { handleRequest(connection); } }; pool.execute(r); } } } -
• Runnable is an interface that represent a task to
be executed: Runnable r = new Runnable() { @Override public void run() { // do something useful } } executor.execute(r); Runnable vs Callable<T> -
• Runnable is an interface that represent a task to
be executed: Runnable r = new Runnable() { @Override public void run() { // do something useful } } executor.execute(r); • Callable<T> is an interface that represent a task that will return something when completed: Callable<Object> c = new Callable<Object>() { @Override public Object call() throws Exception { // solve world hunger return new HungerGames(); } } executor.submit(c); Runnable vs Callable<T> -
Futures • Executors and ThreadPools allow to retrieve the return
value of a task upon completion. -
Futures • Executors and ThreadPools allow to retrieve the return
value of a task upon completion. • Reference to this future value is called Future<T>: -
Callable<Object> c = new Callable<Object>() { @Override public Object call()
throws Exception { // make world peace possible return new Ingsoc(); } } Future<Object> future = executor.submit(c); // Meanwhile do something else try { Object result = future.get(); profitFromWorldPeace(result); } catch(InterruptedException | ExecutionException e) { // pretend to do something } Futures • Executors and ThreadPools allow to retrieve the return value of a task upon completion. • Reference to this future value is called Future<T>: -
• Futures are good to spawn multiple independent tasks, and
collecting their results: What are Future<T>s good for? -
Fork-and-Join • New in Java 7 • Suitable for processes
that couldn’t be evenly split in advance. • Suitable for spawning cascading dependent tasks. • Best suited for recursive algorithms. • Note: DO NOT confuse with POSIX’s fork() function -
Fork-and-join process • When a task is submitted, it should:
• Divide the task in smaller subtasks • Queue the subtasks. • Process subtasks until all subtasks are executed. • Collect the result. -
Fork-and-join process Divide in subtasks Task Subtask 1 Subtask 2
Subtask 3 Subtask 4 -
Fork-and-join process Divide in subtasks Queue the subtasks Task Subtask
1 Subtask 2 Subtask 3 Subtask 4 -
Fork-and-join process Divide in subtasks Queue the subtasks Task Subtask
1 Subtask 2 Subtask 3 Subtask 4 Subtask 1 Subtask 2 Subtask 3 Subtask 4 -
Fork-and-join process Divide in subtasks Queue the subtasks Process each
subtask Task Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 Subtask 4 Partial Result 1 Subtask 1 -
Fork-and-join process Divide in subtasks Queue the subtasks Process each
subtask Collect results Task Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 Subtask 4 Partial Result 1 Subtask 1 -
Fork-and-join process Divide in subtasks Queue the subtasks Process each
subtask Collect results Task Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 Subtask 4 Partial Result 1 Result 1 Result 2 Result 3 Result 4 Complete Result Subtask 1 -
Fork-and-join process Task Subtask 1 Subtask 2 Subtask 3 Subtask
4 Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 Subtask 4 Partial Result 1 Result 1 Result 2 Result 3 Result 4 Complete Result Subtask 1 -
Task Subtask 1 Subtask 2 Subtask 3 Subtask 4 Subtask
1 Subtask 2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 Partial Result 1 Result 1 Result 2 Result 3 Result 4 Complete Result Subtask 1 Fork-and-join process Subtask 4 -
1 Subtask 2 Subtask 3 Subtask 4 Subtask 1 Subtask
2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 artial Result 1 Result 3 Result 4 Complete Result Fork-and-join process Subtask 4 Idle thread -
1 Subtask 2 Subtask 3 Subtask 4 Subtask 1 Subtask
2 Subtask 3 Subtask 4 Subtask 2 Subtask 3 artial Result 1 Result 3 Result 4 Complete Result Fork-and-join process Subtask 4 Idle thread Partial Result 4 -
Recursive tasks Task 1 Subtask 1 Subtask 2 Subtask 3
Subtask 1.1 Subtask 2 Subtask 3 Subtask 1.2 Subtask 1.3 -
Recursive tasks Task 1 Subtask 1 Subtask 2 Subtask 3
Subtask 1.1 Subtask 2 Subtask 3 Subtask 1.2 Subtask 1.3 Subtask 2 Subtask 3 Subtask 1.2 Subtask 1.3 -
Recursive tasks Task 1 Subtask 1 Subtask 2 Subtask 3
Subtask 1.1 Subtask 2 Subtask 3 Subtask 1.2 Subtask 1.3 Subtask 2 Subtask 3 Subtask 1.2 Subtask 1.3 Subtask 2 Subtask 3 Subtask 1.2.1 Subtask 1.3 Subtask 1.2.2