ham-fisted.fjp

Support for java.util.concurrent.ForkJoinPool-specific operations such as managed block and task fork/join. Additionally supports concept of 'exception-safe' via wrapping executing code and unwrapper result post execution in order avoid wrapping exceptions and breaking calling code that may be expecting specific exception types.

Some of the api's fall back to regular executor service code when called.

One thing to note is there is no support for bound-fn in this codebase so it is on the user to use bound-fn-like constructs if support for dynamic variables is required in their code.

Example:

(defn split-parallel-reduce
  "Perform a parallel reduction of a spliterator using the provided ExecutorService"
  [executor-service split ideal-split init-fn rfn merge-fn]
  (let [n-elems (proto/estimate-count split)
        pool (or executor-service (ForkJoinPool/commonPool))]
    (if (or (<= n-elems (long ideal-split)) (= n-elems Long/MAX_VALUE))
      (split-reduce rfn (init-fn) split)
      (if-let [[lhs rhs] (proto/split split)]
        (let [lt (fjp/safe-fork-task pool (split-parallel-reduce pool lhs ideal-split init-fn rfn merge-fn))
              rt (fjp/safe-fork-task pool (split-parallel-reduce pool rhs ideal-split init-fn rfn merge-fn))]
          (merge-fn (fjp/managed-block-unwrap lt) (fjp/managed-block-unwrap rt)))))))

*cpu-pool*

dynamic

User-bindable cpu pool to allow custom forkjoinpools

common-pool

(common-pool)

Returns (ForkJoinPool/commonPool)

common-pool-parallelism

(common-pool-parallelism)

Integer parallelism assigned to the common pool

cpu-pool

(cpu-pool)

Get the currently bound cpu pool as a forkjoinpool

exception-safe

macro

(exception-safe & code)

Wrap code in an exception-safe wrapper - returns a map with either :ham-fisted.fjp/result or :ham-fisted.fjp.error.

in-fork-join-pool?

(in-fork-join-pool?)

Returns true if this task is executing in a fork join pool thread

make-blocker

(make-blocker finished? wait-till-finished get-value)(make-blocker finished? wait-till-finished)

Make a ForkJoinPool$ManagedBlocker managed blocker from a set of functions.

  • finished? - returns truthy if the op has finished
  • wait-till-finished? - blocks until finished. finished? is checked and wait-till-finished is called again if finished? returns falsy. This is so that wait-till-finished can be easily bound to LockSupport/park.
  • get-value - Return the value - this will be called once finished? has returned true.

managed-block

(managed-block dly)(managed-block finished? wait-till-finished get-value)

Block on a delay or future using the fjp system's managed blocking facility. Safe to call all the time whether the current system is in a forkjoinpool task or not.

managed-block-unwrap

(managed-block-unwrap dly)

managed block then safe unwrap the exception-safe result

on-cp

macro

(on-cp & code)

Run arbitrary code on the common-pool. Make sure any blocking operations are wrapped in managed-block.

on-cpu-pool

macro

(on-cpu-pool & code)

Run code on the cpu pool. Code on run the cpu pool must use managed-block as opposed to deref

safe-fork-task

macro

(safe-fork-task pool & code)

Called from within an executing task, fork a executing some code and wrapping it in exception-safe then calling fork-task

unwrap-safe

(unwrap-safe m)

Unwrap result created via executing code wrapped in exception-safe. Throws original exception if found.