ppqueue

A Parallel Process Queue for Python.

Documentation | Git Repo

ppqueue is a Python module that serves as an abstraction layer to both multiprocessing.Process and threading.Thread. I built ppqueue because I too often notice that parallelizing code results in ugly code. With this simple Queue, you can parallelize code easily and attractively. ppqueue offers:

• a single API for parallel execution using processes or threads.
• FIFO priority queueing.
• Gantt charts of job execution (thanks plotnine + pandas)
• progress bars (thanks to tqdm)

Install

pip install ppqueue

Use

A notebook of examples is available at:

www.f2dv.com/r/ppqueue/page/examples/

And more examples are provided in the reference docs:

www.f2dv.com/r/ppqueue/reference/