Pages

Wednesday, February 7, 2018

Jug

"It is a light-weight, Python only, distributed computing framework.

Jug allows you to write code that is broken up into tasks and run different tasks on different processors. You can also think of it as a lightweight map-reduce type of system, although it's a bit more flexible (and less scalable).

It has two storage backends: One uses the filesystem to communicate between processes and works correctly over NFS, so you can coordinate processes on different machines. The other uses a redis database and all it needs is for different processes to be able to communicate with a common redis server.

Jug is a pure Python implementation and should work on any platform. Python 3 is also supported (at least 3.3 and greater).

http://jug.readthedocs.io/en/latest/

https://github.com/luispedro/jug

No comments:

Post a Comment