"Synkhronos is a Python package for accelerating computation of Theano
functions under data parallelism with multiple GPUs. The aim of this
package is to speed up program execution with minimum changes to user
code. Variables and graphs are constructed as usual with Theano or
extensions such as Lasagne. Synkhronos replicates the user-constructed
functions and GPU-memory variables on all devices. The user calls these
functions as in a serial program; parallel execution across all GPUs is
automated. Synkhronos supports management of Theano shared variables
across devices, either by reading/writing individually or through
collective communications, such as all-reduce, broadcast, etc."
https://github.com/astooke/Synkhronos
No comments:
Post a Comment