EasyBuild

"EasyBuild is a software build and installation framework that allows you to manage (scientific) software on High Performance Computing (HPC) systems in an efficient way.

EasyBuild is a software build and installation framework that allows you to manage (scientific) software on High Performance Computing (HPC) systems in an efficient way. It is motivated by the need for a tool that combines the following features:

• a flexible framework for building/installing (scientific) software
• fully automates software builds
• divert from the standard configure / make / make install with custom procedures
• allows for easily reproducing previous builds
• keep the software build recipes/specifications simple and human-readable
• supports co-existence of versions/builds via dedicated installation prefix and module files
• enables sharing with the HPC community (win-win situation)
• automagic dependency resolution
• retain logs for traceability of the build processes

Some key features of EasyBuild:

• build & install (scientific) software fully autonomously
  • also interactive installers, code patching, generating module file, ...
• easily configurable: config file/environment/command line
  • including aspects like module naming scheme
• thorough logging and archiving (see Understanding EasyBuild logs)
  • entire build process is logged thoroughly, logs are stored in install directory;
  • easyconfig file used for build is archived (install directory + file/svn/git repo)
• automatic dependency resolution (see Enabling dependency resolution, –robot / -r and –robot-paths)
  • build entire software stack with a single command, using --robot
• building software in parallel
• robust and thoroughly tested code base, fully unit-tested before each release
• thriving, growing community

Take a look at our HUST‘14 workshop paper Modern Scientific Software Management Using EasyBuild and Lmod (download PDF here) and use that as a reference in case you present academic work mentioning EasyBuild.

The EasyBuild sources are spread across different GitHub repositories:

• the main easybuild repository hosts the documentation and the easybuild Python metapackage
• the easybuild-framework repository hosts the source code of the EasyBuild framework
• the easybuild-easyblocks repository hosts easyblocks, i.e. implementations of install procedures
• the easybuild-easyconfigs repository hosts easyconfigs, i.e. EasyBuild specification files

Corresponding Python packages are available via PyPi:

• https://pypi.python.org/pypi/easybuild
• https://pypi.python.org/pypi/easybuild-framework
• https://pypi.python.org/pypi/easybuild-easyblocks
• https://pypi.python.org/pypi/easybuild-easyconfigs

Read the fine manual (RTFM!) at http://easybuild.readthedocs.org .

The recommended way of installing EasyBuild is via the documented bootstrap procedure You should configure EasyBuild to behave as you prefer, subsequently.

That is all that is needed to get started with installing (scientific) software with ease. Take a look at the typical workflow example in the EasyBuild documentation that shows how to make EasyBuild build and install WRF with a single command."

https://github.com/hpcugent/easybuild

http://easybuild.readthedocs.io/en/latest/

https://archive.fosdem.org/2016/schedule/event/hpc_bigdata_hanythingondemand/