-
Notifications
You must be signed in to change notification settings - Fork 143
Conference call notes 20210203
Kenneth Hoste edited this page Feb 3, 2021
·
5 revisions
(back to Conference calls)
Notes on the 166th EasyBuild conference call, Wednesday February 3rd 2021 (16:00 UTC)
Alphabetical list of attendees (XXX):
-
Kenneth Hoste (HPC-UGent, Belgium)
-
Simon Branford (University of Birmingham, UK)
-
Alex Domingo (Vrije Universiteit Brussel, Belgium)
-
Alexander Grund (TU Dresden, Germany)
-
Adam Huffman (Big Data Institute, Oxford, UK)
-
Christian Kniep (AWS)
-
Terje Kvernes (University of Oslo, Norway)
-
Robert Mijakovic (LuxProvide)
-
Mikael Öhman (Chalmers University of Technology, Sweden)
-
Jörg Saßmannshausen (NIHR Biomedical Research Centre, UK)
- update on recent developments
- review of EasyBuild User Meeting
- switching from OpenBLAS to BLIS in
foss/2021a
- Q&A
- next release (v4.3.3):
before EUM'21?during EUM week?hopefully next week... - recent changes
-
framework
-
bug fixes
- don't clean up imported modules after verifying imports of included Python modules (PR #3544)
- fix for obscure reported issue related to Python garbage collection (issue #3542)
- don't clean up imported modules after verifying imports of included Python modules (PR #3544)
-
enhancements
- detect '
SYSTEM
' toolchain as special case in easystack files (PR #3543) - enhance
extract_cmd
function to use 'cp -a
' for shell scripts (.sh
) (PR #3545)- we should also do this for
*.whl
"source" files (avoids the need forunpack_sources = False
)
- we should also do this for
- add support for specifying custom name to use when checking accepted EULA (PR #3546)
- useful for Intel oneAPI components: can use '
Intel-oneAPI
' to accept EULA for Intel compilers + impi + imkl
- useful for Intel oneAPI components: can use '
- detect '
-
bug fixes
-
easyblocks
-
bug fixes
- set
$PYTHONNOUSERSITE
inPythonBundle.extensions_step
(PR #2289)- to avoid picking up Python packages installed in
$HOME/.local
(withpip install --user
) when skipping/installing extensions
- to avoid picking up Python packages installed in
- fix Boost sanity check on POWER (PR #2291)
- unify handling of
pylibdirs
and don't add duplicated$PYTHONPATH
inPythonBundle
(PR #2281) - enhance Amber easyblock to fix running of
update_amber
script when 'python
' command is not available in OS (PR #2282)
- set
-
enhancements
- update Clang easyblock to add support for building extra tools + leveraging hwloc and Z3 as optional dependencies (PR #2310)
-
new software
- (none)
-
bug fixes
-
easyconfigs
- over 50 merged easyconfig PRs since last conf call
- bug fixes
-
enhancements
- (nothing major)
-
new software
- (nothing major)
-
software updates
- PyTorch 1.7.1 with
fosscuda/2019b
(PR #11636) andfoss/2020b
(PR #12008)-
fosscuda/2020b
is work-in-progress (PR #12003), failing tests? - issue with NCCL is fixed (multi-GPU test was running & failing on single GPU system)
-
- SciPy-bundle v2020.03 with Python 2.7.18 and
{foss,intel}/2020a
(PR #11957) - ReFrame v3.3 (PR #11787)
- PyTorch 1.7.1 with
-
changes
- use libpng provided by EasyBuild in VTK to fix build issue on ppc64le (PR #11990)
-
framework
- to merge/fix/tackle soon
-
framework (v4.3.3 milestone)
- support additional features in easystack files (see issues #3468, #3512, #3513, #3516)
- add toolchain deps to template resolution (PR #3541)
- added so
%(cudaver)s
template is defined when usingfosscuda
toolchain - not merged yet because it results in the
Toolchain
instance being created a lot earlier - also, it triggers a search for the easyconfig files for the toolchain...
- Kenneth will try to find time to look into alternative approach based on
$EBVERSIONCUDA
... - or maybe we just need to be a bit more careful w.r.t. taking toolchain dependencies into account when defining the templates?
- added so
- symlink
lib
tolib64
if onlylib64
exists (issue #3549)- other way around is already done (see PR #3401)
- relevant for OpenSUSE, see easyblocks issue #2309 + easyconfigs issue #11976
-
easyblocks (v4.3.3 milestone)
-
bug fixes
- correctly determine path to active binutils in TensorFlow easyblock (PR #2218)
- fix taking into account
--sysroot
when installing/using CMake - treat files/directories of unpacked sources equally in
PackedBinary
generic easyblock (PR #2306) - make sure the installation of
libiberty.a
in the binutils easyblock goes into a populated directory (PR #2308)
-
enhancements
- enhance OpenBLAS easyblock to make it aware of
optarch
(PR #1946)- needs testing...
- problem with numpy installed on Arm 64-bit with
--optarch=GENERIC
may be related, see https://github.com/EESSI/software-layer/issues/55
- add support for statically linking Bazel (PR #2272)
- improve Bazel easyblock: add support for running tests, enabl static linking, use build dir rather than tmpdir, verbose output (PR #2285)
- add support for skipping steps in Python packages installed as extension (PR #2290)
- update NEURON easyblock to use CMakeMake for recent versions (PR #2304)
- add support for running TensorFlow CPU and GPU tests separately and enhance test failure reporting (PR #2312)
- update impi easyblock for impi 2021.x (oneAPI) (PR #2313)
- enhance OpenBLAS easyblock to make it aware of
- changes
-
new software
- add custom easyblock for:
- new generic easyblock for Intel oneAPI compilers (PR #2305)
- using
intel-compilers
as software name, includingicc
/icpc
/ifort
(classic compilers) +icx
/icpx
/ifx
/dpcpp
(oneAPI compilers)
- using
-
bug fixes
-
easyconfigs (v4.3.3 milestone)
-
bug fixes
- fix for "error: 'runtime_error' is not a member of 'std'" in qtlocation (Qt5) (PR #12012)
-
enhancements
- enable tests for most recent Bazel versions (PR #11894)
-
new software
- Intel oneAPI
- there will be no further updates to Intel Parallel Studio (apparently)
-
intel-compilers
v2020.1 (PR #11982)
- Intel oneAPI
- software updates
-
bug fixes
-
framework (v4.3.3 milestone)