-
Notifications
You must be signed in to change notification settings - Fork 143
Conference call notes 20210203
Kenneth Hoste edited this page Feb 3, 2021
·
5 revisions
(back to Conference calls)
Notes on the 166th EasyBuild conference call, Wednesday February 3rd 2021 (16:00 UTC)
Alphabetical list of attendees (XXX):
-
Kenneth Hoste (HPC-UGent, Belgium)
-
Simon Branford (University of Birmingham, UK)
-
Alex Domingo (Vrije Universiteit Brussel, Belgium)
-
Alexander Grund (TU Dresden, Germany)
-
Adam Huffman (Big Data Institute, Oxford, UK)
-
Christian Kniep (AWS)
-
Terje Kvernes (University of Oslo, Norway)
-
Robert Mijakovic (LuxProvide)
-
Mikael Öhman (Chalmers University of Technology, Sweden)
-
Jörg Saßmannshausen (NIHR Biomedical Research Centre, UK)
- update on recent developments + outlook to next release
- review of EasyBuild User Meeting
- switching from OpenBLAS to BLIS in
foss/2021a
- Q&A
- next release (v4.3.3):
before EUM'21?during EUM week?hopefully next week...- project keeping track of "blockers" for EasyBuild v4.3.3: https://github.com/orgs/easybuilders/projects/11
- recent changes
-
framework
-
bug fixes
- (nothing)
- enhancements
- changes
-
bug fixes
-
easyblocks
-
bug fixes
- Use library search paths of compiler for RPATH when building binutils with system compiler + enhance sanity check by running
--version
for binutils commands (PR #2323)- avoids use of hardcoded paths like
/usr/lib64
when buildingbinutils
with system toolchain
- avoids use of hardcoded paths like
- Fix OpenFOAM sanity check on POWER (PR #2320)
- Use library search paths of compiler for RPATH when building binutils with system compiler + enhance sanity check by running
-
enhancements
- improve Bazel easyblock: add support for running tests, enable static linking, use build dir rather than tmpdir, verbose output (PR #2285)
- add check for accepted EULA in custom easyblock for NVHPC (PR #2311)
- update Clang easyblock to add support for building extra tools + leveraging hwloc and Z3 as optional dependencies (PR #2310)
- update QuantumESPRESSO easyblock to handle v6.7 (PR #2319)
-
new software
- (none)
-
changes
- create less temporary directories for TensorFlow by (only) using
--output_user_root
(PR #2293)
- create less temporary directories for TensorFlow by (only) using
-
bug fixes
- easyconfigs
-
framework
- to merge/fix/tackle soon
-
framework (v4.3.3 milestone)
-
bug fixes
- (BLOCKER for v4.3.3) avoid initializing Toolchain instance when taking into account toolchain dependencies for templates (PR #3560)
- Performance improvements for easyconfig parsing (PR #3555)
- Avoid module use in Lmod if possible to allow faster execution (PR #3557)
- Avoid metadata greedy behaviour (mostly relevant for Cray systems) (PR #3559)
-
enhancements
-
(NICE TO HAVE for v4.3.3) add support for using customized HTTP headers in
download_file
(PR #2472)- important for ITER.org (see EUM'21 talk)
- support additional features in easystack files (see issues #3468, #3512, #3513, #3516)
- add
Generation
module naming scheme (PR #3547) - Allow use of alternate envvar(s) to
$HOME
for user modules (PR #3558)
-
(NICE TO HAVE for v4.3.3) add support for using customized HTTP headers in
-
bug fixes
-
easyblocks (v4.3.3 milestone)
-
bug fixes
- correctly determine path to active binutils in TensorFlow easyblock (PR #2218) [EESSI, RPATH]
- fix taking into account
--sysroot
when installing/using CMake [EESSI] (PR #2247 or PR #2248, latter is best option?) - treat files/directories of unpacked sources equally in
PackedBinary
generic easyblock (PR #2306) - make sure the installation of
libiberty.a
in the binutils easyblock goes into a populated directory (PR #2308) - Fix for building GCC with
--sysroot
on ppc64le (PR #2315) - RPackages: Change to using
R_LIBS_SITE
when installing RPackages (PR #2326) - pass down compilation flags from build environment for ESMF (PR #2325)
-
enhancements
- enhance OpenBLAS easyblock to make it aware of
optarch
(PR #1946)- needs testing...
- problem with numpy installed on Arm 64-bit with
--optarch=GENERIC
may be related, see https://github.com/EESSI/software-layer/issues/55
- add support for skipping steps in Python packages installed as extension + print progress on individual steps for installing Python packages as extensions (PR #2290)
- (BLOCKER for v4.3.3) add support for running TensorFlow CPU and GPU tests separately and enhance test failure reporting (PR #2312)
- (NICE TO HAVE for v4.3.3) update impi easyblock for impi 2021.x (oneAPI) (PR #2313)
- enhance test and install step of
CMakePythonPackage
easyblock (PR #2318) - pass
$CXXFLAGS
to PDT's configure script via '-useropt' (PR #2324) - Add sanity check commands to GCC (including LTO support) (PR #2322)
- Added support for OpenFOAM v2012 layout (PR #2321)
- Update optional feature support of TensorFlow (PR #2314)
- Add support for including PTX code in PyTorch (PR #2328)
- enhance OpenBLAS easyblock to make it aware of
-
changes
- (nothing)
-
new software
- add custom easyblock for:
-
(NICE TO HAVE for v4.3.3) new generic easyblock for Intel oneAPI compilers (PR #2305)
- using
intel-compilers
as software name, includingicc
/icpc
/ifort
(classic compilers) +icx
/icpx
/ifx
/dpcpp
(oneAPI compilers)
- using
-
bug fixes
-
easyconfigs (v4.3.3 milestone)
- bug fixes
- enhancements *
-
new software
-
(NICE TO HAVE FOR v4.3.3) Intel oneAPI
- there will be no further updates to Intel Parallel Studio (apparently)
-
intel-compilers
v2020.1 (PR #11982)
-
(NICE TO HAVE FOR v4.3.3) Intel oneAPI
- software updates
-
framework (v4.3.3 milestone)
- (preliminary) EUM'21 evaluation results available at https://users.ugent.be/~kehoste/eum21_survey_20210203.pdf
- Collect low-level performance results on a variety of CPUs
- comparing BLIS, OpenBLAS, MKL
- on old/new Intel CPUs + AMD Rome
- see https://github.com/flame/blis/tree/master/test/3
- Also test with real-world applications which heavily rely on BLAS
- CP2K, VASP, ...
- using
gobff
toolchain