Skip to content

Conference call notes 20201111

Jump to bottom
Kenneth Hoste edited this page Nov 11, 2020 · 6 revisions

(back to Conference calls)

Notes on the 160th EasyBuild conference call, Wednesday November 11th 2020 (16:00 UTC - 17:00 CET)

Attendees

Alphabetical list of attendees (XXX):

  • Kenneth Hoste (HPC-UGent, Belgium)

Agenda

  • recent developments
  • updates on 2020b version of common toolchains (foss, intel)
  • Q&A

Recent developments

  • EasyBuild v4.3.1 was released on Oct 29th 2020 \o/
  • recent changes
    • framework
      • bug fixes
        • also inject -rpath options for all entries in $LIBRARY_PATH in RPATH wrappers (PR #3495)
        • significantly speed up parsing of easyconfig files by only extracting comments from an easyconfig file when they're actually needed (PR #3498)
        • avoid TypeError being raised by --list-toolchains (PR #3499)
      • enhancements
        • add support for toolchain options like 'extra_cxxflags' to specify extra compiler options (PR #2193)
        • add support for %(module_name)s template value (PR #3497)
      • changes
        • cache result of fetch_files_from_pr function (PR #3484)
          • really only relevant for speedup of test suite
        • exclude test configuration with Lmod 7 and Python 3, except for Python 3.6 (PR #3496)
    • easyblocks
      • bug fixes
        • pass paths to patch one by one to apply_regex_substitutions in GCC easyblock when --sysroot is set (PR #2217)
          • workaround for bug in apply_regex_substitutions (see issue #3493)
        • fix version check in Qt5 easyblock w.r.t. disabling features on old Linux kernel versions (PR #2220)
      • enhancements
        • add -fallow-argument-mismatch option when building CP2K 7.1 or older with GCC 10.x (PR #2223)
        • update TensorFlow easyblock for TensorFlow 2.4 (PR #2225)
    • easyconfigs
      • bug fixes
        • patch for GCC 10.2 to fix broken __has_include macro (PR #11627)
          • required for Libint with foss/2020b
        • fixed checksums issues in R 4.0.0 easyconfig (PR #11600, PR #11616)
        • fix source_urls in Geant4 easyconfigs (PR #11596)
      • enhancements
        • (nothing really significant?)
      • new software
      • software updates
      • changes
  • to merge soon
    • framework (v4.3.2 milestone)
      • bug fixes
        • fix combination of --copy-eb and --from-pr (PRs #3473 + #3482)
        • don't pass username in github_api_get_request when no GitHub token is available (PR #3494)
        • crash in apply_regex_substitutions when passing list of paths to patch (issue #3493)
      • enhancements
        • enhance apply_regex_substitutions to allow specifying action to take in case there are no matches (PR #3440)
        • add support for using customized HTTP headers in download_file (PR #3472)
        • support for specifying easyconfig files via "easystack" file (PR #3479)
    • easyblocks (v4.3.2 milestone)
        • bug fixes*
        • fix two bugs in GROMACS easyblock when using GCC & MKL for FFT and BLAS/LAPACK (PR #2212)
        • correctly determine path to active binutils in TensorFlow easyblock (PR #2218)
        • always define $FCCPP in QuantumESPRESSO easyblock (PR #2221)
        • only configure Python with --enable-optimizations when compiling Python with (recent) GCC compiler PR #2228
      • enhancements
        • enhance OpenBLAS easyblock to make it aware of optarch (PR #1946)
        • improve config checks for Boost.MPI and Boost.Python and fix sanity checks of MT libs (PR #2167)
          • didn't get merged for EasBuild v4.3.1 because it broke the installation of some existing Boost easyconfigs...
        • run motorBike tutorial case for recent (community) OpenFOAM versions (PR #2201)
          • needs testing...
        • add support for building Clang with OpenMP offload support (PR #2229)
      • new software
        • custom easyblock for Metagenome-Atlas (PR #2219)
    • easyconfigs (v4.3.2 milestone)
      • bug fixes
        • added missing space in configopts in ParaView 5.8.0 easyconfigs using 2020a toolchain (PR #10989)
        • use bfd linker for glibc (PR #11331)
        • fix LAMMPS 3Mar2020 easyconfigs using intel toolchain on AMD CPUs by patching out hardcoded -xHost (PR #11577)
      • enhancements
      • new software
      • software updates
        • Julia 1.5.2 (PR #11522)
        • PyTorch 1.7 (WIP) (PR #11636)
        • TensorFlow 2.4.0 (WIP) (PR #11637)
        • QIIME2 2020.08 (WIP) (PR #11661)
        • see PRs for 2020b generation of easyconfigs (more below)

2020b update of common toolchains

  • status:

    • toolchain definitions for foss/2020b (PR #11489) and intel/2020b (PR #11337) are merged \o/
      • to be included with next EasyBuild release (v4.3.2)
      • foss/2020b
        • GCC 10.2 + binutils 2.35
        • OpenMPI 4.0.5 (+ UCX 1.9.0, PMIx 3.1.5, libfabric 1.11.0)
        • OpenBLAS 0.3.12
        • FFTW 3.3.8
        • ScaLAPACK 2.1.0
      • intel/2020b
        • (GCC 10.2 + binutils 2.35 as base)
        • Intel compilers 2020 update 4 (latest)
        • Intel MPI 2019 update 9 (latest)
        • Intel MKL 2020 update 4 (latest)

  • testing

    • several "large" scientific apps have been tested:
      • CP2K 7.1 with foss/2020b + intel/2020b
        • blocked by Boost, required for Libint + PLUMED
        • patch for GCCcore/10.2.0 required to fix compilation of Libint with foss/2020b (see PR #11627)
          • known regression in GCC 10.2 (broken __has_include macro), fixed upstream
        • considered using libxc 5.0.0 as dep, but CP2K 7.1 is not compatible with it yet (see https://github.com/cp2k/cp2k/issues/909)
      • OpenFOAM 8 with foss/2020b + intel/2020b
        • blocked by Qt5, required for ParaView (see PR #11555)
          • strictly requires OpenSSL 1.1...
      • OSU Microbenchmarks
        • very good performance results with both foss/2020b and intel/2020b on RHEL8 w/ ConnectX-6 (Infiniband HDR-100)
      • R 4.0.3 with foss/2020b
        • works fine once all dependencies are in place
      • WRF 3.9.1.1
    • lessons learned
      • GCC 10.x is stricter than earlier versions

  • also fosscuda/2020b?

  • we're dropping the versionsuffix when using Python 3 as a dep (retain with Python 2)

  • TODO:

Easyconfigs merge sprint

Ideas for next EasyBuild User Meeting

Q&A

Clone this wiki locally