New EasyBlock for ROCm-LLVM

[Thyre]

(created using eb --new-pr)

Requires:

• move openmp to a runtime in newer versions of LLVM #3799
• Add support for amdgcn-capabilities configuration option and amdgcn_capabilities easyconfig parameter + related templates, similar to cuda-compute-capabilities easybuild-framework#4860

TODO:

• Clean-up EasyBlock after Fix LLVM easyblock to allow building with multiple versions at once #3812
• Use upper-level CMake arguments for LIBOMPTARGET_AMDGCN_GFXLIST

This PR introduces a separate EasyBlock for ROCm-LLVM, based on the heavy lifting of the LLVM EasyBlock. A few options need to be set differently, e.g. explicit disabling of #3747 due to the "generic" ROCm-LLVM interface not being compatible with the actual HSA being used in their OpenMP Tools Interface.

Lots of work has been done by @bedroge to get this EasyBlock working at all, thanks for that!

[Zeldhoron]

During testing this, when I was trying to build ROCm-LLVM, I added some small changes that fixed some issues for me.

[Thyre]

First test report:
easybuilders/easybuild-easyconfigs#23304 (comment)

[bedroge]

@Thyre I was giving this another try with the easyconfig from easybuilders/easybuild-easyconfigs#23304, but I'm getting an error for openmp:

 == installing bundle component llvm-project-openmp v19.0.0-rocm-6.4.1 (4/5)...
==    patching component llvm-project-openmp...
  >> applying patch ROCm-LLVM-6.4.1_llvm-project-19.0.0_fix-offload-build.patch
==    ... (took < 1 sec)
==    configuring component llvm-project-openmp...
==    ... (took 6 secs)
== ... (took 46 mins 19 secs)
== FAILED: Installation ended unsuccessfully: Nothing found to replace 'cmake_policy\(SET CMP0114 OLD\)' in cmake/Modules/CMakePolicy.cmake (took 46 mins 35 secs)

Looks like that's because of the changes from #3875 (which uses on_missing_match=ERROR for the regex substitution), and because we're reusing the llvm source dir for openmp. The file has already been patched then, so there's nothing to replace anymore, and it fails.

I guess we either need to use a clean source dir for openmp, or disable the on_missing_match=ERROR (or make that optional somehow)?

[Thyre]

@Thyre I was giving this another try with the easyconfig from easybuilders/easybuild-easyconfigs#23304, but I'm getting an error for openmp:

 == installing bundle component llvm-project-openmp v19.0.0-rocm-6.4.1 (4/5)...
==    patching component llvm-project-openmp...
  >> applying patch ROCm-LLVM-6.4.1_llvm-project-19.0.0_fix-offload-build.patch
==    ... (took < 1 sec)
==    configuring component llvm-project-openmp...
==    ... (took 6 secs)
== ... (took 46 mins 19 secs)
== FAILED: Installation ended unsuccessfully: Nothing found to replace 'cmake_policy\(SET CMP0114 OLD\)' in cmake/Modules/CMakePolicy.cmake (took 46 mins 35 secs)

[...]

I guess we either need to use a clean source dir for openmp, or disable the on_missing_match=ERROR (or make that optional somehow)?

I ran into this with ROCm 7.0.0 in the first LLVM build and created #3937 to work around the issue for that. I didn't keep in mind that this also affects the second build, since the sources are patched at that point already.

I think starting from a clean source is the best solution, since there might be other unexpected side-effects otherwise. I'll update the ROCm-LLVM EasyConfig PRs accordingly.

[Thyre]

@bedroge, I updated the ROCm-LLVM 6.4.1 PR to extract the sources again during openmp and triggered a build on jsc-zen3. Lets see if that is sufficient...

[bedroge]

@bedroge, I updated the ROCm-LLVM 6.4.1 PR to extract the sources again during openmp and triggered a build on jsc-zen3. Lets see if that is sufficient...

Thanks, I'll do another build as well.