Skip to content

Conversation

@bedroge
Copy link
Collaborator

@bedroge bedroge commented Jan 27, 2025

The build of librosa with EB 4.9.2 failed in #897 (comment), but a newer version of the easyconfig is available in 4.9.4, and it should fix this issue (see easybuilders/easybuild-easyconfigs#21434).

Note that this shouldn't be merged yet, as it has dependencies on packages that are still being built in #897 (LLVM and numba), but I'm just giving it a try here already to make sure that it indeed fixes the issue.

If it works, we may want to consider doing a rebuild for the other CPU targets (though I'm not sure if it really changes much).

@bedroge bedroge added 2023.06-software.eessi.io 2023.06 version of software.eessi.io sapphirerapids labels Jan 27, 2025
@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/sapphire_rapids, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-software, eessi.io-2023.06-compat

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi.io-2023.06-software, eessi.io-2023.06-compat

@bedroge
Copy link
Collaborator Author

bedroge commented Jan 27, 2025

bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids resulted in:

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids resulted in:

    • no jobs were submitted

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-sapphire_rapids for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.01/pr_898/42996

date job status comment
Jan 27 11:04:33 UTC 2025 submitted job id 42996 awaits release by job manager
Jan 27 11:05:29 UTC 2025 released job awaits launch by Slurm scheduler
Jan 27 11:11:38 UTC 2025 running job 42996 is running
Jan 27 11:38:31 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-42996.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-sapphire_rapids-1737977335.tar.gzsize: 136 MiB (143612249 bytes)
entries: 3993
modules under 2023.06/software/linux/x86_64/intel/sapphire_rapids/modules/all
librosa/0.10.1-foss-2023a.lua
LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua
numba/0.58.1-foss-2023a.lua
software under 2023.06/software/linux/x86_64/intel/sapphire_rapids/software
librosa/0.10.1-foss-2023a
LLVM/14.0.6-GCCcore-12.3.0-llvmlite
numba/0.58.1-foss-2023a
other under 2023.06/software/linux/x86_64/intel/sapphire_rapids
no other files in tarball
Jan 27 11:38:31 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] (1/9) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86-64-intel-srapids-node+default
P: perf: 643.353 timesteps/s (r:0, l:None, u:None)
[ OK ] (2/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 2.04 us (r:0, l:None, u:None)
[ OK ] (3/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 2.05 us (r:0, l:None, u:None)
[ OK ] (4/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 3.77 us (r:0, l:None, u:None)
[ OK ] (5/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 4.15 us (r:0, l:None, u:None)
[ OK ] (6/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 0.4 us (r:0, l:None, u:None)
[ OK ] (7/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 0.33 us (r:0, l:None, u:None)
[ OK ] (8/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86-64-intel-srapids-node+default
P: bandwidth: 13774.46 MB/s (r:0, l:None, u:None)
[ OK ] (9/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86-64-intel-srapids-node+default
P: bandwidth: 13184.08 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-42996.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Jan 27, 2025

Based on the contents of the librosa installation directory, I don't think we need to rebuild this for the other architectures. This is in $EBROOTLIBROSA/0.10.1-foss-2023a/lib/python3.11/site-packages, and it's the same for the zen3 installation:

audioread
audioread-3.0.1.dist-info
lazy_loader
lazy_loader-0.3.dist-info
librosa
librosa-0.10.1.dist-info
__pycache__
resampy
resampy-0.4.3.dist-info
soundfile-0.12.1.dist-info
_soundfile.py
soundfile.py
soxr
soxr-0.3.7.dist-info

A diff -ru on the soxr (which is the extension that actually failed to build in #897) directories mostly shows differences due to the installation prefix, and a change in some binary files (but that's expected, since it's also the case for, for instance, skylake_avx512 vs zen3).

@bedroge
Copy link
Collaborator Author

bedroge commented Jan 27, 2025

bot: build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids resulted in:

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids resulted in:

    • no jobs were submitted

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Jan 27, 2025

Updates by the bot instance eessi-bot-vsc-ugent (click for details)
  • received bot command build repo:eessi.io-2023.06-software arch:x86_64/intel/sapphire_rapids from bedroge

    • expanded format: build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids
  • handling command build repository:eessi.io-2023.06-software architecture:x86_64/intel/sapphire_rapids resulted in:

    • no jobs were submitted

@eessi-bot
Copy link

eessi-bot bot commented Jan 27, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-intel-sapphire_rapids for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.01/pr_898/42997

date job status comment
Jan 27 20:14:14 UTC 2025 submitted job id 42997 awaits release by job manager
Jan 27 20:15:00 UTC 2025 released job awaits launch by Slurm scheduler
Jan 27 20:21:07 UTC 2025 running job 42997 is running
Jan 27 20:34:34 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-42997.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-sapphire_rapids-1738009539.tar.gzsize: 5 MiB (5286326 bytes)
entries: 234
modules under 2023.06/software/linux/x86_64/intel/sapphire_rapids/modules/all
librosa/0.10.1-foss-2023a.lua
software under 2023.06/software/linux/x86_64/intel/sapphire_rapids/software
librosa/0.10.1-foss-2023a
other under 2023.06/software/linux/x86_64/intel/sapphire_rapids
no other files in tarball
Jan 27 20:34:34 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] (1/9) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86-64-intel-srapids-node+default
P: perf: 682.06 timesteps/s (r:0, l:None, u:None)
[ OK ] (2/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 1.89 us (r:0, l:None, u:None)
[ OK ] (3/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 1.74 us (r:0, l:None, u:None)
[ OK ] (4/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 3.86 us (r:0, l:None, u:None)
[ OK ] (5/9) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 3.8 us (r:0, l:None, u:None)
[ OK ] (6/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 0.37 us (r:0, l:None, u:None)
[ OK ] (7/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86-64-intel-srapids-node+default
P: latency: 0.34 us (r:0, l:None, u:None)
[ OK ] (8/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86-64-intel-srapids-node+default
P: bandwidth: 13852.1 MB/s (r:0, l:None, u:None)
[ OK ] (9/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86-64-intel-srapids-node+default
P: bandwidth: 13836.02 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 9/9 test case(s) from 9 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-42997.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Jan 28 09:30:45 UTC 2025 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-sapphire_rapids-1738009539.tar.gz to S3 bucket succeeded

@bedroge bedroge added the ready-to-deploy Mark a PR as ready to deploy label Jan 27, 2025
@Neves-P Neves-P added bot:deploy Ask bot to deploy missing software installations to EESSI and removed ready-to-deploy Mark a PR as ready to deploy labels Jan 28, 2025
@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Jan 28, 2025

Label bot:deploy has been set by user Neves-P, but this person does not have permission to trigger deployments

@Neves-P Neves-P merged commit 882dd62 into EESSI:2023.06-software.eessi.io Jan 28, 2025
49 checks passed
@eessi-bot
Copy link

eessi-bot bot commented Jan 28, 2025

PR merged! Moved ['/project/def-users/SHARED/jobs/2025.01/pr_898/42996', '/project/def-users/SHARED/jobs/2025.01/pr_898/42997'] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.01.28

@eessi-bot
Copy link

eessi-bot bot commented Jan 28, 2025

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2025.01.28

@gpu-bot-ugent
Copy link

gpu-bot-ugent bot commented Jan 28, 2025

PR merged! Moved [] to /scratch/gent/vo/002/gvo00211/SHARED/trash_bin/EESSI/software-layer/2025.01.28

@bedroge bedroge deleted the sapphire_rapids_librosa_0.10.1_2023a branch January 28, 2025 09:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

2023.06-software.eessi.io 2023.06 version of software.eessi.io bot:deploy Ask bot to deploy missing software installations to EESSI sapphirerapids

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants