Skip to content

filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution #2

wants to merge 5 commits into from

Conversation

boegel
Copy link
Contributor

@boegel boegel commented Jun 11, 2025

We should also remove the ParMETIS/4.0.3-gompi-2023a installation that was ingested a while ago, and rebuild the modules that have already been ingested that depend on ParMETIS.

We should probably also put a check in place to make sure that ParMETIS itself also never gets added explicitly, via a blocklist based on software names in EasyBuild hooks? (let's do that in a separate PR)

@boegel boegel mentioned this pull request Jun 11, 2025
Open
@boegel boegel requested a review from ocaisa June 11, 2025 19:28
ocaisa
ocaisa reviewed Jun 12, 2025
View reviewed changes
@boegel boegel force-pushed the filter_ParMETIS branch from b77b60b to a9eadc9 Compare June 12, 2025 06:46
ocaisa
ocaisa requested changes Jun 12, 2025
View reviewed changes
ocaisa
ocaisa approved these changes Jun 12, 2025
View reviewed changes
Copy link
Member

@ocaisa ocaisa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, let's give this a spin and see if it builds

@ocaisa
Copy link
Member

ocaisa commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

4 similar comments
@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

@boegel boegel changed the title filter ParMETIS dependency, since ParMETIS license doesn't allow redi… filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution Jun 12, 2025
@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws arch:x86_64/amd/zen2

@eessi-bot-aws
Copy link

eessi-bot-aws bot commented Jun 12, 2025 •
edited
Loading

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2025.06/pr_2/69116

date job status comment
Jun 12 08:51:59 UTC 2025 submitted job id 69116 awaits release by job manager
Jun 12 08:52:25 UTC 2025 released job awaits launch by Slurm scheduler
Jun 12 09:00:27 UTC 2025 running job 69116 is running
Jun 12 09:08:35 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-69116.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
No artefacts were created or found.
Jun 12 09:08:35 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default
P: perf: 441.249 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default
P: perf: 439.362 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default
P: latency: 2.02 us (r:0, l:None, u:None)
[ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 1.81 us (r:0, l:None, u:None)
[ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 5.41 us (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 4.06 us (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default
P: latency: 0.59 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default
P: latency: 0.58 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default
P: bandwidth: 7268.37 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default
P: bandwidth: 7300.16 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-69116.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@boegel boegel changed the title filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution … Jun 12, 2025
@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: help

@boegel boegel changed the title filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution … filter ParMETIS dependency, since ParMETIS license doesn't allow redistribution Jun 12, 2025
@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

🙈 Message with emoji, I'm stress-testing the bot after updating smee-client to latest version (see also EESSI/eessi-bot-software-layer#320)

bot: help

@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

bot: help

@eessi-bot-aws
Copy link

eessi-bot-aws bot commented Jun 12, 2025 •
edited
Loading

Updates by the bot instance eessi-bot-mc-aws (click for details)

  • received bot command help from boegel

    • expanded format: help

  • handling command help resulted in:
    How to send commands to bot instances

    • Commands must be sent with a new comment (edits of existing comments are ignored).
    • A comment may contain multiple commands, one per line.
    • Every command begins at the start of a line and has the syntax bot: COMMAND [ARGUMENTS]*
    • Currently supported COMMANDs are: help, build, show_config, status

    For more information, see https://www.eessi.io/docs/bot

This was referenced Jun 12, 2025
Open
Open
@boegel
Copy link
Contributor Author

boegel commented Jun 12, 2025

Rebuild of EESSI-extend was triggered:

>> Installing EESSI-extend with 'eb --try-amend=keeppreviousinstall=True --rebuild EESSI-extend-easybuild.eb'...

But it failed with:

== FAILED: Installation ended unsuccessfully: Failed to chmod/chown several paths: ['/cvmfs/software.eessi.io/versions/2023.06/software/linux/x86_64/amd/zen2/software/EESSI-extend/2023.06-easybuild/easybuild' ...

So the classical problem of rebuilding an existing installation... :(

I'll use this as an opportunity to see if we can fix these problems once and for all, since we're just dancing around weird problems caused by fuse-overlayfs, and that doesn't seem to be maintainer/supported very well...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ocaisa ocaisa ocaisa approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@boegel @ocaisa