Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UENV CI #1053

Open
wants to merge 70 commits into
base: develop
Choose a base branch
from
Open

UENV CI #1053

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
70 commits
Select commit Hold shift + click to select a range
ea591f8
add files
simonpintarelli Jan 22, 2025
3518c7b
build uenv base container
simonpintarelli Jan 22, 2025
cf3d29b
update
simonpintarelli Jan 23, 2025
5fd9e06
missing version
simonpintarelli Jan 23, 2025
13a4bfc
uenv recipe
simonpintarelli Jan 23, 2025
39f5a14
update
simonpintarelli Jan 23, 2025
d76f0c2
ignore only build-*/ directories, e.g. not build-cuda.sh
simonpintarelli Jan 23, 2025
1990989
add build script
simonpintarelli Jan 23, 2025
8ea90c0
typo
simonpintarelli Jan 23, 2025
7d042d5
typo
simonpintarelli Jan 23, 2025
bb1e3ad
fix needs
simonpintarelli Jan 23, 2025
6b43025
change to multiline script
simonpintarelli Jan 23, 2025
9a21304
update
simonpintarelli Jan 23, 2025
5e1024f
spack -> spack-clone
simonpintarelli Jan 23, 2025
70a68f0
add a repo.yaml
simonpintarelli Jan 24, 2025
1c9383d
hardcode tag
simonpintarelli Jan 26, 2025
422e4e5
add missing vars
simonpintarelli Jan 26, 2025
b63e9dd
add symlink
simonpintarelli Jan 26, 2025
dce8240
add a version
simonpintarelli Jan 27, 2025
1f90b5f
debug
simonpintarelli Jan 27, 2025
610c1e2
debug
simonpintarelli Jan 27, 2025
920055b
add cuda_arch as variant
simonpintarelli Jan 27, 2025
98b54aa
update
simonpintarelli Jan 27, 2025
b38d6b1
update
simonpintarelli Jan 27, 2025
446c1da
typo
simonpintarelli Jan 27, 2025
cf3cd67
missing SPACK_SYSTEM_CONFIG_PATH
simonpintarelli Jan 27, 2025
f663c10
install missing dependencies
simonpintarelli Jan 27, 2025
f4de587
fix directory
simonpintarelli Jan 27, 2025
cf70e11
fix variants
simonpintarelli Jan 27, 2025
36a8572
try to see artifacts
simonpintarelli Jan 30, 2025
bd2d24e
use CI_PIPELINE_ID for tag
simonpintarelli Jan 30, 2025
466f883
skip python again
simonpintarelli Jan 30, 2025
521e3f9
skip python in base
simonpintarelli Jan 30, 2025
5a917a5
fix parametrization
simonpintarelli Jan 30, 2025
8af0de6
add missing runner
simonpintarelli Jan 30, 2025
c953fe6
copy builddir avoid symlink
simonpintarelli Jan 30, 2025
fbac6d1
fix tar command
simonpintarelli Jan 30, 2025
ab5d64e
fix tar pipe
simonpintarelli Jan 30, 2025
dd7023e
add tests
simonpintarelli Jan 31, 2025
70e9828
add more variables
simonpintarelli Jan 31, 2025
8dab4e3
debug what is in builddir
simonpintarelli Jan 31, 2025
e257b1f
preserve relative path of builddir
simonpintarelli Jan 31, 2025
957443b
fix strip-components count
simonpintarelli Jan 31, 2025
9e95b0f
move spack-stage to /dev/shm/spack-stage to preserve directory betwee…
simonpintarelli Jan 31, 2025
ee847b0
fix tar xf
simonpintarelli Jan 31, 2025
c61e2cc
fix cd
simonpintarelli Jan 31, 2025
a15a2e4
typo
simonpintarelli Jan 31, 2025
fe2a780
build scalapack support
simonpintarelli Jan 31, 2025
31a1b36
add eiger
simonpintarelli Feb 3, 2025
3bff9fa
fix schema
simonpintarelli Feb 3, 2025
801fa73
parametrize $REPO
simonpintarelli Feb 3, 2025
9b6404c
add tests on eiger
simonpintarelli Feb 4, 2025
8b511f4
remove gpus-per-task option on eiger
simonpintarelli Feb 4, 2025
a1c1741
eiger: nomultithread, cpu-bind=verbose
simonpintarelli Feb 4, 2025
e410e27
fix srun -c
simonpintarelli Feb 4, 2025
34f2ca3
add a barrier
simonpintarelli Feb 5, 2025
3c3a4ed
debug
simonpintarelli Feb 5, 2025
05544ed
split
simonpintarelli Feb 5, 2025
37f01b1
case error
simonpintarelli Feb 5, 2025
11ae5ec
remove debug
simonpintarelli Feb 5, 2025
63cd85a
debug
simonpintarelli Feb 5, 2025
8dac1f4
clone spack to /dev/shm
simonpintarelli Feb 5, 2025
8cf24e0
use SLURM_LABELIO
simonpintarelli Feb 5, 2025
6eddaa3
debug output
simonpintarelli Feb 5, 2025
4cb2c2a
fix barrier
simonpintarelli Feb 5, 2025
a66e714
remove broken debug lines
simonpintarelli Feb 5, 2025
0fa1c5c
whitespace
simonpintarelli Feb 5, 2025
4bf4263
cleanup
simonpintarelli Feb 5, 2025
d01b6cd
add CI_JOB_ID to barrier file
simonpintarelli Feb 5, 2025
2a9a97a
skip search in unreadable directorries
simonpintarelli Feb 5, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
.a
bin/
build/
build-*
build-*/
.cache/*
.cproject
*.dSYM/
Expand Down
120 changes: 0 additions & 120 deletions ci/baseimage.cuda.Dockerfile

This file was deleted.

54 changes: 0 additions & 54 deletions ci/baseimage.rocm.Dockerfile

This file was deleted.

28 changes: 28 additions & 0 deletions ci/build-cpu.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
#!/bin/bash

set -xeuo pipefail

export SPACK_SYSTEM_CONFIG_PATH=/user-environment/config

# make sure we keep the stage direcorty
spack config --scope=user add config:build_stage:/dev/shm/spack-stage

spack env create -d ./spack-env
# add local repository with current sirius recipe
spack -e ./spack-env repo add $REPO

spack -e ./spack-env add $SPEC

# build sirius from source
spack -e ./spack-env develop -p $PWD sirius@develop

# display spack.yaml
cat ./spack-env/spack.yaml

spack -e ./spack-env concretize
spack -e ./spack-env install

# the tar pipe below expects a relative path
builddir=$(spack -e ./spack-env location -b sirius)
# create a symlink to spack build directory (keep in artifacts)
tar -cf builddir.tar $builddir
30 changes: 30 additions & 0 deletions ci/build-cuda.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
#!/bin/bash

set -xeuo pipefail

export SPACK_SYSTEM_CONFIG_PATH=/user-environment/config

# make sure we keep the stage direcorty
spack config --scope=user add config:build_stage:/dev/shm/spack-stage

spack env create -d ./spack-env
# add local repository with current sirius recipe
spack -e ./spack-env repo add $REPO

spack -e ./spack-env config add "packages:all:variants:[cuda_arch=${CUDA_ARCH},+cuda]"

spack -e ./spack-env add $SPEC

# build sirius from source
spack -e ./spack-env develop -p $PWD sirius@develop

# display spack.yaml
cat ./spack-env/spack.yaml

spack -e ./spack-env concretize
spack -e ./spack-env install

# the tar pipe below expects a relative path
builddir=$(spack -e ./spack-env location -b sirius)
# create a symlink to spack build directory (keep in artifacts)
tar -cf builddir.tar $builddir
Loading