Skip to content

ci(docker): shallow-clone build-time git deps to cut build-docker time #1000

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
wenxie-amd merged 1 commit into from
Aug 21, 2026
Merged

ci(docker): shallow-clone build-time git deps to cut build-docker time #1000

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -681,12 +681,12 @@ jobs:
repository: AMD-AGI/Primus-Turbo
path: Primus-Turbo
ref: ${{ env.PRIMUS_TURBO_COMMIT }}
- name: Init Primus-Turbo submodules (full clone)
- name: Init Primus-Turbo submodules (shallow)
working-directory: Primus-Turbo
run: |
rm -rf 3rdparty/composable_kernel .git/modules/3rdparty/composable_kernel
git submodule sync --recursive
git submodule update --init --recursive
git submodule update --init --recursive --depth 1 --filter=blob:none
- run: echo "Begin Primus-Turbo Install."
- name: Install Primus-Turbo
run: |
Expand Down
12 changes: 6 additions & 6 deletions .github/workflows/docker/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,18 +38,18 @@ ENV HCC_AMDGPU_TARGET="gfx942,gfx950"

RUN pip3 uninstall aiter amd-aiter -y || true && \
cd /opt && \
git clone https://github.com/ROCm/aiter.git && \
git clone --filter=blob:none https://github.com/ROCm/aiter.git && \
cd aiter && \
git checkout -f ${PRIMUS_TURBO_AITER_COMMIT} && \
git submodule sync && \
git submodule update --init --recursive && \
git submodule update --init --recursive --depth 1 --filter=blob:none && \
PREBUILD_KERNELS=3 pip install --no-cache-dir --use-pep517 .

RUN cd /opt && \
git clone https://github.com/AMD-AGI/Primus-Turbo.git && \
git clone --filter=blob:none https://github.com/AMD-AGI/Primus-Turbo.git && \
cd Primus-Turbo && \
git checkout ${PRIMUS_TURBO_COMMIT} && \
git submodule update --init --recursive && \
git submodule update --init --recursive --depth 1 --filter=blob:none && \
pip3 install -r requirements.txt && \
pip3 install --no-build-isolation . -v

Expand All @@ -72,7 +72,7 @@ RUN pip3 uninstall -y quack-kernels nvidia-cutlass-dsl \
# Install Triton
# ---------------------------------------------------------------------------
RUN cd /opt && \
git clone https://github.com/triton-lang/triton.git && \
git clone --filter=blob:none https://github.com/triton-lang/triton.git && \
cd triton && \
git checkout ${TRITON_COMMIT} && \
pip3 install -r python/requirements.txt && \
Expand All @@ -92,7 +92,7 @@ RUN TORCH_META=$(python3 -c "import importlib.metadata as m; print(m.distributio
# ---------------------------------------------------------------------------
RUN if [ "$PRIMUS_TURBO_FRAMEWORK" != "JAX" ]; then \
cd /opt && \
git clone https://github.com/uccl-project/uccl.git && \
git clone --filter=blob:none https://github.com/uccl-project/uccl.git && \
cd uccl && \
git checkout ${UCCL_COMMIT} && \
cd ep && TORCH_CUDA_ARCH_LIST="gfx942,gfx950" python3 setup.py build && cd .. && \
Expand Down
8 changes: 4 additions & 4 deletions .github/workflows/docker/Dockerfile.ainic
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,8 +67,8 @@ RUN cd ${WORKDIR} && \
# Build rccl
# ---------------------------------------------------------------------------
RUN cd ${WORKDIR} && \
git clone https://github.com/ROCm/rccl.git && \
cd rccl && git checkout rocm-7.1.0 && \
git clone --branch rocm-7.1.0 --single-branch --depth 1 https://github.com/ROCm/rccl.git && \
cd rccl && \
./install.sh -l --prefix build/ --disable-msccl-kernel \
--amdgpu_targets="gfx950" 2>&1 | tee log_rccl_install.txt

Expand All @@ -80,8 +80,8 @@ ENV RCCL_HOME=${WORKDIR}/rccl

# RUN apt-get install -y --allow-unauthenticated libionic-dev && \
RUN cd ${WORKDIR} && \
git clone https://github.com/rocm/amd-anp.git && \
cd amd-anp && git checkout tags/v1.3.0 && \
git clone --branch v1.3.0 --single-branch --depth 1 https://github.com/rocm/amd-anp.git && \
cd amd-anp && \
make -j 16 RCCL_HOME=${RCCL_HOME} \
MPI_INCLUDE=${MPI_PATH}/include/ \
MPI_LIB_PATH=${MPI_PATH}/lib/ \
Expand Down