build: OPS-702: Restructure vLLM dockerfile to use dynamo base container and enable s3 sccache to speed up builds #2503
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…of building from source
nv-tusharma
changed the title
|
/ok to test 06006d3 |
nv-tusharma
changed the title
dillon-cullinan
force-pushed
the
tusharma/vllm-dynamo-base-integ
branch
from
00b26a5 to
9ae81be
Compare
Signed-off-by: Anant Sharma <[email protected]>
Signed-off-by: Anant Sharma <[email protected]>
Signed-off-by: Anant Sharma <[email protected]>
nv-anants
added a commit
that referenced
this pull request
Aug 28, 2025
…ner and enable s3 sccache to speed up builds (#2503) Signed-off-by: Anant Sharma <[email protected]> Co-authored-by: Anant Sharma <[email protected]> Co-authored-by: Dillon Cullinan <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes OPS-702 as well
Overview:
vLLM currently builds NIXL, Dynamo, and other dependencies from source which attributes to the high build time. This PR enables the vLLM Dockerfile to use the dynamo base container build so that the vLLM build can use the build time improvement made in
Dockerfilein the vLLM build to reduce container build times.Details:
Where should the reviewer start?
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)