Skip to content

[None][fix] support SWA scratch reuse rewind - #1

Closed
lowsfer wants to merge 23 commits into
jiaganc:dsv4-scratch-reuse-fixfrom
lowsfer:swa-scratch-reuse-rewind
Closed

[None][fix] support SWA scratch reuse rewind#1
lowsfer wants to merge 23 commits into
jiaganc:dsv4-scratch-reuse-fixfrom
lowsfer:swa-scratch-reuse-rewind

Conversation

@lowsfer

@lowsfer lowsfer commented May 20, 2026

Copy link
Copy Markdown

Summary

  • add SwaScratchReuseConfig with max_rewind_len for SWA scratch reuse
  • exclude the speculative rewind tail from scratch ranges and capacity planning
  • wire max_draft_len through KVCacheManagerV2 / DeepSeek V4 config creation
  • update existing scratch tests to parameterize rewind coverage

Testing

  • pre-commit hooks on commit passed
  • python -m ruff check touched files passed
  • python syntax compile for touched files passed
  • focused KV cache unit execution was blocked locally by MPI/nanobind startup failures

jiaganc and others added 23 commits May 15, 2026 05:14
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
…r_kind

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Jiagan Cheng <jiaganc@nvidia.com>
Signed-off-by: Yao Yao <lowsfer@users.noreply.github.com>
@jiaganc

jiaganc commented May 22, 2026

Copy link
Copy Markdown
Owner

Will merge it to feat branch in NVIDIA#14403.

@jiaganc jiaganc closed this May 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants