Search results

Feature request: bounded-uneven partitioning mode for --balance-data

Status: Open.

#970 In radixark/miles;

· mvillmow opened on Apr 10, 2026

--balance-data incorrectly requires exact divisibility by data-parallel size after invalid rollout samples are dropped

Status: Open.

#969 In radixark/miles;

· mvillmow opened on Apr 10, 2026

A100 support

Status: Open.

#962 In radixark/miles;

· godlikehhd opened on Apr 9, 2026

Sessions silently evicted under memory pressure, causing 404 "session not found" errors

Status: Open.

#956 In radixark/miles;

· DavidBellamy opened on Apr 7, 2026

Session rollback fails with "no assistant message found" after timeout corrupts conversation state

Status: Open.

#955 In radixark/miles;

· DavidBellamy opened on Apr 7, 2026

Session server timeout should measure engine processing time, not wall-clock time from submission

Status: Open.

#936 In radixark/miles;

· DavidBellamy opened on Apr 7, 2026

Gate inference dispatch during weight updates to prevent wasted timeouts

Status: Open.

#921 In radixark/miles;

· DavidBellamy opened on Apr 6, 2026

TITO prefill storms cause GPU contention that starves concurrent decode requests

Status: Open.

#920 In radixark/miles;

· DavidBellamy opened on Apr 6, 2026

Proposal: clarify naming of rollout/training loop CLI arguments

Status: Open.

#877 In radixark/miles;

· DavidBellamy opened on Apr 3, 2026

_truncate_sample_output does not truncate rollout_routed_experts

Status: Open.

#861 In radixark/miles;

· DavidBellamy opened on Apr 2, 2026

SWAKVPool ignores enable_memory_saver, preventing KV cache release for SWA models

Status: Open.

#860 In radixark/miles;

· euclidgame opened on Apr 2, 2026

Bug fixes: rollout engine dist_init_addr wrong-node assignment, numpy 2.x assertion, deep_ep tms flag corruption

Status: Open.

#807 In radixark/miles;

· ashutoshuiuc opened on Mar 26, 2026