[Tracker] Pull request handoff SLA

# Pull request handoff SLA tracker

Review during the daily stand-up alongside the architecture/RFC decision tracker.

The SLA is one business day per handoff; weekends are excluded and public holidays are not modeled.
Drafts, bots, and PRs labeled `stale`, `paused`, or `do-not-track` are excluded.
Last refreshed: 2026-08-20T10:28+00:00

## Newly breached (7)

### Waiting on reviewers (3)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#2592 — Fix compute_pass_majority_metrics: score unanswered rollouts as failures in pass@k](https://github.com/NVIDIA-NeMo/Gym/pull/2592) | [@gwarmstrong](https://github.com/gwarmstrong), [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-08-18 16:55 UTC | 2026-08-19 16:55 UTC | 17h |
| [#2600 — feat: record the routing condition an eval runs under](https://github.com/NVIDIA-NeMo/Gym/pull/2600) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-08-18 19:04 UTC | 2026-08-19 19:04 UTC | 15h |
| [#2474 — Add repeat-level variability statistics to reward profiling](https://github.com/NVIDIA-NeMo/Gym/pull/2474) | [@mlazuka](https://github.com/mlazuka) | review requested | 2026-08-18 20:46 UTC | 2026-08-19 20:46 UTC | 13h |

### Waiting on authors (1)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#2570 — feat(vllm_model): optional session-affinity header for upstream routers](https://github.com/NVIDIA-NeMo/Gym/pull/2570) | [@aoshen02](https://github.com/aoshen02) | changes requested | 2026-08-18 16:53 UTC | 2026-08-19 16:53 UTC | 17h |

### Needs review assignment (3)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#2594 — feat(swebench): configurable image namespace and arch for eval containers](https://github.com/NVIDIA-NeMo/Gym/pull/2594) | Maintainers | reviewer not assigned | 2026-08-18 14:50 UTC | 2026-08-19 14:50 UTC | 19h |
| [#2602 — docs: mention Cline harness in SWE agents README](https://github.com/NVIDIA-NeMo/Gym/pull/2602) | Maintainers | reviewer not assigned | 2026-08-18 20:29 UTC | 2026-08-19 20:29 UTC | 13h |
| [#2605 — Add live web client for Kuhn poker](https://github.com/NVIDIA-NeMo/Gym/pull/2605) | Maintainers | reviewer not assigned | 2026-08-19 01:15 UTC | 2026-08-20 01:15 UTC | 9h |

<details>
<summary><strong>Older breach backlog (88)</strong></summary>

### Waiting on reviewers (45)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#799 — fix: preserve optional fields in structured_outputs strictify_schema_json](https://github.com/NVIDIA-NeMo/Gym/pull/799) | [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-03-02 20:59 UTC | 2026-03-03 20:59 UTC | 121d 13h |
| [#879 — Yev/scicode env v1](https://github.com/NVIDIA-NeMo/Gym/pull/879) | [@dhruvnathawani](https://github.com/dhruvnathawani), [@jubick1337](https://github.com/jubick1337) | review requested | 2026-03-20 18:09 UTC | 2026-03-23 18:09 UTC | 107d 16h |
| [#998 — Add ruler answer prefix](https://github.com/NVIDIA-NeMo/Gym/pull/998) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@cmunley1](https://github.com/cmunley1) | review requested | 2026-04-02 23:04 UTC | 2026-04-03 23:04 UTC | 98d 11h |
| [#1005 — fix: bound retries in server_utils.request()](https://github.com/NVIDIA-NeMo/Gym/pull/1005) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-04-15 08:24 UTC | 2026-04-16 08:24 UTC | 90d 2h |
| [#946 — Turing/ Playwright-based CUA environment with multi-provider adapter support](https://github.com/NVIDIA-NeMo/Gym/pull/946) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-04-29 19:09 UTC | 2026-04-30 19:09 UTC | 79d 15h |
| [#1193 — docs: address repo-health audit nits in README and CONTRIBUTING](https://github.com/NVIDIA-NeMo/Gym/pull/1193) | [@cmunley1](https://github.com/cmunley1) | review requested | 2026-04-30 13:30 UTC | 2026-05-01 13:30 UTC | 78d 20h |
| [#1264 — feat: artifact-root resolution for external plugins](https://github.com/NVIDIA-NeMo/Gym/pull/1264) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-05-07 20:20 UTC | 2026-05-08 20:20 UTC | 73d 14h |
| [#1334 — structured_outputs: add LLM-as-a-judge semantic verification](https://github.com/NVIDIA-NeMo/Gym/pull/1334) | [@jkyi-nvidia](https://github.com/jkyi-nvidia) | review requested | 2026-05-18 20:37 UTC | 2026-05-19 20:37 UTC | 66d 13h |
| [#1491 — Add compute_eval benchmark and resource server](https://github.com/NVIDIA-NeMo/Gym/pull/1491) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-06-02 00:07 UTC | 2026-06-03 00:07 UTC | 56d 10h |
| [#1560 — docs: clarify resources server example-data contract and license validation](https://github.com/NVIDIA-NeMo/Gym/pull/1560) | [@cwing-nvidia](https://github.com/cwing-nvidia), [@lbliii](https://github.com/lbliii) | review requested | 2026-06-10 12:04 UTC | 2026-06-11 12:04 UTC | 49d 22h |
| [#1541 — Add SC_Bench benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/1541) | [@adil-a](https://github.com/adil-a), [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@cwing-nvidia](https://github.com/cwing-nvidia) | review requested | 2026-06-13 00:57 UTC | 2026-06-15 00:57 UTC | 48d 9h |
| [#1598 — Eshachar/openclaw swe](https://github.com/NVIDIA-NeMo/Gym/pull/1598) | [@sdevare-nv](https://github.com/sdevare-nv) | review requested | 2026-06-16 18:19 UTC | 2026-06-17 18:19 UTC | 45d 16h |
| [#1653 — docs: remove model recipe column from RL framework compatibility table](https://github.com/NVIDIA-NeMo/Gym/pull/1653) | [@cwing-nvidia](https://github.com/cwing-nvidia) | review requested | 2026-06-23 03:23 UTC | 2026-06-24 03:23 UTC | 41d 7h |
| [#1669 — fix(harbor): reuse one HTTP client per episode for vLLM session affinity](https://github.com/NVIDIA-NeMo/Gym/pull/1669) | [@grace-lam](https://github.com/grace-lam) | review requested | 2026-06-23 23:50 UTC | 2026-06-24 23:50 UTC | 40d 10h |
| [#1752 — fix: handle vllm context length errors in nano v3 recipe](https://github.com/NVIDIA-NeMo/Gym/pull/1752) | [@yfw](https://github.com/yfw) | review requested | 2026-06-26 05:53 UTC | 2026-06-29 05:53 UTC | 38d 4h |
| [#2026 — feat: Switchyard token-capture integration for OpenHands SWE runs (zero-fork)](https://github.com/NVIDIA-NeMo/Gym/pull/2026) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-07-14 22:36 UTC | 2026-07-15 22:36 UTC | 25d 11h |
| [#1964 — feat(model-server): add OpenAI-compatible /v1/embeddings endpoint](https://github.com/NVIDIA-NeMo/Gym/pull/1964) | [@ffrujeri](https://github.com/ffrujeri) | review requested | 2026-07-15 16:18 UTC | 2026-07-16 16:18 UTC | 24d 18h |
| [#1727 — fix(vllm_model): handle explicit null metadata in preprocessing](https://github.com/NVIDIA-NeMo/Gym/pull/1727) | [@ananthsub](https://github.com/ananthsub) | review requested | 2026-07-15 17:11 UTC | 2026-07-16 17:11 UTC | 24d 17h |
| [#2048 — feat: sandbox_agent swe resources server](https://github.com/NVIDIA-NeMo/Gym/pull/2048) | [@adil-a](https://github.com/adil-a), [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@hemildesai](https://github.com/hemildesai) | review requested | 2026-07-15 21:13 UTC | 2026-07-16 21:13 UTC | 24d 13h |
| [#2052 — hermes_agent: repin to upstream hermes and fix the wrapper for its API](https://github.com/NVIDIA-NeMo/Gym/pull/2052) | [@Glorf](https://github.com/Glorf) | review requested | 2026-07-17 22:38 UTC | 2026-07-20 22:38 UTC | 22d 11h |
| [#2124 — feat(token-id-capture): capture training tokens from external harnesses](https://github.com/NVIDIA-NeMo/Gym/pull/2124) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-07-23 15:54 UTC | 2026-07-24 15:54 UTC | 18d 18h |
| [#2125 — feat(token-id-capture): chain a rollout's calls into one response](https://github.com/NVIDIA-NeMo/Gym/pull/2125) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@pthombre](https://github.com/pthombre) | review requested | 2026-07-23 16:22 UTC | 2026-07-24 16:22 UTC | 18d 18h |
| [#2126 — feat(token-id-capture): deliver rebuilt trajectories safely](https://github.com/NVIDIA-NeMo/Gym/pull/2126) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-07-23 16:22 UTC | 2026-07-24 16:22 UTC | 18d 18h |
| [#2141 — feat: add switchyard_model server for router-backed evals](https://github.com/NVIDIA-NeMo/Gym/pull/2141) | [@ananthsub](https://github.com/ananthsub), [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-07-27 19:55 UTC | 2026-07-28 19:55 UTC | 16d 14h |
| [#2180 — feat(token-id-capture): resolve each call's parent at request time](https://github.com/NVIDIA-NeMo/Gym/pull/2180) | [@pthombre](https://github.com/pthombre) | review requested | 2026-07-29 13:59 UTC | 2026-07-30 13:59 UTC | 14d 20h |
| [#2181 — feat(vllm-model): supply the previous call's exact training tokens](https://github.com/NVIDIA-NeMo/Gym/pull/2181) | [@pthombre](https://github.com/pthombre) | review requested | 2026-07-29 14:00 UTC | 2026-07-30 14:00 UTC | 14d 20h |
| [#2155 — [GDPVal] Fix Stirrup reference paths and make head-server wait configurable](https://github.com/NVIDIA-NeMo/Gym/pull/2155) | [@agronskiy](https://github.com/agronskiy) | review requested | 2026-07-29 16:40 UTC | 2026-07-30 16:40 UTC | 14d 17h |
| [#2160 — [GDPVal] Fix what reaches the rubric judge, and stop silent zeros](https://github.com/NVIDIA-NeMo/Gym/pull/2160) | [@agronskiy](https://github.com/agronskiy) | review requested | 2026-07-29 16:40 UTC | 2026-07-30 16:40 UTC | 14d 17h |
| [#2162 — [GDPVal] Add model-agnostic Slurm orchestration for multi-allocation rollouts](https://github.com/NVIDIA-NeMo/Gym/pull/2162) | [@agronskiy](https://github.com/agronskiy) | review requested | 2026-07-29 16:40 UTC | 2026-07-30 16:40 UTC | 14d 17h |
| [#2301 — feat(sandbox): add E2B sandbox provider](https://github.com/NVIDIA-NeMo/Gym/pull/2301) | [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-04 13:34 UTC | 2026-08-05 13:34 UTC | 10d 20h |
| [#2304 — default port range to the 5000-5999 band](https://github.com/NVIDIA-NeMo/Gym/pull/2304) | [@adil-a](https://github.com/adil-a) | review requested | 2026-08-04 13:48 UTC | 2026-08-05 13:48 UTC | 10d 20h |
| [#2311 — docs: rewrite Configure Agents index and document external agent harnesses](https://github.com/NVIDIA-NeMo/Gym/pull/2311) | [@cwing-nvidia](https://github.com/cwing-nvidia), [@lbliii](https://github.com/lbliii) | review requested | 2026-08-04 14:30 UTC | 2026-08-05 14:30 UTC | 10d 19h |
| [#2386 — feat: harden SWE against filesystem overflow](https://github.com/NVIDIA-NeMo/Gym/pull/2386) | [@sdevare-nv](https://github.com/sdevare-nv) | review requested | 2026-08-06 17:31 UTC | 2026-08-07 17:31 UTC | 8d 16h |
| [#2142 — Add EnterpriseOps-Gym benchmark: resources server, benchmark registration, and per-turn telemetry agent](https://github.com/NVIDIA-NeMo/Gym/pull/2142) | [@bxyu-nvidia](https://github.com/bxyu-nvidia) | review requested | 2026-08-08 08:52 UTC | 2026-08-10 08:52 UTC | 8d 1h |
| [#2427 — feat: automation bench, general-agent, tau2-synth environments and verifiers 0.3 bump](https://github.com/NVIDIA-NeMo/Gym/pull/2427) | [@ananthsub](https://github.com/ananthsub), [@d-molinari](https://github.com/d-molinari) | review requested | 2026-08-07 22:39 UTC | 2026-08-10 22:39 UTC | 7d 11h |
| [#2172 — feat: make Legal Agent Bench agent harness and sandbox-backends configurable](https://github.com/NVIDIA-NeMo/Gym/pull/2172) | [@cmunley1](https://github.com/cmunley1) | review requested | 2026-08-10 16:56 UTC | 2026-08-11 16:56 UTC | 6d 17h |
| [#2481 — feat: swe_trace_converter change for the opencode backend](https://github.com/NVIDIA-NeMo/Gym/pull/2481) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@sdevare-nv](https://github.com/sdevare-nv) | review requested | 2026-08-11 18:44 UTC | 2026-08-12 18:44 UTC | 5d 15h |
| [#2458 — feat: deepswe environment](https://github.com/NVIDIA-NeMo/Gym/pull/2458) | [@Glorf](https://github.com/Glorf), [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-12 04:41 UTC | 2026-08-13 04:41 UTC | 5d 5h |
| [#2507 — fix(anthropic): make Messages conversion loss-aware](https://github.com/NVIDIA-NeMo/Gym/pull/2507) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@cmunley1](https://github.com/cmunley1), [@ffrujeri](https://github.com/ffrujeri), [@linj-glitch](https://github.com/linj-glitch) | review requested | 2026-08-12 06:45 UTC | 2026-08-13 06:45 UTC | 5d 3h |
| [#2383 — feat: judge endpoint resiliency](https://github.com/NVIDIA-NeMo/Gym/pull/2383) | [@e-dobrowolska](https://github.com/e-dobrowolska) | review requested | 2026-08-12 16:43 UTC | 2026-08-13 16:43 UTC | 4d 17h |
| [#2346 — feat(sandbox): add Tenki provider](https://github.com/NVIDIA-NeMo/Gym/pull/2346) | [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-12 16:45 UTC | 2026-08-13 16:45 UTC | 4d 17h |
| [#2420 — feat: strands agent ](https://github.com/NVIDIA-NeMo/Gym/pull/2420) | [@Glorf](https://github.com/Glorf), [@ffrujeri](https://github.com/ffrujeri) | review requested | 2026-08-13 17:47 UTC | 2026-08-14 17:47 UTC | 3d 16h |
| [#2457 — feat: terminus 2 agent integration](https://github.com/NVIDIA-NeMo/Gym/pull/2457) | [@bxyu-nvidia](https://github.com/bxyu-nvidia), [@hemildesai](https://github.com/hemildesai) | review requested | 2026-08-13 17:51 UTC | 2026-08-14 17:51 UTC | 3d 16h |
| [#2151 — feat: agentic math environments](https://github.com/NVIDIA-NeMo/Gym/pull/2151) | [@ananthsub](https://github.com/ananthsub), [@ffrujeri](https://github.com/ffrujeri) | review requested | 2026-08-13 18:23 UTC | 2026-08-14 18:23 UTC | 3d 16h |
| [#2120 — [rollout-observability][7/7] Add SWE agent rollout observations](https://github.com/NVIDIA-NeMo/Gym/pull/2120) | [@mlazuka](https://github.com/mlazuka) | review requested | 2026-08-17 16:09 UTC | 2026-08-18 16:09 UTC | 1d 18h |

### Waiting on authors (6)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#1600 — docs(fern): add SEO meta descriptions + headlines to nightly docs (#1589)](https://github.com/NVIDIA-NeMo/Gym/pull/1600) | [@lbliii](https://github.com/lbliii) | changes requested | 2026-06-29 14:05 UTC | 2026-06-30 14:05 UTC | 36d 20h |
| [#2339 — Katherine/gdpval devel staging](https://github.com/NVIDIA-NeMo/Gym/pull/2339) | [@katherineh123](https://github.com/katherineh123) | changes requested | 2026-08-09 22:03 UTC | 2026-08-10 22:03 UTC | 7d 12h |
| [#1973 — fix: write traces on timeout (Apptainer) + improve Hermes traces](https://github.com/NVIDIA-NeMo/Gym/pull/1973) | [@elisam0](https://github.com/elisam0) | changes requested | 2026-08-17 02:42 UTC | 2026-08-18 02:42 UTC | 2d 7h |
| [#2551 — Default simple agent to max_steps=1](https://github.com/NVIDIA-NeMo/Gym/pull/2551) | [@yfw](https://github.com/yfw) | changes requested | 2026-08-17 03:14 UTC | 2026-08-18 03:14 UTC | 2d 7h |
| [#2302 — feat(longmemeval): add LongMemEval long-term-memory QA benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/2302) | [@pachmu](https://github.com/pachmu) | changes requested | 2026-08-18 08:02 UTC | 2026-08-19 08:02 UTC | 1d 2h |
| [#2072 — feat(spartqa): add SpartQA spatial-reasoning benchmark](https://github.com/NVIDIA-NeMo/Gym/pull/2072) | [@pachmu](https://github.com/pachmu) | changes requested | 2026-08-18 08:14 UTC | 2026-08-19 08:14 UTC | 1d 2h |

### Needs review assignment (37)

| PR | Waiting on | Reason | Handoff | SLA deadline | Overdue |
| --- | --- | --- | --- | --- | --- |
| [#834 — Add Tau^2 Bench training environment](https://github.com/NVIDIA-NeMo/Gym/pull/834) | Maintainers | reviewer not assigned | 2026-03-06 22:23 UTC | 2026-03-09 22:23 UTC | 117d 12h |
| [#1103 — structured_outputs: support oneOf/anyOf branches and $defs/$ref schemas](https://github.com/NVIDIA-NeMo/Gym/pull/1103) | Maintainers | reviewer not assigned | 2026-04-21 05:08 UTC | 2026-04-22 05:08 UTC | 86d 5h |
| [#1233 — structured_outputs: extend XML type coercion to handle oneOf/anyOf/allOf composition](https://github.com/NVIDIA-NeMo/Gym/pull/1233) | Maintainers | reviewer not assigned | 2026-05-05 21:17 UTC | 2026-05-06 21:17 UTC | 75d 13h |
| [#1274 — Add audiobench_alpaca_audio benchmark + audiobench_judge resource server](https://github.com/NVIDIA-NeMo/Gym/pull/1274) | Maintainers | reviewer not assigned | 2026-05-08 20:49 UTC | 2026-05-11 20:49 UTC | 72d 13h |
| [#1315 — Add GitHub issue template for environment integrations](https://github.com/NVIDIA-NeMo/Gym/pull/1315) | Maintainers | reviewer not assigned | 2026-05-13 19:42 UTC | 2026-05-14 19:42 UTC | 69d 14h |
| [#1358 — feat(vllm_model): chunk long single-clip audio in chat_completions](https://github.com/NVIDIA-NeMo/Gym/pull/1358) | Maintainers | reviewer not assigned | 2026-05-18 21:04 UTC | 2026-05-19 21:04 UTC | 66d 13h |
| [#1429 — docs: clarify SWE-bench dataset downloads](https://github.com/NVIDIA-NeMo/Gym/pull/1429) | Maintainers | reviewer not assigned | 2026-05-27 08:53 UTC | 2026-05-28 08:53 UTC | 60d 1h |
| [#1590 — feat(equivalence_llm_judge): cap extracted-answer length sent to judge](https://github.com/NVIDIA-NeMo/Gym/pull/1590) | Maintainers | reviewer not assigned | 2026-06-12 22:06 UTC | 2026-06-15 22:06 UTC | 47d 12h |
| [#1719 — feat(code_gen): add per-language subset metrics for livecodebench-x](https://github.com/NVIDIA-NeMo/Gym/pull/1719) | Maintainers | reviewer not assigned | 2026-06-25 01:11 UTC | 2026-06-26 01:11 UTC | 39d 9h |
| [#1720 — feat(instruction_following): add loose-mode evaluation and compute_metrics](https://github.com/NVIDIA-NeMo/Gym/pull/1720) | Maintainers | reviewer not assigned | 2026-06-25 01:12 UTC | 2026-06-26 01:12 UTC | 39d 9h |
| [#1745 — fix(config): seed no-model refs for prepare-data](https://github.com/NVIDIA-NeMo/Gym/pull/1745) | Maintainers | reviewer not assigned | 2026-06-26 00:31 UTC | 2026-06-29 00:31 UTC | 38d 9h |
| [#1797 — fix(inference_provider): normalize provider endpoint errors](https://github.com/NVIDIA-NeMo/Gym/pull/1797) | Maintainers | reviewer not assigned | 2026-06-27 04:43 UTC | 2026-06-29 04:43 UTC | 38d 5h |
| [#1800 — Harden SWE agent test file parsing](https://github.com/NVIDIA-NeMo/Gym/pull/1800) | Maintainers | reviewer not assigned | 2026-06-27 10:32 UTC | 2026-06-29 10:32 UTC | 37d 23h |
| [#1788 — fix: make rollout /run failures recoverable](https://github.com/NVIDIA-NeMo/Gym/pull/1788) | Maintainers | reviewer not assigned | 2026-06-26 22:02 UTC | 2026-06-29 22:02 UTC | 37d 12h |
| [#1784 — feat(vllm-model): consume native dynamo token data](https://github.com/NVIDIA-NeMo/Gym/pull/1784) | Maintainers | reviewer not assigned | 2026-06-29 23:38 UTC | 2026-06-30 23:38 UTC | 36d 10h |
| [#1847 — Rgala/browsecomp search providers newstable](https://github.com/NVIDIA-NeMo/Gym/pull/1847) | Maintainers | reviewer not assigned | 2026-07-01 00:35 UTC | 2026-07-02 00:35 UTC | 35d 9h |
| [#1908 — Actions: sync project status to release label](https://github.com/NVIDIA-NeMo/Gym/pull/1908) | Maintainers | reviewer not assigned | 2026-07-02 13:16 UTC | 2026-07-03 13:16 UTC | 33d 21h |
| [#1939 — Tb e2e](https://github.com/NVIDIA-NeMo/Gym/pull/1939) | Maintainers | reviewer not assigned | 2026-07-06 18:22 UTC | 2026-07-07 18:22 UTC | 31d 16h |
| [#2080 — feat: Switchyard OpenCode integration](https://github.com/NVIDIA-NeMo/Gym/pull/2080) | Maintainers | reviewer not assigned | 2026-07-20 12:50 UTC | 2026-07-21 12:50 UTC | 21d 21h |
| [#2109 — fix(server_utils): use unpredictable per-process secret for session signing](https://github.com/NVIDIA-NeMo/Gym/pull/2109) | Maintainers | reviewer not assigned | 2026-07-22 21:53 UTC | 2026-07-23 21:53 UTC | 19d 12h |
| [#2122 — [rollout-observability][follow-up] Correlate auxiliary Model Server calls](https://github.com/NVIDIA-NeMo/Gym/pull/2122) | Maintainers | reviewer not assigned | 2026-07-24 18:54 UTC | 2026-07-27 18:54 UTC | 17d 15h |
| [#2027 — Simplify ModelCallRecord; Refactor call capture logic; Extend to agents](https://github.com/NVIDIA-NeMo/Gym/pull/2027) | Maintainers | reviewer not assigned | 2026-07-28 06:26 UTC | 2026-07-29 06:26 UTC | 16d 4h |
| [#1865 — feat(resources_servers): add interactive browser RL environment (local Playwright + remote CDP backends)](https://github.com/NVIDIA-NeMo/Gym/pull/1865) | Maintainers | reviewer not assigned | 2026-07-30 13:23 UTC | 2026-07-31 13:23 UTC | 13d 21h |
| [#2254 — fix(hermes_agent): never present fabricated tokens as policy output](https://github.com/NVIDIA-NeMo/Gym/pull/2254) | Maintainers | reviewer not assigned | 2026-07-30 21:27 UTC | 2026-07-31 21:27 UTC | 13d 13h |
| [#2295 — Add unified Webarena, VisualWebarena and WebVoyager support](https://github.com/NVIDIA-NeMo/Gym/pull/2295) | Maintainers | reviewer not assigned | 2026-08-03 21:27 UTC | 2026-08-04 21:27 UTC | 11d 13h |
| [#2349 — docs: parent resolution and verified prefix supply](https://github.com/NVIDIA-NeMo/Gym/pull/2349) | Maintainers | reviewer not assigned | 2026-08-05 16:09 UTC | 2026-08-06 16:09 UTC | 9d 18h |
| [#2388 — fix: only skip venv setup when the venv was setup](https://github.com/NVIDIA-NeMo/Gym/pull/2388) | Maintainers | reviewer not assigned | 2026-08-06 16:28 UTC | 2026-08-07 16:28 UTC | 8d 17h |
| [#2437 — feat(agents): add aggregate metrics proxy helper](https://github.com/NVIDIA-NeMo/Gym/pull/2437) | Maintainers | reviewer not assigned | 2026-08-08 12:41 UTC | 2026-08-10 12:41 UTC | 7d 21h |
| [#2412 — fix(pinchbench): address the model server per rollout so capture attributes calls](https://github.com/NVIDIA-NeMo/Gym/pull/2412) | Maintainers | reviewer not assigned | 2026-08-07 13:59 UTC | 2026-08-10 13:59 UTC | 7d 20h |
| [#2513 — fix: serialize Jest in nv-internal SWE](https://github.com/NVIDIA-NeMo/Gym/pull/2513) | Maintainers | reviewer not assigned | 2026-08-12 13:56 UTC | 2026-08-13 13:56 UTC | 4d 20h |
| [#2526 — feat(core): add shared failure-routing helpers](https://github.com/NVIDIA-NeMo/Gym/pull/2526) | Maintainers | reviewer not assigned | 2026-08-13 02:08 UTC | 2026-08-14 02:08 UTC | 4d 8h |
| [#2527 — fix: bound model request retries](https://github.com/NVIDIA-NeMo/Gym/pull/2527) | Maintainers | reviewer not assigned | 2026-08-13 09:39 UTC | 2026-08-14 09:39 UTC | 4d 0h |
| [#2553 — feat: add OrcaRouter as a named inference provider](https://github.com/NVIDIA-NeMo/Gym/pull/2553) | Maintainers | reviewer not assigned | 2026-08-14 03:26 UTC | 2026-08-17 03:26 UTC | 3d 7h |
| [#2578 — [Super 3.5 evals] Apply measured full-rack vLLM configuration](https://github.com/NVIDIA-NeMo/Gym/pull/2578) | Maintainers | reviewer not assigned | 2026-08-17 18:10 UTC | 2026-08-18 18:10 UTC | 1d 16h |
| [#2580 — docs: fix Fern polish issues from NVBugs 6570461](https://github.com/NVIDIA-NeMo/Gym/pull/2580) | Maintainers | reviewer not assigned | 2026-08-17 19:01 UTC | 2026-08-18 19:01 UTC | 1d 15h |
| [#2587 — Fix #2585](https://github.com/NVIDIA-NeMo/Gym/pull/2587) | Maintainers | reviewer not assigned | 2026-08-18 02:31 UTC | 2026-08-19 02:31 UTC | 1d 7h |
| [#2588 — [GDPVal] Harden production rollout and judging paths](https://github.com/NVIDIA-NeMo/Gym/pull/2588) | Maintainers | reviewer not assigned | 2026-08-18 02:40 UTC | 2026-08-19 02:40 UTC | 1d 7h |

</details>

Navigation Menu

Uh oh!

[Tracker] Pull request handoff SLA #2067

Pull request handoff SLA tracker

Newly breached (7)

Waiting on reviewers (3)

Waiting on authors (1)

Needs review assignment (3)

Waiting on reviewers (45)

Waiting on authors (6)

Needs review assignment (37)

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#2592 — Fix compute_pass_majority_metrics: score unanswered rollouts as failures in pass@k	@gwarmstrong, @jkyi-nvidia	review requested	2026-08-18 16:55 UTC	2026-08-19 16:55 UTC	17h
#2600 — feat: record the routing condition an eval runs under	@ananthsub, @bxyu-nvidia	review requested	2026-08-18 19:04 UTC	2026-08-19 19:04 UTC	15h
#2474 — Add repeat-level variability statistics to reward profiling	@mlazuka	review requested	2026-08-18 20:46 UTC	2026-08-19 20:46 UTC	13h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#2594 — feat(swebench): configurable image namespace and arch for eval containers	Maintainers	reviewer not assigned	2026-08-18 14:50 UTC	2026-08-19 14:50 UTC	19h
#2602 — docs: mention Cline harness in SWE agents README	Maintainers	reviewer not assigned	2026-08-18 20:29 UTC	2026-08-19 20:29 UTC	13h
#2605 — Add live web client for Kuhn poker	Maintainers	reviewer not assigned	2026-08-19 01:15 UTC	2026-08-20 01:15 UTC	9h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#799 — fix: preserve optional fields in structured_outputs strictify_schema_json	@jkyi-nvidia	review requested	2026-03-02 20:59 UTC	2026-03-03 20:59 UTC	121d 13h
#879 — Yev/scicode env v1	@dhruvnathawani, @jubick1337	review requested	2026-03-20 18:09 UTC	2026-03-23 18:09 UTC	107d 16h
#998 — Add ruler answer prefix	@bxyu-nvidia, @cmunley1	review requested	2026-04-02 23:04 UTC	2026-04-03 23:04 UTC	98d 11h
#1005 — fix: bound retries in server_utils.request()	@bxyu-nvidia	review requested	2026-04-15 08:24 UTC	2026-04-16 08:24 UTC	90d 2h
#946 — Turing/ Playwright-based CUA environment with multi-provider adapter support	@bxyu-nvidia	review requested	2026-04-29 19:09 UTC	2026-04-30 19:09 UTC	79d 15h
#1193 — docs: address repo-health audit nits in README and CONTRIBUTING	@cmunley1	review requested	2026-04-30 13:30 UTC	2026-05-01 13:30 UTC	78d 20h
#1264 — feat: artifact-root resolution for external plugins	@ananthsub, @bxyu-nvidia	review requested	2026-05-07 20:20 UTC	2026-05-08 20:20 UTC	73d 14h
#1334 — structured_outputs: add LLM-as-a-judge semantic verification	@jkyi-nvidia	review requested	2026-05-18 20:37 UTC	2026-05-19 20:37 UTC	66d 13h
#1491 — Add compute_eval benchmark and resource server	@ananthsub, @bxyu-nvidia	review requested	2026-06-02 00:07 UTC	2026-06-03 00:07 UTC	56d 10h
#1560 — docs: clarify resources server example-data contract and license validation	@cwing-nvidia, @lbliii	review requested	2026-06-10 12:04 UTC	2026-06-11 12:04 UTC	49d 22h
#1541 — Add SC_Bench benchmark	@adil-a, @ananthsub, @bxyu-nvidia, @cwing-nvidia	review requested	2026-06-13 00:57 UTC	2026-06-15 00:57 UTC	48d 9h
#1598 — Eshachar/openclaw swe	@sdevare-nv	review requested	2026-06-16 18:19 UTC	2026-06-17 18:19 UTC	45d 16h
#1653 — docs: remove model recipe column from RL framework compatibility table	@cwing-nvidia	review requested	2026-06-23 03:23 UTC	2026-06-24 03:23 UTC	41d 7h
#1669 — fix(harbor): reuse one HTTP client per episode for vLLM session affinity	@grace-lam	review requested	2026-06-23 23:50 UTC	2026-06-24 23:50 UTC	40d 10h
#1752 — fix: handle vllm context length errors in nano v3 recipe	@yfw	review requested	2026-06-26 05:53 UTC	2026-06-29 05:53 UTC	38d 4h
#2026 — feat: Switchyard token-capture integration for OpenHands SWE runs (zero-fork)	@bxyu-nvidia	review requested	2026-07-14 22:36 UTC	2026-07-15 22:36 UTC	25d 11h
#1964 — feat(model-server): add OpenAI-compatible /v1/embeddings endpoint	@ffrujeri	review requested	2026-07-15 16:18 UTC	2026-07-16 16:18 UTC	24d 18h
#1727 — fix(vllm_model): handle explicit null metadata in preprocessing	@ananthsub	review requested	2026-07-15 17:11 UTC	2026-07-16 17:11 UTC	24d 17h
#2048 — feat: sandbox_agent swe resources server	@adil-a, @ananthsub, @bxyu-nvidia, @hemildesai	review requested	2026-07-15 21:13 UTC	2026-07-16 21:13 UTC	24d 13h
#2052 — hermes_agent: repin to upstream hermes and fix the wrapper for its API	@Glorf	review requested	2026-07-17 22:38 UTC	2026-07-20 22:38 UTC	22d 11h
#2124 — feat(token-id-capture): capture training tokens from external harnesses	@bxyu-nvidia	review requested	2026-07-23 15:54 UTC	2026-07-24 15:54 UTC	18d 18h
#2125 — feat(token-id-capture): chain a rollout's calls into one response	@bxyu-nvidia, @pthombre	review requested	2026-07-23 16:22 UTC	2026-07-24 16:22 UTC	18d 18h
#2126 — feat(token-id-capture): deliver rebuilt trajectories safely	@bxyu-nvidia	review requested	2026-07-23 16:22 UTC	2026-07-24 16:22 UTC	18d 18h
#2141 — feat: add switchyard_model server for router-backed evals	@ananthsub, @bxyu-nvidia	review requested	2026-07-27 19:55 UTC	2026-07-28 19:55 UTC	16d 14h
#2180 — feat(token-id-capture): resolve each call's parent at request time	@pthombre	review requested	2026-07-29 13:59 UTC	2026-07-30 13:59 UTC	14d 20h
#2181 — feat(vllm-model): supply the previous call's exact training tokens	@pthombre	review requested	2026-07-29 14:00 UTC	2026-07-30 14:00 UTC	14d 20h
#2155 — [GDPVal] Fix Stirrup reference paths and make head-server wait configurable	@agronskiy	review requested	2026-07-29 16:40 UTC	2026-07-30 16:40 UTC	14d 17h
#2160 — [GDPVal] Fix what reaches the rubric judge, and stop silent zeros	@agronskiy	review requested	2026-07-29 16:40 UTC	2026-07-30 16:40 UTC	14d 17h
#2162 — [GDPVal] Add model-agnostic Slurm orchestration for multi-allocation rollouts	@agronskiy	review requested	2026-07-29 16:40 UTC	2026-07-30 16:40 UTC	14d 17h
#2301 — feat(sandbox): add E2B sandbox provider	@hemildesai	review requested	2026-08-04 13:34 UTC	2026-08-05 13:34 UTC	10d 20h
#2304 — default port range to the 5000-5999 band	@adil-a	review requested	2026-08-04 13:48 UTC	2026-08-05 13:48 UTC	10d 20h
#2311 — docs: rewrite Configure Agents index and document external agent harnesses	@cwing-nvidia, @lbliii	review requested	2026-08-04 14:30 UTC	2026-08-05 14:30 UTC	10d 19h
#2386 — feat: harden SWE against filesystem overflow	@sdevare-nv	review requested	2026-08-06 17:31 UTC	2026-08-07 17:31 UTC	8d 16h
#2142 — Add EnterpriseOps-Gym benchmark: resources server, benchmark registration, and per-turn telemetry agent	@bxyu-nvidia	review requested	2026-08-08 08:52 UTC	2026-08-10 08:52 UTC	8d 1h
#2427 — feat: automation bench, general-agent, tau2-synth environments and verifiers 0.3 bump	@ananthsub, @d-molinari	review requested	2026-08-07 22:39 UTC	2026-08-10 22:39 UTC	7d 11h
#2172 — feat: make Legal Agent Bench agent harness and sandbox-backends configurable	@cmunley1	review requested	2026-08-10 16:56 UTC	2026-08-11 16:56 UTC	6d 17h
#2481 — feat: swe_trace_converter change for the opencode backend	@bxyu-nvidia, @sdevare-nv	review requested	2026-08-11 18:44 UTC	2026-08-12 18:44 UTC	5d 15h
#2458 — feat: deepswe environment	@Glorf, @hemildesai	review requested	2026-08-12 04:41 UTC	2026-08-13 04:41 UTC	5d 5h
#2507 — fix(anthropic): make Messages conversion loss-aware	@bxyu-nvidia, @cmunley1, @ffrujeri, @linj-glitch	review requested	2026-08-12 06:45 UTC	2026-08-13 06:45 UTC	5d 3h
#2383 — feat: judge endpoint resiliency	@e-dobrowolska	review requested	2026-08-12 16:43 UTC	2026-08-13 16:43 UTC	4d 17h
#2346 — feat(sandbox): add Tenki provider	@hemildesai	review requested	2026-08-12 16:45 UTC	2026-08-13 16:45 UTC	4d 17h
#2420 — feat: strands agent	@Glorf, @ffrujeri	review requested	2026-08-13 17:47 UTC	2026-08-14 17:47 UTC	3d 16h
#2457 — feat: terminus 2 agent integration	@bxyu-nvidia, @hemildesai	review requested	2026-08-13 17:51 UTC	2026-08-14 17:51 UTC	3d 16h
#2151 — feat: agentic math environments	@ananthsub, @ffrujeri	review requested	2026-08-13 18:23 UTC	2026-08-14 18:23 UTC	3d 16h
#2120 — [rollout-observability][7/7] Add SWE agent rollout observations	@mlazuka	review requested	2026-08-17 16:09 UTC	2026-08-18 16:09 UTC	1d 18h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#1600 — docs(fern): add SEO meta descriptions + headlines to nightly docs (#1589)	@lbliii	changes requested	2026-06-29 14:05 UTC	2026-06-30 14:05 UTC	36d 20h
#2339 — Katherine/gdpval devel staging	@katherineh123	changes requested	2026-08-09 22:03 UTC	2026-08-10 22:03 UTC	7d 12h
#1973 — fix: write traces on timeout (Apptainer) + improve Hermes traces	@elisam0	changes requested	2026-08-17 02:42 UTC	2026-08-18 02:42 UTC	2d 7h
#2551 — Default simple agent to max_steps=1	@yfw	changes requested	2026-08-17 03:14 UTC	2026-08-18 03:14 UTC	2d 7h
#2302 — feat(longmemeval): add LongMemEval long-term-memory QA benchmark	@pachmu	changes requested	2026-08-18 08:02 UTC	2026-08-19 08:02 UTC	1d 2h
#2072 — feat(spartqa): add SpartQA spatial-reasoning benchmark	@pachmu	changes requested	2026-08-18 08:14 UTC	2026-08-19 08:14 UTC	1d 2h

PR	Waiting on	Reason	Handoff	SLA deadline	Overdue
#834 — Add Tau^2 Bench training environment	Maintainers	reviewer not assigned	2026-03-06 22:23 UTC	2026-03-09 22:23 UTC	117d 12h
#1103 — structured_outputs: support oneOf/anyOf branches and $defs/$ref schemas	Maintainers	reviewer not assigned	2026-04-21 05:08 UTC	2026-04-22 05:08 UTC	86d 5h
#1233 — structured_outputs: extend XML type coercion to handle oneOf/anyOf/allOf composition	Maintainers	reviewer not assigned	2026-05-05 21:17 UTC	2026-05-06 21:17 UTC	75d 13h
#1274 — Add audiobench_alpaca_audio benchmark + audiobench_judge resource server	Maintainers	reviewer not assigned	2026-05-08 20:49 UTC	2026-05-11 20:49 UTC	72d 13h
#1315 — Add GitHub issue template for environment integrations	Maintainers	reviewer not assigned	2026-05-13 19:42 UTC	2026-05-14 19:42 UTC	69d 14h
#1358 — feat(vllm_model): chunk long single-clip audio in chat_completions	Maintainers	reviewer not assigned	2026-05-18 21:04 UTC	2026-05-19 21:04 UTC	66d 13h
#1429 — docs: clarify SWE-bench dataset downloads	Maintainers	reviewer not assigned	2026-05-27 08:53 UTC	2026-05-28 08:53 UTC	60d 1h
#1590 — feat(equivalence_llm_judge): cap extracted-answer length sent to judge	Maintainers	reviewer not assigned	2026-06-12 22:06 UTC	2026-06-15 22:06 UTC	47d 12h
#1719 — feat(code_gen): add per-language subset metrics for livecodebench-x	Maintainers	reviewer not assigned	2026-06-25 01:11 UTC	2026-06-26 01:11 UTC	39d 9h
#1720 — feat(instruction_following): add loose-mode evaluation and compute_metrics	Maintainers	reviewer not assigned	2026-06-25 01:12 UTC	2026-06-26 01:12 UTC	39d 9h
#1745 — fix(config): seed no-model refs for prepare-data	Maintainers	reviewer not assigned	2026-06-26 00:31 UTC	2026-06-29 00:31 UTC	38d 9h
#1797 — fix(inference_provider): normalize provider endpoint errors	Maintainers	reviewer not assigned	2026-06-27 04:43 UTC	2026-06-29 04:43 UTC	38d 5h
#1800 — Harden SWE agent test file parsing	Maintainers	reviewer not assigned	2026-06-27 10:32 UTC	2026-06-29 10:32 UTC	37d 23h
#1788 — fix: make rollout /run failures recoverable	Maintainers	reviewer not assigned	2026-06-26 22:02 UTC	2026-06-29 22:02 UTC	37d 12h
#1784 — feat(vllm-model): consume native dynamo token data	Maintainers	reviewer not assigned	2026-06-29 23:38 UTC	2026-06-30 23:38 UTC	36d 10h
#1847 — Rgala/browsecomp search providers newstable	Maintainers	reviewer not assigned	2026-07-01 00:35 UTC	2026-07-02 00:35 UTC	35d 9h
#1908 — Actions: sync project status to release label	Maintainers	reviewer not assigned	2026-07-02 13:16 UTC	2026-07-03 13:16 UTC	33d 21h
#1939 — Tb e2e	Maintainers	reviewer not assigned	2026-07-06 18:22 UTC	2026-07-07 18:22 UTC	31d 16h
#2080 — feat: Switchyard OpenCode integration	Maintainers	reviewer not assigned	2026-07-20 12:50 UTC	2026-07-21 12:50 UTC	21d 21h
#2109 — fix(server_utils): use unpredictable per-process secret for session signing	Maintainers	reviewer not assigned	2026-07-22 21:53 UTC	2026-07-23 21:53 UTC	19d 12h
#2122 — [rollout-observability][follow-up] Correlate auxiliary Model Server calls	Maintainers	reviewer not assigned	2026-07-24 18:54 UTC	2026-07-27 18:54 UTC	17d 15h
#2027 — Simplify ModelCallRecord; Refactor call capture logic; Extend to agents	Maintainers	reviewer not assigned	2026-07-28 06:26 UTC	2026-07-29 06:26 UTC	16d 4h
#1865 — feat(resources_servers): add interactive browser RL environment (local Playwright + remote CDP backends)	Maintainers	reviewer not assigned	2026-07-30 13:23 UTC	2026-07-31 13:23 UTC	13d 21h
#2254 — fix(hermes_agent): never present fabricated tokens as policy output	Maintainers	reviewer not assigned	2026-07-30 21:27 UTC	2026-07-31 21:27 UTC	13d 13h
#2295 — Add unified Webarena, VisualWebarena and WebVoyager support	Maintainers	reviewer not assigned	2026-08-03 21:27 UTC	2026-08-04 21:27 UTC	11d 13h
#2349 — docs: parent resolution and verified prefix supply	Maintainers	reviewer not assigned	2026-08-05 16:09 UTC	2026-08-06 16:09 UTC	9d 18h
#2388 — fix: only skip venv setup when the venv was setup	Maintainers	reviewer not assigned	2026-08-06 16:28 UTC	2026-08-07 16:28 UTC	8d 17h
#2437 — feat(agents): add aggregate metrics proxy helper	Maintainers	reviewer not assigned	2026-08-08 12:41 UTC	2026-08-10 12:41 UTC	7d 21h
#2412 — fix(pinchbench): address the model server per rollout so capture attributes calls	Maintainers	reviewer not assigned	2026-08-07 13:59 UTC	2026-08-10 13:59 UTC	7d 20h
#2513 — fix: serialize Jest in nv-internal SWE	Maintainers	reviewer not assigned	2026-08-12 13:56 UTC	2026-08-13 13:56 UTC	4d 20h
#2526 — feat(core): add shared failure-routing helpers	Maintainers	reviewer not assigned	2026-08-13 02:08 UTC	2026-08-14 02:08 UTC	4d 8h
#2527 — fix: bound model request retries	Maintainers	reviewer not assigned	2026-08-13 09:39 UTC	2026-08-14 09:39 UTC	4d 0h
#2553 — feat: add OrcaRouter as a named inference provider	Maintainers	reviewer not assigned	2026-08-14 03:26 UTC	2026-08-17 03:26 UTC	3d 7h
#2578 — [Super 3.5 evals] Apply measured full-rack vLLM configuration	Maintainers	reviewer not assigned	2026-08-17 18:10 UTC	2026-08-18 18:10 UTC	1d 16h
#2580 — docs: fix Fern polish issues from NVBugs 6570461	Maintainers	reviewer not assigned	2026-08-17 19:01 UTC	2026-08-18 19:01 UTC	1d 15h
#2587 — Fix #2585	Maintainers	reviewer not assigned	2026-08-18 02:31 UTC	2026-08-19 02:31 UTC	1d 7h
#2588 — [GDPVal] Harden production rollout and judging paths	Maintainers	reviewer not assigned	2026-08-18 02:40 UTC	2026-08-19 02:40 UTC	1d 7h

Uh oh!

[Tracker] Pull request handoff SLA #2067

Description

Pull request handoff SLA tracker

Newly breached (7)

Waiting on reviewers (3)

Waiting on authors (1)

Needs review assignment (3)

Waiting on reviewers (45)

Waiting on authors (6)

Needs review assignment (37)

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions