feat(benchmark): per-k latency sweep infrastructure + GPU/CPU report#57

Merged

nmrenyi merged 30 commits into

mainfrom

feat/benchmark-retrieve-k-override

May 15, 2026

Commits on May 14, 2026

feat(benchmark): add --retrieve-k override for per-k latency sweep

nmrenyi
and
claude
committed
feat(benchmark): capture retrieved chunks + response text per run

nmrenyi
and
claude
committed
fix(benchmark): update model-file check to match production stack

nmrenyi
and
claude
committed
feat(benchmark): add --rag-only flag to skip No-RAG mode

nmrenyi
and
claude
committed
fix(benchmark): use suspending delay() instead of Thread.sleep()

nmrenyi
and
claude
committed
fix(benchmark): keep CPU alive through screen-off (PARTIAL_WAKE_LOCK + Default dispatcher)

nmrenyi
and
claude
committed
refactor(benchmark): move benchmark to a foreground service

nmrenyi
and
claude
committed
fix(benchmark): record actual backend (GPU/CPU) in config metadata

nmrenyi
and
claude
committed
analysis: k-sweep latency report (GPU + CPU on Snapdragon 8 Elite)

nmrenyi
and
claude
committed
analysis: add CPU k=20 — confirms 4096-token wall is backend-invariant

nmrenyi
and
claude
committed
review: address Copilot feedback on PR #57

nmrenyi
and
claude
committed

Commits on May 15, 2026