feat: make 4096-token prompt ceiling explicit + experimental findings#60

Merged

nmrenyi merged 23 commits into

mainfrom

feat/explicit-max-num-tokens

May 17, 2026

Commits on May 16, 2026

feat: make the 4096-token prompt ceiling explicit in EngineConfig
nmrenyi
committed
analysis: document the maxNumTokens experiment in latency_report_v2
nmrenyi
committed
docs: maxnumtoken_investigation.md — explain why GPU breaks at lifted context
nmrenyi
committed
analysis: cross-link the maxnumtoken investigation from latency_report_v2
nmrenyi
committed
docs: maxnumtoken_investigation — Step 2 reproducibility + reachability constraint
nmrenyi
committed
analysis: cross-link Step 2 reproducibility + FP32-reachability into latency_report_v2
nmrenyi
committed
docs: maxnumtoken_investigation — Step 3 confirms FP16 as root cause
nmrenyi
committed
analysis: cross-link Step 3 FP32-control finding into latency_report_v2
nmrenyi
committed
docs: maxnumtoken_investigation — Step 5 full FP32 GPU sweep at max=4096
nmrenyi
committed
docs: lead investigation + report with prominent FP16 default warning
nmrenyi
committed
feat: consolidate max_num_tokens to single source + record provenance in JSON
nmrenyi
committed
docs: record artifact-fingerprint → precision mapping (verified)
nmrenyi
committed

Commits on May 17, 2026