feat(evaluation): admin System tab for indexing speed and RAG quality - #811

Draft

EnjoyBacon7 wants to merge 14 commits into

feat/evaluation-page

Commits on Jul 27, 2026

feat(evaluation): admin System tab for indexing speed and RAG quality
EnjoyBacon7
committed
fix(evaluation): install promptfoo in the API image too
EnjoyBacon7
committed
fix(evaluation): index corpus files under their bare filename
EnjoyBacon7
committed
fix(evaluation): resolve the DB name in the runner and fail fast on a dead actor
EnjoyBacon7
committed
fix(evaluation): sanitize file_id, match ground truth on source name, Node 22
EnjoyBacon7
committed
docs(evaluation): add a sample test set and corpus manifest
EnjoyBacon7
committed
chore(evaluation): un-ignore the committed test set CSV
EnjoyBacon7
committed
fix(evaluation): give promptfoo a writable per-run config dir
EnjoyBacon7
committed
fix(evaluation): make the answer transform a valid expression, normalize ids
EnjoyBacon7
committed
fix(evaluation): name retrieved documents by file_id, not the storage path
EnjoyBacon7
committed
fix(evaluation): single-run locking, percentiles, and env-driven limits
aditykris
committed
docs(evaluation): make comments concise and install-agnostic
aditykris
committed
fix(evaluation): address review findings
aditykris
committed
refactor(evaluation): dispatch runs through a port, not a Ray handle
aditykris
committed