test(e2e): NL→SQL evals via AI gateway (gated by AI_GATEWAY_* envs)#3

Merged

mattvollmer merged 9 commits intomainfrom

blink/nl2sql-e2e

Sep 15, 2025

Commits on Sep 15, 2025

test(e2e): add NL→SQL evals gated by AI gateway vars
blink-so[bot]
committed
test(e2e): import it/expect from vitest to fix ReferenceError

blink-so[bot]
and
mattvollmer
committed
ci/e2e: require explicit AI_GATEWAY_BASE_URL and model; remove default OpenAI base so E2E skips when unconfigured
blink-so[bot]
committed
fix(query): avoid collision with generated SQL by shifting LIMIT/OFFSET placeholders after max index; relax contract regex

blink-so[bot]
and
mattvollmer
committed
test(e2e): instruct model to inline literals (no placeholders) to avoid param mismatch

blink-so[bot]
and
mattvollmer
committed
test(e2e): switch to dual-block output (sql + json params); pass params to runQuery; enforce error if either block missing

blink-so[bot]
and
mattvollmer
committed
test(e2e): add per-test fallback params when placeholders present but model omits params

blink-so[bot]
and
mattvollmer
committed
test(e2e): make JSON params block optional; default to [] and allow per-test fallbacks

blink-so[bot]
and
mattvollmer
committed
ci: split core and E2E; mark E2E non-blocking; stabilize E2E prompts, add debug, increase timeouts
blink-so[bot]
committed