Clarify live API conformance gap in Future Direction#23
Conversation
commit: |
There was a problem hiding this comment.
LGTM — docs-only clarification of a Future Direction bullet.
Extended reasoning...
Overview
This PR changes a single line in README.md under the Future Direction > Testing section. It replaces the old "E2E SDK tests" bullet with a more accurate description: the project has api-conformance tests that validate response format structure, but the real gap is tests that run against actual LLM provider APIs (gated behind API keys) to catch format drift.
Security risks
None. This is a documentation-only change with no code impact.
Level of scrutiny
Minimal scrutiny required. This is a one-line wording change in a readme file with no functional impact on the codebase.
Other factors
No bugs were found. No outstanding reviewer comments. The change is self-contained, accurate based on the project structure, and improves clarity over the previous bullet point.
Summary
api-conformancetests that validate response format structure, but the real gap is tests that run against actual LLM APIs (gated behind API keys) to catch format drift as providers evolveTest plan