Skip to content

docs: reframe drift detection for users, not maintainers #78

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jpr5 merged 1 commit into from
Apr 4, 2026
+12 −15
Merged

docs: reframe drift detection for users, not maintainers #78

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 12 additions & 15 deletions docs/index.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1363,10 +1363,7 @@ <h3>Chaos Testing</h3>
<div class="feature-card fade-in" style="transition-delay: 0.4s">
<div class="feature-icon">&#128202;</div>
<h3>Drift Detection</h3>
<p>
Daily CI validation against real APIs. Know immediately when provider behavior changes
break your fixtures.
</p>
<p>Fixtures stay accurate as providers evolve. Fixes ship before your tests break.</p>
</div>
</div>
</div>
Expand All @@ -1375,35 +1372,35 @@ <h3>Drift Detection</h3>
<!-- ─── Section 6: Drift Detection / Reliability ──────────────── -->
<section class="section-reliability" id="reliability">
<div class="container">
<h2 class="fade-in">Verified against real APIs, every day</h2>
<h2 class="fade-in">Your mocks never go stale</h2>
<p class="reliability-sub fade-in" style="transition-delay: 0.1s">
aimock's drift detection runs daily against live provider APIs. When response formats
change, you know immediately &mdash; not when your tests break in production.
LLM providers change their response formats without warning. aimock catches it within 24
hours and ships the fix before your tests break.
</p>

<div class="drift-flow fade-in" style="transition-delay: 0.2s">
<div class="drift-step">
<div class="drift-step-num">1</div>
<h3>Real API calls</h3>
<p>
Daily CI hits actual OpenAI, Anthropic, Gemini endpoints to capture current response
formats.
Daily CI hits actual OpenAI, Anthropic, Gemini endpoints to detect response format
changes.
</p>
</div>
<div class="drift-step">
<div class="drift-step-num">2</div>
<h3>Response validation</h3>
<h3>Compare &amp; detect</h3>
<p>
Compares real responses against aimock's fixture format. Schema changes are caught
instantly.
Response schemas are validated against aimock's builders. Any drift is flagged
automatically.
</p>
</div>
<div class="drift-step">
<div class="drift-step-num">3</div>
<h3>Auto-remediation</h3>
<h3>Fix &amp; ship</h3>
<p>
Drift detected &rarr; PR opened &rarr; fixtures, skills, and docs updated
automatically. Zero manual effort.
Drift detected &rarr; fixtures, builders, skills, and docs updated &rarr; PR shipped.
Always current, within a day.
</p>
</div>
</div>
Expand Down
Loading