Skip to content

Commit ce3faac

Browse files
avnath13claude
andcommitted
Add the design-diff demo: recipe assistant vs recipe + nutrition
A genuine variant (recipe app plus nutrition and health guidance at 800k MAU), generated through the real pipeline, and the agentify diff report comparing it to the original. The diff shows the sharp contrast: the weight class rises lightweight to enterprise while the escalation rung stays at 1, driven by health-grade domain harm rather than tenancy, and the skill refuses individualized medical advice. - examples/recipe-nutrition.* (variant design + architecture) and recipe-nutrition.diff.html (the comparison report) - build-site.mjs also publishes *.diff.html; the diff is in the site gallery and linked from the README - eval: recipe-nutrition seeded (rung 1 + enterprise weight class), all 6 seeded cases pass Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
1 parent b614f23 commit ce3faac

9 files changed

Lines changed: 3377 additions & 4 deletions

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -184,6 +184,8 @@ Three complete generated designs are committed in [`examples/`](examples/); open
184184

185185
Each design embeds diagrams drawn with the agent-native vocabulary: a component architecture plus a request sequence, a ticket lifecycle state machine, or a voice pipeline.
186186

187+
And a [**design comparison**](https://avnath13.github.io/agentify/examples/recipe-nutrition.diff.html) produced by `agentify diff`: the recipe assistant with health guidance added and 800k users, showing what the change did (the weight class rises to enterprise while the rung stays the same, and the skill refuses to give individualized medical advice).
188+
187189
<picture>
188190
<source media="(prefers-color-scheme: dark)" srcset="docs/assets/drive-through-voice-dark.png">
189191
<img alt="Architecture for a drive-through voice agent: a store-edge boundary with audio edge, streaming ASR and streaming TTS; an order-agent runtime with input and output guardrails, a model gateway with a cached menu prefix, order state, a menu store, a bounded order agent, barge-in, POS submit as a tier-2 action, staff takeover for allergens and low confidence, and a voice eval gate" src="docs/assets/drive-through-voice-light.png" width="100%">

docs/index.html

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -274,6 +274,12 @@ <h3>Drive-through voice agent</h3>
274274
<p>A cascaded voice design with the conversational latency budget, turn-taking (VAD, endpointing, barge-in), and audio-native evaluation, drawn with the speech component types.</p>
275275
<span class="open">Open design &rarr;</span>
276276
</a>
277+
<a class="g-card" href="examples/recipe-nutrition.diff.html">
278+
<span class="kind">agentify diff</span>
279+
<h3>Compare: add nutrition and scale</h3>
280+
<p>The recipe assistant with health guidance added and 800k users. A visual diff shows what the change did: the weight class jumps to enterprise while the rung stays the same, and the skill refuses to give individualized medical advice.</p>
281+
<span class="open">Open comparison &rarr;</span>
282+
</a>
277283
</div>
278284
</div>
279285
</section>

eval/cases.jsonl

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,3 +10,4 @@
1010
{"id":"drive-through-voice","prompt":"A voice agent that takes drive-through food orders.","answers":"Quick-service restaurant chain, noisy environment, orders go to the POS, human staff nearby, weekly regional menus, order accuracy is the top metric.","design":"examples/drive-through-voice.design.html","expect":{"mustMention":["latency","cascaded","barge-in","endpoint"],"mustNot":[]}}
1111
{"id":"insurance-photo-claims","prompt":"An agent that assesses vehicle damage from a photo a customer uploads and drafts a claim.","answers":"Auto insurer, customer uploads photos, a human adjuster approves payouts.","expect":{"mustMention":["multimodal","grounding","hallucination","human"],"mustNot":[]}}
1212
{"id":"lead-triage","prompt":"An agent that triages inbound sales leads: enrich from CRM, score, and draft a reply for a rep to approve.","answers":"300 leads/day, CRM has the data, reps approve every send.","expect":{"rung":3,"mustMention":["human","approv","enrich"],"mustNot":[]}}
13+
{"id":"recipe-nutrition","prompt":"The recipe app, but it also gives basic nutrition and dietary-health guidance, at 800k MAU.","answers":"Same catalog and team, 800k MAU, wants calories/macros and answers about diabetes/hypertension, nervous about wrong dietary-health advice.","design":"examples/recipe-nutrition.design.html","expect":{"rung":1,"weightClass":"enterprise","mustMention":["deterministic","disclaimer","fail-closed"],"mustNot":[]}}

0 commit comments

Comments
 (0)