Skip to content

feat(evals): tier-2 pilot — false-PASS 6/6 at control, doctrine delta 0; the membrane finding - #1039

Merged
boshu2 merged 2 commits into
mainfrom
tier2-pilot-results
Aug 5, 2026
Merged

feat(evals): tier-2 pilot — false-PASS 6/6 at control, doctrine delta 0; the membrane finding#1039
boshu2 merged 2 commits into
mainfrom
tier2-pilot-results

Conversation

@boshu2

@boshu2 boshu2 commented Aug 5, 2026

Copy link
Copy Markdown
Owner

Headroom screen (luna-low, n=3/task): t01 hardened 3/3 false-PASS, t03
vacuous-green 3/3, t02 dead (0/3 — diagnostic errors are habit; excluded
honestly). Stage-A pilot contrast: premortem doctrine injected, presence
asserted in all six transcripts — treatment false-PASS still 3/3 + 3/3,
flagged_gap 0. The three-context gradient is now measured on one skill in
one week: doctrine moves quiz answers (wave 1), shapes advice (routing b3),
and does NOT override a plan's explicit closure instruction mid-execution.
Prompt-carried trust doctrine fails exactly where trust matters; false-PASS
reduction belongs to the deterministic layer. Pre-reg updated to power for
the gate arm, add the effort contrast, and record t02's death. PILOT — never
promotable; config luna-low only.

… 0; the membrane finding

Headroom screen (luna-low, n=3/task): t01 hardened 3/3 false-PASS, t03
vacuous-green 3/3, t02 dead (0/3 — diagnostic errors are habit; excluded
honestly). Stage-A pilot contrast: premortem doctrine injected, presence
asserted in all six transcripts — treatment false-PASS still 3/3 + 3/3,
flagged_gap 0. The three-context gradient is now measured on one skill in
one week: doctrine moves quiz answers (wave 1), shapes advice (routing b3),
and does NOT override a plan's explicit closure instruction mid-execution.
Prompt-carried trust doctrine fails exactly where trust matters; false-PASS
reduction belongs to the deterministic layer. Pre-reg updated to power for
the gate arm, add the effort contrast, and record t02's death. PILOT — never
promotable; config luna-low only.
@boshu2
boshu2 enabled auto-merge (squash) August 5, 2026 02:10
…erable class), doctrine removed 0

Post-hoc deterministic gates on the 12 existing pilot workspaces (zero new
runs): t03's ran-zero-tests procedural gate blocks 6/6 vacuous-green claims;
t01's whitespace-metamorphic gate (derived from visible cases + stated bar,
holdout-blind by construction) blocks 0/6 — live workers trim by habit and
fail only the decimal case beyond the gate's derivational reach. Measured
stack at luna-low: doctrine 0/12, gates 6/12, holdout the rest. Oracle
coverage IS the trust boundary; results doc gains the layered table.
@boshu2
boshu2 merged commit 6bcce51 into main Aug 5, 2026
7 checks passed
@boshu2
boshu2 deleted the tier2-pilot-results branch August 5, 2026 02:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant