Blind agent-judgment exercise run 18 (2026-08-01), 58 commands, against the
release skill at 33e82a6a (commit b74ace58). This is the run recorded in
.codearbiter/reports/agent-lane-proof.json.
Run 18 verified that every fix from runs 16 and 17 holds — helpers survive a
plugin root containing a space, the :/ + ,top clean-tree spelling gives the
same answer from a subdirectory and filters both remedy-written paths, the
step-6c marker no longer trips step 7, and the rebuild subshell contains its
cd. The bare-. counterfactual reproduces the documented silent pass exactly.
Run 18's HIGH-2 (a step-3 parenthetical instructing an interactive rebase
over already-published commits) was fixed immediately rather than filed — it
was a destructive instruction. That fix is the post_exercise_delta recorded in
the proof artifact, and it is why proof_current is false.
Everything below is open.
HIGH — Back-fill's own first release cannot clear Phase 1 step 3
The adoption floor that bounds the footer check is derived from
.codearbiter/CONTEXT.md. Pre-flight states explicitly that a consumer which
reached this skill through the Back-fill lane has no CONTEXT.md yet, by
design — that lane exists precisely so a release-only consumer can skip full
onboarding.
Empty floor → nothing to floor against → the entire history is footer-checked.
Reproduced in a scratch repo: 4 commits, 4 [NEEDS-TRIAGE] lines. On a real
repository that is the unbounded triage block A-5.5 exists to prevent, on the
only path the Back-fill lane serves.
This is a design gap, not a sentence. The floor needs a source that does not
presuppose onboarding — the first commit touching the declared payload, or the
back-fill marker's own commit, are the obvious candidates.
MEDIUM — the rebuild's exit code is never checked
Pre-flight says to run the declared rebuild and then assert the artifacts are
in sync. Nothing says the rebuild must have SUCCEEDED. A failed build leaves the
previous artifacts in place, so the freshness assertion passes on a stale
bundle that a broken build failed to update.
MEDIUM — run-pre-tag exit 5 is reported as "drift" regardless of why the command failed
Exit 5's remedy is "reconcile the drift the command reported". A declared
command can exit non-zero for reasons that are not drift at all — a missing
interpreter (see #583, #584), a missing dependency, a network failure. The
operator is handed a confident diagnosis of the wrong problem. Same house rule
as elsewhere in this campaign: "could not run" is not "ran and disagreed".
MEDIUM — the one number that matters is the only step left to the eye
Step 4 has the operator apply the bump word to $BASE_VERSION by hand. None of
the fifteen subcommands does this arithmetic. The downstream guards do not close
it: a minor window mis-applied as a patch gives semver-greater 2.11.1 2.11.0
→ exit 0; check-manifests compares the manifests against the same wrong value
step 6a just wrote → exit 0; classify receives a carried <tag_version> and a
re-read <manifest_version> that agree → publish_fresh.
So the file's own hard rule — "a feat in the window cannot ship as a
patch" — has no enforcement anywhere in the lane. It is the single
unmechanized judgment left in a lane whose stated doctrine is "never by eye",
and it is the one an unenforced hard rule points directly at.
Fix direction: an apply-bump <base> <word> subcommand, asserted against
the classify-window output.
LOW — three
- Multi-valued fields come back comma-separated and the splitting is never
spelled out, so each consumer of $ARTIFACTS/$PRE_TAG invents its own.
LAST_TAG is resolved from local tags with no fetch; a stale clone silently
bases the window on the wrong baseline. (Run 18 confirmed local and remote
tag sets are currently identical here, so this did not fire.)
- A cross-reference to
$REBUILD went stale when the subshell landed.
Blind agent-judgment exercise run 18 (2026-08-01), 58 commands, against the
release skill at
33e82a6a(commitb74ace58). This is the run recorded in.codearbiter/reports/agent-lane-proof.json.Run 18 verified that every fix from runs 16 and 17 holds — helpers survive a
plugin root containing a space, the
:/+,topclean-tree spelling gives thesame answer from a subdirectory and filters both remedy-written paths, the
step-6c marker no longer trips step 7, and the rebuild subshell contains its
cd. The bare-.counterfactual reproduces the documented silent pass exactly.Run 18's HIGH-2 (a step-3 parenthetical instructing an interactive rebase
over already-published commits) was fixed immediately rather than filed — it
was a destructive instruction. That fix is the
post_exercise_deltarecorded inthe proof artifact, and it is why
proof_currentisfalse.Everything below is open.
HIGH — Back-fill's own first release cannot clear Phase 1 step 3
The adoption floor that bounds the footer check is derived from
.codearbiter/CONTEXT.md. Pre-flight states explicitly that a consumer whichreached this skill through the Back-fill lane has no
CONTEXT.mdyet, bydesign — that lane exists precisely so a release-only consumer can skip full
onboarding.
Empty floor → nothing to floor against → the entire history is footer-checked.
Reproduced in a scratch repo: 4 commits, 4
[NEEDS-TRIAGE]lines. On a realrepository that is the unbounded triage block A-5.5 exists to prevent, on the
only path the Back-fill lane serves.
This is a design gap, not a sentence. The floor needs a source that does not
presuppose onboarding — the first commit touching the declared payload, or the
back-fill marker's own commit, are the obvious candidates.
MEDIUM — the rebuild's exit code is never checked
Pre-flight says to run the declared
rebuildand then assert the artifacts arein sync. Nothing says the rebuild must have SUCCEEDED. A failed build leaves the
previous artifacts in place, so the freshness assertion passes on a stale
bundle that a broken build failed to update.
MEDIUM —
run-pre-tagexit 5 is reported as "drift" regardless of why the command failedExit 5's remedy is "reconcile the drift the command reported". A declared
command can exit non-zero for reasons that are not drift at all — a missing
interpreter (see #583, #584), a missing dependency, a network failure. The
operator is handed a confident diagnosis of the wrong problem. Same house rule
as elsewhere in this campaign: "could not run" is not "ran and disagreed".
MEDIUM — the one number that matters is the only step left to the eye
Step 4 has the operator apply the bump word to
$BASE_VERSIONby hand. None ofthe fifteen subcommands does this arithmetic. The downstream guards do not close
it: a
minorwindow mis-applied as a patch givessemver-greater 2.11.1 2.11.0→ exit 0;
check-manifestscompares the manifests against the same wrong valuestep 6a just wrote → exit 0;
classifyreceives a carried<tag_version>and are-read
<manifest_version>that agree → publish_fresh.So the file's own hard rule — "a
featin the window cannot ship as apatch" — has no enforcement anywhere in the lane. It is the singleunmechanized judgment left in a lane whose stated doctrine is "never by eye",
and it is the one an unenforced hard rule points directly at.
Fix direction: an
apply-bump <base> <word>subcommand, asserted againstthe classify-window output.
LOW — three
spelled out, so each consumer of
$ARTIFACTS/$PRE_TAGinvents its own.LAST_TAGis resolved from local tags with no fetch; a stale clone silentlybases the window on the wrong baseline. (Run 18 confirmed local and remote
tag sets are currently identical here, so this did not fire.)
$REBUILDwent stale when the subshell landed.