Skip to content

Ground documentation assessment in evidence and information availability - #42

Closed
irl-dan wants to merge 1 commit into
codex/imp-087-joint-calibrationfrom
codex/imp-087-assessment-calibration
Closed

irl-dan wants to merge 1 commit into
codex/imp-087-joint-calibrationfrom
codex/imp-087-assessment-calibration

Conversation

@irl-dan

@irl-dan irl-dan commented Oct 6, 2026 •

Copy link
Copy Markdown
Contributor

Assessors can miss incompatible numerical evidence while rejecting a subject for requirements it never had or information supplied only after it finished. Require each finding to identify its governing requirement and evidence, compare actual scoped values, and distinguish subject-time availability from later assessment access.

The SOFR assessor applies these distinctions without changing the original decision-note agreement or house requirements. Ten authored cases cover conflicts, equivalent units, scope, placement and temporal availability. No CLI, kernel or standard-library change is included.

Validation: all 35 repository check commands pass (including 20 unit tests and component package checks), and both exact-head CI jobs pass. Three live evaluator-only trials on saved SOFR notes now identify the previously missed conflict and avoid the earlier date/availability rejections. These trials combine the wording change with an explicit caller statement about evidence timing; they do not isolate either change's effect or estimate reliability.

Remaining defects: truncated evidence reads can be mistaken for absent evidence despite a complete-coverage claim; one assessment mixes historical reproduction and live-run metadata, and another fails to reconcile a subject's fulfillment claim with its detected violation. This PR is a targeted improvement, not a fully qualified assessor or workshop-ready release.

Stacked on #41. Publication and attendee qualification remain separate.

@irl-dan irl-dan added bug Something isn't working documentation Improvements or additions to documentation labels Oct 6, 2026
@irl-dan irl-dan closed this Oct 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant