specs/automation: inngest-probe-suite.t27 — safe probe suite behind /inngest_probe - #3556
Merged
Conversation
Contributor
|
📓 NotebookLM Notebook linked to this PR
This notebook contains session context, decisions, and artifacts for this work. |
Contributor
gHashTag
force-pushed
the
specs/inngest-probe-suite
branch
from
September 10, 2026 02:30
b36373e to
3f412db
Compare
…ed Inngest function behind /inngest_probe Closes #3559 - specs/automation/inngest-probe-suite.t27: payload = manifest safe_probe + e2e_test true; transport = Inngest GQL invokeFunction; expectations FAILED-at-guard | COMPLETED | skip; verdicts; forbidden side effects; one suite at a time; admin only. - specs/functions/training-stuck-check.t27: NOTE states the 404 retirement (host #2328). - tools/published_figures.py: test-blocks pin 12462 -> 12465 (the three test blocks of the new spec; #3557 had moved 12456 -> 12462), the movement written in the pin's note. - docs/now/2026-09-10-inngest-probe-suite-as-a-t27-spec.md.
gHashTag
force-pushed
the
specs/inngest-probe-suite
branch
from
September 10, 2026 02:39
3f412db to
7d6e78d
Compare
Contributor
PR DashboardGenerated at: 2026-09-10 02:39:53 UTC
Summary
Seal Status
|
Contributor
|
📓 NotebookLM Notebook linked to this PR
This notebook contains session context, decisions, and artifacts for this work. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #3559
What
specs/automation/inngest-probe-suite.t27— the spec of the safe probe suite the bot's admin command/inngest_proberuns (host gHashTag/999-multibots-telegraf #2325 merged, #2326 merged, #2331 open).States: payload = manifest
safe_probe+e2e_test: trueforced; transport = Inngest GQLinvokeFunction; slug<appId>-<ID>; run found by functionID + queuedAt window (5 s lookback) +eventNameprefixinngest/function.invoked; poll 3 s, budget 120 s; expectationsFAILED-at-guard | COMPLETED | skip; verdictsmatch | mismatch | timeout | invoke-error | skipped; suite ok iff no mismatch/timeout/invoke-error; forbidden side effects (charges-balance,paid-api,messages-user,messages-owners); one suite at a time; admin only, inline-button confirm.Also in this PR (2026-09-10):
specs/functions/training-stuck-check.t27NOTE: the 404 retirement (host origin/master is a single orphan commit with no ancestor in common with the previous 2545-commit history (old history is safe) #2328) — a training Replicate answers 404 for is markedfailed, one warn, no event, no user message; skipped in safe mode.tools/published_figures.py: test-blocks pin 12462 → 12465 (the spec's threetestblocks; specs/ui/viewport.t27: one viewport contract for the site's explorers (breakpoints, touch targets, QA matrix) #3557 moved it 12456 → 12462 the same day), movement written in the pin's note as the check demands.docs/now/2026-09-10-inngest-probe-suite-as-a-t27-spec.md.Verdict
Vendored wasm (
trinity/apps/website/public/t27/t27_compiler.wasm): typecheck ok, 0 discarded, hir ok — 27 consts, 3 structs, 3 tests. Necessary, not sufficient (the wasm accepts wrong annotations). Bootstrap compiler onmasternot run locally; CI runs it.Status (honesty)
LIVE_RUN_STATUS = "not-yet-run"stays for the bot's own report. Two suites have been judged offline: the admin's run of 2026-09-09 19:11Z (28/28 with the corrected rule, host #2326) and a mirror run of 2026-09-10 02:16Z with the bot's own code, which exposed two judge defects (21 of 28 never judged; a step span left RUNNING) fixed in host #2331 and re-judged 28/28. Counts (28 planned = 17 FAILED-at-guard + 11 COMPLETED) are from the manifest at mbmain.Not in this PR: a
PROBE_EXPECTconstant on the 28 function cards (needs the site generator schema in trinity to accept it); the 404 branch of training-stuck-check as a declared step.gate-topologyanduntrusted-inputfailed on the previous run; whether they pass now is for this CI run to say.