Skip to content

Repository files navigation

Grill Loop

中文 | English

test MIT License GitHub Pages

Grill Loop is a Codex skill for stress-testing and improving product, strategy, and experiment plans through an auditable review loop.

It extends the idea behind grill-me: keep asking the hard questions, but avoid forcing a human to sit in the loop for every small decision.

Grill Loop preview

Interactive explainer

Use the visual page as the public landing/demo page:

python3 -m http.server 8765
open http://127.0.0.1:8765/grill-loop-visual/

The visual page is intentionally not just decoration. It explains the core adoption story:

Grill Me asks deeply
→ every question waits for a human
→ human attention becomes the bottleneck
→ Grill Loop routes simple/researchable/judgment/escalation cases
→ the human only handles exceptions

Why not just use Grill Me?

grill-me is valuable because it asks detailed, one-question-at-a-time follow-ups. That is also the operational bottleneck: every question waits for a human response, including questions that are low-risk, reversible, or answerable from available evidence.

Grill Loop changes the operating model:

  • simple and reversible questions can fast-pass;
  • questions answerable from local evidence go through research;
  • important or disputed questions go to an independent judge;
  • only questions requiring unavailable business facts, authority, or risk acceptance escalate to the human.

The goal is not to replace human judgment. The goal is to reserve human attention for the decisions that actually need it.

What it does

Grill Loop runs one plan through a stateful loop:

  1. A Grill role finds the highest-impact unresolved issue.
  2. The controller routes the issue as FAST_PASS, RESEARCH, JUDGE, or ESCALATE.
  3. A candidate revision is prepared when appropriate.
  4. A Judge role scores the retained artifact with a fixed rubric.
  5. The state manager records the decision and decides whether the loop should continue.

The skill preserves:

  • the original source plan;
  • immutable draft snapshots;
  • machine-readable state in state.json;
  • a human-readable decision log in decisions.md;
  • explicit terminal status and unresolved escalations.

Install

One-line install

curl -fsSL https://raw.githubusercontent.com/jcanha11/grill-loop-skill/main/install.sh | bash

By default, this installs to:

$HOME/.agents/skills/grill-loop

To install into another skill directory:

curl -fsSL https://raw.githubusercontent.com/jcanha11/grill-loop-skill/main/install.sh | \
  GRILL_LOOP_SKILLS_DIR="$HOME/.codex/skills" bash

Manual install

git clone https://github.com/jcanha11/grill-loop-skill.git
mkdir -p "$HOME/.agents/skills"
cp -R grill-loop-skill/grill-loop "$HOME/.agents/skills/grill-loop"

Restart Codex or start a new session if the skill does not appear immediately.

Ask Codex to install it

Paste this into Codex:

Use $skill-installer to install the skill folder from
https://github.com/jcanha11/grill-loop-skill/tree/main/grill-loop
into my user skills directory. Then verify it by running:
python3 -m unittest grill-loop/scripts/test_grill_state.py

If your Codex environment does not support repository skill installation through $skill-installer, paste this instead:

Clone https://github.com/jcanha11/grill-loop-skill, copy the grill-loop folder
to $HOME/.agents/skills/grill-loop, and run its unit tests.
Do not publish or modify any of my other files.

Ask another agent to install it

For any agent that supports the open Agent Skills format:

Install the Agent Skill at:
https://github.com/jcanha11/grill-loop-skill/tree/main/grill-loop

Preserve the SKILL.md file, references/, scripts/, tests/, and agents/openai.yaml.
Install it as a user-level skill named grill-loop.
After installation, run the Python unittest suite in grill-loop/scripts/test_grill_state.py.

For agents that do not support skills natively, ask them to clone the repository and use grill-loop/SKILL.md as the workflow instruction file.

Use

Supervised

Use this when you want the loop to automate simple work but pause for human decisions.

Use $grill-loop in supervised mode to stress-test and improve this plan.

Autonomous

Use this when you explicitly authorize subagents and want the loop to continue without interrupting you unless no safe conservative branch exists.

Use $grill-loop in autonomous mode with specialized subagents to improve this plan.
You may choose conservative reversible branches, but keep unresolved business decisions in the final escalation list.

Autonomous mode must not invent missing facts. If the loop cannot safely continue, it should stop with unresolved items rather than pretend certainty.

Repository layout

grill-loop/
  SKILL.md
  agents/openai.yaml
  references/
    role-contracts.md
    rubric.md
  scripts/
    grill_state.py
    test_grill_state.py
  tests/
    fixtures/flawed-plan.md

grill-loop-visual/
  index.html

install.sh

Validation

Run the deterministic state-manager tests:

python3 -m unittest grill-loop/scripts/test_grill_state.py

Expected result:

Ran 12 tests
OK

How to evaluate whether it is useful

The skill should be judged by measurable workflow impact, not by whether the idea sounds elegant.

Useful evaluation metrics:

  • Human interruption rate: how many questions require user input per review.
  • Review completion rate: how often the loop reaches passed or conditional_pass.
  • Quality lift: score improvement from baseline to final draft.
  • Decision auditability: whether another reviewer can understand why each branch was accepted, rejected, or escalated.
  • False autonomy rate: how often autonomous mode makes assumptions that should have escalated.
  • Time to decision: elapsed time from initial plan to final artifact.

The first success criterion is simple: compared with grill-me, the user should spend less active attention while still receiving a sharper, better-scored plan.

Sharing

If you want to share the project, use the visual explainer first:

https://jcanha11.github.io/grill-loop-skill/grill-loop-visual/

Launch copy, channel notes, and measurement guidance live in docs/PROMOTION.md.

Status

This is an experimental v0.1 skill. It is suitable for local use and method exploration. Treat autonomous runs as conservative review assistance, not as authority to launch, spend budget, change production systems, or make irreversible business decisions.

License

MIT. See LICENSE.

Releases

Packages

Contributors

Languages