Smoke Test: Claude - 22858353205 #20228
Description
Summary
All smoke tests completed successfully. Overall Status: PARTIAL (1 test skipped).
PR used for review testing: #20143 (copilot/19744-reimplement-goal)
Core Tests (#1–10)
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP - Last 2 merged PRs | ✅ |
| 2 | mcpscripts-gh CLI - Query 2 PRs | ✅ |
| 3 | Serena MCP - Activate + find_symbol (>3 symbols) | ✅ |
| 4 | Make Build | ✅ |
| 5 | Playwright - github.com title check | ✅ |
| 6 | Tavily Web Search - "GitHub Agentic Workflows" | ✅ |
| 7 | File Writing | ✅ |
| 8 | Bash - Verify file creation | ✅ |
| 9 | Discussion query - got #20223 | ✅ |
| 10 | Agentic Workflows MCP status (smoke-claude: active) | ✅ |
PR Review Tests (#11–17)
| # | Test | Status |
|---|---|---|
| 11 | Update PR body (append) | ✅ |
| 12 | PR review comments (2 comments) | ✅ |
| 13 | Submit PR review (COMMENT) | ✅ |
| 14 | Resolve review thread (PRRT_kwDOPc1QR85y6u7r) |
✅ |
| 15 | Add reviewer (copilot) | ✅ |
| 16 | Push to PR branch (smoke test file committed) | ✅ |
| 17 | Close PR |
Details
Core Test Details
- Test 1: Retrieved merged PRs including Show Codex session preview in parse agent log step like other engines #20199 "Show Codex session preview in parse agent log step"
- Test 2: Got open PRs Fix __GH_AW_WIKI_NOTE__ placeholder not substituted when Wiki is disabled #20225 (WIP - Wiki notes) and Default cancel-in-progress: false for non-agent job concurrency groups #20224 (WIP - concurrency groups) via mcpscripts-gh
- Test 3: Serena activated
/home/runner/work/gh-aw/gh-aw,find_symbol("main")returned 95,690+ chars of results (many symbols found) - Test 4:
make buildcompiledgh-awbinary successfully with-ldflags "-s -w -X main.version=ba68404" - Test 5: GitHub page title "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✓ contains "GitHub"
- Test 6: Tavily returned 3 results from githubnext.com, github.blog, and other sources
- Test 7/8: File
/tmp/gh-aw/agent/smoke-test-claude-22858353205.txtcreated and verified - Test 9: Discussion 🧩 Constraint Solving POTD:Boolean Satisfiability (SAT) — Encoding the World in Clauses #20223 "🧩 Constraint Solving POTD: Boolean Satisfiability (SAT)"
- Test 10: smoke-claude: compiled=Yes, status=active, triggers: pull_request(smoke label), reaction(heart), schedule(every 12h)
PR Review Test Details
- Test 11: Appended "✨ PR Review Safe Output Test - Run 22858353205" to PR Replace hardcoded
/opt/gh-aw/paths withGH_AW_HOMEenv var for self-hosted runner portability #20143 body - Test 12: Added 2 review comments: one on
.changeset/patch-gh-aw-home-portability.mdline 1 and one on.github/workflows/ace-editor.lock.ymlline 54 - Test 13: Submitted COMMENT review "💥 Automated smoke test review - all systems nominal!"
- Test 14: Resolved thread
PRRT_kwDOPc1QR85y6u7r(Copilot review onactions/setup/setup.sh) - Test 15: Added
copilotas reviewer - Test 16: Created
docs/smoke-test-push-22858353205.mdand pushed to branch - Test 17: No test PR available to safely close (skipped)
Run: §22858353205
Timestamp: 2026-03-09T14:34:00Z
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 9, 2026, 4:42 PM UTC