Skip to content
cccskills
FreePublished on GitHub

codew-release-qa-sweep

Check Codewhale release readiness through ordered tests, builds, version checks, and manual terminal checks. Record command results and observed behavior, including responsiveness, route isolation, and follow-up input handling, while explicitly identifying any skipped checks.

OriginalShow the original description

Use before claiming Codewhale release work is done: run the full gate sweep and list the manual QA targets.

See how to install

Good for

  • Run automated checks on the actual release branch
  • Check whether a PR merges into the release branch
  • Manually test terminal responsiveness and input behavior
  • Report release readiness with results and skipped checks

Files included (1)

  • SKILL.md5.3 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Codewhale Release QA Sweep

Run this before claiming any Codewhale release work is "done." A green automated gate sweep plus the three manual QA targets is the evidence bar. No sweep, no "done" — report exactly what was run and the result of each step.

When to use

  • Before telling the maintainer (or a PR thread) that release work is complete or merge-ready.
  • After harvesting/landing PRs into the release branch, before the publish boundary.
  • When verifying a release candidate on the real landing branch (e.g. <release-branch>), which is often local-only.

Automated gate sweep

Run from the repo root, in order. Stop on the first failure and report it.

# 0. Confirm you are on the real release head, not a main-based assumption.
git branch --show-current          # expect e.g. <release-branch>
git status --short                 # working tree should be clean

# 1. Formatting + stray whitespace/conflict markers
cargo fmt --all --check
git diff --check

# Core npm workspace tests plus the shared web gate (install web dependencies first).
# check:web checks committed facts before regeneration, then docs, design tokens,
# lint, TypeScript and the production build. These do not replace the Rust gates.
npm test && npm run check:web

# 2. Library/protocol/cli/flow/state tests, locked
cargo test -p codewhale-config -p codewhale-protocol -p codewhale-cli \
  -p codewhale-workflow -p codewhale-state --locked

# 3. TUI test binaries, locked
cargo test -p codewhale-tui --lib --locked

# 4. TUI debug build, locked
cargo build -p codewhale-cli --bin codewhale --locked

# 5. Release build for the shipped binaries, locked
cargo build --release --locked -p codewhale-cli --bin codewhale

# 6. Version-drift gate (workspace ↔ npm ↔ Cargo.lock ↔ changelog ↔ README)
./scripts/release/check-versions.sh

# 7. Binary smoke
./target/release/codewhale --version

If you are validating a PR for landing, also test mergeability against the actual release head, never the main-based clean flag:

git merge-tree $(git merge-base <release-branch> <pr-head>) <release-branch> <pr-head>

A PR that is clean against main can still conflict with the release branch.

Manual QA targets

Unit/build gates do not cover the live TUI. Exercise all three and record what you saw:

Use the built binary with a sealed local home and loopback fixtures, then exercise the relevant scenarios below in an actual terminal. Record dimensions, inputs, visible state, and side effects. Do not substitute a full-screen assertion harness for looking at and using the product.

  1. Six-worker fanout liveness (regression refs #3216, #2211). Spawn 6 sub-agents. Confirm typing, render, cancel, and the workbar stay live throughout, and that Esc cancels mid-fanout (prompt interrupt, not a wedged ~24s burst or freeze). For the Windows Terminal retest path (ref #3289), start in plan mode, add follow-up input to the plan, press Esc, switch to yolo/accept flow, trigger at least two auto/Fleet worker spawns, and keep typing/cancel/mode-switch checks live for several minutes. Attach logs if the freeze reproduces.
  2. Multi-terminal route isolation (regression ref #3227). Open multiple terminals on distinct provider/model routes. Confirm zero cross-terminal contamination and no provider+model mismatch — each terminal honors its own route.
  3. Running-turn input contract (regression ref #3203). During a busy turn, confirm Enter queues a typed follow-up, the preview advertises Enter send now, and an empty Enter promotes the oldest queued follow-up. Confirm Ctrl+Enter steers typed text directly, Shift+Enter inserts a newline, and Ctrl+G/Ctrl+S only stash drafts.

Reporting format

Report a checklist: each command, pass/fail, and the salient output line (test counts, the --version string, check-versions.sh verdict). For manual QA, state what you actually observed per target, citing the regression ref where one applies. If a step was skipped or could not be run (e.g. no display for TUI QA), say so explicitly — do not imply coverage you do not have.

Red flags / don't

  • Don't claim "done," "passing," or "merge-ready" without the evidence above. Assertions without command output are not acceptable.
  • Don't trust the main-based mergeability flag for a release branch; use git merge-tree against the real head.
  • Don't skip the manual TUI targets because the build is green — the freeze, route-mismatch, and steering regressions live in the runtime, not the gates.
  • Don't tag, publish, create a GitHub Release, push artifacts, or merge/close any PR or issue without maintainer approval. A green sweep is readiness evidence, not permission.
  • Never harvest/close from a PR title or label alone — review from code, tests, comments, and checks.
  • When the sweep clears a harvested PR, preserve contributor credit: cherry-pick keeps the original author, otherwise add Co-authored-by: Name <email> and a Harvested from PR #N by @handle body line (the spaced form the auto-close-at-main workflow greps for).
  • Keep any contributor-facing comment positive and crediting; gates stay dry-run/advisory unless the maintainer approves enforcement.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

batch

FreeSummary

Split a large goal into clearly bounded tasks that can run in parallel. Coordinate existing agent and worktree tools, then combine and verify the results. The skill starts only when explicitly requested.

  • Splitting a large goal into parallel tasks
  • Coordinating work across multiple agents
  • Running tasks in separate worktrees
codewhale-hq/Codewhale41.1KUpdated Oct 19, 2026

best-of-n

FreeSummary

Generate independent options for design, implementation, explanations, or debugging, then compare them using one shared rubric. Code candidates use separate working copies and undergo independent verification before a winner is presented for review.

  • Comparing several plausible design approaches
  • Evaluating independent implementations of the same task
  • Comparing explanations or debugging approaches
codewhale-hq/Codewhale41.1KUpdated Oct 19, 2026

computer-use

FreeSummary

Operate desktop apps and isolated browsers on registered computers by inspecting interface controls, entering information, and checking results. The skill also covers screenshots and recording, with separate routing for the user's signed-in Chrome through Chromewhale.

  • Entering information through a desktop app interface
  • Working in an isolated browser session
  • Capturing screenshots or recordings for a task
codewhale-hq/Codewhale41.1KUpdated Oct 19, 2026

Check a local Codewhale checkout before contributing: inspect branch and sync status, build the CLI, and run the repository’s CI checks. Present recent commits and changelog entries from local files, with clear status for each step.

  • Checking a checkout before contributing
  • Reviewing local changes and sync status
  • Running the build and CI verification commands
codewhale-hq/Codewhale41.1KUpdated Oct 19, 2026

cw-dogfood

FreeSummary

Builds and installs Codewhale with a source revision identifier, then verifies the installed version in a fresh shell. It guides hands-on runtime checks for interface behavior, routing, approvals, and other changes that automated tests may miss.

  • Verifying terminal interface changes in the actual product
  • Installing and checking a local release build
  • Checking model routing and approval behavior
codewhale-hq/Codewhale41.1KUpdated Oct 19, 2026

cw-gates

FreeSummary

Verify Codewhale changes with checks matched to their scope and risk. Collect actual test counts, automated limit checks, and command output to show what passed, what failed, and what remains unverified.

  • Verify a fix before marking it complete
  • Choose tests for the changed area
  • Check limits and consistency rules enforced by CI
codewhale-hq/Codewhale41.1KUpdated Oct 19, 2026

See all skills by codewhale-hq

Report a problem with this skill