Skip to content
cccskills
FreePublished on GitHub

dev-smoke

AI DevKit · Smoke-test the user flows a change affects (CLI, API, UI) end to end with a disposable sandboxed script against the real app. Use before calling a feature or fix done, when unit tests pass but the flow is untested, or when users ask for a smoke, e2e, or impact check.

The English summary is being prepared. Showing the original description.

Works withPlaywright

Run score Not tested

See how to install

Files included (4)

  • SKILL.md3.9 KB
  • agents/openai.yaml333 B
  • references/smoke-template.sh3.5 KB
  • references/web-smoke-template.mjs4.6 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Smoke

Exercise the flows a change touches the way a user would, then throw the script away. Report with verify; use dev-testing for permanent tests.

Rules

  • Drive the real entry point: built binary, running server, CLI, UI, or job. Imported functions and mocks are not smoke checks.
  • Sandbox everything: temp dir, isolated HOME and config, empty git hooks, seeded test data, test accounts and tokens.
  • Never use production, shared environments, real accounts or credentials, or paid APIs. Ask before outward-facing side effects: messages, emails, webhooks, deploys, pushes.
  • Start servers on a dedicated port, wait until they respond, and stop the whole process tree on exit. Never reuse or kill the user's own servers.
  • Keep secrets out of the script and its output.
  • Write the script outside the repo; commit it only if the user asks to promote it.
  • Timebox setup. If the app cannot run locally, say what was not checked instead of faking a pass.

Workflow

  1. Read the change: git diff against the base branch, plus untracked files.
  2. Map impact outward: changed symbols -> callers -> entry points (commands, routes, screens, jobs, hooks, config, migrations) -> user flows. Add adjacent flows sharing the changed code, config, or data; note skipped flows and why.
  3. List scenarios as setup / action / expected result, ordered by risk. Wait for the user to add or cut flows; when running unattended, proceed and include the list in the report.
  4. Search memory for known setup: npx ai-devkit@latest memory search --query "<project> smoke setup" --tags "smoke". Build once, then write the script from references/smoke-template.sh (CLI, API) or references/web-smoke-template.mjs (browser). Each check asserts output, files, HTTP status, or exit code, not just "it ran"; API checks also assert the body and one error case (bad input, missing auth). Print PASS/FAIL per check and exit non-zero on any failure.
  5. Run it and read the full output.
  6. On a failure, first rule out a wrong check (selector, timing, setup), then rerun it on the base commit in a separate worktree (dev-worktree) to separate regressions from pre-existing failures.
  7. Report with verify: scenarios, command, exit code, per-check result, pre-existing failures, flows not covered.
  8. Delete the script and sandbox, or offer to promote valuable checks into permanent tests or the project's release smoke suite. Store non-obvious setup: npx ai-devkit@latest memory store --title "<project> smoke setup" --content "<start command, port, health URL, seeding, traps>" --tags "smoke".

UI and Web

  • Use the harness's browser tool when available (for example Claude in Chrome or a Playwright MCP server); otherwise the web template, with Playwright installed in the sandbox.
  • Use a fresh browser context per check, and act like a user: navigate, click, fill forms, submit.
  • Assert visible content, URL, network status, and zero console errors, not just that the page loaded. Match visible elements by role or text; hidden duplicates (mobile menus, templates) cause false failures.
  • UI impact includes shared components, layouts, global styles, and every route rendering the changed component. Check narrow viewports or dark mode when layout or theming changed.
  • Save a screenshot per check as evidence, and read it before judging a failure.
  • Not covered: native mobile apps, desktop apps, pixel-level visual diffs. Report them as unchecked.

Stop

Pause when impacted flows are unclear, a scenario needs anything the Rules forbid, setup needs destructive actions, or failures come from the environment rather than the change.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

AI DevKit · Exchange information with active Codex, Claude Code, and other AI agents using ai-devkit agent list, detail, and send. Use when an agent needs to find another active agent, read its recent context, send it information, or request information back.

The English summary is being prepared. Showing the original description.

codeaholicguy/ai-devkit1.7KUpdated Oct 24, 2026

AI DevKit · Manage running AI agents with ai-devkit agent commands. Use when an agent needs to identify itself, list agents, start workers, inspect agent detail, assign work, group agents, resume sessions, stop agents, or delegate work to other agents.

The English summary is being prepared. Showing the original description.

codeaholicguy/ai-devkit1.7KUpdated Oct 24, 2026

AI DevKit · Supervise multi-agent workflows over repeated passes: poll progress, unblock waiting agents, coordinate dependencies, relay outputs, resolve conflicts, and verify completion. Use only for ongoing multi-agent coordination, not one-off list/detail/send/start/kill actions.

The English summary is being prepared. Showing the original description.

codeaholicguy/ai-devkit1.7KUpdated Oct 24, 2026

AI DevKit · Check local AI DevKit readiness and run setup only when status shows onboarding or harness integration gaps.

The English summary is being prepared. Showing the original description.

codeaholicguy/ai-devkit1.7KUpdated Oct 24, 2026

AI DevKit · Use when the user asks to brainstorm, ideate, generate ideas, expand options, challenge ideas, pressure-test ideas, compare concepts, narrow choices, name something, plan content angles, explore strategy, evaluate product ideas, technical approaches, experiments, or decisions.

The English summary is being prepared. Showing the original description.

codeaholicguy/ai-devkit1.7KUpdated Oct 24, 2026

AI DevKit · Update CHANGELOG.md Unreleased items from git commits since the latest release. Use when users ask to update changelog/release notes from recent commits, with one concise line per commit and commit/PR links.

The English summary is being prepared. Showing the original description.

codeaholicguy/ai-devkit1.7KUpdated Oct 24, 2026

See all skills by codeaholicguy

Report a problem with this skill