Skip to content
cccskills
FreePublished on GitHubEnglish overview

openclaw-testing

Choose suitable tests and checks for OpenClaw changes, then investigate failures using the relevant evidence. It guides local validation and directs environment-dependent or release testing to the appropriate procedures, keeping checks tied to the changed behavior.

OriginalShow the original description

Choose proportional OpenClaw tests/checks, diagnose failures, route environment-sensitive or release proof to its owner.

Works withTelegramDocker
AI rating90/ 100See how to install

Good for

  • Choosing checks for source code changes
  • Reproducing a bug and verifying its repair
  • Investigating failed CI jobs
  • Selecting package, Docker, or release validation procedures

Overview

What it does

Select tests and checks for OpenClaw changes and investigate failures. The skill chooses among checks for changed files, type checking, static code analysis, focused tests, and builds. For failures in CI, an automated validation environment, it identifies the relevant commit and job, then distinguishes product issues from problems with the test environment, infrastructure, or credentials.

When it helps

It is intended for developers verifying bug fixes or deciding what to test after changes to SDK or plugin behavior. It also helps select validation that needs dedicated environments or procedures, including package installation, Docker, live services, and release candidates.

Example requests

  • “Choose and run the checks and tests needed for this change.”
  • “Reproduce the bug, then verify the fix with the relevant tests.”
  • “Investigate the cause using the failed CI job’s logs.”

Notes

Follow OpenClaw documentation and the AGENTS.md that applies to the changed files, using pnpm or repository runner scripts. Do not run tools from untrusted contributors locally; use a validation environment without credentials. Testing an operating Gateway or real data requires explicit approval for each task. Passing part of release validation does not itself authorize publication.

This overview was written by AI (OpenAI Codex) from the public SKILL.md. Check the original below for the exact behavior.

Objective evaluation

AI rated this skill on four points using only the contents of its SKILL.md. Stars and popularity are not taken into account.

Clear instructionsIs it clear when to use it and what it does?
AGoodIt explicitly covers change-specific validation selection, CI failure diagnosis, and routing to specialized validation.
Concrete stepsAre steps, inputs, outputs, and examples spelled out?
AGoodIt provides commands by change type and a failure investigation procedure using test:ci-failed.
SafetyAre sending data, deleting files, and running commands disclosed?
AGoodIt prohibits local execution of untrusted code and requires approval for real-data testing and credentialed execution.
Easy setupDoes it need few tools or API keys, and are they documented?
BPartly lackingIt references pnpm and specialized environments, but the text does not include dependency installation steps.

The total counts each point as A = 25, B = 15, C = 5. Rated by AI (OpenAI Codex) as of Oct 19, 2026. Treat it as a guide and read the original before installing.

Disagree? Request a re-evaluation

Tell us which point is wrong and why. No login needed. We will check it against the SKILL.md, redo the evaluation, and show the result here.

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

Files included (3)

  • SKILL.md6.5 KB
  • agents/openai.yaml273 B
  • references/package-and-docker.md6.0 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

OpenClaw Testing

Proof policy

  • PR CI = default broad proof. Change builds + focused tests pass → open ready PR. CI runs broad suites; never delay PR for pre-PR suite runs.

  • Before PR, prove narrowly: touched tests with pnpm test <file> --maxWorkers=1, targeted typecheck, lint, format. Prefer local proof for trusted, bounded work when dependencies and current host capacity are qualified. Local execution is optional: a focused command can still load a large compiler graph or expand to broad lanes.

  • Choose remote proof deliberately. Use PR CI for broad proof; Crabbox/Testbox may cover expensive checks, a busy or unqualified local host, another OS/device, live providers/channels, long E2E, or heavy benchmarks. Acquire only when the command is ready and capacity is granted promptly. If queued, stop only the task-owned allocation; use PR CI or a safe local scope. Keep uncovered platform-specific proof pending. Never force heavy work onto a busy machine or chain providers. Use the smallest profile proven for the selected workload.

  • Never rerun or re-push just for green. Fix real failures; read available CI failure classification before attributing red.

  • Prove changed contract, complete required gates, finish. Broaden/repeat only for changed inputs, failures, or named unresolved risk.

  • Follow scoped AGENTS.md; authoring/reviewing tests: use boundary guide and test-audit.

Select the proof

  • Select proof for touched contract; reuse valid proof (rerun for changed inputs or missing coverage); finish workflow's required gates within user/host limits; report unrun checks and gaps. Prove user-visible behavior through real flow when feasible; external APIs need live contract proof; isolated mock-Gateway harness = valid channel boundary proof. Docs-only: docs sanity and git diff --check.

  • Runtime defect: reproduce real entry point; rerun it + relevant siblings.

  • Trusted source: pnpm changed:lanes --json, focused tests + targeted typecheck/lint/format; pnpm check:changed = optional smart local check.

  • Public SDK/plugin contract: representative consumers, not all-plugin sweep.

  • Build output, lazy imports, package boundaries: include pnpm build.

  • Workflow: git diff --check + pnpm check:workflows.

  • Docs only: relevant docs/link/format checks + git diff --check; no runtime tests.

  • Read on demand: local commands, Crabbox, OpenClaw remote setup, package/Docker proof, release CI, plugin release matrix, Docker authoring, channel skill/ Control UI E2E.

  • An isolated mock-Gateway harness is valid channel boundary proof; state live gaps. Prove user-visible behavior through the real flow when feasible; external APIs require live contract proof. Read the scoped channel/platform guide for live-channel or native-app work. Telegram claims require Test Server userbot proof with Convex-leased credentials. Platform claims require real-device evidence; macOS permission proof requires a stable signed app.

  • Release proof: preserve candidate/Tooling SHAs; never grants publication authority.

Source and state boundaries

  • Never execute untrusted contributor/fork code, wrappers, config locally. Use secretless fork CI or sanitized direct AWS through Crabbox; never credential-hydrated Testbox. Credentialed execution: maintainer approval after review required; never hydrate untrusted lease.
  • Isolated state + free port. Never restart, edit, or test operator Gateway/real data without explicit per-task approval. Preserve unrelated processes and shared dependency installs.
  • Concurrent test/check commands: separate OPENCLAW_VITEST_FS_MODULE_CACHE_PATH values or run serially; checks can run Vitest too. Repository wrappers only, never raw Vitest. Prepared linked worktrees: node scripts/check-changed.mjs and node scripts/run-vitest.mjs <file> --maxWorkers=1 avoid pnpm reconciliation.

CI failures

  • PR CI fails → pnpm test:ci-failed <pr>; read pre-existing/new/unknown classification.
  • Fix new failures; investigate unknown → pnpm test:ci-failed <pr> --run until selected tests pass locally → push once.
  • --run enables OPENCLAW_NODE_TEST_PLAN_CONTINUE_ON_FAILURE=1: collect ordinary failures across selected configs, while infrastructure failures still stop; use the same opt-in for manual focused reruns.
  • Pre-existing failures: failure-table landing rule. Matching signatures ≠ job-name-only attribution.
  • Never gh run rerun to chase green; never local full suite for CI repair.
  • Bind diagnosis to exact SHA + job. Fetch failed logs once; prefer exact run/job state over stale PR rollups.
  • Distinguish product, harness, infrastructure, credentials, superseded-run cancellation. Snapshots pass macOS/fail CI: reproduce Linux/Node bytes before regenerating.

Baseline and expected-failure exceptions

Narrow baseline, snapshot, ignore, and expected-failure exceptions are implementer decisions only when each entry is verified against source and the PR records its reason (for example, tool-owned metadata in an upgrade snapshot while user data stays exact). Never mask a real regression or user-data change. Blanket or unverified exceptions need approval. Exact shrink-only ratchet updates are maintenance.

Test failure policy

  • Failures = defects. Bounded reproduction attempt (same shard order first); identify owner; fix product, fixture, shared-state, ordering bugs.
  • Proven repair: add regression; cite another owner's fix when applicable.
  • Safe fix cannot be established/completed: record original failure, attempts, evidence, uncertainty in PR; continue under normal CI/review gates.
  • Unresolved failure alone neither blocks landing nor requires extra approval. Passing replay ≠ proven fix.
  • Never hide failures with retries, longer timeouts, weaker assertions, broader mocks, altered baselines.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

1password

FreeSummary

Set up and authenticate the 1Password CLI, then supply stored passwords and API keys to commands or configuration. The skill covers desktop integration, service accounts, and interactive sign-in while keeping secrets out of chat and logs.

  • Setting up the 1Password CLI
  • Supplying API keys to commands
  • Using service account authentication in CI
openclaw/openclaw392.4KUpdated Oct 18, 2026

acp-router

FreeSummaryAI rating 80

Route requests from OpenClaw to external coding agents such as Claude Code or Cursor. Start or continue sessions using ACP, a protocol for connecting agents, or relay prompts directly through acpx while preserving conversation context.

  • Starting a Claude Code session in a thread
  • Continuing work with an external coding agent
  • Relaying prompts directly through acpx
openclaw/openclaw392.4KUpdated Oct 18, 2026

Add a model provider to OpenClaw and verify it with a real response. The skill validates configuration, keeps credentials in environment or file references, and reports test results and any default model changes.

  • Adding a model provider to OpenClaw
  • Configuring credentials through environment or file references
  • Checking whether a model returns a real response
openclaw/openclaw392.4KUpdated Oct 18, 2026

agent-transcript

FreeSummary

Prepare an agent activity transcript for a GitHub pull request or issue. Extract relevant prompts, decisions, and results from local logs, remove sensitive material, and preview the edited record before separately authorized publication.

  • Preparing an agent activity record for a pull request
  • Extracting task-relevant prompts and results from local logs
  • Previewing a transcript with sensitive information removed
openclaw/openclaw392.4KUpdated Oct 18, 2026

apple-notes

FreeSummary

Manage Apple Notes on macOS through memo, a command-line tool. Create, browse, search, edit, delete, and move notes between folders, or export selected notes to HTML or Markdown for use outside the app.

  • Creating notes with titles
  • Finding notes by folder or approximate search
  • Editing notes and organizing them into folders
openclaw/openclaw392.4KUpdated Oct 18, 2026

apple-reminders

FreeSummary

Manage Apple Reminders from your Mac with remindctl, a terminal tool. View tasks by date, add or edit reminders, organize lists, and mark tasks complete or delete them, including personal to-dos that sync to iOS.

  • Review today’s tasks and overdue reminders
  • Add personal to-dos with due dates
  • Organize tasks visible on an iPhone or iPad
openclaw/openclaw392.4KUpdated Oct 18, 2026

See all skills by openclaw

Report a problem with this skill