Skip to content
cccskills
FreePublished on GitHub

skill-release-gate

Evaluate an Agent Skill bundle before release by checking structure, activation conditions, output quality, scripts, safety, file integrity, and host compatibility. Receive a detailed JSON report that distinguishes local evidence checks from production readiness backed by external attestation.

OriginalShow the original description

Evaluate an Agent Skill bundle for structural integrity, trigger quality, artifact improvement, script correctness, safety, installed-tree integrity, and target-host portability before release.

See how to install

Good for

  • Reviewing a skill bundle before distribution
  • Evaluating activation accuracy and output improvements
  • Checking scripts, safety, and distributed files
  • Assessing host compatibility and release evidence

Files included (8)

  • SKILL.md3.9 KB
  • assets/hosts.json752 B
  • assets/manifest.json782 B
  • evals/artifacts.json316 B
  • evals/cases.json866 B
  • evals/evidence.json606 B
  • references/eval-contract.md3.6 KB
  • scripts/evaluate_skill.py37.6 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Skill release gate

Use this skill before publishing or distributing an Agent Skill directory bundle.

Workflow

  1. Resolve SKILL_ROOT to the absolute directory containing this installed SKILL.md. Do not assume the process cwd is the installed bundle.
  2. Resolve TARGET_ROOT from the original workspace working directory and resolve the user-supplied candidate as an absolute TARGET_BUNDLE.
  3. Read references/eval-contract.md from SKILL_ROOT.
  4. Inspect the positive and near-miss trigger cases in evals/cases.json under TARGET_BUNDLE.
  5. Inspect the shared baseline and with-skill assertions in evals/artifacts.json under TARGET_BUNDLE.
  6. Inspect the explicit script and safety results in evals/evidence.json under TARGET_BUNDLE.
  7. Inspect the declared runtime capabilities in assets/hosts.json under TARGET_BUNDLE and verify the target file hashes against its assets/manifest.json.
  8. For production, replace deterministic predictions, artifacts, evidence, and host capabilities with captured results; set all four captured modes; and bind every raw trigger observation, both artifacts, the complete evidence set, and the non-empty host matrix to non-empty sources and matching SHA-256 provenance digests. These local checks can set localEvidenceReady, but locally recomputable hashes do not prove capture.
  9. Obtain an external JSON attestation whose evidenceRoot matches the report, plus the SHA-256 of its exact bytes from a separate trusted policy or release channel. The attestation must be a regular file outside the target bundle.
  10. Before execution, show the exact resolved argv. The installed evaluator is scripts/evaluate_skill.py under SKILL_ROOT. For the shipped lesson fixture, build argv from python3, that absolute evaluator path, --fixture-demo, and the absolute TARGET_BUNDLE. For production, use the same installed script with --attestation, --trusted-attestation-sha256, and the absolute TARGET_BUNDLE, without --fixture-demo.
  11. Return checksPassed, fixturePassed, localEvidenceReady, trustAnchorValid, productionReady, and passed with the evidence root, evaluation modes, failed checks, precision, recall, every raw trigger observation, per-case repeated-run rates, artifact comparison, script and safety evidence, installed-tree verification, and portability matrix. Include the resolved script path, resolved target path, cwd, exact argv, and exit code. Mark unavailable observations unverified.

Output contract

Return the complete JSON evaluation report. Preserve every layer-specific check and its evidence so a passing aggregate cannot hide a routing, artifact, script, safety, installed-tree, or portability failure. fixturePassed reports a successful teaching fixture. localEvidenceReady reports only local digest integrity. passed is true only when productionReady also has a valid out-of-bundle trust anchor.

Failure behavior

If configuration is invalid, provenance is absent or mismatched, the trusted attestation is missing or invalid, a file hash differs, a required capability is absent, or any production gate fails, stop with a nonzero result and report the failed layer. The explicit --fixture-demo path may exit successfully only when fixturePassed is true, and it never makes a release claim. Never publish, install elsewhere, repair evidence, create the trust decision, or weaken a threshold automatically.

Do not publish a bundle merely because SKILL.md parses or one positive prompt activates. Do not label a package portable when a target drops required companion files or ignores required runtime extensions.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

blueprint-figure

FreeSummary

Create static SVG diagrams, scalable images for lessons, READMEs, and manuals. It uses real system names, nine diagram types, and consistent colors and arrows, with checks for readable labels, accessible descriptions, and valid markup.

  • Add a diagram of system interactions to a README
  • Explain state transitions in a manual
  • Illustrate data flow from logs or specifications
rohitg00/ai-engineering-from-scratch71.2KUpdated Oct 18, 2026

build-project

FreeSummary

Learn AI engineering by building a project one stage at a time. The tutor guides predictions, learner-written code, automated checks, and reflection, then records progress so the next session can continue from the right stage.

  • Learn AI engineering through hands-on projects
  • Resume a project from the next unfinished stage
  • Find coding mistakes with step-by-step hints
rohitg00/ai-engineering-from-scratch71.2KUpdated Oct 18, 2026

check-tests

FreeSummary

Run a local check of test evidence and retain source paths in the result. The workflow stops when required evidence is missing, keeping the findings tied to their sources.

  • Checking local test evidence
  • Keeping source paths in check results
  • Stopping a check when evidence is missing
rohitg00/ai-engineering-from-scratch71.2KUpdated Oct 18, 2026

Test your understanding of a phase in AI Engineering from Scratch through eight multiple-choice questions. Receive a score, explanations for incorrect answers, and specific lessons to review before continuing your studies.

  • Checking your understanding after completing a phase
  • Assessing readiness for the next phase
  • Finding lessons to review from incorrect answers
rohitg00/ai-engineering-from-scratch71.2KUpdated Oct 18, 2026

Prepare for four Claude certification tracks through guided lessons, practical exercises, quizzes, and mock exams. The tutor checks understanding and learner-created work, records progress, and uses assessment results to guide review.

  • Choosing a certification track for a learning goal
  • Resuming lessons from saved progress
  • Completing guided exercises without writing code
rohitg00/ai-engineering-from-scratch71.2KUpdated Oct 18, 2026

course-guide

FreeSummary

Find relevant lessons in AI Engineering from Scratch from a topic, question, or bug. Get a short selection of lessons, necessary prerequisites, and the next learning command, with dedicated routes for specialized subjects.

  • Finding lessons on a topic you want to learn
  • Locating lessons that explain a bug's underlying cause
  • Choosing what to study next based on your progress
rohitg00/ai-engineering-from-scratch71.2KUpdated Oct 18, 2026

See all skills by rohitg00

Report a problem with this skill