Skip to content
cccskills
FreePublished on GitHubEnglish overview

running-evals

Runs and interprets GitHub CLI event evaluations, including skill-on and skill-off comparisons, replay, and smoke checks. It guides case selection, credential handling, cleanup verification, and reporting of behavioral versus infrastructure results.

OriginalShow the original description

Use when asked to run, compare, debug, re-run, or interpret the GitHub CLI event evals, including skill-off/skill-on trials, review-loop, design probes, replay, smoke testing, cleanup, or saved artifacts.

cli/cli47,066 stars(GitHub 47,066 + cccskills 0)
Works withGitHub

Run score Not tested

See how to install

Good for

  • Running a requested event evaluation
  • Comparing skill-on and skill-off trials
  • Replaying a saved evaluation artifact
  • Checking cleanup and interpreting grader results

Overview

What it does

This skill guides GitHub CLI event evaluations from case selection through execution, result interpretation, and cleanup checks. It directs the user to consult the runbook and credential and execution-mode references, then select a trial that matches the requested scenario. Results are separated into task completion, event routing, polling, and semantic validity, with behavioral failures distinguished from infrastructure failures. The workflow also covers replaying saved evidence and running smoke checks without a model. Reports include the scenario, model, budget, grader outcomes, evidence that the agent waited for notifications, artifact locations, and cleanup status.

When it helps

Use it to run a new evaluation, compare skill-on and skill-off results, reproduce a failure, check grader regressions, or verify a command or API protocol. It can also guide a smoke test and confirmation that cleanup finished.

Example requests

  • “Run this event evaluation and compare the skill-on and skill-off results.”
  • “Replay the saved evaluation artifacts and check the grader results.”
  • “Run a smoke test and verify cleanup.”

Notes

The workflow requires the working-tree ./bin/gh and an explicitly authorized sandbox organization and live-resource run. Credential roles must be checked using the prescribed references; tokens must not be printed, and scopes or credentials must not be broadened or created silently. The procedure does not fetch, push, commit, publish, or change Git remotes. Cleanup should be checked in the runner report and unfinished journals; retries use the original owning identities.

This overview was written by AI (OpenAI Codex) from the public SKILL.md. Check the original below for the exact behavior.

Document check

AI checked the SKILL.md for operations that need care and for setup requirements. The score comes only from actually running the skill (hands-on test).

SafetyAre sending data, deleting files, and running commands disclosed?
AGoodIt requires authorization, forbids token output and remote changes, and specifies cleanup.
Easy setupDoes it need few tools or API keys, and are they documented?
BPartly lackingIt requires `./bin/gh`, credentials, and a sandbox organization, with setup references.

Not counted in the score. Rated by AI (OpenAI Codex) as of Nov 18, 2026. Treat it as a guide and read the original before installing.

Disagree? Request a re-evaluation

Tell us which point is wrong and why. No login needed. We will check it against the SKILL.md, redo the evaluation, and show the result here.

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

Files included (3)

  • SKILL.md3.4 KB
  • references/credentials.md1.8 KB
  • references/execution-modes.md1.0 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

This dispatcher helps with GitHub Agentic Workflows by identifying whether a request is about design, creation, configuration, updates, debugging, or upgrades. It selects the matching workflow prompt or skill file so the agent can follow task-specific guidance.

  • Design a GitHub Agentic Workflow from scratch
  • Create or configure a workflow engine
  • Update or debug an existing workflow
cli/cli47KUpdated Nov 7, 2026

cli-exercise

FreeSummary

Exercise a real command-line program with specified cases or a stated goal, then capture and verify the observed behavior. It produces local media evidence such as a session video, helping reviewers see what the command did without treating the recording as proof of general correctness.

  • Record specified CLI test cases
  • Demonstrate a command’s behavior
  • Validate an interactive terminal workflow
cli/cli47.1KUpdated Nov 19, 2026

Verify CLI exercise expectations against recorded evidence, render requested media, inspect the results, and return local artifacts with case outcomes. The workflow keeps failures visible and does not publish evidence by default.

  • Verifying a recorded CLI exercise
  • Rendering and inspecting session evidence
  • Returning local artifacts without publishing
cli/cli47.1KUpdated Oct 31, 2026

Use this skill to execute supplied CLI test cases without changing their commands, inputs, ordering, or assertions. It guides preparation, exercise, and validation case by case, then classifies results as passed, failed, blocked, or observed based on actual evidence.

  • Run caller-supplied CLI cases in their specified order
  • Preserve literal inputs and expected assertions
  • Validate each case against observed output or state
cli/cli47.1KUpdated Oct 31, 2026

Use this skill to explore a CLI goal by choosing observable checks within an approved scope. It guides the agent through preparation, one exercise, and immediate validation for each case, then helps report what the evidence established and what remained unreachable.

  • Explore a CLI task with a clear goal and approved boundaries
  • Choose checks for an outcome such as uploading a file
  • Run and validate CLI cases one at a time
cli/cli47.1KUpdated Oct 31, 2026

This internal module checks whether cli-exercise can use its required build, terminal, and media tools. When a dependency is missing, it identifies a suitable setup path and requires approval before installation, then rechecks readiness. It does not authorize recordings or other actions.

  • Check cli-exercise tool readiness
  • Find missing recording or rendering dependencies
  • Prepare an approved dependency installation
cli/cli47.1KUpdated Oct 31, 2026

See all skills by cli

Report a problem with this skill