Skip to content
cccskills
FreePublished on GitHub

whalesong-annotate

Attach review scores to recorded Whalesong traces and build comparison pairs — mark a session good/bad/regressed, then diff two runs deterministically. Use when evaluating agent changes, reviewing a run after the fact, or building a small eval set.

The English summary is being prepared. Showing the original description.

See how to install

Files included (1)

  • SKILL.md1.7 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

Whalesong: annotate and compare

Two jobs: leave durable review marks on traces, and diff runs.

Scoring

whalesong_score writes a Langfuse-style score row onto a trace. Suggested names stay consistent so later queries aggregate cleanly:

  • review — categorical: accepted / needs-work / failed
  • rating — numeric 1–5
  • regression — boolean: true means this run was worse than its baseline

Always pass comment with the one-line reason; a bare score is a label nobody can act on later. Scores are the only write this plugin performs — confirm the trace id before writing.

Comparing runs

whalesong_compare takes two trace ids (or file paths) and returns a deterministic diff: overall similarity, per-channel and temporal similarity, deltas in duration / tokens / errors / p95 latency / finding counts, and the timeline points where the two runs diverged most.

Good pairs:

  • same task, before/after a prompt or model change,
  • a passing run vs. its scored regression pair,
  • the same workflow across two different agent CLIs.

Similarity near 1.0 means the runs' shape matched; it says nothing about output quality — inspect the differing span names the diff reports.

Typical flow

  1. Triage or list traces → pick the pair.
  2. whalesong_compare → report the deltas that matter.
  3. whalesong_score both runs so the verdict is durable.

Keep the write side boring: one score, one comment, correct trace id.

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

Audit a page or UI against WCAG 2.2 AA. Runs a static HTML scanner and a contrast calculator, then walks the manual keyboard, zoom, screen-reader-name and form checks the tools cannot do, and reports findings with the criterion, evidence, fix and how to verify. Use for accessibility reviews, WCAG checks, contrast questions or "is this accessible".

The English summary is being prepared. Showing the original description.

codewhale-hq/codewhale-plugin-marketplace5Updated Oct 21, 2026

batch

Free

Break a large, parallelizable goal into bounded work units, coordinate existing agent/worktree machinery, integrate, and verify. Explicit-only.

The English summary is being prepared. Showing the original description.

codewhale-hq/codewhale-plugin-marketplace5Updated Oct 21, 2026

Generate a small set of independent candidate solutions in worktrees, judge them against one explicit rubric, and apply the winner only after PASS verification.

The English summary is being prepared. Showing the original description.

codewhale-hq/codewhale-plugin-marketplace5Updated Oct 21, 2026

Read and act on selected Chrome tabs and frames — their real browser, their logged-in sessions. Use for questions about the current page, filling a form the user is on, following a link they mentioned, or checking what a site actually renders. Not for throwaway automation in a clean profile.

The English summary is being prepared. Showing the original description.

codewhale-hq/codewhale-plugin-marketplace5Updated Oct 21, 2026

Deploy or change a Cloudflare Worker with cf. Review config, preflight, build and dry-run; show the target and change, obtain explicit approval, deploy and verify. Covers versions, secrets, rollback and named modes.

The English summary is being prepared. Showing the original description.

codewhale-hq/codewhale-plugin-marketplace5Updated Oct 21, 2026

Look up current Cloudflare documentation (Workers, Pages, KV, R2, D1, Queues, DNS, WAF, platform APIs) through Cloudflare's official remote MCP server. Use when answering Cloudflare questions or writing Cloudflare config.

The English summary is being prepared. Showing the original description.

codewhale-hq/codewhale-plugin-marketplace5Updated Oct 21, 2026

See all skills by codewhale-hq

Report a problem with this skill