本文へ移動
cccskills
無料GitHub で公開

launch-run

Launch a specific Coval evaluation with explicit cases and execution bounds. Use when resources are already selected; for result analysis use quick-eval.

インストール方法を見る

含まれるファイル(1)

  • SKILL.md2.0 KB

SKILL.md(原文)

インストールする前に、エージェントに与えられる指示の中身を確認できます。

Launch a Coval run

Use quick-eval when installed; it covers planning, bounded execution and the result audit. Do not bypass its session budget when invoked from that workflow. If this skill is installed alone, follow the same minimum launch contract:

  1. Confirm the intended organization, workspace and API environment. Read the agent, persona, exact cases and selected metric definitions. Check command help and errors. Authentication is not proof of tenant identity.
  2. Prepare a structured launch request with explicit options.test_case_ids, iteration count, concurrency, metric IDs and a verified per-call duration limit. Count cases × iterations × (1 + mutation count), per persona, including any prior runs in the session. Concurrency does not reduce total cost.
  3. Show the concrete plan and bounded stopping condition. A request to plan or inspect is not paid-run authority; honor already granted execution authority and ask only when scope/budget must expand. Default to proposing one call for an untested connection, not the entire test set.
  4. Execute coval --agent runs launch --input-json @run.json. Check ok and exit status. Save the returned run ID. If the response is ambiguous, inspect matching runs before retrying; never blindly retry a launch.
  5. Return the run ID and actual observed status. Queued is not completed. Follow the user's requested scope: for a completed evaluation, poll and audit results as in quick-eval; for launch-only, hand back the run without claiming quality.

Use the current runs schema. Do not use /eval/*, invent command flags, add schedules, change agent defaults, or rerun unattended. A local plan is not a server-enforced spending cap.

レビュー

まだレビューはありません。使ってみた感想をお寄せください。

同じリポジトリのスキル

概要と使いどころ

Analyze a Coval accent testing report from runs across different speaker accents. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or metric summary and wants evidence-backed next steps such as prompt changes, STT/confirmation adjustments, accent-robust routing, or expanded accent coverage.

日本語の概要は準備中です。原文の説明を表示しています。

coval-ai/coval-external-skills32026年9月16日 更新

Analyze a Coval adversarial / red-team testing report and turn it into an agent-hardening plan. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or a per-scenario scorecard from an adversarial sweep and wants evidence-backed next steps such as prompt/guardrail changes, refusal hardening, verification fixes, escalation routing, or expanded attack coverage.

日本語の概要は準備中です。原文の説明を表示しています。

coval-ai/coval-external-skills32026年9月16日 更新

Analyze a Coval audio-quality testing report from runs across different voice, speaking-style, volume, interruption, and background-noise scenarios. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or metric summary and wants evidence-backed next steps such as prompt changes, tool handling fixes, STT/TTS adjustments, trace setup, or expanded audio-scenario coverage.

日本語の概要は準備中です。原文の説明を表示しています。

coval-ai/coval-external-skills32026年9月16日 更新

Build or improve a Coval dashboard with metric visualizations backed by real data. Creates new dashboards from scratch or rebuilds existing ones by analyzing usage patterns, metric frequency, and data density. Use when user says "create a dashboard", "build a dashboard", "improve my dashboard", "add widgets", "visualize my metrics", "make a performance dashboard", or "dashboard for my runs".

日本語の概要は準備中です。原文の説明を表示しています。

coval-ai/coval-external-skills32026年9月16日 更新

Build a compact Coval test set from product requirements, observed conversation failures or a coverage gap. Design realistic scenarios with separate expected behaviors, provenance and controlled voice/persona variation.

日本語の概要は準備中です。原文の説明を表示しています。

coval-ai/coval-external-skills32026年9月16日 更新

Select and configure a Coval metric for a concrete product criterion, choosing transcript, audio, trace or deterministic evidence and testing the result. Use for metric creation or scoring design, not for final human calibration.

日本語の概要は準備中です。原文の説明を表示しています。

coval-ai/coval-external-skills32026年9月16日 更新

coval-ai のスキルをすべて見る

このスキルの問題を報告する