Retrieve and analyze simulation results from a Coval run. Use when user wants to review evaluation outcomes or debug agent behavior.
インストールする前に、エージェントに与えられる指示の中身を確認できます。
Retrieve results for $ARGUMENTS.
List all simulations for the run:
coval simulations list --run-id <run_id> --format json
Get detailed simulation data:
coval simulations get <simulation_id> --format json
This returns:
For each simulation, extract:
| Field | Description |
|---|---|
status | COMPLETED or FAILED |
test_case_id | Which test case was run |
transcript | Full conversation |
has_audio | Whether audio is available |
error_message | Failure reason (if any) |
## Results for Run <run_id>
| Simulation | Status | Test Case | Audio |
|------------|--------|-----------|-------|
| sim_abc123 | COMPLETED | tc_xyz | Yes |
| sim_def456 | FAILED | tc_uvw | No |
### Failed Simulations
- sim_def456: "Connection timeout"
### View Details
`coval simulations get <sim_id>`
### Download Audio
`coval simulations audio <sim_id> -o output.wav`
List simulations with filters:
coval simulations list --run-id <run_id> --filter "status=FAILED"
coval simulations list --run-id <run_id> --filter "has_audio=true"
まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
Analyze a Coval accent testing report from runs across different speaker accents. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or metric summary and wants evidence-backed next steps such as prompt changes, STT/confirmation adjustments, accent-robust routing, or expanded accent coverage.
日本語の概要は準備中です。原文の説明を表示しています。
Analyze a Coval adversarial / red-team testing report and turn it into an agent-hardening plan. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or a per-scenario scorecard from an adversarial sweep and wants evidence-backed next steps such as prompt/guardrail changes, refusal hardening, verification fixes, escalation routing, or expanded attack coverage.
日本語の概要は準備中です。原文の説明を表示しています。
Analyze a Coval audio-quality testing report from runs across different voice, speaking-style, volume, interruption, and background-noise scenarios. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or metric summary and wants evidence-backed next steps such as prompt changes, tool handling fixes, STT/TTS adjustments, trace setup, or expanded audio-scenario coverage.
日本語の概要は準備中です。原文の説明を表示しています。
Build or improve a Coval dashboard with metric visualizations backed by real data. Creates new dashboards from scratch or rebuilds existing ones by analyzing usage patterns, metric frequency, and data density. Use when user says "create a dashboard", "build a dashboard", "improve my dashboard", "add widgets", "visualize my metrics", "make a performance dashboard", or "dashboard for my runs".
日本語の概要は準備中です。原文の説明を表示しています。
Build a compact Coval test set from product requirements, observed conversation failures or a coverage gap. Design realistic scenarios with separate expected behaviors, provenance and controlled voice/persona variation.
日本語の概要は準備中です。原文の説明を表示しています。
Select and configure a Coval metric for a concrete product criterion, choosing transcript, audio, trace or deterministic evidence and testing the result. Use for metric creation or scoring design, not for final human calibration.
日本語の概要は準備中です。原文の説明を表示しています。