跳到正文
cccskills

查找技能

33 个(coval-ai 的仓库) · 按人气排序

Discover failure modes in Coval runs, uploaded conversations or local conversation exports using scoped sampling and transcript, audio and trace evidence. Prepare human review without inventing ground truth or launching new runs.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Analyze a Coval accent testing report from runs across different speaker accents. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or metric summary and wants evidence-backed next steps such as prompt changes, STT/confirmation adjustments, accent-robust routing, or expanded accent coverage.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Launch a specific Coval evaluation with explicit cases and execution bounds. Use when resources are already selected; for result analysis use quick-eval.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Execute a bounded Coval evaluation on explicit test cases, then audit conversation, recording and metric evidence. Use when the user requests a run; does not automatically rerun, tune an agent or schedule evaluations.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Delegate a read-only Coval evaluation, simulation, monitoring, product-how-to, or troubleshooting subtask to Sofia through the official Coval MCP consult_sofia tool. Use when the user needs Coval-specific FDE judgment, analysis of organization data, metric or test-set recommendations, or a diagnosis grounded in Coval runs and conversations.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Build a compact Coval test set from product requirements, observed conversation failures or a coverage gap. Design realistic scenarios with separate expected behaviors, provenance and controlled voice/persona variation.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Configure an AI agent to send OpenTelemetry traces to Coval. Use when a user wants to add Coval tracing, instrument an agent for simulations or conversation monitoring, make traces show up in Coval, handle SIP/PSTN/WebSocket trace correlation, or replace the one-command wizard with a security-reviewable manual setup.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Set up and connect a new Coval agent for evaluation. Guides through agent type selection, endpoint configuration, system prompt, and default resource attachment. Use when user says "set up an agent", "connect my agent", "create an agent", "add an agent", or "configure agent endpoint".

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Validate one Coval judge against independent human labels, with grouped development/test separation, class-specific errors and uncertainty. Use for trust claims or calibration; without real labels, prepare review rather than inventing ground truth.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Compare before/after Coval runs using matched cases, stable metric versions and inspected conversation evidence. Use to assess a regression or proposed improvement; does not automatically launch or tune anything.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Build or improve a Coval dashboard with metric visualizations backed by real data. Creates new dashboards from scratch or rebuilds existing ones by analyzing usage patterns, metric frequency, and data density. Use when user says "create a dashboard", "build a dashboard", "improve my dashboard", "add widgets", "visualize my metrics", "make a performance dashboard", or "dashboard for my runs".

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Analyze development-set disagreements between human annotations and one Coval text LLM judge, then propose a focused prompt revision. Use coval-calibrate-metric for independent trust measurements.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Audit an existing Coval evaluation setup for coverage, misleading scores, missing evidence, judge validation and execution risk. Read-only; use when inheriting an eval or deciding whether its results support a release decision.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Choose the next useful step for evaluating a voice or chat agent with Coval. Use for getting started or deciding what to do next; use a specific skill directly when the task is already clear.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Comprehensive overview of ALL Coval platform resources, their hierarchy, relationships, API endpoints, and ID formats. Use when user asks about Coval resources, data model, how things relate, what endpoints exist, or needs context about the platform structure before making API calls.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Design and create a simulation persona for testing an AI agent. Guides through use case selection, voice and language configuration, behavior prompt crafting, and interruption calibration. Use when user says "create a persona", "design a persona", "set up a test persona", "configure simulation persona", or "build a caller profile".

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Derive a SET of simulation personas for an agent from product artifacts — backend payloads, UI screenshots, journey/product docs, and sample real user messages — instead of designing one persona by hand. Identifies who actually interacts with the agent and how they behave, then creates the personas via the CLI. Best for text/chat agents and for new agents with no interaction history. Use when the user says "make personas from these screenshots/payloads", "who are my users", "create a set of personas", "derive personas from my product", "build a persona library", or "I have backend data, turn it into personas".

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Analyze a Coval audio-quality testing report from runs across different voice, speaking-style, volume, interruption, and background-noise scenarios. Use when a user provides a Coval report URL, report export, run IDs, screenshots, or metric summary and wants evidence-backed next steps such as prompt changes, tool handling fixes, STT/TTS adjustments, trace setup, or expanded audio-scenario coverage.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

End-to-end Coval accent testing workflow. Creates one persona per accent (each using a distinct accent voice and mirroring your Standard Customer behavior), launches one run per accent against the same voice agent + test set + metrics, polls for completion, builds a per-persona comparison table from the results, and creates the saved multi-run report (grouped by Persona) via the public API. Use when a user wants to follow the Testing Across Accents cookbook (https://docs.coval.dev/guides/testing-across-accents) without doing each step by hand.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

End-to-end Coval adversarial / red-team testing workflow. Builds one adversarial test set (12 core attack vectors plus legitimate controls, each with an expected-behavior checklist), creates a persistent "Adversarial User" persona and a Composite Evaluation metric that scores each scenario against its own expected behaviors, launches a multi-iteration run against the agent (voice or chat), polls for completion, builds a per-scenario pass/fail scorecard, and creates a saved report grouped by Test Case. Use when a user wants to follow the Adversarial & Red-Team Testing cookbook (https://docs.coval.dev/guides/adversarial-red-team-testing) without doing each step by hand. Triggers: "adversarial test set", "red team my agent", "jailbreak / prompt-injection testing", "test my agent against bad actors".

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

End-to-end Coval audio-quality testing workflow. Launches one run per audio-robustness scenario against the same voice agent + test set + metrics, polls for completion, and produces the multi-run report URL grouped by Persona. Use when a user wants to follow the Testing Across Audio Qualities cookbook (https://docs.coval.dev/guides/testing-across-audio-qualities) without doing each step by hand.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

watch-run

免费

Monitor a Coval run's progress with live updates. Use when user wants to check run status or wait for completion.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Download audio recordings from Coval voice simulations. Use when user wants to listen to or analyze call recordings.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新

Retrieve and analyze simulation results from a Coval run. Use when user wants to review evaluation outcomes or debug agent behavior.

中文简介正在准备中。当前显示原文说明。

coval-ai/coval-external-skills32026年9月16日 更新