Analyze graded `trial_result` JSONL outputs from the eval pipeline, including reliability and custom slicing.
中文简介正在准备中。当前显示原文说明。
查看安装方法安装前可以查看交给 AI 代理的指令内容。
Use this skill for analysis over graded JSONL outputs, typically after:
agent-eval-harness eval '{"mode":"grade",...}' > graded.jsonl
For normal baseline-vs-challenger comparisons, use:
agent-eval-harness eval '{"mode":"compare",...}'
Use custom scripts only when suite-specific analysis is required.
When writing a custom script:
trial_result.pass and score non-null).taskId, trialIndex, runId).exactPassAtK naming for combinatorics-based pass@k metrics (do not label exact values as estimatedPassAtK).Reference helpers remain in references/ for bootstrap/statistics utilities.
还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问，或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
Interview the user relentlessly about a plan or design until reaching shared understanding, resolving each branch of the decision tree. Use when user wants to stress-test a plan, get grilled on their design, or mentions "grill me".
中文简介正在准备中。当前显示原文说明。
Use test-driven development for behavior-changing feature or fix work, and whenever the user mentions TDD, test-first, red-green-refactor, tracer bullets, integration tests, or public-interface behavior tests. Skip for docs-only, path-only rename, formatting-only, or purely mechanical chores unless explicitly requested.
中文简介正在准备中。当前显示原文说明。
Build command-only adapters for `eval` run mode using strict stdin/stdout JSON contracts.
中文简介正在准备中。当前显示原文说明。
End-to-end eval-suite orchestration with the `eval` command: run -> grade -> compare -> calibrate, using strict JSON contracts and schema discovery.
中文简介正在准备中。当前显示原文说明。