跳到正文
cccskills
免费在 GitHub 公开

result-auditor

Validate and scientifically interpret completed research runs, including negative, null, boundary, confounded, failed, and inconclusive outcomes. Use after execution to assess evidence and claim impact; not to edit methods or schedule experiments.

中文简介正在准备中。当前显示原文说明。

实测评分 未实测

查看安装方法

包含的文件(2)

  • SKILL.md3.0 KB
  • agents/openai.yaml214 B

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Result Auditor

Start a fresh isolated context with python tools/context_view.py show --role auditor --experiment E0001 --run-manifest <path> (replace ID/path). The packet supplies complete Card/contract, a verified manifest and raw-source references without planner interpretations, global Claim status or next actions. Do not open full project state or planner chat before the first verdict. Read docs/PROTOCOLS.md, docs/ROLE_HANDOFFS.md and docs/CONTEXT_POLICY.md on a fresh context or changed hash; load docs/METHOD_REALIZATION_PROTOCOL.md for Candidate/refinement results and docs/EVIDENCE_COMPLETION_PROTOCOL.md for post-P0 aggregation. Inspect raw metrics and relevant logs/artifacts; an integrity check or excerpt alone is not scientific review. Fix validity, fairness and verdict before reconciliation. Record reviewed inputs, checks and any isolation exception. Execution failure is not evidence against the hypothesis.

Assign exactly one result type: SUPPORTING, FALSIFYING, BOUNDARY, NULL, CONFOUNDING, IMPLEMENTATION_FAILURE, or INCONCLUSIVE. Produce the structured Diagnosis required by the result schema: validity, convergence, baseline fairness, primary observation, Claim impact, performance/scientific value, confidence, suspected causes, unresolved confounds, failure level and one finite recommended action. Check seed/statistical protocol, data leakage and missing artifacts.

Use F1 only for execution failures and recommend Debug/Tuning. Use F2 for a valid but failed realization and identify implicated design dimensions before recommending refinement. Do not declare F3 in an individual Result Record; the Orchestrator applies the multi-Candidate hypothesis-risk gate after accumulating valid F2 evidence. A NULL result must retain explicit scientific value. Cheap results remain PRELIMINARY_NON_PAPER regardless of Metric.

Related preapproved runs may share one audit invocation, but inspect every manifest and retain separately linked Result Records, failed seeds, negative results and required statistical checks. Write schema-valid records linked to immutable manifests and preserve meaningful outcomes in memory. Recommend a diagnosis or next experiment when useful, but do not change code, method, queue, stage, budget or Claim status directly; the Orchestrator applies decisions. Lack of isolation uses the existing FULL_CONTEXT_EXCEPTION path, never an invented blind verdict.

For Claim-Evidence aggregation, preserve supporting, falsifying, null and boundary findings as references. Assess Directness, Validity, Consistency and Confound Control without averaging them; missing primary evidence, invalid evaluation or unfair baselines are hard failures. Cheap and Tuning results remain outside formal evidence.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Direct a claim-driven research experiment project from post-Idea intake through method realization, prioritized evidence collection, Human Gates, and Evidence Freeze. Use for scientific planning, state transitions, queues, budgets, or recovery; not for running code or independently auditing results.

中文简介正在准备中。当前显示原文说明。

cpt13-g/build-research-evidence452026年10月21日 更新

Implement and execute approved research Experiment, Tuning, or Design Cards with reproducible logs, metrics, environment, and artifacts. Use for bounded coding, debugging, and runs; not for changing claims, priorities, budgets, or the Research Spine.

中文简介正在准备中。当前显示原文说明。

cpt13-g/build-research-evidence452026年10月21日 更新

Audit recent high-relevance papers from a target venue to identify claim-relevant experimental evidence gaps after core P0 results exist. Use for venue completeness and reviewer-risk analysis; not for redefining the research question or running experiments.

中文简介正在准备中。当前显示原文说明。

cpt13-g/build-research-evidence452026年10月21日 更新

查看 cpt13-g 的全部技能

报告此技能的问题