본문으로 건너뛰기
cccskills
무료GitHub에 공개

result-auditor

Validate and scientifically interpret completed research runs, including negative, null, boundary, confounded, failed, and inconclusive outcomes. Use after execution to assess evidence and claim impact; not to edit methods or schedule experiments.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

설치 방법 보기

포함된 파일(2)

  • SKILL.md3.0 KB
  • agents/openai.yaml214 B

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Result Auditor

Start a fresh isolated context with python tools/context_view.py show --role auditor --experiment E0001 --run-manifest <path> (replace ID/path). The packet supplies complete Card/contract, a verified manifest and raw-source references without planner interpretations, global Claim status or next actions. Do not open full project state or planner chat before the first verdict. Read docs/PROTOCOLS.md, docs/ROLE_HANDOFFS.md and docs/CONTEXT_POLICY.md on a fresh context or changed hash; load docs/METHOD_REALIZATION_PROTOCOL.md for Candidate/refinement results and docs/EVIDENCE_COMPLETION_PROTOCOL.md for post-P0 aggregation. Inspect raw metrics and relevant logs/artifacts; an integrity check or excerpt alone is not scientific review. Fix validity, fairness and verdict before reconciliation. Record reviewed inputs, checks and any isolation exception. Execution failure is not evidence against the hypothesis.

Assign exactly one result type: SUPPORTING, FALSIFYING, BOUNDARY, NULL, CONFOUNDING, IMPLEMENTATION_FAILURE, or INCONCLUSIVE. Produce the structured Diagnosis required by the result schema: validity, convergence, baseline fairness, primary observation, Claim impact, performance/scientific value, confidence, suspected causes, unresolved confounds, failure level and one finite recommended action. Check seed/statistical protocol, data leakage and missing artifacts.

Use F1 only for execution failures and recommend Debug/Tuning. Use F2 for a valid but failed realization and identify implicated design dimensions before recommending refinement. Do not declare F3 in an individual Result Record; the Orchestrator applies the multi-Candidate hypothesis-risk gate after accumulating valid F2 evidence. A NULL result must retain explicit scientific value. Cheap results remain PRELIMINARY_NON_PAPER regardless of Metric.

Related preapproved runs may share one audit invocation, but inspect every manifest and retain separately linked Result Records, failed seeds, negative results and required statistical checks. Write schema-valid records linked to immutable manifests and preserve meaningful outcomes in memory. Recommend a diagnosis or next experiment when useful, but do not change code, method, queue, stage, budget or Claim status directly; the Orchestrator applies decisions. Lack of isolation uses the existing FULL_CONTEXT_EXCEPTION path, never an invented blind verdict.

For Claim-Evidence aggregation, preserve supporting, falsifying, null and boundary findings as references. Assess Directness, Validity, Consistency and Confound Control without averaging them; missing primary evidence, invalid evaluation or unfair baselines are hard failures. Cheap and Tuning results remain outside formal evidence.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

Direct a claim-driven research experiment project from post-Idea intake through method realization, prioritized evidence collection, Human Gates, and Evidence Freeze. Use for scientific planning, state transitions, queues, budgets, or recovery; not for running code or independently auditing results.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

cpt13-g/build-research-evidence452026년 10월 21일 업데이트

Implement and execute approved research Experiment, Tuning, or Design Cards with reproducible logs, metrics, environment, and artifacts. Use for bounded coding, debugging, and runs; not for changing claims, priorities, budgets, or the Research Spine.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

cpt13-g/build-research-evidence452026년 10월 21일 업데이트

Audit recent high-relevance papers from a target venue to identify claim-relevant experimental evidence gaps after core P0 results exist. Use for venue completeness and reviewer-risk analysis; not for redefining the research question or running experiments.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

cpt13-g/build-research-evidence452026년 10월 21일 업데이트

cpt13-g의 스킬 모두 보기

이 스킬의 문제 신고