본문으로 건너뛰기
cccskills
무료GitHub에 공개

baseline-repro

Internal Harness instruction source for baseline-repro. Route through visible Harness aliases instead of invoking directly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

설치 방법 보기

포함된 파일(3)

  • SKILL.md4.5 KB
  • agents/openai.yaml299 B
  • references/baseline-report.md1.1 KB

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Baseline Repro

References

Read these first:

  • ../../../.agents/references/context-layering-policy.md
  • ../../../.agents/references/contract-gating-rule.md
  • ../../../.agents/references/pre-training-rule.md
  • ../../../.agents/references/run-artifact-contract.md
  • ../../../.agents/references/language-policy.md
  • ../../../.agents/references/documentation-evidence-rule.md
  • ../../../.agents/references/documentation-style.md
  • ./references/baseline-report.md
  • ../../../PROJECT_STATE.json
  • ../../../docs/Refined_Idea.md if it exists
  • ../../../docs/30_evidence/Baseline_Table.md if it exists
  • ../../../docs/10_contract/Evaluation_Contract.md if it exists
  • ../../../docs/10_contract/Baseline_Contract.md if it exists
  • ../../../docs/35_protocol/Research_Protocol.md if it exists

When To Use

Use this skill for WF5 when the user wants baselines reproduced fairly before new method implementation.

Required Work

  1. Read the baseline candidates from docs/Refined_Idea.md, docs/30_evidence/Baseline_Table.md, and project state. For legacy projects, fall back to docs/Technical_Spec.md when no refined idea exists.
  2. Create or refresh the first runnable project environment for the baselines and sync the ## Environment section in CLAUDE.md.
  3. Use docs/Dataset_Stats.md and project context to align data and evaluation conditions.
  4. Resolve baseline inclusion/skipping rules from the approved Baseline Contract when present, and resolve the canonical evaluation protocol from the approved Evaluation Contract when present; otherwise derive drafts from reproduced baseline evidence and persist the tracked metric names for WF10.
  5. Reproduce each requested baseline with minimal environment-specific changes.
  6. Compare reproduced metrics against paper-reported metrics.
  7. Record baseline run artifact bundle paths for reproduced metrics.
  8. Write docs/Baseline_Report.md using the canonical template.
  9. Create or refresh docs/30_evidence/Baseline_Table.md as the human-readable Conclusion Evidence table for baseline repos, papers, configs, reproduced metrics, logs, and skip reasons.
  10. If docs/20_facts/Codebase_Map.md exists, keep it synchronized when baseline directories, scripts, configs, or durable entry points change.
  11. Update:
  • PROJECT_STATE.json baseline metrics
  • PROJECT_STATE.json evaluation protocol or tracked metrics for later WF10 comparison
  • project_map.json baseline status and entry point
  • CLAUDE.md environment facts and baseline reference

Durable Docs Render

Output Rules

  • Keep adaptation notes, training config notes, and reproduced-versus-paper comparison.
  • Include evidence sources for reproduced metrics, commit hashes, configs, and any paper-reported values.
  • Include run artifact bundle paths for reproduced metrics.
  • Keep docs/30_evidence/Baseline_Table.md source-artifact oriented; it is human-readable Conclusion Evidence, not an .evidence/** Evidence Chain.
  • If no approved Baseline or Evaluation Contract exists, write the affected baseline/evaluation protocol as draft/derived and surface the approval gap.
  • WF5 is the first hard approval point for baseline/evaluation contracts in dynamic-context projects. Use protocol drift, context gates, docchain gates, and review packets when approval or explicit draft acceptance is needed.
  • Treat environment creation here as part of the canonical WF5 gate, not as a separate pre-workflow step.
  • Use the canonical pre-training commit rule for baseline code changes.
  • Report a Gate ledger for baseline reproduction, contract readiness, protocol drift, dynamic-context gates, docchain checks, workflow-state checks, and semantic commits. Mark any skipped gate NOT_RUN with the reason.
  • Treat template wording as structure-only; localize headings and narrative text according to ../../../.agents/references/language-policy.md unless a field is explicitly English-only.

Codex Adaptation

  • Treat natural-language requests as the canonical $baseline-repro flow.
  • Preserve the original expectations around faithful reproduction and minimal baseline edits.
  • Use the Codex toolchain, but keep the canonical output files and state updates.

Execution Rule

Follow the local prompt, baseline report template, and language policy instead of simplifying the reproduction stage.

Durable Docs Render

temporary drafts.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

analyze

무료

Convert run artifacts into calibrated interpretation and next decisions.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

linzhe001/Harness-Research872026년 8월 9일 업데이트

Internal Harness instruction source for auto-paper. Route through visible Harness aliases instead of invoking directly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

linzhe001/Harness-Research872026년 8월 9일 업데이트

Internal Harness instruction source for auto-paper-argument. Route through visible Harness aliases instead of invoking directly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

linzhe001/Harness-Research872026년 8월 9일 업데이트

Internal Harness instruction source for auto-paper-citation. Route through visible Harness aliases instead of invoking directly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

linzhe001/Harness-Research872026년 8월 9일 업데이트

Internal Harness instruction source for auto-paper-data. Route through visible Harness aliases instead of invoking directly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

linzhe001/Harness-Research872026년 8월 9일 업데이트

Internal Harness instruction source for auto-paper-figure. Route through visible Harness aliases instead of invoking directly.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

linzhe001/Harness-Research872026년 8월 9일 업데이트

linzhe001의 스킬 모두 보기

이 스킬의 문제 신고