본문으로 건너뛰기
cccskills
무료GitHub에 공개

shipping-reproducible-results

Package completed data analysis and ML work so an independent recipient can reproduce the claimed results, verify artifact lineage, and operate the handoff within its stated scope. Use when finalizing a project, study, model package, or review bundle; not for deploying to a live system.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

실행 점수 미검증

설치 방법 보기

포함된 파일(5)

  • SKILL.md5.3 KB
  • agents/openai.yaml265 B
  • assets/reproduction-handoff.md3.2 KB
  • assets/run-manifest.yaml1.4 KB
  • references/reproduction-contract.md4.6 KB

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Shipping Reproducible Results

Ship an evidence-bearing result, not merely code that once ran. The package must connect the approved question to immutable inputs, an executable workflow, generated outputs, validation evidence, and an explicit handoff boundary.

Freeze the result contract

Before packaging, record:

  • the approved question, population, unit of analysis, time window, and exclusions;
  • the exact claims and acceptance criteria being delivered;
  • which outputs are authoritative and which are exploratory;
  • the source snapshot or retrieval contract, including access limitations;
  • the intended execution environment and supported operating scope.

Do not silently expand a validated result from a sample to a population, from retrospective analysis to prospective use, or from one environment to another.

Build the provenance chain

Make each authoritative output traceable through:

source identity -> immutable snapshot or query -> transformation -> configuration
-> code revision -> environment -> model artifact -> evaluation -> published output

Record content hashes for immutable local artifacts and durable identifiers for remote sources. Preserve raw inputs when permitted; otherwise preserve the exact query, retrieval time, schema, row counts, access requirements, and a safe fixture sufficient to test the pipeline.

Separate source data, intermediate artifacts, final outputs, caches, and human edits. Never require a recipient to guess which file is canonical.

Make execution deterministic enough to audit

Provide one documented entry point from a clean state. Pin direct dependencies and runtime versions; record relevant system libraries and hardware. Seed every controllable source of randomness and document remaining nondeterminism rather than promising bitwise equality when the stack cannot provide it.

Packaging does not authorize restricted-data access, material compute, credential use, external transfer, or publication. Verify the relevant authority before those actions. When execution is not authorized or available, prepare the reproducible contract and label the unexecuted stages instead of running them.

Define acceptable reproduction precisely:

  • exact hashes for deterministic artifacts;
  • numeric tolerances for floating-point outputs;
  • statistical or ranking tolerances for nondeterministic training;
  • invariant schemas, row counts, and decision outcomes where values may vary.

Fail loudly on missing inputs, schema drift, stale caches, or incompatible artifacts.

Prove the full path

Run from the documented clean entry point without relying on notebook state, shell history, undeclared credentials, or files outside the package. Verify every material claim with evidence of matching scope.

A green unit test is not proof of complete reproduction. The completion matrix must distinguish:

  • environment creation;
  • input acquisition or verification;
  • preprocessing and feature generation;
  • model loading or training;
  • evaluation and independent validation;
  • report or artifact generation;
  • comparison with the authoritative expected outputs.

If a full rerun is impossible because data, compute, or credentials are unavailable, ship the maximum verifiable subset and mark the unexecuted stages as unproven. Do not call the package fully reproducible.

Handoff to a named owner

Document how to run, verify, interpret, update, and safely retire the result. Include known limitations, prohibited uses, external dependencies, expected costs, credential ownership, failure signals, and escalation contacts. Preserve rejected hypotheses and failed experiments when they affect future maintenance or interpretation.

Use assets/reproduction-handoff.md as the release document and assets/run-manifest.yaml as a machine-readable starting point. For verification levels, lineage requirements, and clean-room acceptance rules, read references/reproduction-contract.md.

Release gate

Release only when the package contains no secrets, unintended or unauthorized private data, machine-specific absolute paths, undeclared dependencies, or ambiguous canonical artifacts. Keep approved restricted artifacts in their authorized secure location and publish only permitted references or sanitized fixtures. External sharing and public release require separate authority. The final status must be one of:

  • reproduced: an independent clean run met the declared acceptance criteria;
  • ready for independent reproduction: the complete package and entry point are prepared, but an independent clean run has not yet been performed;
  • replayable with constraints: the executable path is present but named stages require unavailable access or resources;
  • archival evidence only: outputs and provenance are preserved, but the computation cannot currently be rerun.

State the status prominently. Never upgrade it based on intent or partial checks.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

Audit datasets, joins, labels, and ground truth before analysis or modeling. Use when data meaning, row grain, time semantics, source-of-truth reliability, or label construction may invalidate conclusions; not for general model evaluation after the evidence base is already trusted.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

aiopshwang/data-analysis-ml-agent-skills132026년 8월 27일 업데이트

Design leakage-safe machine learning experiments that mirror real deployment and support fair model comparisons. Use when defining prediction timing, feature eligibility, train-validation-test splits, baselines, metrics, or controlled model iterations; not for auditing whether raw labels are trustworthy.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

aiopshwang/data-analysis-ml-agent-skills132026년 8월 27일 업데이트

Isolate the root cause of ML performance drops, inconsistent evaluations, prediction errors, and training-serving mismatches across data, labels, splits, pipelines, models, metrics, and runtime behavior. Use when investigating a reproducible failure or regression, not routine model selection or general performance validation.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

aiopshwang/data-analysis-ml-agent-skills132026년 8월 27일 업데이트

Orchestrate an end-to-end data analysis or machine learning project from decision framing through reproducible handoff. Use when a request spans multiple lifecycle stages or an ambiguous modeling request must become a decision-ready result; use narrower audit or experiment-design skills for isolated reviews.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

aiopshwang/data-analysis-ml-agent-skills132026년 8월 27일 업데이트

Route data analysis and machine learning work to the right skill in this suite. Use when starting any analysis, modeling, validation, or reproducibility task and the matching specialized skill is not yet clear; not needed when one specific skill already clearly applies.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

aiopshwang/data-analysis-ml-agent-skills132026년 8월 27일 업데이트

Validate trained models and analytical claims against their intended decision, independent evidence, and human-reviewed ground truth. Use when reviewing model performance, analysis conclusions, launch claims, or evaluation reports; use failure diagnosis instead when the main task is locating a known defect.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

aiopshwang/data-analysis-ml-agent-skills132026년 8월 27일 업데이트

aiopshwang의 스킬 모두 보기

이 스킬의 문제 신고