跳到正文
cccskills
免费在 GitHub 公开

shipping-reproducible-results

Package completed data analysis and ML work so an independent recipient can reproduce the claimed results, verify artifact lineage, and operate the handoff within its stated scope. Use when finalizing a project, study, model package, or review bundle; not for deploying to a live system.

中文简介正在准备中。当前显示原文说明。

实测评分 未实测

查看安装方法

包含的文件(5)

  • SKILL.md5.3 KB
  • agents/openai.yaml265 B
  • assets/reproduction-handoff.md3.2 KB
  • assets/run-manifest.yaml1.4 KB
  • references/reproduction-contract.md4.6 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Shipping Reproducible Results

Ship an evidence-bearing result, not merely code that once ran. The package must connect the approved question to immutable inputs, an executable workflow, generated outputs, validation evidence, and an explicit handoff boundary.

Freeze the result contract

Before packaging, record:

  • the approved question, population, unit of analysis, time window, and exclusions;
  • the exact claims and acceptance criteria being delivered;
  • which outputs are authoritative and which are exploratory;
  • the source snapshot or retrieval contract, including access limitations;
  • the intended execution environment and supported operating scope.

Do not silently expand a validated result from a sample to a population, from retrospective analysis to prospective use, or from one environment to another.

Build the provenance chain

Make each authoritative output traceable through:

source identity -> immutable snapshot or query -> transformation -> configuration
-> code revision -> environment -> model artifact -> evaluation -> published output

Record content hashes for immutable local artifacts and durable identifiers for remote sources. Preserve raw inputs when permitted; otherwise preserve the exact query, retrieval time, schema, row counts, access requirements, and a safe fixture sufficient to test the pipeline.

Separate source data, intermediate artifacts, final outputs, caches, and human edits. Never require a recipient to guess which file is canonical.

Make execution deterministic enough to audit

Provide one documented entry point from a clean state. Pin direct dependencies and runtime versions; record relevant system libraries and hardware. Seed every controllable source of randomness and document remaining nondeterminism rather than promising bitwise equality when the stack cannot provide it.

Packaging does not authorize restricted-data access, material compute, credential use, external transfer, or publication. Verify the relevant authority before those actions. When execution is not authorized or available, prepare the reproducible contract and label the unexecuted stages instead of running them.

Define acceptable reproduction precisely:

  • exact hashes for deterministic artifacts;
  • numeric tolerances for floating-point outputs;
  • statistical or ranking tolerances for nondeterministic training;
  • invariant schemas, row counts, and decision outcomes where values may vary.

Fail loudly on missing inputs, schema drift, stale caches, or incompatible artifacts.

Prove the full path

Run from the documented clean entry point without relying on notebook state, shell history, undeclared credentials, or files outside the package. Verify every material claim with evidence of matching scope.

A green unit test is not proof of complete reproduction. The completion matrix must distinguish:

  • environment creation;
  • input acquisition or verification;
  • preprocessing and feature generation;
  • model loading or training;
  • evaluation and independent validation;
  • report or artifact generation;
  • comparison with the authoritative expected outputs.

If a full rerun is impossible because data, compute, or credentials are unavailable, ship the maximum verifiable subset and mark the unexecuted stages as unproven. Do not call the package fully reproducible.

Handoff to a named owner

Document how to run, verify, interpret, update, and safely retire the result. Include known limitations, prohibited uses, external dependencies, expected costs, credential ownership, failure signals, and escalation contacts. Preserve rejected hypotheses and failed experiments when they affect future maintenance or interpretation.

Use assets/reproduction-handoff.md as the release document and assets/run-manifest.yaml as a machine-readable starting point. For verification levels, lineage requirements, and clean-room acceptance rules, read references/reproduction-contract.md.

Release gate

Release only when the package contains no secrets, unintended or unauthorized private data, machine-specific absolute paths, undeclared dependencies, or ambiguous canonical artifacts. Keep approved restricted artifacts in their authorized secure location and publish only permitted references or sanitized fixtures. External sharing and public release require separate authority. The final status must be one of:

  • reproduced: an independent clean run met the declared acceptance criteria;
  • ready for independent reproduction: the complete package and entry point are prepared, but an independent clean run has not yet been performed;
  • replayable with constraints: the executable path is present but named stages require unavailable access or resources;
  • archival evidence only: outputs and provenance are preserved, but the computation cannot currently be rerun.

State the status prominently. Never upgrade it based on intent or partial checks.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Audit datasets, joins, labels, and ground truth before analysis or modeling. Use when data meaning, row grain, time semantics, source-of-truth reliability, or label construction may invalidate conclusions; not for general model evaluation after the evidence base is already trusted.

中文简介正在准备中。当前显示原文说明。

aiopshwang/data-analysis-ml-agent-skills132026年8月27日 更新

Design leakage-safe machine learning experiments that mirror real deployment and support fair model comparisons. Use when defining prediction timing, feature eligibility, train-validation-test splits, baselines, metrics, or controlled model iterations; not for auditing whether raw labels are trustworthy.

中文简介正在准备中。当前显示原文说明。

aiopshwang/data-analysis-ml-agent-skills132026年8月27日 更新

Isolate the root cause of ML performance drops, inconsistent evaluations, prediction errors, and training-serving mismatches across data, labels, splits, pipelines, models, metrics, and runtime behavior. Use when investigating a reproducible failure or regression, not routine model selection or general performance validation.

中文简介正在准备中。当前显示原文说明。

aiopshwang/data-analysis-ml-agent-skills132026年8月27日 更新

Orchestrate an end-to-end data analysis or machine learning project from decision framing through reproducible handoff. Use when a request spans multiple lifecycle stages or an ambiguous modeling request must become a decision-ready result; use narrower audit or experiment-design skills for isolated reviews.

中文简介正在准备中。当前显示原文说明。

aiopshwang/data-analysis-ml-agent-skills132026年8月27日 更新

Route data analysis and machine learning work to the right skill in this suite. Use when starting any analysis, modeling, validation, or reproducibility task and the matching specialized skill is not yet clear; not needed when one specific skill already clearly applies.

中文简介正在准备中。当前显示原文说明。

aiopshwang/data-analysis-ml-agent-skills132026年8月27日 更新

Validate trained models and analytical claims against their intended decision, independent evidence, and human-reviewed ground truth. Use when reviewing model performance, analysis conclusions, launch claims, or evaluation reports; use failure diagnosis instead when the main task is locating a known defect.

中文简介正在准备中。当前显示原文说明。

aiopshwang/data-analysis-ml-agent-skills132026年8月27日 更新

查看 aiopshwang 的全部技能

报告此技能的问题