跳到正文
cccskills
免费在 GitHub 公开

forecast-experiment

Records hypotheses, evidence and decisions when proposing, running or evaluating forecast experiments, including backtests and feature or model comparisons. Excludes routine tests and unchanged forecast operation.

中文简介正在准备中。当前显示原文说明。

查看安装方法

包含的文件(1)

  • SKILL.md2.0 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Forecast experiments

Read the evaluation contract and point-in-time contract before designing a comparison.

Before execution

Save a proposal with the MLflow experiment record before launching the run. Record:

  • The hypothesis and intended change.
  • Motivating experiment IDs and prior results inspected; use none for the first baseline.
  • The comparison baseline, fixed evaluation dates and metrics, and what result would support the hypothesis.

Use saved artifacts for the proposal and conclusion, and tags for related experiment/run IDs. Link execution runs for folds, variants and retries to the research record; distinguish these from experiments that motivated the idea. If proposing only, save the proposal without launching work.

During execution

Link the exact run manifests for inputs, code, environment, configuration and seeds; do not copy their contents into prose. Retain failed and interrupted attempts with their status. Preserve the original proposal; start a linked experiment when the hypothesis or evaluation protocol changes.

After execution

Append the results, evidence links, limitations, conclusion and next decision: keep, reject or investigate further. Compare against the baseline on matching evaluation rows. Record losses and failures as well as gains. If reviewing an existing run without a prior proposal, mark the rationale as retrospective; do not invent a pre-run hypothesis.

Identify evaluation periods whose results informed experiment choices as development data, not untouched holdouts. Keep experiment history in MLflow; put durable accepted design decisions in the wiki with experiment IDs. Follow this procedure manually when automation is absent.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

gh

免费

Diagnose GitHub CLI hiccups caused by Codex sandbox constraints; not a general GitHub workflow.

中文简介正在准备中。当前显示原文说明。

zoltanmaric/coppersushi692026年10月14日 更新

goldfish

免费

Review a design artifact (spec, plan, PR packet) with fresh, memoryless subagents. Invoke when the user asks — "goldfish this", "fresh eyes", "tear this apart" — or after suggesting it for a spec that has grown load-bearing and the user agrees.

中文简介正在准备中。当前显示原文说明。

zoltanmaric/coppersushi692026年10月14日 更新

grill

免费

Interrogate the user before implementing a non-trivial or ambiguous ask, converging on shared intent. Use when the user says "grill me", when an ask admits multiple interpretations, or before any sizable piece of work whose intent isn't fully clear.

中文简介正在准备中。当前显示原文说明。

zoltanmaric/coppersushi692026年10月14日 更新

Launches and supervises long-running commands — solves, workflows, downloads, builds — detached with a log, PID and exit sentinel, then tells stuck from slow and kills verifiably. Use before running anything that may exceed a minute, for nohup or background launches, and when a run hangs, shows no output, or timed out.

中文简介正在准备中。当前显示原文说明。

zoltanmaric/coppersushi692026年10月14日 更新

llm-wiki

免费

Build and maintain a persistent, LLM-maintained markdown wiki following Andrej Karpathy's LLM Wiki pattern — the agent incrementally compiles raw sources into an interlinked knowledge base instead of re-deriving answers from scratch. Use this whenever the user wants to ingest a source (an article, paper, transcript, chapter, meeting notes), file knowledge or conversation findings into the wiki, query the accumulated knowledge base, lint or health-check the wiki, or mentions "the wiki", "knowledge base", "ingest this", "file this", "what do we know about X", or accumulating notes on a topic over time — even if they don't say "LLM Wiki" explicitly.

中文简介正在准备中。当前显示原文说明。

zoltanmaric/coppersushi692026年10月14日 更新

mermaid

免费

Guides writing and editing Mermaid diagrams in GitHub-rendered Markdown so they remain readable across themes and preserve placeholder labels.

中文简介正在准备中。当前显示原文说明。

zoltanmaric/coppersushi692026年10月14日 更新

查看 zoltanmaric 的全部技能

报告此技能的问题