A/B test CLAUDE.md instruction changes against eval benchmarks. Capture baselines, test variants, compare results.
中文简介正在准备中。当前显示原文说明。
查看安装方法安装前可以查看交给 AI 代理的指令内容。
Systematically improve Mycelium instructions through measurement. Adapted from n-trax.
baseline -- Capture current performance/mycelium:eval-runner run-split optimization — record as optimization scores/mycelium:eval-runner run-split holdout — record as holdout scores.claude/optimization/baseline.json: timestamp, CLAUDE.md hash, optimization metrics, holdout metrics, overall and per-category metricstest <variant> -- Test a variant.claude/optimization/variants/<variant>.md/mycelium:eval-runner run-split optimization — this is the hill-climbing signal/mycelium:eval-runner run-split holdout — this validates generalization.claude/optimization/results/<variant>.jsonreport -- Compare all variantsGenerate comparison table with split-aware columns:
| Variant | Opt Pass Rate | Holdout Pass Rate | Delta Opt | Delta Holdout | Overfit? | Decision |
Flag Overfit? = YES when optimization delta is positive but holdout delta is negative.
exemplar <eval-name> -- Capture winning trajectoryAfter a clean eval win (1 iteration, fast), save the approach to .claude/optimization/exemplars/.
还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问，或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
Accessibility audit, scoped to the surfaces a product actually has. Detects web / rendered_markdown / terminal / native_app / video_audio / document / headless, then applies only the criteria that bind. WCAG 2.1 AA in full for web; not at all for headless.
中文简介正在准备中。当前显示原文说明。
Bring Mycelium into a project that already has code. Detects that the repo predates the framework, asks before touching anything, then reads the codebase to draft what it CAN establish (delivery, solution shape) and — the actual point — names what it cannot (purpose, strategy, real user evidence). The output is a discovery backlog with a head start, never a filled canvas.
中文简介正在准备中。当前显示原文说明。
Design the smallest viable test to validate or invalidate a critical assumption. Based on Torres's assumption testing framework, organized by Gilad's AFTER model (Assessment → Fact-Finding → Tests → Experiments → Release Results).
中文简介正在准备中。当前显示原文说明。
Use before any research activity or significant decision. Reviews cognitive biases relevant to the current stage.
中文简介正在准备中。当前显示原文说明。
Use to evaluate whether current work aligns with Better Value Sooner Safer Happier. Run at diamond completion and periodically.
中文简介正在准备中。当前显示原文说明。
Lint canvas files for staleness, missing fields, inconsistent evidence types, and orphaned references. Run periodically or before major transitions.
中文简介正在准备中。当前显示原文说明。