“eval-plan”的搜索结果

在付费评估前确定通过标准、比较条件、干扰项目和停止规则，先进行零费用演练，再开展三项付费试评，并用支出表为后续实施审批提供依据。

• 支出前确定评估标准
• 进行零费用演练
• 用三项付费试评核查支出

Scope a Claude Managed Agent through six questions about its job, trigger, inputs, actions, success criteria, and recurrence. Produce a validated build sheet with configuration components, deferred features, and an evaluation plan, without requiring an API key.

中文简介正在准备中。当前显示英语简介。

• Turn an agent idea into a concrete build plan
• Define success criteria before implementation
• Separate the initial scope from later integrations

Prepare an AI-SPEC.md design agreement for an AI development phase. The skill coordinates framework selection, documentation and domain research, and evaluation planning so the phase has a defined technical direction and assessment strategy.

中文简介正在准备中。当前显示英语简介。

• Define the design agreement for an AI development phase
• Research frameworks, documentation, and the application domain
• Plan how to evaluate an AI system

Design an evaluation plan for an LLM or AI feature before shipping it. Use when asked how to evaluate a prompt/model/agent, set up an eval harness, define quality metrics for an AI feature, or build a regression gate. Produces an eval plan — task definition, datasets, metrics & rubrics, baselines, automated + human evals, a pass bar, and a regression gate.

中文简介正在准备中。当前显示原文说明。

Builds an eval plan for an AI feature - error analysis on real traces, failure-mode ranking, code checks and binary LLM judges validated against human labels, CI tests, production monitoring, and a launch bar. Use when you ask how do we eval this, how do I test an AI feature, our LLM outputs are inconsistent, are the evals good enough, LLM-as-judge, hallucinations, or what accuracy is good enough to launch. Draws on 41 Lenny's Podcast guests incl. Hamel Husain, Shreya Shankar and Sander Schulhoff.

中文简介正在准备中。当前显示原文说明。