Standard collaboration patterns for all squad agents — worktree awareness, decisions, cross-agent communication
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/waza1.4천2026년 10월 18일 업데이트
무료GitHub에 공개
waza-runner
Run evaluations on Agent Skills to measure their effectiveness. USE FOR: "run skill evals", "evaluate my skill", "test skill quality", "check skill triggers", "skill compliance check", "measure skill performance", "run evals on [skill-name]", "grade skill execution". DO NOT USE FOR: writing skills (use skill-authoring), improving frontmatter (use sensei), or general testing unrelated to skills.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
설치 방법 보기포함된 파일(2)
- SKILL.md2.4 KB
- references/EVAL-SPEC.md3.1 KB
SKILL.md(원문)
설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.
Skill Eval Runner
Evaluate Agent Skills like you evaluate AI Agents
This skill runs evaluations on other skills to measure their effectiveness using the same patterns that power AI agent evaluations.
When to Use
- Running quality evaluations on a skill
- Testing if a skill triggers on correct prompts
- Measuring skill behavior quality
- Generating eval reports for CI/CD
Commands
Run Evals
Run evals on <skill-name>
Initialize Eval Suite
Create evals for <skill-name>
Generate Report
Generate eval report for <skill-name>
Workflow
- Check for Eval Suite: Look for
eval.yamlin the skill directory - Load Tasks: Parse task definitions from
tasks/*.yaml - Execute: Run each task through the configured graders
- Report: Output results in JSON or Markdown format
Metrics Measured
| Metric | Description | Default Threshold |
|---|---|---|
| Task Completion | Did the skill accomplish the goal? | 80% |
| Trigger Accuracy | Was skill invoked on correct prompts? | 90% |
| Behavior Quality | Tool calls, efficiency, reasoning | 70% |
Grader Types
- Code Graders: Deterministic assertions, regex matching
- LLM Graders: Model-as-judge with configurable rubrics
- Human Graders: Manual review workflow
Example Usage
Running Evals
# From CLI
waza run ./my-skill/eval.yaml
# Output to file
waza run ./my-skill/eval.yaml -o results.json
Interpreting Results
{
"summary": {
"pass_rate": 0.85,
"composite_score": 0.82
},
"metrics": {
"task_completion": { "score": 0.9, "passed": true },
"trigger_accuracy": { "score": 0.95, "passed": true }
}
}
References
- Eval Specification - Full eval.yaml schema
- Writing Tasks - Task definition guide
- Grader Reference - Available graders
리뷰
아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.
댓글
로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.
아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.
같은 저장소의 스킬
Prepare and publish a new version of the waza azd extension. USE FOR: "publish extension", "release new version", "bump version", "prepare release", "update changelog", "azd publish", "new release", "version bump", "cut a release". DO NOT USE FOR: running evals (use waza), writing skills (use skill-authoring), CI/CD pipeline changes (edit workflow files directly).
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/waza1.4천2026년 10월 18일 업데이트
Explains code snippets in plain English, breaking down what the code does step by step. Perfect for learning, code reviews, or documentation.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/waza1.4천2026년 10월 18일 업데이트
**UTILITY SKILL** - Explain code snippets, functions, and algorithms in plain language. USE FOR: explain code, what does this code do, break down this function, help me understand this, walk through this algorithm, clarify this logic, explain this snippet, describe what happens here. DO NOT USE FOR: writing new code (use code generation), fixing bugs (use debugging), refactoring (use refactoring skills), code review with action items. INVOKES: file reading tools to access code, language detection for tailored explanations. FOR SINGLE OPERATIONS: If the user just needs to see file contents, use file reading tools directly.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/waza1.4천2026년 10월 18일 업데이트
The complete two-phase Init Mode protocol the Squad coordinator runs when no team exists yet in the current repo. Phase 1 = propose the team (no files created, wait for user confirm). Phase 2 = create .squad/ scaffolding, casting state, .gitattributes for merge drivers, and the always-on built-ins (Scribe, Ralph, Rai, Fact Checker). Loaded on demand when the coordinator detects no .squad/team.md exists.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/waza1.4천2026년 10월 18일 업데이트
Selecting WHO handles work is the Routing table; selecting HOW they handle it (Direct, Lightweight, Standard, Full) is Response Mode. This skill contains the complete decision table, exemplar prompts for each mode, the Lightweight spawn template, and the upgrade rules. Squad coordinator loads this on demand once routing has identified the agent — to pick the right ceremony level for the task.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
microsoft/waza1.4천2026년 10월 18일 업데이트