为Paperclip新增或扩展贯穿真实浏览器、服务器、数据库和runner的端到端评估,整理测试数据、判定条件与证据,并在现有报告中查看操作结果。
- 新增完整用户操作流程的评估
- 更新测试数据与判定条件
- 在评估报告中加入截图和产物
从其他智能体近期的工作记录中识别反复出现的问题,为指令、技能或工具说明提出最小改进,附上具体证据、可审阅的差异或草案,并检查新规则是否妨碍过去的成功任务。
Reflect on another agent's recent execution record and propose the smallest durable instruction, skill, or tool-description change. Use for evidence-backed coaching proposals, never hot-swaps.
reflection-coach阅读其他智能体近期的任务和评论,针对反复出现的问题提出最小改进方案。它用具体记录佐证错误的完成判断、返工、依赖过时假设及工具误用等问题,判断应修改AGENTS.md、可复用技能还是工具说明。除文字解释外,还会准备供审阅的差异或技能草案。
适合反复向某个智能体提出相同纠正意见,或希望依据工作记录调整指令时使用。它避免重复已有规则,并考虑新规则是否会妨碍过去已成功完成的任务。单次失败不会被认定为重复问题的趋势。
需要Paperclip API连接信息、认证密钥及指定的目标智能体。不适用于自我评估,也不修改产品代码或共享基础设施。提案和应用不得在同一次运行中完成。展示差异的审批交互获接受后,才能在另一次运行中应用修改。修改量也有上限。
本介绍由 AI(OpenAI Codex)根据公开的 SKILL.md 撰写。准确的规格请查看下方原文。
AI 仅根据 SKILL.md 的内容,从 4 个方面进行了评估。星标数和热度不计入评估。
总分按每项 A=25 分、B=15 分、C=5 分相加。 由 AI(OpenAI Codex)于 2026年10月20日 评估。仅供参考,安装前请同时查看原文。
安装前可以查看交给 AI 代理的指令内容。
You are coaching another agent. You are not that agent. Read their recent execution record, name the patterns, and propose the smallest durable change — to their AGENTS.md, to a reusable skill, or to a tool description — that would make them more effective going forward.
This skill runs on a target agent and produces a reviewable proposal. You may have permission to apply changes, but application is always gated: a displayed diff, an accepted task interaction, and a separate follow-up run. You never propose and apply in the same run.
Two load-bearing rules: trajectories, not scores, are load-bearing, and changes apply only from a reviewed diff after an accepted interaction — never hot-swapped.
recent-agent-reflection) hands you a bounded set of agents to review.Required:
targetAgentId — the agent you are coaching. Never coach yourself.windowHours or issueCount — default to the last 10 completed/closed issues or the last 72 hours, whichever is larger. Cap at 25 issues to stay within budget.Optional:
focus — free-text hint ("verification misses", "late escalations"). Bias clustering toward this axis if given.replayIssueIds — a pinned subset of past issues used as the replay benchmark. If absent, pick 3–5 representative recent issues from the window.Every proposal must satisfy all of these:
AGENTS.md may grow by at most +20% per proposal. Want more? Split proposals.targetAgentId == PAPERCLIP_AGENT_ID, refuse and ask for another coach.curl -sS "$PAPERCLIP_API_URL/api/agents/<targetAgentId>" \
-H "Authorization: Bearer $PAPERCLIP_API_KEY"
Record name, role, reportsTo, adapterType, adapterConfig.instructionsFilePath (where AGENTS.md lives), and current assigned skills via GET /api/agents/<targetAgentId>/skills. Refuse and exit if targetAgentId == $PAPERCLIP_AGENT_ID.
curl -sS "$PAPERCLIP_API_URL/api/companies/$PAPERCLIP_COMPANY_ID/issues?assigneeAgentId=<targetAgentId>&status=done,in_review,blocked&limit=25" \
-H "Authorization: Bearer $PAPERCLIP_API_KEY"
For each issue, pull the trajectory substrate — the issue body and its comments:
curl -sS "$PAPERCLIP_API_URL/api/issues/<issueId>" -H "Authorization: Bearer $PAPERCLIP_API_KEY"
curl -sS "$PAPERCLIP_API_URL/api/issues/<issueId>/comments" -H "Authorization: Bearer $PAPERCLIP_API_KEY"
Keep status transitions, blocker reasons, reviewer comments, approval outcomes, human corrections, and PR-link comments. Comments are the closest thing Paperclip has to an execution trace — treat them as first-class evidence.
Before proposing anything, read what already exists so you don't restate it:
AGENTS.md at adapterConfig.instructionsFilePath.MEMORY.md / memory/ files in their cwd if the adapter uses para-memory-files.If a rule you were about to propose is already present, drop it. A failure pattern despite an existing rule is a different finding — record it as "existing rule X is not being followed" and propose how to make it stick (move to a skill, add a negative example, strengthen the trigger), not a duplicate.
Name each cluster from this taxonomy:
AGENTS.md.For each cluster keep a list of (issueId, commentId, one-line evidence quote) tuples. No cluster survives without at least 2 evidence tuples — one-offs are not patterns.
AGENTS.md update. E.g. "always re-run failing tests before marking in_review."AGENTS.md so the agent knows when to reach for it. Common case for non-obvious procedures.Sanity check reuse honestly: a rule that applies to all coders belongs in a shared skill; a "reusable skill" that only fits one role belongs in that agent's AGENTS.md.
Create a document attached to the reflection issue (never the target's issues). One section per cluster:
## Cluster: <name>
**Pattern (1 sentence, quotable):**
**Root cause hypothesis:**
**Evidence (≥2):**
- [PAP-NNN](/PAP/issues/PAP-NNN) — "<verbatim fragment>"
- [PAP-MMM](/PAP/issues/PAP-MMM) — "<verbatim fragment>"
**Proposed change:**
- Target surface: AGENTS.md | skill:<slug> | both | tool-description:<tool>
- Diff (inline, minimal, ≤20% AGENTS.md growth / ≤15KB skill):
```diff
...
```
**Expected still-passes (replay):**
- [PAP-XXX](/PAP/issues/PAP-XXX), [PAP-YYY](/PAP/issues/PAP-YYY)
**Why this change, not something bigger:**
(1–2 sentences on why you didn't rewrite more.)
SKILL.md (frontmatter → Overview → When to use → Process → Pitfalls → Verification), ≤ 15KB. Put it under drafts/<skill-slug>/SKILL.md and attach it to the reflection issue.AGENTS.md. Do not rewrite the whole file; quote 1–3 lines of context per change. Keep total growth ≤ +20%; split if you can't.For each pinned replay issue, ask: "If this rule had been in effect, would the agent still have succeeded?" Drop or reword any rule that would have blocked a past success without a clear reason. Record the walk in "Expected still-passes." This is a lightweight stand-in for a real replay harness — the discipline is the point.
From a reflection issue (assigned to the target's manager or the requester):
PUT /api/issues/{issueId}/documents/reflection-proposal.skills/<skill-slug>/ (or attach it) and link it in the proposal.request_confirmation, show the diff in payload.detailsMarkdown, set continuationPolicy: wake_assignee_on_accept, and include the exact payload.target.key listed below.Server-enforced mutation target keys:
agent:<agentId>:instructionsagent:<agentId>:profileskill:<skillId>skill-slug:<slug>skill-import:<source>skills:scan-projectsWhen the interaction resolves accepted, apply the change in a separate run:
POST /api/agents/<targetAgentId>/skills/sync with {"mode":"add","desiredSkills":["<skill-ref>"]} when the target should receive it. Use remove only for the named assignments. Use replace only after explicit confirmation to overwrite the complete desired skill set.The server rejects Reflection Coach mutations unless the accepted request_confirmation was created by Reflection Coach in a previous run, has a displayed diff, and is bound to the resource by one of the target keys above. If the interaction was rejected or is still pending, apply nothing. If you were asked to apply without a reviewed diff and an accepted interaction, refuse and name the gate — no-same-run-apply is load-bearing.
AGENTS.md + assigned skills first. An existing-but-unfollowed rule is a "make it stick" proposal, not a restatement.targetAgentId != $PAPERCLIP_AGENT_IDAGENTS.md growth ≤ 20%, skills ≤ 15KB, tool descriptions ≤ 500 chars还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
为Paperclip新增或扩展贯穿真实浏览器、服务器、数据库和runner的端到端评估,整理测试数据、判定条件与证据,并在现有报告中查看操作结果。
为Paperclip Runner添加或扩展行为评估,定义判定条件、执行目标和报告验证数据,利用正常及异常证据验证结果,并保留执行记录与费用。
通过实际浏览器操作网页和应用,检查界面显示与运行情况。结合截图、简单表单填写、错误及网络请求记录,帮助复现问题并确认操作结果。
通过 Paperclip 分配的 AgentMail 收件箱,查看任务关联邮件、发送新邮件或回复,并核查投递结果;重试时保留相同标识,避免重复发送。
检查GitHub、GitLab和Perforce变更中的评审意见、自动检查失败及说明缺漏,整理待办事项,并按请求协助修改和解决已处理的讨论。
根据构想或现有代码仓库,梳理AI智能体的职责、汇报关系与工作交接,生成符合规范的公司或团队文件包,供组织协作和导入Paperclip使用。