본문으로 건너뛰기
cccskills
무료GitHub에 공개

senpai-tool-telemetry

Audit recent tool use across local Senpai OpenHands root and recursively delegated conversations without exposing tool arguments. Use for provider comparisons, tool-loop diagnosis, status-poll analysis, error rates, and latency reports.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

설치 방법 보기

포함된 파일(2)

  • SKILL.md2.8 KB
  • .senpai-developer-only111 B

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Senpai tool telemetry

Use this developer-only skill when inspecting a copied or mounted Senpai OpenHands state tree. It is deliberately excluded from the skills installed into advisor and student runtimes.

Run the read-only analyzer from the Senpai repository:

uv run python tools/senpai_tool_telemetry.py \
  /path/to/openhands_state \
  --hours 12 \
  --naive-timezone UTC \
  --json /tmp/senpai-tool-telemetry.json

Pass multiple state roots to compare deployments in one report. The command recursively discovers root and delegated-child events/ directories. It prints a compact table and writes structured JSON containing per source/root-or-child-depth/role/model/tool calls, successes, errors, pending calls, retained tool latency, explicit status-check volume, and identical-call repetition signals.

OpenHands SDK v1.40 event timestamps may be naive local wall time. Give the capture host's actual timezone with --naive-timezone, using an IANA name, UTC, or a fixed offset such as +02:00. For copied roots from different hosts, add a repeatable override such as --source-timezone /path/to/cedar=+02:00. A naive timestamp without a matching default or source override fails clearly; the analyzer never guesses UTC or the machine running the report. Explicit offsets embedded in an event are preserved regardless of these options.

Tool arguments are never included in the report. The analyzer creates a short-lived in-memory fingerprint only to identify repeated identical calls. Do not copy raw event bodies into a report merely to recover arguments.

Interpret the output carefully:

  • get_training_status and get_job_status counts are model-issued tool calls. They do not include cheap controller-internal monitor polls.
  • Latency is action-to-observation wall time when both timestamps survived.
  • Model attribution comes from each conversation's current base_state.json. If a conversation changed models in place, older calls cannot be attributed more precisely from the event store alone.
  • A pending call has no matching persisted observation. It may be genuinely active or evidence of an interrupted turn.
  • A rapid repeat means the same conversation called the same tool with the same arguments inside the configured repetition window. It is a diagnostic signal, not automatically a bug.

Report evidence before recommendations. Separate provider behavior from runtime failures such as dead terminal sessions, missing observations, or schema errors.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

Look up any arxiv paper on alphaxiv.org to get a structured AI-generated overview. This is faster and more reliable than trying to read a raw PDF.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

wandb/senpai372026년 10월 17일 업데이트

Operator-side analysis of historical ML experiment PRs in Senpai research tracks. Use this skill whenever the user asks to: analyze experiments, categorize PRs, bucket experiments, summarize what's been tried, understand experiment history, review merged vs closed results, or asks "what experiments have we run / worked / failed". Also triggers for: "pull the latest experiments", "what's been tried so far", "category breakdown of PRs", "which experiments succeeded", "noam track analysis". When a branch name is mentioned (e.g. "noam branch", "on the noam branch"), pass it as the base branch to scope the fetch to just those PRs.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

wandb/senpai372026년 10월 17일 업데이트

Create a typed assignment branch and draft PR for one student. Use when the advisor has a concrete hypothesis and the student has no open `status:wip` or `status:review` assignment.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

wandb/senpai372026년 10월 17일 업데이트

Create or improve a Senpai target repository's program.md. Use this skill whenever the user wants to point Senpai at a fresh ML or research target repository, define the research objective, primary metric, benchmark contract, allowed edit boundaries, W&B reporting contract, or prepare a repo for autonomous advisor/student experiment loops.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

wandb/senpai372026년 10월 17일 업데이트

Open GitHub Issues for human input and respond to the researcher team. Use this skill whenever you need to handle a human_issue event, respond to human issues, ask humans a question, or check team communications. Also triggers for: "any human messages?", "check issues", "respond to humans".

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

wandb/senpai372026년 10월 17일 업데이트

Choose, configure, launch, and collect bounded subagents for research and engineering decisions. Root agents and delegation-capable subagents should read this before delegating: every task requires an explicit model tier, and high-leverage work such as research ideation, round planning, plateau pivots, large research reviews, hard optimization, disputed evidence, and expensive experiment portfolios requires frontier judgment.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

wandb/senpai372026년 10월 17일 업데이트

wandb의 스킬 모두 보기

이 스킬의 문제 신고