본문으로 건너뛰기
cccskills
무료GitHub에 공개

audit-documentation-drift

Audit documentation claims against implementation and authoritative repository evidence. Use when checking whether README, architecture, configuration, API, usage, or feature documentation is stale, incomplete, contradicted by code, missing implemented behavior, or inconsistent with a normative contract.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

설치 방법 보기

포함된 파일(3)

  • SKILL.md6.2 KB
  • evals/evals.json1.6 KB
  • SKILL-GOALS.md554 B

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

Audit Documentation Drift

Determine whether documentation still describes the system it governs. Treat drift as claim conformance: identify a documentation claim, identify the authoritative evidence governing or implementing it, compare them in the applicable revision/scope, and report only demonstrated disconnects.

Inputs and operating mode

Resolve the audited project/component, documentation surface, revision/branch, and material environment variants from the request. Ask only for missing scope that could change the audit result.

Audit read-only. Do not repair documentation or implementation unless a separate instruction explicitly requests repair after the audit.

Resolve scope and authority

  1. Discover only documentation and implementation artifacts capable of establishing the requested claims. Do not inventory every file merely because it exists.
  2. Distinguish artifact roles:
    • normative/contract documentation — specifies intended behavior;
    • descriptive documentation — describes current implementation;
    • planning/history — records proposed or past behavior;
    • generated/derived documentation — inherits from a source/generator contract;
    • implementation/tests/configuration — observed behavior evidence, not automatically intent.
  3. Record unresolved authority instead of assuming code always wins. An unambiguous normative requirement contradicted by implementation is implementation nonconformance, not documentation drift.

Extract testable claims

Extract claims whose truth can materially affect a user or maintainer:

  • supported features and public behavior;
  • commands, arguments, APIs, configuration keys/defaults and environment variables;
  • architecture responsibilities and data flows;
  • setup/operational procedures;
  • compatibility/version/platform statements;
  • executable examples.

For CLI/config-heavy systems, inspect the framework actually used (for example Typer/Click decorators, parser/schema definitions, Pydantic models, constants) rather than relying on language-specific grep recipes.

Ignore private/internal symbols unless the documentation's established purpose requires exposing them.

Compare claims with evidence

For each material claim:

  1. Record the documentation source and scope.
  2. Identify what evidence would support or falsify it.
  3. Inspect the strongest practical implementation/contract evidence.
  4. Execute a safe focused check when static evidence cannot distinguish possibilities.
  5. Use git history only when chronology, regression origin, or stale-revision explanation can change or locate the finding.
  6. Separate OBSERVED evidence from DERIVED conclusions.

Do not infer drift because code changed in commits that did not touch documentation. A drift window exists only when a documented claim demonstrably became false or incomplete.

Classify demonstrated disconnects

  • DOCUMENTED_NOT_IMPLEMENTED — descriptive docs claim behavior the audited implementation does not provide.
  • IMPLEMENTED_NOT_DOCUMENTED — public/user-relevant implemented behavior is absent from documentation whose established scope should cover it.
  • OUTDATED — documentation describes an older observed behavior rather than the audited revision.
  • MISMATCHED_DETAIL — docs and implementation disagree on a material parameter, name, default, path, sequence, or constraint.
  • IMPLEMENTATION_NONCONFORMANCE — authoritative normative documentation is unambiguous and implementation violates it.
  • UNCERTAIN — evidence, authority, scope, or environment cannot resolve the claim.

Evidence contract

Each finding records:

  • documentation claim and precise location;
  • implementation/contract evidence and precise location;
  • audited revision or commit when material;
  • classification;
  • concrete consequence;
  • correction surface: documentation, implementation, generator/source, or authority decision;
  • confidence/evidence gap where unresolved.

Use line numbers when stable and useful. Use commit SHAs when revision identity or chronology matters. Quote only enough source text to establish the discrepancy.

Prioritize by consequence

Do not map category mechanically to severity. Assess the specific consequence:

  • safety/security/data-loss or incompatible public contract;
  • commands/config/API guidance causing failed or incorrect execution;
  • architecture/operational guidance capable of producing materially wrong changes;
  • discoverability gaps for user-relevant capabilities;
  • minor descriptive inconsistency.

State why the consequence earns its priority.

Report structure

Produce:

# Documentation Drift Audit Report

## Scope
- Project/component:
- Revision:
- Environments/variants:
- Documentation inspected:
- Implementation/contract evidence inspected:

## Findings
### <finding>
- Classification:
- Consequence:
- Documentation:
- Evidence:
- Analysis:
- Correction surface:

## Unresolved Coverage / Evidence
<items that prevent a stronger conclusion>

## Optional Timeline
<include only when chronology materially explains or locates drift>

Counts may summarize demonstrated findings but are not a quality score.

Boundaries

  • Do not assume project structure, documentation scope, or authority without evidence.
  • Do not treat planning/TODO material as current implementation claims.
  • Do not treat tests as infallible intent.
  • Do not report generated-file drift without resolving the source/generator relationship.
  • Do not manufacture undocumented-feature findings from private implementation details.
  • Do not run broad git archaeology when current-state comparison resolves the question.
  • Do not make a correction recommendation without identifying which authoritative surface is wrong or unresolved.
  • Leave persistence, artifact registration, orchestration status, and caller-specific return envelopes to the caller; they are not part of documentation-drift analysis.

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

댓글

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

보내면 바로 공개됩니다. 이메일 주소나 전화번호 같은 개인 정보는 쓰지 마세요. URL은 2개까지입니다.

0 / 1,000자

이 양식은 reCAPTCHA로 보호되며 Google 개인정보처리방침 및 서비스 약관이 적용됩니다.

같은 저장소의 스킬

Add automated documentation updater to any Claude skill. Creates a Python sync script that downloads upstream docs, processes markdown for AI consumption, and maintains local cache with configurable refresh. Collects template variables, then delegates implementation through 5-phase workflow. Use when adding auto-updating reference documentation to plugins or skills.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Jamie-BitFlight/claude_skills672026년 10월 20일 업데이트

SAM-style feature initiation workflow — discovery through codebase analysis, architecture spec, task decomposition, validation, and context manifest. Use when a user asks to add a feature, plan a feature, or convert an idea into an executable SAM plan.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Jamie-BitFlight/claude_skills672026년 10월 20일 업데이트

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a button", "take a screenshot", "scrape data from a page", "test this web app", "login to a site", "automate browser actions", or any task requiring programmatic web interaction.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Jamie-BitFlight/claude_skills672026년 10월 20일 업데이트

Browser automation for AI agents using the agent-browser CLI and Playwright. Use when navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, logging into sites, or automating any browser task. Triggers on "open a website", "fill out a form", "click a button", "scrape data", "test this web app", "automate browser actions", or any programmatic web interaction request.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Jamie-BitFlight/claude_skills672026년 10월 20일 업데이트

Runs the description-drift experiment — spawns all Claude Code agents simultaneously to collect self-reported capabilities, then compares them against static frontmatter descriptions to reveal how reliable orchestrator routing based on descriptions actually is. Use when measuring description drift across the agent fleet, re-running the capability collection experiment, analyzing a specific agent's self-reported capabilities, or auditing whether frontmatter descriptions accurately reflect agent behavior.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Jamie-BitFlight/claude_skills672026년 10월 20일 업데이트

Create or adapt Claude Code agent definitions. Use when creating an agent, changing subagent configuration, selecting agent scope, or designing a specialized delegation role.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

Jamie-BitFlight/claude_skills672026년 10월 20일 업데이트

Jamie-BitFlight의 스킬 모두 보기

이 스킬의 문제 신고