Shipping Artifacts: The Docs That Make AI-Built Code Reviewable
Purpose
AI agents write code fast, but they leave no durable record of intent — what the system is supposed to do, who is allowed to do what, where the secrets live, which rules are actually verified. Without that record, no human (and no auditing agent) can tell whether the code is safe to ship. This skill defines the small set of documents that restore reviewability.
These docs are written for two readers: a human reviewer and the next AI coding agent. They are the intended-state half of every later audit — a security or performance review is only as good as the intent it can compare the code against.
Locations and names: the repo's setup wins
Every location, file name and doc-format convention in this plugin is a default. The host repo's own setup comes first. Before writing anything (a system doc, the coverage map, an audit report), look for that setup:
- Agent instructions —
AGENTS.md, CLAUDE.md, and whatever they import or point to. They often name the docs folder, the files in it, who maintains each one, and how dates are recorded.
- A docs location — an existing
docs/, documentation/ or similar folder.
- Existing equivalents — a document that already covers what one of the files below covers, under any name (
ARCHITECTURE.md, docs/security.md, docs/env.md). Match on what it covers, not on its file name.
- An existing test-coverage map — a file that maps behaviour to the tests covering it, such as
docs/test-coverage.md. Match on what it covers: a TESTS.md or testing.md that describes how the repo tests is the testing method, not the coverage map.
- A reports location — wherever the repo already keeps audit or review output.
Then:
- Follow what you find. Write into the repo's docs location, update its existing equivalent instead of creating a parallel file, and keep its naming and date conventions. What each document must contain does not change; only where it lives and what it is called. If its agent instructions say how or by whom a doc is maintained, follow that too.
- Use the plugin's defaults only where the repo has none: docs in
documentation/ at the repo root, the file names below, the coverage map at documentation/tests.md, reports at reports/<name>_{timestamp}.md, and no "updated date" line (the file's history is the source of truth).
- Say which you did. The output names every location and file written, and whether each follows the repo's setup or a plugin default.
- Never create a file whose name differs from an existing one only in letter case —
tests.md beside TESTS.md, Architecture.md beside architecture.md. On Windows and macOS they are the same file, so the write overwrites it; elsewhere they become two files that collide on the next checkout. Check case-insensitively before creating a file. If the existing one covers the same thing, use it. If it covers something else (a TESTS.md that is the testing method, not a coverage map), do not write into it: use the repo's real equivalent, and where there is none, pick a name that collides with nothing.
Throughout this plugin, a name such as architecture.md or tests.md means that document, wherever and under whatever name the repo keeps it.
How the set is organized
The set is not a fixed list — it is a small core plus conditional docs you add only when the capability exists.
- Core docs — every reviewable app has these surfaces, so always produce them.
- Conditional docs — include one only if the app actually has that capability. If it doesn't, write a single line in
architecture.md ("No scheduled work — no cron.md.") rather than inventing an empty document. Reviewability comes from an honest map, and "we don't do X" is part of the map.
- Most docs are reverse-engineered from code by
/document-app. The one exception is tests.md, which is derived from the other docs by /derive-tests — it is the verification map, not a description of a subsystem.
Be brutally honest about the current state without being paranoid. The job is an accurate map, not a clean bill of health. Each doc is short, table-and-bullet heavy, and skips generic theory.
Core documents
Each entry: default file name · one-line purpose · what it must capture · how a reviewer uses it.
-
architecture.md — what the system is and how it hangs together.
- Must capture: product overview + key assumptions; tech stack; how auth/sessions/claims flow end to end; the trust boundaries (e.g. service-role vs. client); a short Known risks / assumptions list (each entry backed by where it shows up in the code, not a generic checklist); a "Related Documents" index of every other doc produced.
- Reviewer use: the root document — everything else is cross-referenced from here.
-
flows.md — the journeys where permissions and side effects are actually exercised.
- Must capture: each load-bearing flow as actor + precondition + success outcome; the step-by-step sequence across UI → server → data → jobs → providers → agents; the authz check at each protected step (which claim/role/scope, on which resource, and the expected deny case); the trust-boundary crossings (browser→server, server→provider, job→app, agent→tool, webhook→app); the state changes and side effects each step causes (writes, emails queued, jobs triggered, outbound calls).
- Reviewer use: the runtime view a static
permissions.md matrix can't show — where and in what order authorization is enforced, and where it can be skipped.
- Anti-PRD rule: a flow that doesn't touch permissions, data integrity, external side effects, money, privacy, or operational safety does not belong here. This is a security/operations map, not a feature spec.
-
permissions.md — who is allowed to do what.
- Must capture: roles/claims; where scope is derived (token vs. DB); a resource × operation × role matrix; which tables have row-level security and which rely on code-enforced checks.
- Reviewer use: the baseline an access-control audit compares the code against.
flows.md shows it in motion; this is the static reference.
-
variables.md — configuration and secrets, mapped to risk.
- Must capture: a table of Name · used-by · scope (server/client) · source · rotation · risk; explicit confirmation that no secret is bundled client-side; a pre-go-live checklist.
- Reviewer use: the secrets/PII-leak surface and the rotation plan during incident response.
-
tests.md — the verification map: which documented rules are actually checked, which are only proposed, and which are checked by nothing.
- Must capture, in three clearly separated sections so the map can't read falsely green:
- Existing coverage — tests that are in the repo today, each tied to the rule it pins (so the map reflects reality, not a wish-list).
- Proposed tests — recommended cases not yet written, marked by test type (automated unit/integration · guarded live · manual review).
- Gaps — documented rules with no verification at all, ranked by what crossing them exposes.
- Each row carries: use-case → rule → expected behavior (including the deny/negative case) → evidence source (doc + code) → status (existing / proposed / none). It also notes which checks the repo's gate requires: under the gate policy the repo states (e.g. a local command plus a human go), or, where it states none, the CI checks that gate merges to
main.
- Reviewer use: the operational form of "documented == implemented" — it shows whether each rule the other docs claim is actually pinned by a test today, only proposed, or unverified.
- Produced by
/derive-tests (not /document-app), because it is derived from the other docs and the existing test suite rather than read off a subsystem.
Conditional documents (include only when the capability exists)
-
emails.md — every notification the system sends. Include only if the app sends transactional or automated email.
- Must capture: the queue → processor → provider path; templates and the variables they accept; retry/backoff behavior; where to look when a send fails.
- Reviewer use: spotting unvalidated template inputs and PII exposure boundaries.
-
cron.md — all scheduled work and how to operate it safely. Include only if scheduled or background jobs exist.
- Must capture: an inventory table (job → schedule → function → secrets → limits → retry); how each job stays idempotent; how internal calls authenticate; where to see last runs.
- Reviewer use: finding forgeable triggers and unbounded background jobs.
-
seo.md — how a single-page app handles SEO and social previews. Include only if there are public/indexable or bot-facing routes.
- Must capture: the preview approach (static meta / prerender / edge HTML); a route → needs-SEO → public-data-only table; how dynamic metadata is sanitized; bot-vs-human routing.
- Reviewer use: catching public-data-only violations and metadata injection on bot routes.
-
automation.md — embedded agents and other automation paths. Include only if the app embeds AI agents, LLM workflows, tool-calling, webhooks, or external automation.
- Must capture, per automation/agent: trigger + owner + whether it runs automatically or only after approval; the inputs it may read and the exact tools/APIs it may call (the tool surface is itself a hard guardrail); where steering lives (the prompt) vs. the non-prompt hard guardrails; the output contract back to the app (schema, validation, failure handling); app-owned side effects vs. agent-owned suggestions; and the controls — approval gates, audit/timeline logging, rate limits, retries, kill switch.
- Reviewer use: makes hidden automation paths visible and draws the line between what an agent proposes and what the app enforces — the highest-risk surface in modern AI-built apps.
Notes
- Each produced doc adds a reference to itself in
architecture.md under a "Related Documents" section (or in the index the repo already keeps for its docs), so the set stays discoverable.
- Skip any conditional document that doesn't apply, and say so in one line rather than inventing content.
- Keep examples and finished templates out of these docs — they describe this system, not the general method.
- The agent operating-context file (
AGENTS.md or CLAUDE.md, whichever the repo's structure makes canonical) is a different artifact — instructions derived from these docs, not system documentation. It is produced at the handoff step by /ship-check, which follows that structure, not here.
tests.md is produced by /derive-tests; the rest are produced by /document-app.
- Keep the repo's date convention. Where it has none, do not include an "updated date" line; the file's history is the source of truth.