무료GitHub에 공개

abi-wdbx-persistence

WDBX persistence superpower. JSONL snapshots, CRC32-framed WAL, epoch-gated segment checkpoints, recovery, compaction.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi스타 19(GitHub 19 + cccskills 0)

실행 점수 미검증

설치 방법 보기

포함된 파일(1)

SKILL.md8.9 KB

SKILL.md(원문)

설치하기 전에 에이전트에게 전달되는 지시 내용을 확인할 수 있습니다.

WDBX moved out of this repository on 2026-08-22. It now lives in the sibling repo ../wdbx together with abi-compute, abi-foundation, abi-core, and abi-telemetry; abi consumes them by relative path. Source paths below therefore read ../wdbx/crates/.... Run WDBX-only tests from that repo (./tools/cargo.sh test --locked --manifest-path ../wdbx/Cargo.toml --workspace < /dev/null, run from the abi checkout), and abi's gate (./tools/check.sh) from here.

Under the Abbey System Constitution (docs/superpowers/specs/2026-08-22-abbey-system-constitution.md) WDBX is the provenance-aware episodic substrate, not a vector store. Most of the evidence half of its specification is unimplemented; the measured gap list is in docs/superpowers/specs/2026-08-22-wdbx-conformance-gap-analysis.md. Do not describe an episodic capability as Current on the strength of the vector-store features that do exist.

ABI Superpower: WDBX Persistence

Exposes the WDBX durability layer as a superpower. Layered snapshot + WAL + segment design with runtime recovery and compaction.

Actions

init

Initialize a new durable store:

/abi-wdbx-persistence init --path ./data

verify

Cross-check checkpoint integrity, block-chain validity, WAL frame integrity, and merged checkpoint+WAL chain:

/abi-wdbx-persistence verify --path ./data

compact

Retain newest N segment checkpoints, reclaim older ones:

/abi-wdbx-persistence compact --path ./data --keep 5

recover

Show recovery status (latest checkpoint + WAL delta):

/abi-wdbx-persistence recover --path ./data

wal

Inspect WAL frames:

/abi-wdbx-persistence wal --path ./data

segments

List segment checkpoints and epochs:

/abi-wdbx-persistence segments --path ./data

snapshot

Create JSONL snapshot (compatibility mirror):

/abi-wdbx-persistence snapshot --path ./data

Architecture

┌─────────────────────────────────────────────────────────────────┐
│                        WDBX Store                                │
└─────────────────────────────────────────────────────────────────┘
                              │
              ┌───────────────┼───────────────┐
              ▼               ▼               ▼
       ┌─────────────┐ ┌─────────────┐ ┌─────────────┐
       │  WAL        │ │  Segments   │ │  Snapshot   │
       │  (wal)      │ │ (segments)  │ │ (persist)   │
       │             │ │             │ │  (mirror)    │
       │ CRC32 frames│ │ Manifest +  │ │  JSONL +    │
       │ Append-only │ │ epoch files │ │  SHA-256    │
       │ Replay +    │ │ compactRetain│ │  checksum   │
       │ corruption  │ │ Latest-N    │ │             │
       │ detection   │ │             │ │             │
       └─────────────┘ └─────────────┘ └─────────────┘
              │               │               │
              └───────────────┼───────────────┘
                              ▼
                    ┌─────────────────────┐
                    │  Recovery           │
                    │  (recovery +        │
                    │   durable_store)    │
                    │                     │
                    │  1. Load latest     │
                    │     segment epoch   │
                    │  2. Replay WAL      │
                    │     delta forward   │
                    │  3. Checkpoint      │
                    │     runtime mutations
                    └─────────────────────┘

File Formats

WAL (`../wdbx/crates/abi-wdbx/src/wal.rs`)

CRC32-framed append-only records
Supports: putVector, putBlock, putSpatial, putTemporalNode, putTemporalEdge, deleteVector
Replay reconstructs state deterministically (reuses persistence.deserialize)
Corruption detection: flipped-byte CRC rejection, bad-header rejection

Segments (`../wdbx/crates/abi-wdbx/src/segments.rs`)

Manifest: <base>.manifest — lists epoch checkpoints in order
Checkpoints: <base>.seg.<epoch>.jsonl — immutable epoch snapshots
loadLatest() — loads newest epoch
listEpochs() — lists active epochs
reclaimEpochs() — removes old epochs
compactRetainingLatest(keep) — retains newest N checkpoints

Snapshot (`../wdbx/crates/abi-wdbx/src/persistence.rs` + `../wdbx/crates/abi-wdbx/src/persistence.rs`)

Header: # ABI-WDBX v1
Records: minified JSON per record (kv, vector, block, spatial, temporal_node, temporal_edge)
Trailer: # checksum:<sha256-hex> covering record body
Load rejects ChecksumMismatch on tamper/truncation
Checksum-less snapshots loadable (backward compatibility)
Integer field overflow → FieldOutOfRange (no panic)
Vector ID monotonic restore → CorruptVectorId on mismatch
Block timestamp restore → SHA-256 chain reproduces exactly

Recovery Flow (`../wdbx/crates/abi-wdbx/src/wal.rs` + `../wdbx/crates/abi-wdbx/src/durable.rs`)

Load latest segment checkpoint (default runtime baseline)
Replay sidecar WAL delta forward
Checkpoint runtime mutations through segments
Compatibility mirror — monolithic JSONL snapshot still written

CLI commands (wdbx db *) recover WAL-ahead state before read/write:

block insert/get → recover → operate
query → recover → search
db verify → cross-checks WAL replay vs current checkpoint block count

CLI Surface (`abi wdbx db`)

Command	Description
`db init <path>`	Create new segment-backed store
`db verify <path>`	Full integrity check (checkpoint + WAL + block chain)
`db compact <path> [--codec none	pq
`block insert <path> <profile> <metadata>`	Write segment checkpoint + WAL
`block get <path>`	Read latest block
`query <path> [text] [persona]`	Stats, hybrid search, or persona-isolated retrieval

Durability Invariants

Invariant	Enforced By
Append-only WAL	`../wdbx/crates/abi-wdbx/src/wal.rs` single-writer, CRC frames
Checkpoint immutability	`../wdbx/crates/abi-wdbx/src/segments.rs` epoch files never modified
Snapshot integrity	SHA-256 trailer, `ChecksumMismatch` on load
Block chain integrity	SHA-256 link, `verifyBlocks()`
Epoch ordering	Manifest lists epochs sequentially
Vector ID monotonicity	`CorruptVectorId` on restore mismatch
WAL-ahead recovery	`../wdbx/crates/abi-wdbx/src/wal.rs` prefers segment + WAL delta

CLI Access

abi wdbx db init ./data
abi wdbx db verify ./data
abi wdbx db compact ./data 5
abi wdbx block insert ./data abbey '{"note":"test"}'
abi wdbx block get ./data
abi wdbx query ./data "search text" abbey

Build and runtime boundary

abi-wdbx is a normal Rust workspace crate; there is no feat-wdbx switch or FeatureDisabled stub. Persistence is selected at runtime by the requested store path and environment. Tests use scratch paths, ABI_WDBX_PATH=:memory:, or ABI_WDBX_PERSIST=0 and never open the user's live store.

Claim Boundary

Per docs/spec/wdbx-north-star.mdx §3.1 and docs/contracts/external-claims-audit.mdx:

✅ JSONL snapshot + CRC32 WAL + segment checkpoints
✅ Runtime recovery (load epoch + replay WAL)
✅ db verify cross-checks all layers
✅ db compact retains newest N epochs
✅ Compatibility JSONL mirror for tooling
❌ NOT full MVCC visibility (block snapshots + epoch checkpoints only)
❌ NOT cross-process/concurrent checkpoint coordination
❌ NOT at-rest encryption (proposed Phase 4)
❌ NOT signed snapshots (proposed Phase 4)

리뷰

아직 리뷰가 없습니다. 사용해 본 소감을 남겨 주세요.

로그인 없이 쓸 수 있습니다. 사용 후기, 질문, 작동하지 않은 환경 등을 편하게 남겨 주세요.

아직 댓글이 없습니다. 첫 댓글을 남겨 보세요.

같은 저장소의 스킬

abbey-system-prompt

무료

Maintain the Abbey / Aviva / Abi Discord system prompts in the Rust abbey-bot (`src/ask.rs`) and keep the hosted Grok bots (Grok Bot Abbey, Aviva Grok) in step with them. Use when the user says "improve grok bots", "abbey prompt", "persona prompt", "ask.rs", "system prompt", "tip floor", asks to change how Abbey/Aviva/Abi speak on Discord, or after an abbey-bot PR merges and the hosted bot's tip floor needs bumping. Runs as /abbey-system-prompt.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi192026년 10월 27일 업데이트

abi-claims-validator

무료

Validate ABI docs and external collateral against repo evidence and docs/contracts/external-claims-audit.mdx. Use when auditing claims, scanning docs for unsupported QPS/sharding/FHE/AES language, checking one claim before publish, or re-confirming the external-claims audit. Agent procedure only — not a CLI or slash command. Pair with abi-doc-claims-sync when editing docs.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi192026년 10월 27일 업데이트

abi-doc-claims-sync

무료

Synchronize ABI Markdown and docs claims with executable behavior. Use before editing README, AGENTS.md, CLAUDE.md, GEMINI.md, docs/**/*.mdx, walkthroughs, changelogs, or any old ABI Markdown that mentions WDBX, MCP, GPU, clustering, compression, FHE, agents, or benchmarks.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi192026년 10월 27일 업데이트

abi-goal-orchestrator

무료

Plan and execute ABI repo work from the TODO board, roadmap/spec docs, stable Rust 1.99.1 constraints, and validation gates. Use when the user asks to find ABI todos/roadmaps, organize a large implementation from tasks/todo.md, or decide the next safe work slice. Distinct from the goals skill — that skill owns the persistent ledger tasks/goals.md; this skill plans from the active board and north-star specs.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi192026년 10월 27일 업데이트

abi-mcp-transport

무료

Validate ABI MCP JSON-RPC stdio and its custom loopback HTTP compatibility endpoint, including auth, limits, notifications, and shutdown.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi192026년 10월 27일 업데이트

abi-plugin-system

무료

Review ABI's 16 compiled-in plugin fixtures, manifest validation, manual bundled registry, and real CLI/MCP run dispatch without claiming dynamic loading.

한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.

donaldfilimon/abi192026년 10월 27일 업데이트

donaldfilimon의 스킬 모두 보기

이 스킬의 문제 신고

설치

명령으로 설치

npx skills add https://github.com/donaldfilimon/abi --skill abi-wdbx-persistence

터미널에 붙여 넣고 실행합니다(Node.js 필요). Claude Code, Codex 등 설치할 에이전트를 고를 수 있습니다.

에이전트에게 부탁하기

다음 Agent Skill을 설치해 주세요.
https://github.com/donaldfilimon/abi/tree/main/.claude/skills/abi-wdbx-persistence

먼저 SKILL.md와 첨부 파일의 내용을 확인해 수상한 처리(외부 전송, 인증 정보 읽기 등)가 없는지 확인한 뒤 Claude Code는 ~/.claude/skills/abi-wdbx-persistence/, Codex는 ~/.agents/skills/abi-wdbx-persistence/ 에 배치해 주세요.

이 문장을 그대로 Claude Code나 Codex에 보내면 내용을 확인한 뒤 설치해 줍니다.

GitHub에서 소스 보기

저장소: donaldfilimon/abi
스타: 19
포크: 4
카테고리: 기타
라이선스: Apache-2.0
원문 언어: 영어
최종 업데이트: 2026년 10월 27일

스킬은 에이전트를 위한 지시와 스크립트의 묶음입니다. cccskills는 내용의 안전성을 보증하지 않습니다. 설치하기 전에 내용을 확인하세요.

포함된 파일(1)

SKILL.md(원문)

ABI Superpower: WDBX Persistence

Actions

init

verify

compact

recover

wal

segments

snapshot

Architecture

File Formats

WAL (../wdbx/crates/abi-wdbx/src/wal.rs)

Segments (../wdbx/crates/abi-wdbx/src/segments.rs)

Snapshot (../wdbx/crates/abi-wdbx/src/persistence.rs + ../wdbx/crates/abi-wdbx/src/persistence.rs)

Recovery Flow (../wdbx/crates/abi-wdbx/src/wal.rs + ../wdbx/crates/abi-wdbx/src/durable.rs)

CLI Surface (abi wdbx db)

Durability Invariants

CLI Access

Build and runtime boundary

Claim Boundary

리뷰

댓글

같은 저장소의 스킬

abbey-system-prompt

abi-claims-validator

abi-doc-claims-sync

abi-goal-orchestrator

abi-mcp-transport

abi-plugin-system

WAL (`../wdbx/crates/abi-wdbx/src/wal.rs`)

Segments (`../wdbx/crates/abi-wdbx/src/segments.rs`)

Snapshot (`../wdbx/crates/abi-wdbx/src/persistence.rs` + `../wdbx/crates/abi-wdbx/src/persistence.rs`)

Recovery Flow (`../wdbx/crates/abi-wdbx/src/wal.rs` + `../wdbx/crates/abi-wdbx/src/durable.rs`)

CLI Surface (`abi wdbx db`)