Results for “content ingestion”

Re-ingest-correctness SOP for production RAG. Activate when a calling agent builds, reviews, or debugs an ingestion pipeline that runs more than once over a changing corpus — scheduled re-index, incremental updates, CI re-ingest, or a "retrieval has duplicates / shows deleted docs" bug. Encodes the rule — **ingestion must be idempotent: a document's content hash decides insert/update/skip, so re-running over unchanged docs is a no-op** — plus the docstore + doc-hash upsert machinery (LlamaIndex `IngestionPipeline` + `DocstoreStrategy`), the delete-propagation problem, and cross-framework equivalents (LangChain `index()` + `RecordManager`, manual hash table). ENHANCE overlay over [[llamaindex]]: the IngestionPipeline exists in the base skill but the re-ingest-correctness contract is not surfaced.

The English summary is being prepared. Showing the original description.

Prepare readable Markdown from HTTPS article pages using an optional external Defuddle cleaner. The workflow checks URLs, requires network consent and executable review, previews extracted content, and can retain the cleaned source separately from wiki ingestion.

• Extract readable Markdown from a web article
• Prepare a web source for later wiki ingestion
• Save cleaned content with source metadata

Check names, aliases, and existing pages before saving content to a gbrain knowledge store. The skill reads likely matches to identify duplicates, links to existing information, and routes new material to the appropriate ingestion skills.

• Check notes for duplicates before saving
• Resolve different names for the same person or company
• Review files before a bulk import

Import text, files, URLs, repositories, and database content into cognee memory. This skill explains input handling, storage organization, extraction options, and cost estimates, while helping diagnose unsupported arguments and document update errors.

• Importing documents, URLs, or database content
• Organizing stored information by project or topic
• Estimating tokens and cost before importing

Use ManagedCode.MarkItDown when a .NET application needs deterministic document-to-Markdown conversion for ingestion, indexing, summarization, or content-processing workflows. USE FOR: ManagedCode.MarkItDown integration; document ingestion flows; Office or rich-text conversion to Markdown; indexing and summarization pipelines. DO NOT USE FOR: unrelated stacks; generic tasks that do not need this specific guidance. INVOKES: inspect the repository context, edit targeted files, and run relevant build, test, lint, or validation commands when changes are made.

The English summary is being prepared. Showing the original description.

Turn incoming SMS, meeting events, and social mentions into cited pages in GBrain, a knowledge store. The workflow extracts people and other entities, updates timelines, sanitizes content, and preserves failed payloads for retry.

• Save SMS events to a sender’s timeline
• Route completed meetings to meeting ingestion
• Record social mentions with source links

Route articles, meeting notes, videos, documents, and conversations to specialized workflows for saving in GBrain. Preserve sources, add citations, and update related people, companies, concepts, and timelines with links back to the saved material.

• Save an article with its sources and related concepts
• Update attendee pages from meeting notes
• Organize video and podcast transcripts

Collect public posts across a blog, newsletter, or feed archive and save clean Markdown pages for each article. The workflow avoids duplicates, supports resumed runs, repairs empty results, and hands articles to a separate enrichment skill.

• Importing a blog's public article archive
• Organizing public newsletter posts as knowledge pages
• Rerunning a feed import without duplicates

Organize knowledge notes with links that explain their relationships, search saved information, review conflicting claims, and prepare weekly digests. Retrieve earlier work sessions and conversations by topic or date to recover context before continuing a task.

• Find saved knowledge on a topic
• Add source material and update related notes
• Review conflicting claims across notes

Ingest new documents, raw text, folders, or URLs into the Obsidian wiki as distilled, linked knowledge. Use for general wiki ingestion when no more specific ingest skill applies, including processing _raw/ staged content.

The English summary is being prepared. Showing the original description.

Crawl websites (news, blogs, papers, GitHub, product docs, RSS feeds) into a fixed-schema JSONL file, then create a dataset and a searchable application in Viking AI Search. Supports one-time crawl and scheduled recurring crawl with automatic incremental sync.

The English summary is being prepared. Showing the original description.

When you want to extract content from a video — YouTube, Loom, Vimeo, Riverside, Zoom recording, local MP4, X/IG video, anything yt-dlp supports. Three depth modes user picks per invocation — transcript (just words, fast/free), visual (transcript + ffmpeg frame extraction + Claude vision pass on key moments), multimodal (Gemini native video ingestion if $GEMINI_API_KEY set, else dense Claude vision). Uses local Whisper for transcription (MLX-Whisper on Apple Silicon, faster-whisper elsewhere), falls back to platform-provided transcripts when available (Loom, Riverside, YouTube auto-subs). Saves to ~/Documents/videos/<source>-<slug>-<date>/ and optionally captures summary to second-brain raw/ as call-/meeting-/note-. Triggers on "/watch-video <url>," "watch this video," "transcribe this loom," "analyze this video," "summarize this recording," "key moments from this," "what happened in this video." This skill replaces and broadens the prior youtube-transcript skill.

The English summary is being prepared. Showing the original description.

This skill should be used when the user wants to query their Google NotebookLM notebooks for citation-backed, source-grounded answers, or manage notebooks, sources, and Studio content (audio, report, video, infographic, presentation, data table, flashcards, quiz, mind map). It drives the @roomi-fields/notebooklm-mcp engine — via the notebooklm MCP tools when they are available in the session, otherwise via its HTTP REST API — and covers Google login, citation formats, the daily-quota-aware batch/ingestion pattern, and source discovery.

The English summary is being prepared. Showing the original description.

Convert PDF files into Markdown with ComPDF. Use for knowledge-base ingestion, developer documentation, content repurposing, research workflows, or any PDF-to-Markdown request.

The English summary is being prepared. Showing the original description.

Advisory wrap for tool results from untrusted external surfaces. Appends `[QUARANTINE-NOTICE]` to next-turn context after `mcp__*`, `WebFetch`, and `Read` of `**/uploads/**` so prior tool output is treated as data — not directives. Use when the session ingests MCP user-content (Zendesk, Intercom, support tickets), fetched HTML, or operator-uploaded files. Hook fires AFTER ingestion — advisory, not structural.

The English summary is being prepared. Showing the original description.

Use ManagedCode.MarkItDown when a .NET application needs deterministic document-to-Markdown conversion for ingestion, indexing, summarization, or content-processing workflows.

The English summary is being prepared. Showing the original description.

Produces structured markdown session continuation documents for multi-session workflows. Captures active work streams, decisions with rationale, knowledge-file deltas learned during the session, the exact files to load next conversation, ingested content, artifacts, and open items into an ingestion-optimized handoff. Carries pending KF updates and unresolved items forward across handoff chains so context never drops. Generates a closeout checklist and echoes the starter prompt to chat. Use when approaching context limits, wrapping up a session, or managing work across conversations. Trigger on: "create a handoff," "session closeout," "wrap up this session," "build session handoff," "BSH," "continue next session," "we're running out of context," "context is getting long." Do NOT use for Memory optimization, context budget analysis, project audits, deciding whether work is ready for autonomous/Claude Code execution (use rootnode-handoff-trigger-check), or summaries with no continuation intent.

The English summary is being prepared. Showing the original description.