Skip to content
cccskills
FreePublished on GitHub

cli

Use crawlberg cli reference documentation.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192 stars(GitHub 192 + cccskills 0)

Run score Not tested

See how to install

Files included (1)

  • SKILL.md1.2 KB

SKILL.md (original)

Review the instructions the agent will receive before you install.

<!-- This file is auto-generated by alef — DO NOT EDIT. --> <!-- alef:hash:f2e8727dee99aaf87518323d10c36cd54bf3147354fe5c3f04fcaa2dc9994415 --> <!-- To regenerate: alef docs --> <!-- To verify freshness: alef verify -->

crawlberg CLI Reference

Use this skill when invoking, documenting, or changing the crawlberg command-line interface.

  • crawlberg: High-performance web crawler and scraper
    • crawlberg batch-crawl: Crawl multiple websites concurrently
    • crawlberg batch-scrape: Scrape multiple URLs concurrently
    • crawlberg citations: Convert markdown links into numbered citations
    • crawlberg crawl: Crawl a website following links
    • crawlberg download: Download a document from a URL and report its metadata
    • crawlberg interact: Execute browser actions on a single page
    • crawlberg map: Discover all URLs on a website via sitemaps and link extraction
    • crawlberg mcp: Start the MCP server (stdio transport by default).
    • crawlberg scrape: Scrape a single URL and extract metadata
    • crawlberg serve: Start the REST API server.
    • crawlberg version: Print the crawlberg version as JSON

Reviews

No reviews yet. Tell others what you thought.

Comments

No login needed. Share how it worked for you, ask a question, or note where it did not run.

No comments yet. Be the first to write one.

Comments are published right away. Do not include personal information such as email addresses or phone numbers. Up to 2 URLs.

0 / 1,000 characters

This form is protected by reCAPTCHA, and the Google Privacy Policy and Terms of Service apply.

More skills from this repository

api

Free

Use crawlberg api reference documentation.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192Updated Oct 26, 2026

crawlberg

Free

Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192Updated Oct 26, 2026

crawlberg-automating-the-browser

Free

Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `crawlberg interact URL --actions` with the real action schema, result shape, limits, and external-CDP options.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192Updated Oct 26, 2026

crawlberg-crawling-a-site

Free

Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `crawlberg crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192Updated Oct 26, 2026

crawlberg-headless-fallback

Free

Use when a static fetch returns nothing useful and the page needs a real browser. Covers `--browser-mode auto|always|never`, external CDP via `--browser-endpoint`, symptoms of JS-only pages and WAF blocks, and the performance cost.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192Updated Oct 26, 2026

crawlberg-mapping-urls

Free

Use when the user wants the list of URLs on a site rather than the page content — sitemap analysis, link planning, or seeding another tool. Covers `crawlberg map URL` with `--limit`, `--search`, robots, output, and how it differs from a full crawl.

The English summary is being prepared. Showing the original description.

xberg-io/crawlberg192Updated Oct 26, 2026

See all skills by xberg-io

Report a problem with this skill