api
FreeUse crawlberg api reference documentation.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192Updated Oct 26, 2026
FreePublished on GitHub
mcp
Use crawlberg mcp reference documentation.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192 stars(GitHub 192 + cccskills 0)
Run score Not tested
See how to installFiles included (1)
- SKILL.md1.3 KB
SKILL.md (original)
Review the instructions the agent will receive before you install.
<!-- This file is auto-generated by alef — DO NOT EDIT. -->
<!-- alef:hash:34de71e606bffc40dbee2c2a91d1e2ab4ff3de3ab689236df9a96abca748dc2b -->
<!-- To regenerate: alef docs -->
<!-- To verify freshness: alef verify -->
crawlberg MCP Reference
Use this skill when integrating crawlberg through Model Context Protocol tools, prompts, or resources.
batch_crawl: Crawl multiple seed URLs concurrently. Returns crawl results for all seeds.batch_scrape: Scrape multiple URLs concurrently. Returns results for all URLs.crawl: Crawl a website following links. Returns content for all discovered pages up to max_depth/max_pages.download: Download a document from a URL. Returns metadata about the downloaded file.generate_citations: Convert markdown links into numbered citations with an appended reference list.get_version: Get the current crawlberg library version.interact: Execute browser actions on a page. Actions may mutate page or application state.map: Discover all pages on a website via links and sitemaps. Returns a list of discovered URLs.scrape: Scrape a single URL and extract content as markdown or JSON. Returns page content, metadata, links, and images.
Reviews
No reviews yet. Tell others what you thought.
Comments
No login needed. Share how it worked for you, ask a question, or note where it did not run.
No comments yet. Be the first to write one.
More skills from this repository
cli
FreeUse crawlberg cli reference documentation.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192Updated Oct 26, 2026
crawlberg
FreeCrawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192Updated Oct 26, 2026
Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `crawlberg interact URL --actions` with the real action schema, result shape, limits, and external-CDP options.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192Updated Oct 26, 2026
Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `crawlberg crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192Updated Oct 26, 2026
Use when a static fetch returns nothing useful and the page needs a real browser. Covers `--browser-mode auto|always|never`, external CDP via `--browser-endpoint`, symptoms of JS-only pages and WAF blocks, and the performance cost.
The English summary is being prepared. Showing the original description.
xberg-io/crawlberg192Updated Oct 26, 2026