跳到正文
cccskills
免费在 GitHub 公开

cli

Use crawlberg cli reference documentation.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg星标 192(GitHub 192 + cccskills 0)

实测评分 未实测

查看安装方法

包含的文件（1）

  • SKILL.md1.2 KB

SKILL.md（原文）

安装前可以查看交给 AI 代理的指令内容。

<!-- This file is auto-generated by alef — DO NOT EDIT. --> <!-- alef:hash:f2e8727dee99aaf87518323d10c36cd54bf3147354fe5c3f04fcaa2dc9994415 --> <!-- To regenerate: alef docs --> <!-- To verify freshness: alef verify -->

crawlberg CLI Reference

Use this skill when invoking, documenting, or changing the crawlberg command-line interface.

  • crawlberg: High-performance web crawler and scraper
    • crawlberg batch-crawl: Crawl multiple websites concurrently
    • crawlberg batch-scrape: Scrape multiple URLs concurrently
    • crawlberg citations: Convert markdown links into numbered citations
    • crawlberg crawl: Crawl a website following links
    • crawlberg download: Download a document from a URL and report its metadata
    • crawlberg interact: Execute browser actions on a single page
    • crawlberg map: Discover all URLs on a website via sitemaps and link extraction
    • crawlberg mcp: Start the MCP server (stdio transport by default).
    • crawlberg scrape: Scrape a single URL and extract metadata
    • crawlberg serve: Start the REST API server.
    • crawlberg version: Print the crawlberg version as JSON

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问，或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护，适用 Google 的隐私权政策和服务条款。

同一仓库的技能

api

免费

Use crawlberg api reference documentation.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg1922026年10月26日 更新

crawlberg

免费

Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg1922026年10月26日 更新

crawlberg-automating-the-browser

免费

Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `crawlberg interact URL --actions` with the real action schema, result shape, limits, and external-CDP options.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg1922026年10月26日 更新

crawlberg-crawling-a-site

免费

Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `crawlberg crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg1922026年10月26日 更新

crawlberg-headless-fallback

免费

Use when a static fetch returns nothing useful and the page needs a real browser. Covers `--browser-mode auto|always|never`, external CDP via `--browser-endpoint`, symptoms of JS-only pages and WAF blocks, and the performance cost.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg1922026年10月26日 更新

crawlberg-mapping-urls

免费

Use when the user wants the list of URLs on a site rather than the page content — sitemap analysis, link planning, or seeding another tool. Covers `crawlberg map URL` with `--limit`, `--search`, robots, output, and how it differs from a full crawl.

中文简介正在准备中。当前显示原文说明。

xberg-io/crawlberg1922026年10月26日 更新

查看 xberg-io 的全部技能

报告此技能的问题