api
免费Use crawlberg api reference documentation.
中文简介正在准备中。当前显示原文说明。
Use crawlberg mcp reference documentation.
中文简介正在准备中。当前显示原文说明。
实测评分 未实测
查看安装方法安装前可以查看交给 AI 代理的指令内容。
Use this skill when integrating crawlberg through Model Context Protocol tools, prompts, or resources.
batch_crawl: Crawl multiple seed URLs concurrently. Returns crawl results for all seeds.batch_scrape: Scrape multiple URLs concurrently. Returns results for all URLs.crawl: Crawl a website following links. Returns content for all discovered pages up to max_depth/max_pages.download: Download a document from a URL. Returns metadata about the downloaded file.generate_citations: Convert markdown links into numbered citations with an appended reference list.get_version: Get the current crawlberg library version.interact: Execute browser actions on a page. Actions may mutate page or application state.map: Discover all pages on a website via links and sitemaps. Returns a list of discovered URLs.scrape: Scrape a single URL and extract content as markdown or JSON. Returns page content, metadata, links, and images.还没有评价。欢迎分享你的使用感受。
无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。
还没有评论。来写第一条吧。
Use crawlberg api reference documentation.
中文简介正在准备中。当前显示原文说明。
Use crawlberg cli reference documentation.
中文简介正在准备中。当前显示原文说明。
Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.
中文简介正在准备中。当前显示原文说明。
Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `crawlberg interact URL --actions` with the real action schema, result shape, limits, and external-CDP options.
中文简介正在准备中。当前显示原文说明。
Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `crawlberg crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.
中文简介正在准备中。当前显示原文说明。
Use when a static fetch returns nothing useful and the page needs a real browser. Covers `--browser-mode auto|always|never`, external CDP via `--browser-endpoint`, symptoms of JS-only pages and WAF blocks, and the performance cost.
中文简介正在准备中。当前显示原文说明。