跳到正文
cccskills
免费在 GitHub 公开

web-search-scraper-api-skill

Extract a webpage’s content from its URL and convert it to Markdown, a plain-text format that preserves document structure. Use it to collect articles, blog posts, tutorials, or documentation for reading and further processing.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should proactively apply this skill when users express needs like extract complete markdown from a specific website, scrape the content of an article link, get the text from a target url, convert a webpage to markdown format, fetch the main content of a blog post, extract data from a given web page, parse the html of a website into markdown, download the readable text from a news article, obtain the content of a tutorial page, extract all the markdown text from any http or https url, scrape documentation from a web link, or grab the text of a single webpage.

查看安装方法

适用场景

  • Extract the text of a news article
  • Convert a blog post to Markdown
  • Collect documentation for offline reading
  • Retrieve page text to check for updates

包含的文件(2)

  • SKILL.md5.1 KB
  • scripts/web_search_scraper_api.py3.8 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Web Search Scraper API Skill

📖 Introduction

This skill provides users with a one-stop web page extraction service through the BrowserAct Web Search Scraper API template. It can directly extract structured markdown content from any given URL. By simply inputting the target URL, you can get clean and usable markdown data.

✨ Features

  1. No hallucinations, ensuring stable and precise data extraction: Pre-set workflows avoid AI generative hallucinations.
  2. No human-machine verification issues: No need to deal with reCAPTCHA or other verification challenges.
  3. No IP access restrictions or geofencing: No need to handle regional IP limitations.
  4. More agile execution speed: Compared to purely AI-driven browser automation solutions, task execution is faster.
  5. Extremely high cost-effectiveness: Compared to AI solutions that consume a lot of Tokens, it can significantly reduce the cost of data acquisition.

🔑 API Key Guidance Process

Before running, you must check the BROWSERACT_API_KEY environment variable. If it is not set, do not take other actions first; you should ask and wait for the user to provide it cooperatively. The Agent must inform the user at this time:

"Since you have not configured the BrowserAct API Key, please go to the BrowserAct Console first to get your Key."

🛠️ Input Parameters Details

Agent should flexibly configure the following parameters based on user needs when calling the script:

  1. target_url
    • Type: string
    • Description: The website URL to extract content from. Supports any HTTP/HTTPS URL.
    • Example: https://www.browseract.com

🚀 Invocation Method (Recommended)

Agent should execute the following independent script to achieve "one command gets the result":

# Example invocation
python -u ./scripts/web_search_scraper_api.py "target_url"

⏳ Execution Status Monitoring

Since the task involves automated browser operations, it may take a long time (several minutes). The script will continuously output status logs with timestamps (e.g., [14:30:05] Task Status: running) while running. Notice for Agent:

  • While waiting for the script to return results, please keep paying attention to the terminal output.
  • As long as the terminal is still outputting new status logs, it means the task is running normally. Do not misjudge it as a deadlock or unresponsiveness.
  • If the status remains unchanged for a long time or the script stops outputting and no result is returned, the retry mechanism can be triggered.

📊 Data Output Description

Upon successful execution, the script will directly parse and print the result from the API response. The result contains:

  • content: The complete markdown content of the webpage.

⚠️ Error Handling & Retry Mechanism

During the execution of the script, if an error occurs (such as network fluctuation or task failure), the Agent should follow this logic:

  1. Check the output content:

    • If the output contains "Invalid authorization", it means the API Key is invalid or expired. At this time, do not retry, and you should guide the user to recheck and provide the correct API Key.
    • If the output does not contain "Invalid authorization" but the task execution fails (for example, the output starts with Error: or the returned result is empty), the Agent should automatically try to re-execute the script once.
  2. Retry limit:

    • Automatic retry is limited to once. If the second attempt still fails, stop retrying and report the specific error message to the user.

🌟 Typical Use Cases

  1. Article Extraction: Scrape the main content of a news article link into markdown.
  2. Blog Post Parsing: Download the readable text from a target blog post URL.
  3. Webpage to Markdown: Convert any given website URL into clean markdown format.
  4. Documentation Scraping: Fetch the contents of a tutorial or documentation page for offline reading.
  5. Content Monitoring: Automatically extract the text from a specific webpage for updates.
  6. Data Processing: Parse the HTML of an arbitrary HTTP/HTTPS URL to structure its content.

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

Extract wholesale product details from 1688.com, including quantity-based prices, product variants with dimensions and weight, seller information, shop scores, promotions, and review summaries. Organize these details to compare sourcing options and supplier metrics.

中文简介正在准备中。当前显示英语简介。

  • Compare wholesale prices by order quantity
  • Check dimensions and weight for product variants
  • Compare supplier scores and repeat purchase rates
browser-act/skills62062026年8月24日 更新

Fetches complete Airbnb listing details for a given numeric listing ID via the internal GraphQL API, returning title, room type, description, amenities, photos, coordinates, city, house rules, highlights, ratings, review count, bedroom configuration, and property overview. Use when user mentions Airbnb listing details, Airbnb property info, Airbnb room details, get Airbnb listing data, Airbnb amenities list, Airbnb house rules, Airbnb property description, Airbnb detail page scraper, Airbnb rooms detail, Airbnb property page data, Airbnb listing info, fetch Airbnb room details, pull Airbnb listing.

中文简介正在准备中。当前显示原文说明。

browser-act/skills62062026年8月24日 更新

Extracts Airbnb accommodation search results from a destination query via SSR-embedded data, returning listing ID, URL, name, coordinates, rating, price, photos, and badge info for each result, plus pagination cursors for multi-page retrieval. Use when user mentions Airbnb search results, Airbnb listings, vacation rental search, short-term rental listings, scrape Airbnb, get Airbnb data, find rentals on Airbnb, Airbnb destination search, Airbnb property list, Airbnb stays search, Airbnb accommodation results, pull Airbnb listings, collect Airbnb search data, Airbnb scraper, Airbnb search page extraction, Airbnb search by destination.

中文简介正在准备中。当前显示原文说明。

browser-act/skills62062026年8月24日 更新

Amazon Alexa for Shopping Q&A automation: submits questions to Amazon's Alexa/Rufus AI shopping assistant and collects response text; supports optional keyword search context (navigate to search results page before asking for category-specific answers). Use when user mentions Amazon Alexa, Rufus, Amazon shopping assistant, Amazon AI chat, ask Amazon, Amazon Q&A, automate Alexa questions, Rufus chatbot, Amazon assistant automation, collect Alexa responses, bulk question submission to Amazon, keyword search context, category research. Also applies to extracting Amazon product recommendations from conversational AI, automating repeated queries to Amazon's AI shopping feature, collecting Alexa shopping responses at scale, or market research within a specific product category.

中文简介正在准备中。当前显示原文说明。

browser-act/skills62062026年8月24日 更新

This skill helps users extract structured product details from Amazon using a specific ASIN (Amazon Standard Identification Number). Use this skill when the user asks to get Amazon product details by ASIN, lookup Amazon product title and price using ASIN, extract Amazon product ratings and reviews count for a specific ASIN, check Amazon product availability and current price, get Amazon product description and features via ASIN, enrich product catalog with Amazon data using ASIN, monitor Amazon product price changes for specific ASINs, retrieve Amazon product brand and material information, fetch Amazon product images and specifications by ASIN, validate Amazon ASIN and get product metadata.

中文简介正在准备中。当前显示原文说明。

browser-act/skills62062026年8月24日 更新

This skill helps users extract structured best-selling product data from Amazon via the BrowserAct API. Agent should proactively apply this skill when users express needs like search for best selling products on Amazon, extract Amazon product data based on keywords, find top rated Amazon products, monitor Amazon competitor prices and sales, discover trending products on Amazon marketplace, extract Amazon product titles prices and ratings, gather Amazon product sales volume for market research, search Amazon best sellers in specific region, collect Amazon product reviews and promotion details, analyze Amazon product availability and badges, get Amazon product data for market analysis.

中文简介正在准备中。当前显示原文说明。

browser-act/skills62062026年8月24日 更新

查看 browser-act 的全部技能

报告此技能的问题