Skip to content
cccskills

Results for “web scraping”

153 skills · sorted by relevance

This skill provides guidance for using Firecrawl MCP for web scraping and content extraction. Use when scraping web pages, crawling websites, searching the web with content extraction, mapping site URLs, or extracting structured data from web pages.

The English summary is being prepared. Showing the original description.

s-hiraoku/vscode-sidebar-terminal22Updated Oct 21, 2026

Apify Automation

FreeSummaryAI rating 90

Run Apify Actors, programs that collect web data, through the Composio integration. Retrieve structured results, create reusable tasks with preset inputs, and inspect execution logs for both quick collection jobs and longer runs.

  • Collect restaurant data with a Google Places scraper
  • Retrieve selected dataset fields in JSON format
  • Create reusable tasks for recurring data collection
ComposioHQ/awesome-claude-skills77.6KUpdated Sep 18, 2026

Apify Automation

FreeSummary

Run Apify Actors, programs that collect web data, through the Composio integration. Retrieve structured results, create reusable tasks with preset inputs, and inspect execution logs for both quick collection jobs and longer runs.

  • Collect restaurant data with a Google Places scraper
  • Retrieve selected dataset fields in JSON format
  • Create reusable tasks for recurring data collection
composio-community/awesome-codex-skills17KUpdated Jul 26, 2026

Web scraping with anti-bot bypass, content extraction, undocumented APIs and poison pill detection. Use when extracting content from websites, handling paywalls, implementing scraping cascades or processing social media. Covers requests, trafilatura, Playwright with stealth mode, yt-dlp and instaloader patterns.

The English summary is being prepared. Showing the original description.

MaxMiksa/Autonomous-Company3.2KUpdated Oct 21, 2026

Build a complete web scraping Actor with Crawlee and deploy to Apify. Use when you need end-to-end web scraping on Apify: defining an input schema, building a router-based Crawlee crawler, extracting structured data, storing results in a dataset, testing locally, and deploying the Actor to the platform. Trigger with "apify scrape website", "build apify actor", "crawlee scraper", "apify main workflow".

The English summary is being prepared. Showing the original description.

jeremylongshore/tons-of-skills-marketplace2.9KUpdated Oct 21, 2026

Assesses lawful basis for AI training data processing per EDPB April 2025 report on LLMs and general-purpose AI. Covers legitimate interest balancing tests, consent challenges for ML training, public dataset assessment, and web scraping lawfulness. Keywords: AI training data, lawful basis, EDPB LLM, legitimate interest, consent, web scraping.

The English summary is being prepared. Showing the original description.

mukul975/Privacy-Data-Protection-Skills315Updated Mar 17, 2026

Add WebMCP tools to a website codebase so browser agents can act through the site's own logic instead of scraping the page. Use when asked to make a site agent-ready, add WebMCP or document.modelContext tools, or implement site tools with @nekuda/webmcp-sdk.

The English summary is being prepared. Showing the original description.

nekuda-ai/webmcp-kit47Updated Sep 30, 2026

Escalate blocked scraping campaigns with provider-neutral proxy rotation — decide between datacenter, residential, and mobile pools, integrate rotation with scrapling, configure session stickiness for stateful flows, monitor cost and health, and stay inside legal and ethical boundaries. Use as the next step after `headless-web-scraping` client-side stealth (StealthyFetcher, rate limiting, robots.txt) is insufficient and traffic is legitimate.

The English summary is being prepared. Showing the original description.

pjt222/agent-almanac42Updated Oct 21, 2026

Extract data from web pages using the scrapling Python library — select the appropriate fetcher tier (HTTP, stealth Chromium, or full browser automation) based on target site defenses, configure headless browsing, and extract structured data with CSS selectors. Use when WebFetch is insufficient for JS-rendered pages, anti-bot-protected sites, or structured multi-element extraction requiring DOM traversal.

The English summary is being prepared. Showing the original description.

pjt222/agent-almanac42Updated Oct 21, 2026

Apify

FreeSummary

Collect social posts, business listings, and product reviews through Apify actors, ready-made data collection tools. Filter results by date, rating, or engagement in code before sending relevant records to the AI for research or lead generation.

  • Find competitors' most popular social posts
  • Build a contact list of local businesses
  • Extract recent negative Amazon reviews
danielmiessler/LifeOS19.5KUpdated Sep 4, 2026

browser-use

FreeSummary

Automate browser tasks such as clicking, typing, navigation, data extraction, testing, and screenshots. It controls Chrome through CDP, a browser control protocol, and supports work requiring logged-in sessions or pages rendered with JavaScript.

  • Automating repeated clicks and form entry
  • Collecting information from JavaScript-rendered pages
  • Testing website interactions and taking screenshots
davidondrej/skills4.2KUpdated Oct 21, 2026

Deploy Apify Actors and integrate scraping into external applications. Use when deploying an Actor to the platform, integrating Actor results into a web app (Next.js, Express), wiring webhooks, or scheduling scraping pipelines. Trigger with "deploy apify actor", "apify Vercel integration", "apify production deploy", "integrate apify results", "apify API endpoint".

The English summary is being prepared. Showing the original description.

jeremylongshore/tons-of-skills-marketplace2.9KUpdated Oct 21, 2026

This skill should be used when the user asks to "build web automation scripts", "check browser automation for detection", "generate web scraping code", "create form filling automation", or "build anti-detection browser scripts".

The English summary is being prepared. Showing the original description.

borghei/Claude-Skills962Updated Oct 7, 2026

Web search and content extraction with Tavily and Exa via inference.sh CLI. Apps: Tavily Search, Tavily Extract, Exa Search, Exa Answer, Exa Extract. Capabilities: AI-powered search, content extraction, direct answers, research. Use for: research, RAG pipelines, fact-checking, content aggregation, agents. Triggers: web search, tavily, exa, search api, content extraction, research, internet search, ai search, search assistant, web scraping, rag, perplexity alternative

The English summary is being prepared. Showing the original description.

aiskillstore/marketplace442Updated Oct 21, 2026

Extract structured data from websites, scrape page content, and collect information across multiple pages. Trigger when the user asks to: extract data from a website, scrape a page, collect information from URLs, pull content from web pages, gather data across multiple pages, or download page content.

The English summary is being prepared. Showing the original description.

billy-enrizky/openbrowser-ai277Updated Sep 28, 2026

Browser automation via Playwright for web testing, screenshots, form filling, scraping, and verification. Use when tasks require navigating websites, interacting with web pages, or testing web applications.

The English summary is being prepared. Showing the original description.

ArabelaTso/Skills-4-SE258Updated Aug 21, 2026

Parse and extract data from HTML with Cheerio. Use when a user asks to scrape static web pages, parse HTML files, extract data from HTML, build a web scraper for server-rendered pages, extract text or links from HTML documents, parse RSS/XML feeds, transform HTML content, or process HTML emails. Covers jQuery-style selectors, DOM traversal, text extraction, attribute parsing, and integration with HTTP clients for web scraping pipelines.

The English summary is being prepared. Showing the original description.

TerminalSkills/skills174Updated Oct 21, 2026

Browser automation via webctl CLI in Claude.ai containers with authenticated proxy support. Use when users mention webctl, browser automation, Playwright browsing, web scraping, or headless Chrome in container environments.

The English summary is being prepared. Showing the original description.

oaustegard/claude-skills154Updated Oct 21, 2026

Browser automation, web scraping, E2E testing, and visual regression with Playwright. Covers 30+ patterns: login flows, form testing, responsive design checks, broken link validation, API mocking, data extraction, PDF generation, accessibility audits (axe-core), performance budgets (Lighthouse), visual diffing, multi-browser testing (Chromium/Firefox/WebKit), mobile emulation, infinite scroll, shadow DOM, iframes, file downloads, auth state reuse, cookie consent handling, WebSocket monitoring, console error detection, HAR export, trace viewer, Docker CI, GitHub Actions, and parallel sharding. Use when user asks to test a website, take screenshots, check responsive design, automate a browser task, scrape data, validate forms, check broken links, test login, audit accessibility, or measure page performance. Do NOT use for unit testing, API-only testing, or static analysis. Requires Node.js 18+.

The English summary is being prepared. Showing the original description.

EliasOulkadi/shokunin113Updated Oct 5, 2026

Smart agentic web data extraction with multi-strategy scraping (Crawl4AI v4, Firecrawl), LLM extraction loops, anti-bot bypass, and structured export / Ekstraksi data web cerdas dan agentic dengan scraping multi-strategi (Crawl4AI v4, Firecrawl), ekstraksi LLM, bypass anti-bot, dan ekspor terstruktur.

The English summary is being prepared. Showing the original description.

roedyrustam/vibes-plug105Updated Oct 20, 2026

Use when the user wants web research: gathering cited, multi-angle evidence on a specific question. Triggers on: "research X for me", "do web research on", "look up sources for", "find citations for", "gather evidence on", "what does the web say about X". Also invoked programmatically by other beagle skills (prfaq-beagle Ignition, brainstorm-beagle reference points, strategy-interview context grounding) via the companion contract. Does NOT trigger on codebase lookups ("find this function", "search the repo"), local file search, LLM-as-judge evaluation, or paywalled/auth-gated scraping. Produces a written plan, parallel-subagent findings, and a cited synthesis report on disk — never inline prose, never unsourced claims.

The English summary is being prepared. Showing the original description.

existential-birds/beagle84Updated Sep 16, 2026

This skill enables web scraping and content extraction using Firecrawl API directly via curl. Use when scraping web pages, crawling websites, or extracting structured data. MCP server not required.

The English summary is being prepared. Showing the original description.

s-hiraoku/vscode-sidebar-terminal22Updated Oct 21, 2026

Router and protocol for reading and extracting web content. Decides first WHAT is needed (main text vs. structure vs. screenshot) and then WHICH tool available on the system delivers it. If nothing suitable is present, it recommends installing the web-scraper module.

The English summary is being prepared. Showing the original description.

ellmos-ai/skills8Updated Oct 19, 2026

Guide ethical web scraping patterns. Use for crawl scope, extraction, anti-abuse limits, browser scraping, structured data, and integration with Scrapling/Firecrawl.

The English summary is being prepared. Showing the original description.

CruxExperts/LocalSetup6Updated Oct 21, 2026