516건 · 관련도순
"Implement a web crawler pipeline covering URL discovery, fetching, parsing, and storage. Use this skill when the user needs to build a site crawler, audit website structure, or collect web data systematically — even if they say 'scrape a website', 'crawl all pages', or 'site audit spider'.".
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Skippable Phase 0 of the Gaia evidence verification pipeline. Use only on declared need for higher-quality Stage-2 evidence: a promotion candidate, or a skill that gaia-meta-sweep flagged as under-evidenced. Given a skill id, source repo/context, and needed evidence types (benchmark-result, arxiv, peer-review, social-signal), it runs Firecrawl searches, scrapes top hits to markdown, and appends discovered sources into Phase 1 inputs. Missing benchmark evidence is recorded as benchmark-source candidates first, not direct scoring rows. Trigger phrases: "discover evidence", "find new evidence", "Phase 0", "run ev-discovery", "search for benchmarks/papers", "under-evidenced", "promotion candidate needs stronger proof". This is the ONLY ev-* skill that searches the web for NEW evidence; other ev-* skills aggregate or verify known sources. Requires Firecrawl to be usable (`firecrawl --status` authenticated OR FIRECRAWL_API_KEY set); skips gracefully when neither holds.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Audit robots.txt for AI crawler access policies. Checks GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and other AI crawlers. Use when user says "robots AI", "AI crawlers", "block AI", "allow AI bots", "AI crawl policy".
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Crawl websites and extract content from multiple pages via the Tavily CLI. Use this skill when the user wants to crawl a site, download documentation, extract an entire docs section, bulk-extract pages, save a site as local markdown files, or says "crawl", "get all the pages", "download the docs", "extract everything under /docs", "bulk extract", or needs content from many pages on the same domain. Supports depth/breadth control, path filtering, semantic instructions, and saving each page as a local markdown file.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Audit an existing sitemap.xml / robots.txt or generate new ones following sitemaps.org protocol and Google Search Central guidance, with a growth-first default that allows every crawler including AI search and AI training bots. Use this skill whenever the user asks to "build a sitemap", "generate sitemap.xml", "audit the sitemap", "refresh sitemap", "write robots.txt", "check robots", "allow AI crawlers", "block AI crawlers", "fix crawl budget", "submit to Google", or any other discovery / indexing configuration task. Output is a valid sitemap.xml (or sitemap index) and/or robots.txt, plus a written audit when auditing.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Integrate Firecrawl into product code: SDK setup and FIRECRAWL_API_KEY onboarding, /scrape, /search and /interact endpoints. Use when an application (not the agent itself) calls Firecrawl.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Search the public web and crawl URLs via the Unique AI Platform's `unique-cli web-search` command, with automatic per-turn citation tracking so cited web facts render as clickable external reference chips and `<sup>N</sup>` footnotes on the Unique platform. ALWAYS use this skill when the user asks to search the public web, research a topic online, look up news/articles/regulations, fetch the contents of one or more URLs, or perform any "two-phase" web research (search → review snippets → crawl selected URLs for full content). Routes through the Unique AI Platform's `/web-search-api` endpoints, so the engine (Google, Brave, Tavily, Jina, Firecrawl, …) and crawler are resolved server-side from the current environment — you never need to manage engine API keys yourself. Use this instead of fabricating answers from training data whenever fresh / source-cited information is needed. Do NOT use this skill for the internal knowledge base (`unique-cli search`) or for arbitrary tool execution (`unique-cli mcp`).
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Web search and scraping via Firecrawl API. Use when you need to search the web, scrape websites (including JS-heavy pages), crawl entire sites, or extract structured data from web pages. Requires FIRECRAWL_API_KEY environment variable.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Web scraping, search, crawling, and page interaction via the Firecrawl CLI. Use this skill whenever the user wants to search the web, find articles, research a topic, look something up online, scrape a webpage, grab content from a URL, extract data from a website, crawl documentation, download a site, or interact with pages that need clicks or logins. Also use when they say "fetch this page", "pull the content from", "get the page at https://", or reference scraping external websites. This provides real-time web search with full page content extraction and interact capabilities — beyond what Claude can do natively with built-in tools. Do NOT trigger for local file operations, git commands, deployments, or code editing tasks.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
Crawl websites and extract content from multiple pages via the Tavily CLI. Use this skill when the user wants to crawl a site, download documentation, extract an entire docs section, bulk-extract pages, save a site as local markdown files, or says "crawl", "get all the pages", "download the docs", "extract everything under /docs", "bulk extract", or needs content from many pages on the same domain. Supports depth/breadth control, path filtering, semantic instructions, and saving each page as a local markdown file.
한국어 요약은 준비 중입니다. 원문 설명을 표시하고 있습니다.
OpenClaw의 PR과 Issue가 기존 작업과 중복되는지 근거로 판단하고, prtags에서 관련 작업을 하나의 그룹으로 묶어 판단 이유와 확신도를 기록합니다.
로컬에 저장한 Slack 대화를 검색하고 기간별 메시지 조회와 정확한 집계를 수행합니다. 데이터가 최신인지 확인하고 필요하면 동기화하거나 스레드를 가져옵니다.
로컬에 저장한 Notion 페이지를 검색하고 데이터베이스 목록, 페이지 수, 동기화 상태를 확인합니다. 필요하면 데이터를 갱신하거나 Markdown 파일을 내보냅니다.
로컬에 저장된 GitHub 데이터에서 Issue, PR, 중복 후보를 찾습니다. 동기화 상태와 정보 누락을 확인하고 판단 전에 최신 상태를 대조합니다.
Granola 로컬 보관 자료에서 회의 메모, 녹취록, 패널을 검색하고 가져옵니다. 동기화 상태를 확인하고 필요할 때 갱신하며, 읽기 전용 SQL로 정확한 개수와 순위를 구합니다.
Find and fix internal links that lead to missing pages or server errors. Check rendered pages and HTTP responses, then identify URLs to update or remove and explain how broken links affect search engine crawling.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Extract webpage content from a URL through 9Router and receive Markdown, plain text, or HTML. Choose among supported extraction services, limit output length, or use a fallback chain that tries another provider when needed.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Explore old files and email archives to rediscover personal writing, ideas, and meaningful conversations. Review selected items one at a time, save worthwhile material as organized notes, and track progress within explicitly permitted folders.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Convert attached office documents, EPUB, CSV, and text-based PDFs into local Markdown using Firecrawl AnyDoc CLI. Files stay inside the agent container, producing readable text for review without uploading documents to an external parsing service.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Extract web page content as Markdown from a single URL or a site crawl. When access is blocked, progressively switch from basic fetching to Chrome and Bright Data proxy services, which route requests through other IP addresses.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Audit content for AI search by checking clear answers, supporting sources, author and brand information, and crawler access. Receive a readiness report with prioritized improvements and specific suggestions for rewriting passages.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Audit the technical factors that affect how search engines discover and index a website. Check crawl access, URLs, security, mobile pages, loading performance, and JavaScript rendering, then report measured results with prioritized fixes.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.
Assess a website’s readiness for AI search alongside traditional SEO. Review content citation readiness, crawler access, brand mentions, technical foundations, and structured data, then generate scores, prioritized recommendations, and client reports.
한국어 요약은 준비 중입니다. 영어 요약을 표시하고 있습니다.