跳到正文
cccskills
免费在 GitHub 公开

indexability

Audit important pages for settings that interfere with search indexing, including noindex directives, HTTP headers, and robots.txt rules. Identify accidental restrictions, suggest configuration fixes, and guide follow-up checks in Google Search Console.

中文简介正在准备中。当前显示英语简介。

原文查看原文说明

Use when auditing a site for accidental noindex directives, investigating why important pages are not appearing in Google Search, or reviewing CMS settings that control indexing at the page or category level.

查看安装方法

适用场景

  • Investigating important pages missing from Google Search
  • Checking for leftover staging restrictions after launch
  • Reviewing CMS indexing settings for pages and categories
  • Finding restrictions in headers and robots.txt

包含的文件(2)

  • SKILL.md3.2 KB
  • references/rule.md4.1 KB

SKILL.md(原文)

安装前可以查看交给 AI 代理的指令内容。

Make important pages indexable

A page blocked from indexing cannot appear in search results, regardless of its content quality or backlinks. Accidentally blocking key landing pages, product pages, or blog posts is one of the most impactful technical SEO errors — often silently losing significant organic traffic.

Quick Reference

  • Verify that pages you want ranked are not blocked by noindex, robots.txt, or X-Robots-Tag headers
  • Test indexability with Google Search Console's URL Inspection tool — 'URL is on Google' confirms indexing
  • Common accidental blocks: staging environments promoted to production, CMS default noindex settings, and overly broad robots.txt Disallow rules

Check

For each important page (homepage, key landing pages, product pages, top blog posts): (1) Check <meta name='robots' content='...'> — does it contain noindex? (2) Check X-Robots-Tag HTTP response header — does it contain noindex? (3) Check robots.txt — is the URL's path blocked by a Disallow rule? (4) In Google Search Console, use URL Inspection to confirm the page is indexed. Flag any important page with any form of noindex or robots.txt block.

Fix

  1. For pages with <meta name='robots' content='noindex'>:
    • Remove the noindex tag entirely, or change to content='index, follow'.
    • In Next.js: remove the robots: { index: false } from the page's metadata.
  2. For pages with X-Robots-Tag: noindex HTTP header:
    • Remove the header in your server config (Nginx, Apache, CDN rules).
    • In Vercel: check vercel.json headers configuration.
  3. For pages blocked by robots.txt:
    • Remove or narrow the Disallow rule.
    • Test with Google's robots.txt tester in Search Console.
  4. After removing blocks, request indexing in Google Search Console (URL Inspection → Request Indexing).
  5. Monitor the Coverage report over the following weeks to confirm the page moves to "Indexed".

Explain

A page that cannot be crawled or indexed cannot rank, no matter how good its content or how many links point to it. Google explicitly states that noindex and robots.txt blocks prevent pages from appearing in search results. Accidental indexing blocks are among the most common causes of sudden, unexplained drops in organic search traffic.

Code Review

Parse every page's HTML for <meta name='robots'> or <meta name='googlebot'> tags containing noindex. Check HTTP response headers for X-Robots-Tag with noindex. Cross-reference with robots.txt Disallow patterns. Flag any route in the application where noindex is set unconditionally (rather than conditionally for draft/private content).


For full implementation details, code examples, and framework-specific guidance, see references/rule.md.

Rule page: https://frontendchecklist.io/rules/seo/indexability

评价

还没有评价。欢迎分享你的使用感受。

评论

无需登录即可发表。欢迎分享使用感受、提问,或说明在哪些环境下无法运行。

还没有评论。来写第一条吧。

提交后会立即公开。请勿填写邮箱、电话等个人信息。URL 最多 2 个。

0 / 1000 字

此表单受 reCAPTCHA 保护,适用 Google 的隐私权政策和服务条款。

同一仓库的技能

404-page

免费

Create and review custom 404 pages that help visitors recover from broken or moved links through search and navigation. Check the rendered page and HTTP response so missing content returns a proper 404 status.

中文简介正在准备中。当前显示英语简介。

  • Creating a helpful custom 404 page
  • Adding search and navigation for broken links
  • Checking missing pages that return HTTP 200
thedaviddias/Front-End-Checklist7.5万2026年10月6日 更新

Audit or create a dedicated About page that explains a website’s purpose and identifies its people or organization. Review the rendered output and supporting information, including expertise and contact details, to find gaps.

中文简介正在准备中。当前显示英语简介。

  • Reviewing a website’s About page
  • Creating a page about the organization and its mission
  • Checking how operator information appears in rendered output
thedaviddias/Front-End-Checklist7.5万2026年10月6日 更新

Review and add automated accessibility checks for components, pages, and continuous integration workflows. Use axe-based tools to detect structural and attribute issues, while identifying checks that still need keyboard or screen reader testing.

中文简介正在准备中。当前显示英语简介。

  • Review accessibility coverage for shared components
  • Add accessibility checks to page flow tests
  • Run accessibility tests in CI
thedaviddias/Front-End-Checklist7.5万2026年10月6日 更新

Review sign-in, registration, multi-factor authentication, and account recovery for accessibility barriers. Find blocked paste, difficult code entry, and inaccessible backup methods, then suggest authentication paths that support password managers, autofill, or device approval.

中文简介正在准备中。当前显示英语简介。

  • Reviewing accessibility across the sign-in process
  • Checking verification code paste and autofill
  • Inspecting password reset and account recovery
thedaviddias/Front-End-Checklist7.5万2026年10月6日 更新

Review form errors, success messages, and live updates so screen reader users receive important notifications. Check the HTML delivered to the browser, announcement settings, display duration, and dismissal controls, then identify specific elements that need changes.

中文简介正在准备中。当前显示英语简介。

  • Reviewing form error announcements
  • Checking success message display duration
  • Auditing live update notifications
thedaviddias/Front-End-Checklist7.5万2026年10月6日 更新

Review HTML tables so screen reader users can understand how headers and data relate. Check header markup, table descriptions, and merged cells, then identify specific fixes and ways to verify them.

中文简介正在准备中。当前显示英语简介。

  • Reviewing tables for screen reader accessibility
  • Checking header relationships in tables with merged cells
  • Reviewing table patterns in a design system
thedaviddias/Front-End-Checklist7.5万2026年10月6日 更新

查看 thedaviddias 的全部技能

报告此技能的问题