Back To Guides
04 Indexability
01 Metrics 02 Fix List 03 Content 04 Indexability 05 Structured Data 06 Social Tags 07 Images 08 Outgoing Links 09 Report 10 Page Snapshot

Feature Guide

Indexability

What the OptiScan.io Indexability section checks for crawling, canonical URLs, robots directives, robots.txt, sitemap.xml, and HTTPS.

The Simple Version

Indexability shows whether a page appears safe for search engines to crawl, understand, and index. It does not guarantee indexing, but it highlights signals that can block or confuse it.

What OptiScan.io Checks

The section reviews HTTPS, canonical URL, robots meta tag, X-Robots-Tag HTTP header, overall indexability status, robots.txt, and sitemap.xml availability and validity.

Why It Matters

A strong page can still underperform if indexing signals are wrong. Noindex, nofollow, invalid robots.txt rules, or sitemap problems can prevent important pages from being discovered or understood.

How To Use It

  • Confirm the canonical URL is intentional.
  • Remove noindex or nofollow only when the page should be indexable.
  • Review X-Robots-Tag headers for server-level directives.
  • Keep robots.txt and sitemap.xml readable and valid.

What This Means For You

Use Indexability when a page should be discoverable but its crawler signals need verification.