Technical SEO

Crawling & Indexing Documentation

by Google Search Central

This structured collection is aimed at the moment a site stops behaving as expected: pages are not indexed, duplicates appear, Googlebot receives the wrong response, or a JavaScript application renders incomplete content. It turns Google's crawling and indexing model into an operational debugging checklist.

Go to course on Google Search Central
Free

Price

Self-paced · 4-8 hours

Time investment

Intermediate

Level

What you'll learn

  • How crawl discovery and scheduling work
  • How robots.txt, noindex, canonicals, and sitemaps interact
  • How to reason about duplicate and alternate URLs
  • How to troubleshoot indexing with Search Console

Prerequisites

Basic HTML and HTTP concepts recommended. No paid tool is required.

Who it's for

Technical SEOs, engineers, and developers maintaining large, international, or JavaScript-rendered sites.

Topics covered

CrawlingIndexingRobots.txtSitemaps

Ready to start?

This course is hosted and delivered entirely by Google Search Central — enrollment happens on their site.

Go to course