โ† all guides

Crawling vs indexing: the difference

Why a bot visited a page but it is still not in search, and what depends on you.

These two words are often confused, but they are different stages. Understanding the difference saves time when troubleshooting.

Crawling

This is when a search bot visits a page and reads its content. At this stage you can act directly: make the page available, link to it, notify the engine about it. It is crawling that indexing services, including aitunz, speed up.

Indexing

This is when the engine decides to add the page to its database, after which it can appear in results. The decision is made by the engine itself, based on quality, uniqueness and value. No one can guarantee indexing, anyone promising 100 percent is being dishonest.

Why a bot visited but the page is not in search

A common situation: a crawl happened but there is no indexing. That means you passed the crawl stage, and the rest is about content and signals. Check noindex, canonical, uniqueness and the value of the page.

The takeaway is simple: you are responsible for the bot reaching the page and the page being open. The engine is responsible for the indexing decision. aitunz handles the first part and honestly shows which bots have already crawled each of your links.

Speed up indexing of your links
First 10 per day free
Start free