Crawl budget is the set of URLs on your site that Google can and wants to crawl, limited on one side by what your server can handle and on the other by how much Google wants your pages. Google says the concept matters for sites with a million or more pages, or ten thousand or more that change daily. A small business site does not have a crawl budget problem. It may have a crawl demand problem, which is different.
The two halves
Crawl capacity is the ceiling: how many connections Google will hold open to your server without slowing it down for visitors. Crawl demand is the appetite: how much Google wants to fetch, driven by how popular your URLs are, how often they change, and how worthwhile past crawls turned out to be. Budget is where the two meet.
Who Google says should care
Large sites with more than a million unique pages that change weekly, medium sites with more than ten thousand pages that change daily, and sites with many URLs stuck in discovered, currently not indexed. Google adds that if your pages are crawled the same day they are published, you do not need to read the guide at all.
What a small site actually has
A demand question. When sixty pages are not being crawled, it is not because Google ran out of capacity for them. It is because nothing has told Google those pages matter: no links from crawled pages, no links from other sites, and a site history that has not yet earned much attention. The fix is the same as for the discovered status: link to the pages, earn links to the site, remove the pages that dilute it.
Housekeeping that helps at any size
Keep the server fast, because a slow response lowers the capacity half. Do not generate endless parameter and filter URLs. Return proper not-found codes for pages that are gone rather than soft redirects to the homepage. Keep redirect chains short. None of that is crawl budget optimisation on a small site. It is just not wasting the attention you have.
Where this shows up in the tracker
Every term in this glossary is something the product actually measures or acts on. Plans start at £29 a month, with rank tracking, AI visibility, the daily AI readiness scan, security and domain health, Search Console, backlinks and audits on every one of them.
Related terms
Discovered, currently not indexed
Discovered, currently not indexed means Google knows a page exists, usually from your sitemap or a link, but has not yet fetched it. The page has not been judged and rejected. It has been queued and left there. On a small site that almost always means Google has not found a reason to prioritise it, not that your server is overloaded.
Sitemap
An XML sitemap is a file listing the URLs on your site that you want search engines to find, usually at yourbrand.com/sitemap.xml. Google says it helps discovery and does not guarantee that anything in it will be crawled or indexed. A small, well-linked site may not need one; most sites should have one anyway, because it is free and it is how you tell Google what changed.
Duplicate content
Duplicate content is substantially the same content available at more than one URL, on your own site or across sites. There is no duplicate content penalty. What happens instead is that Google picks one version to index and folds the others into it, and if it picks the wrong one, or splits links between them, you lose some of what you have earned.
Internal linking
Internal linking is linking from one page on your website to another. It is how Google discovers most of your pages, how it works out which ones you consider important, and how it learns what each page is about from the words used to link to it. It is also the one ranking lever that costs nothing and that you control completely.