Sitemap indexing: get every page in your sitemap crawled
Submitting a sitemap tells Google which URLs exist. It doesn't make Google crawl them any sooner. Send the same sitemap to @IndexForgeBot: it opens every page, filters out what can't be indexed and pushes the rest to Google, usually indexed within 1–3 days.
Sitemap in Search Console vs sitemap in the bot
Keep doing the first: it's how Google tracks your site over time. Use the second when a batch of pages needs to be crawled now.
| Feature | Search Console | Index Forge |
|---|---|---|
| What it does | Lists URLs for Google to crawl on its own schedule | Sends each indexable URL for crawling now |
| Checks pages first | Reports problems after crawling | Filters 404, redirect, noindex, robots.txt, canonical before sending |
| Site verification | Required | Not needed |
| Cost | Free | $0.01 per URL that passes |
Sitemap indexes, followed to the last page
Send sitemap_index.xml and the bot reads every child sitemap. Several sitemap URLs in one message work too.
Or just send the domain
Type yoursite.com into the chat. The bot sends the homepage, and one button takes every page from the site's sitemap. If there's no sitemap, it tells you so and asks for a list instead.
Clean the sitemap while you index it
A sitemap full of redirects and noindexed pages tells Google your dates and URLs can't be trusted. The report shows exactly which entries to remove.
- 404 and 410Removed pages still listed. Delete them from the sitemap.
- RedirectsOld URLs. List the final address instead.
- noindexA page shouldn't be in the sitemap and closed from indexing at the same time.
- Canonical elsewhereOnly canonical URLs belong in a sitemap.
- robots.txt blocksGoogle can't crawl them, so listing them achieves nothing.
What happens after you send a sitemap
You see the full picture before paying: how many pages the sitemap lists, how many can be indexed and what it will cost.
- The bot downloads the sitemap. If it's an index, it opens every child sitemap listed in it.
- It collects all page URLs and removes duplicates.
- Each page is checked like Googlebot: status code, redirects, noindex in meta and headers, robots.txt and canonical.
- You get a summary with the number of pages that passed and the price at $0.01 each.
- You confirm, and the pages that passed are sent for crawling. Pages that aren't accepted are refunded.
Large sitemaps
One batch holds up to 10,000 URLs. Bigger sites send their sitemap in parts.
If your sitemap index lists more than 10,000 pages, send the child sitemaps one by one, for example posts first, then products, then categories. Splitting by type has a second benefit: the filtered report for each part shows which type of page has problems.
For regular publishing, there's no need to resend the whole sitemap each time. Send only the new and updated URLs, either in the chat or through the API, and keep the sitemap in Search Console for long-term discovery.
When sitemap indexing helps most
Google reads sitemaps on its own schedule. These are the cases where waiting costs you.
- A new siteGoogle has no crawl history and visits rarely at first.
- A new sectionHundreds of pages added at once to an existing site.
- After a migrationNew URLs need to be crawled before old ones drop out.
- After fixing errorsPages that were noindexed or broken and are now fine.
If the sitemap can't be read
It's usually one of three things, and each is quick to fix on your side.
- Sitemap not foundThe address returns 404. Try
/sitemap_index.xmlor/wp-sitemap.xml. - Not XMLThe server returns an HTML page instead of the sitemap, often a cache or security plugin.
- Empty sitemapThe file exists but lists no pages. Check your CMS or plugin settings.
Sitemap indexing questions
Didn't find yours? Press 💬 Support in the bot.
Does submitting a sitemap get pages indexed?
Can I send a sitemap index?
What if my sitemap has more than 10,000 URLs?
Do I still need to submit the sitemap in Search Console?
Will pages from the sitemap be charged if they're broken?
Does the bot change my sitemap?
Your next 10 links
are on us
Open the bot, paste links and see what passes the check. No card, no sign-up form.