Using Sitemaps

You can index only the sitemaps listed on the webpage by enabling Sitemaps in the WEB collection settings.
SearchBlox supports sitemap.xml listed in robots.txt when Follow Sitemap is enabled.
If a sitemap.xml file contains links to other sitemaps, SearchBlox will index all the linked sitemaps.
Only standard XML sitemaps are supported. Compressed XML files (tar or gzip) are not supported.
When Ignore Sitemaps is disabled, only sitemap links such as https://example.com/sitemap.xml are indexed.
By default, Ignore Sitemaps is enabled in the WEB collection settings.
You can index multiple sitemaps by providing multiple URLs in the root path.
Allow/Disallow path rules are applied when indexing sitemap URLs.
Spider depth and other WEB collection settings do not apply to sitemaps.