Sitemap order of URL indexing
Hello, When Coveo crawls over a sitemap does it request urls in the order they are in the sitemap?
Currently in Coveo testing org it looks to me like crawling is a single threaded process that follows exact sitemap index and sitemap url order.
Does it behave exactly the same in Production? If no, then how does it handle Url order in a sitemap? Does it respect order at all?
The reason Iâm asking is that I could implement a special server side tracking feature in this case. I could add a special url in the end of every sitemap to know for sure that crawling is done for a particular sitemap.
The sitemap is downloaded to extract all URLs to refresh. Depending of the number of refresh threads (which I think is 2 by default), we process each URL in parallel, but in the order that are defined in the sitemap.