I am trying to spider my website with the Dust-Me Selectors extension. It’s quite a large site (~1000 pages including URL query strings). The extension can spider a single page just fine. But when I give it my sitemap (which only has ~80 links to my main pages) it simply says “Processing sitemap … one moment please …”. I even left it running through the night but nothing changed.
I have tried this on sitemaps of other websites and it works fine, so I know its nothing local to my machine or firefox setup.
Here is the sitemap i am having problems with: