I've got a site with about 6 million pages. It's hosted on a VPS with 2gb ram.
XML sitemaps aren't generating and the process is timing out and going to a 404 page.
1. I've confirmed the plugin works by excluding pages (and just indexing the posts). Sitemaps generate properly in that case.
2. I've reduced the max entries per sitemap page to 200.
Questions:
Is there a setting somewhere to increase the processing time?
Is it possible to cache the XML files once they are generated (as the pages rarely update)? We rare using W3 Total Cache.