Questions about Crawler ability.




Wordpress LScache Plugin: Questions about Crawler ability.

Last Updated on: Wed, 15 Apr 2026 00:00:02
If my crawler crawled for over a week and several thousand posts are crawled, and I then purge all cache are those crawled pages then removed and obsolete? So it has to restart all over again? do I understand this correctly? Secondly, it would be AMAZING if you can include some post limit to the crawler. For example if we have 10 000 products, but we only want the last 1000 by latest date be crawled. Hi, Yes , purge all cache will purge everything. Thats good suggestion , but for now , you can use a sitemap to tell crawler what to crawl as workaround. Best regards,



LiteCache Rush: Speed comes from using less, not from doing it faster



Reference