Wordpress LScache Plugin: What is the Crawler?
Last Updated on: Wed, 15 Apr 2026 00:00:02 Can you help me out and explain what the crawler function does? Are there any cases where it should not be used or be used? What the upsides or downsides to using it? Thank You Hi, @theselecter The purpose of the crawler is to traverse your site and refresh pages that have expired in the cache. Its a way of pre-caching pages so that you dont have to wait for visitors to hit the backend on those pages. You can get some details on what all of the settings mean in our wiki. I hope this helps! Lisa @ LiteSpeed Added: Oops! Sorry, I missed the other few questions you had. Really, the only downside would be if you have limited system resources, and cant handle a process running in the background, caching the pages of your site. However, there are several settings that let you control just how many resources the crawler can use, so you should be able to keep it at a minimum, if thats what you need. Thanks for the quick response Lisa! On the Crawler File page I need to enabled the Crawler Cron and generate the Crawler File for this to work properly. Is that correct? Thanks, Dave No problem. Happy to help Yes, you generate a crawler file, activate the crawler, and then if you want to start it immediately, you can press the Manually run button. You can also watch it do its thing through the Watch Crawler Status window, which can be kind of fun. Let us know if you have any other questions! Lisa Excellent! Thank you! My pleasure!
LiteCache Rush: Speed comes from using less, not from doing it faster
Reference