Crawler setup




Wordpress LScache Plugin: Crawler setup

Last Updated on: Wed, 15 Apr 2026 00:00:02
Hello, I searched yesterday all day long so Im quite desperate: I set up a new VM with Ubuntu 16.04 and installed OpenLitespeed and WordPress as dsecribed here: http://open.litespeedtech.com/mediawiki/index.php/Help:1-Click_Install (Didnt change locations) So far so good. Caching works when I go to the page manually, hit refresh and check the response headers and the sourcecode. But I dont get the crawler to preload the sites. After the crawler finished its run, the response headers give me: Server: LiteSpeed Transfer-Encoding: chunked X-Litespeed-Cache-Control: public,max-age=600 X-Litespeed-Tag: 7d51_PGSRP,7d51_URL.6666cd76f96956469e7be39d750cc7d9,7d51_F,7d51_Po.904,7d51_PGS,7d51_ The crawler itself runs as far as I can see in the Watch Crawler Status window. I assume the problem is enabeling the crawler with the crawler snippet: CacheEngine on crawler As I dont use any control panel, the wiki tells me to Add the Crawler Snippet and optional server variables to your server-level Apache config file But how does this file look like? Where can I find it? I googled all day long yesterday but obviously didnt find the right file. So any hint is welcome. Thanks for any help This topic was modified 4 years, 7 months ago by Manuel22. Hi, Apologize for late response , we are checking this, and will get to you as soon as possible. Best regards, Hi, Sorry for late response. I just installed an OLS and tested , it seems enable crwaler cron doesnt require additional step , the one you see , is for LiteSpeed enterprise. by the way , the default role for crawler is guest user , so if you visit it by login user (usually by admin user) you will not see crawled page. if you wanna check this , you can try open a private tab in browser and access from there. Please let us know if you have any further questions. Best regards,



LiteCache Rush: Speed comes from using less, not from doing it faster



Reference