Wordpress LScache Plugin: Use crawler for multiple Domains but one installation
Last Updated on: Wed, 15 Apr 2026 00:00:02 Hey there We have a setup where multiple domains are pointing to the same wp-installation, i.e: domain.com domain.de domain.us .. are all accessing the same wordpress installation & database, but content is a bit different on each. Currently the crawler seems to only work relative as for one domain. I could create a master-sitemap which points to the sitemap.xml for each domain. How can I get the crawler to preload all the pages / sitemaps for all domains? Thanks! Currently the parsed sitemap is stored in wp_litespeed_crawler table. There you can see all URIs are relative path. https://github.com/litespeedtech/lscache_wp/blob/master/src/crawler.cls.php#L247 The base domain is appended here by home_url(). So its possible to crawl w/ different domains. Q1) Are all those domains replaceable? Means, when you visit one page domain.com/postA, for other sites, its just simply domain.us/postA? Do they have same path structure? Q2) When visiting different domains, is home_url() changed correspondingly? Thanks for the great answer. Q1) No. Similar but not identical. For example the page domain.de/postA gets domain.us/de/postA. Therefore domain.de/sitemap.xml has different entries then domain.us/sitemap.xml Q2) Yes, home_url() does change relative to the currently visited domain. But the wp-admin area is usually only run on one domain. As I observed it, the crawler only gets run from one domain. I already tried to feed it a sitemap-master.xml sitemap which lists the different domain-sitemaps, but as you described this doesnt work because its indeed relative. Technically I could rewrite crawler.cls.php file to get the desired result, but this would impact upgradability. What is the best way of getting all the urls from the different sitemaps into one table and then crawl it absolute? Appreciate the professional support. Currently to save space, all parsed sitemap URLs stored in DB dropped the domain part. As your domains URI structures didnt exactly match each other, seems the ideal solution should: Step1) your sitemap provides all URLs w/ all domains. A full list. Step2) Plugin side keeps the domain when parsing sitemap. Then when crawling, it can always honor your original sitemap. To achieve this, we need some changes on plugin side. I will add a new option in Sitemap settings, to remain the domain in parsed sitemap data. Bcos this need to be compatible w/ Server IP option, may take a while. Once its done, will be in v3.0.0-rc3 and update here. Thats awesome! 1) Is confirmed. 2) Looking forward to use this. Let me know as soon as I can test this. Its the only feature stopping us from switching to litespeed Webserver and quic.cloud. Thanks! Here you go: https://github.com/litespeedtech/lscache_wp/commit/e898b3611a0ff833e89015508a9e6a0945910932 You are absolutely awesome. Very impressed with the quality of service. The feature seems to work! I created a sitemap-master.xml where I added the sitemap_index.xmls from the different domains. It takes them all, means all the urls do show up under the Map tab. Sadly the crawler seems to be stuck and doesnt go through them. Resetting doesnt help. And what about using the new https://my.preview.quic.cloud cdn & dashboard on a production site? Would like to go that way as soon as possible. Hi, Did you see any error message when crawler stuck ? Best regards, Hi. This is how the panel looks, resetting doesnt change the state, nor does deactivating the plugin etc.. It seems stuck . https://imgur.com/zjVQ6ZS Any tricks? Hi, Please check debug log , see if it says anything if you have server access, could also check the PHP process Best regards,
LiteCache Rush: Speed comes from using less, not from doing it faster
Reference