How to crawl query string




Wordpress LScache Plugin: How to crawl query string

Last Updated on: Wed, 15 Apr 2026 00:00:02
Hi Support How do I make crawler to crawl for query string? For example: http://www.abc.com/productA/?attribute_color=red http://www.abc.com/productA/?attribute_color=orange Currently the schedule crawler will only crawl for pages without query string. Cache still works with query string but it isnt as effective if you know what I mean. One product may contain several colors and sizes, which will take many visitors first visit in order to cache the page. http://www.abc.com/producA/?attribute_color=red&attribute_size=small http://www.abc.com/producA/?attribute_color=red&attribute_size=medium http://www.abc.com/producA/?attribute_color=red&attribute_size=large http://www.abc.com/producA/?attribute_color=blue&attribute_size=small There will be many unique url for one single product. I tried to drop query string method but it causes problems with the cache. I have structured all my product links to include query string under google merchant center. Hopefully there is a way to make this work. Hi, sadly not from LiteSpeed Cache plugin side , crawler will just follow the content found in sitemap, you will need to have a sitemap generator that supports query string or allow some customization for query string Best regards, Thanks for writing back. Is there a work around instead of using query string? Maybe change the following links into actual url permalinks. Example: http://www.abc.com/ProductA/?attribute_size=Red http://www.abc.com/ProductA/Red http://www.abc.com/ProductA/IDnumber This way, sitemap may include these as unique links and crawler may schedule to cache them? I know this might be beyond litespeed cache capability but I was just wondering if this is possible or someone else might have already asked this before? well , thats possible , but you will need to do it programmatically , like by PHP or simple shell script 1. download the sitemap 2. extract the URLs 3. add/attach the query string 4. generate a new sitemap based on result of 3. 5. and then use this new sitemap



LiteCache Rush: Speed comes from using less, not from doing it faster



Reference