Kitt Cache Crawler Knowledgebase

The Cache Mode feature is an undocumented LiteSpeed feature that not only speeds up crawling. It also allows to refresh the cache of a URL if the cache is not expired. If the cache is not expired the cache is refreshed by the set TTL. If the cache is expired it is normally warmed up. The cache...

For each cached URL, LiteSpeed LScache creates a static copy of the output of the URL in the /lscache directory, which is outside the public_html directory. The compression feature can be used todetermine whether the cache that has been preheated by Kitt should be compressed as...

With the Crawler Mode Feature you can specify whether the cache should be purged before the crawl starts. Except for Wordpress or when using the LiteSpeed LScache plugin for Wordpress,the entire cache created by the respective cache plugin is always purged. The LiteSpeed LScache Plugin...

cURL debugging enables a very detailed evaluation of each individual cURL request. When this feature is enabled, Kitt writes a debug_log to the /log directory.Please note that this will slow down crawling and result in a higher server load. Please activate this function only in...

The feature limit allows the quantity of URLs to be crawled to be limited and works in conjunction with the feature offset. The input parameterswork the same as when using MySql Queries. For example, if you want to crawl 1000 URLs, but start crawling at the thousandth URL instead of the...

If you want to use the cache inventory, activate the switch for the logging feature.

If you are using the Journal Theme, you can warm up the associated cache if the Product Quickview is activated.

See Description for Limit Feature.

The post type selection function is made possible by supporting the Yoast Seo plugin and allows the selection of specific (sub) post types.Depending on the selection, only the cache for the selected post type or types will be warmed up.

The Follow Redirection feature lets you set whether Kitt should follow a redirect. If this function is activated, the forwarding target is crawled and the cache is warmed up for it.Otherwise, Kitt stops the request and no cache is warmed up. The cache status "redirect" is then displayed...