What is Kitt Cache Crawler?
Kitt is an application that automatically requests all URLs on a website. This process is also known as crawling. However, Kitt does not index any content like a search engine crawler, but leaves it with a request. This crawling serves the sole purpose of warming up the page cache. Thanks to the multithreading mode, Kitt is able to request up to 200,000 URLs within 1 hour without overloading the server. However, Kitt is not a universal crawler like almost every other external crawler or crawler service. On the one hand, Kitt imitates a natural user, which is particularly important, but not only important for LiteSpeed LScache. On the other hand, each Kitt Cache Crawler version is individually adapted to the respective page cache of an application, because not all page caches are the same.