Kitt Cache Warmup Crawler for WooCommerce W3 Total Cache Plugin (W3TCWC) "plaid" Edition

Cache plugins for WordPress abound, but few are as popular as the W3 Total Cache plugin. After all, in addition to the actual cache function, it offers numerous functions for optimization and thus for improving the loading time. Even if these optimization functions are not significantly different from those of other cache plugins, the W3 Total Cache plugin has the advantage that you can use this plugin with a conventional server configuration. It does not need a special web server, as is the case with the LiteSpeed ​​LScache plugin, although you can sometimes see a significant performance advantage with the LiteSpee LScache plugin. Despite these differences, all cache plugins share the same disadvantage. In order to be able to use the advantages of the page cache, this cache must be warmed up. Almost every cache plugin has a built-in crawler, but these are all far too slow, are not very flexible and cause a noticeably high server load. When using Wordpress and the WooCommerce plugin professionally, the built-in crawler can hardly keep up with the sometimes frequent purge processes of the cache. This significant disadvantage almost completely negates the benefit of the cache.

Kitt The Cache Crawler solves this significant problem. Kitt was not specifically designed to meet the needs of a page cache, but also to the needs of the W3 Total Cache Plugin for Wordpress. Kitt is therefore not only lightning fast and crawls up to 200,000 URLs per hour, but also adapts itself to the current load conditions of the server. If conventional crawlers are usually started at night because fewer visitors are expected at that time, this does not matter to Kitt. Kitt automatically adjusts the crawling speed to the current load, so that the server is never overloaded and the front end is never restricted.

Kitt Cache Crawler is a standalone Application that has to be installed in parallel to your WordPress Installation. Installation is simple and can be done by everyone. If you were able to install WordPress, then you can install Kitt as well.

Requirements:

• WordPress
• Apache web server (nginx and LiteSpeed (LSWS/OLS) are unsupported)
• W3 Total Cache Plugin
• WooCommerce Plugin
• YOAST Seo Plugin for WordPress (optional)
  If YOAST Seo Plugin isn't installed URLs to be crawled cannot be filtered by Post Types.
• PHP Version >= PHP 7.4 & < 8.2
• cURL
• ionCube Loader (Version >11)
• /proc/stat must be readable
• /proc/cpuinfo must be readable
• PHP Function sys_getloadavg must exist
• DirectAdmin is unsupported!!!

All requirements are mandatory! If any of the listed requirements are not met, Kitt will not run.

When developing Kitt Cache Crawler, we placed great value on high utility. However, this does not mean that Kitt should become a monster of attitude, so that it would take too much time to adapt Kitt to individual needs. Kitt is already pre-configured during installation, so in most cases it is sufficient to accept these default settings. However, experts have a wealth of settings available to make Kitt even faster. However, you should invest some time in the dynamic load control. Kitt will also support you, but the better you understand how your server reacts under load, the better you can support Kitt in his work.

• Crawling up to 200,000 URLs within 1 hour Kitt Cache Crawler can crawl up to 200,000 URLs within 1 hour, even on Shared Hosting. This is up to 20x faster as built-in Crawler.
• Dynamic Load Control Kitt Cache Crawler cares about the Load of your Server. A Dynamic Load Control checks the current Load while Crawling. When the load gets too high, Kitt automatically reduces the speed and the number of concurrent requests until a predefined limit is reached. This dynamic load control guarantees that frontend operation is not adversely affected by crawling.
• Auto-Adjust Configuration Kitt Cache Crawler comes with pre-configured Settings, that fits in most cases. So you don't have to learn which settings are the best. Each setting is also provided with recommendations that give you even more security when making any changes.
• Control Panel Version and Version for Command Line Interface (CLI) Each Kitt Cache Crawler version can be run in at least 2 ways. Kitt can be run from within the Control Panel, but also for use in the Command Line Interface. The CLI version is therefore also suitable for use as a cron job.
• Tune-up Settings A wealth of tuning settings are available for experts to make Kitt even faster.
• Cache Inventory The cache inventory optionally gives a detailed report on the cache status of each URL. This report also includes information about Cache Vary's cache status.
• URLs Most Wanted URLs Most Wanted reduces cache warmup time and resources by up to 70% and dramatically offloads the cache warmup server.