What is Most Wanted Feature?
The term "Most Wanted" already indicates what it is about. It's about the most requested URLs, but what do you need the most requested URLs for?
Both the built-in crawler and the Kitt Cache Crawler use the sitemap as the basis for the URLs to be crawled, with Kitt also offering the option of limiting the selection and thus the number of URLsbased on the post type. Basically, but only fundamentally, the underlying sitemap fulfills its purpose, but far-reaching consequences. What many users do not know is that up to 70% of all URLs containedin the sitemap are either never or only very rarely requested. This inevitably raises the question of why spend resources on the warmup when a large number of URLs are not requested at all or only very rarely?
The cache warmup is not just a convenient feature to warm up the cache in the shortest amount of time. This also has disadvantages, because the cache warmup can often take a very long time and the serverload increases significantly during the warmup. This is especially true for the built-in crawler of the LiteSpeed Cache plugin. As a result, but only when using the built-in crawler, the greatly increasedserver load affects the loading time of the frontend, sometimes significantly.
One therefore inevitably comes to the conclusion that it would make sense to reduce the number of URLs to be crawled to what is absolutely necessary without causing any disadvantages. Exactly from thisconclusion, the Most Wanted function was created. Since version 1.6, this can be optionally activated in the crawler settings. Activated means that the next time you crawl, the sitemap will no longer beused for crawling, but rather the URLs stored in the database. Of course, you should only activate this function when there is a sufficient number of saved URLs. The URLs are recorded independently andregardless of whether the Most Wanted function is activated. In addition to the sitemap, the selection of post types is also inactive, which would have little use for the most wanted function.
If necessary, the Most Wanted function allows you to limit the selection of saved URLs, so that it is possible to set the minimum number of hits and/or a period of time.
The Most Wanted function has an inconspicuous but very important side function. If the sitemap only contains the URLs relevant to search engines, the Most Wanted function will capture all requested URLs.Thus also pagination, filter URLs and search results. The URLs for the search results pages are not currently cached by the LiteSpeed Cache Plugin, but this will change in future versions. URLs thatcontain an anchor, i.e. so-called fragment URLs and AJAX requests, are excluded from the Most Wanted function until further notice. For the first time, this side function also warms up the cache ofthe URLs that were unreachable for both the built-in crawler and Kitt!
As previously noted, the requested URLs are recorded automatically and independently of the crawler settings immediately after the installation or update of the Kitt Cache crawler. When planning thisfunction, great care was taken to ensure that no or only insignificant resources are consumed by the URL acquisition. You can therefore assume that this function will not affect the operation of yourWordpress installation.
The function for capturing requested URLs is also integrated into the cache function of the LiteSpeed web server or the LiteSpeed Cache plugin. This means that every URL requested by a user is cachedduring a session. This not only further relieves your server, but also ensures that a URL that has already been requested is not tracked multiple times by a single user.
Installation of URLs Most Wanted Feature:
If you want to use URLs Most Wanted Feature go to plugin menu of Wordpress Admin and activate plugin: "URLs Most Wanted for Kitt Cache Crawler". This plugin has no configuration and only adds wp-request.phpto the root of Wordpress. It also adds a small Javascript inline script to the head section of your theme. If done this feature records all request URLs from users (guests), but not from bots and not from logged-inusers. Only cachable URLs are recorded (Error pages are excluded).