Throttling module

I’m working on a module for our website to have search engines by-pass the normal EE throttling settings. The reason for this is that we were seeing lots of “You have exceeded the allowed page load frequency” in our Google search results.

We have already been doing this crudely for about 6 months with a hack in /libraries/Throttling.php. It works very well and the “exceeded” errors in Google have disappeared. The new function I’ve added to Throttling.php does a reverse DNS lookup to verify that the bot is real and then adds the IP address of the bot to a whitelist or blacklist accordingly. If a search engine bot checks out then throttling is disabled for that IP address.

I am now making this into a more proper module so that we can manage the list of user agents from within CP. I also want to add the option to switch off throttling for logged in users is certain member groups. However, it would be great if I didn’t have to do the hack in Throttling.php.

I don’t think that there is an extension hook that I can use. Is there another way to tie into the throttling function of EE without needing to do the hack each time after an EE update?

Any help would be greatly appreciated. 😊