What this solution does
The module protects website content from automated scraping by competitor bots, including articles, product descriptions, and specifications. It employs a multi-level defense system to detect and block both simple and advanced bots that mimic human behavior. The module also allows restricting or completely blocking access for visitors from specific countries based on their IP addresses. Blocking parasitic bots helps significantly reduce server load.
Blocking mechanisms:
By activity: blocks users making too many requests in a short time.
By IP address and subnet range.
By User-Agent: includes a list for popular bots.
By country: geolocation is determined via IP address.
By official AI bots (OpenAI, Anthropic (Claude), Perplexity, Apple): available from version 1.21.2.
JS Challenge: verifies JavaScript execution to filter out bots without script support, without manual CAPTCHA.
The 'Anti-Scraping and Bot Protection' module by Protobyte filters traffic based on multiple criteria. To ensure 100% availability for legitimate search engines, the system uses reverse DNS verification, while bots impersonating search crawlers are blocked immediately. Rules can be configured for specific sites within a 1C-Bitrix multisite environment, by page URL, user group, IP address, subnet range, and User-Agent. An integrated interface allows analysis of blocked IP addresses and flexible adjustment of blocking rules. The demo period includes full functionality without restrictions. If the composite mode is enabled on the site, additional steps described in the installation instructions must be performed.
General iT can install and configure this module and check how it works on your website.