Pantheon: Creating an RSS feed from any web page and monitoring new items

What this solution does

The Pantheon module generates an RSS feed from web pages that lack a native subscription, such as competitor catalogs, supplier news sections, or industry resources. The system automatically checks specified pages on a scheduled basis with an interval as short as 15 minutes and instantly notifies users of new entries or important news. Current data is displayed in a gadget on the administrative panel desktop. Feed creation is performed in a visual builder where the algorithm automatically identifies the structure of entries and their fields, including title, price, image, and link. Errors in field detection are corrected with a single click. Multiple feeds can be merged into a single stream, and previews of new entries can be imported into a gadget or information block.

For businesses, it is critical to learn first about competitor new products, supplier arrivals, or important industry news. However, such websites rarely provide RSS feeds, forcing staff to manually check dozens of sites daily. As a result, new items are noticed one to two days later, when it is already too late to react effectively.

The Pantheon module automatically converts any such web page into an RSS feed and performs monitoring on a scheduled basis. As soon as a new entry appears, the system immediately notifies the user. This allows you to react within the same hour: add products to your catalog, launch promotions, or contact suppliers.

The Pantheon module enables the creation of RSS feeds from any web page and monitors for new content. This solution is designed for companies that need to receive timely notifications about critical supplier updates, such as new stock arrivals, shipment rescheduling, or changes in cooperation terms.

To create a feed, navigate to Services, then Pantheon, select the RSS Feed Builder, and click Add Feed. In the form that opens, enter the name for the new feed and the URL of the web page containing the product list or news items.

Click the "Determine Automatically" button. The page opens directly within the admin panel. The module finds repeating entries — in this case, seven news items — and automatically identifies the title, summary, image, link, and date within them. The result appears in a green panel below the button. Detected entries are outlined with a dashed border, identified fields are highlighted, and checkmarks appear on the field control buttons.

3. Edit the field by clicking. If the field is not found or the wrong one is selected, press the field button and click the target element in any single record. Remove an unnecessary field by clicking the cross icon on its button. The tooltip under the buttons explains which element to click. The module automatically locates identical elements in the remaining records. Knowledge of HTML or XPath is not required.

4. Refine extracted data. In the table below the builder, each field displays the expression used and the value source: text, link address, image address, or attribute. Users familiar with XPath can manually edit these expressions.

5. Preview and save. The preview displays the title, summary, image, link, and publication date for each entry before saving. Once saved, the feed receives a permanent address and becomes available via a desktop gadget.

Automatic monitoring is enabled for each feed. The module checks the page on a set schedule with intervals as short as 15 minutes. You can specify working days of the week and active hours. When a new record appears—such as a product, news item, or tender—the system immediately sends a notification. The first check records existing content to prevent false alerts about previously published materials. If the site becomes unreachable or its structure changes, the module will report the error.

The Pantheon module enables the creation of RSS feeds from any web page and monitors for new entries. Upon detecting an update, the system instantly sends a notification via email or transmits data through a webhook to a CRM, custom script, or automation service. The link within the message directs straight to the newly found news item. An example of an actual notification from the module when a supplier publishes important information is shown below.

The Pantheon module allows creating combined RSS feeds that merge multiple sources into a single stream. For instance, you can include supplier news, manufacturer new products, and industry updates. In the creation form, simply select the source feeds to generate one link and one gadget for all devices. Entries from different sources appear in a unified list with new items at the top. Duplicate links found across multiple feeds are displayed only once. Each entry includes a label indicating its specific source.

The Pantheon module generates an RSS feed or a consolidated feed from any web page and displays it directly on the administrative dashboard. The interface shows the title, image, and description of each item. A 'New items only' mode filters the content to show exclusively new records. This allows users to instantly monitor updates from suppliers, competitors, and the industry upon logging into the system without opening external websites.

The Pantheon module collects all detected records on a single page, displaying the appearance date, the source feed, and a link to the original material. Filters are available for time period, specific feed, aggregated feed, and tag. The interface includes a dedicated column for marking new records. Data export to Excel format is supported.

The Pantheon module enables the creation of RSS feeds from web pages that lack native RSS support and monitors them for new content. The solution operates directly within the 1C-Bitrix administration panel, eliminating the need for external services or separate accounts. Generated feeds are accessible on the administrator's dashboard and within the Record History page.

The module is purchased with a single payment, featuring no subscription fees or tiered plans, and imposes no limits on the number of feeds. Page checks for updates can be configured with intervals starting from 15 minutes, including options to specify time windows and days of the week.

Upon detecting new entries, the system sends notifications via email or through webhooks to CRM systems and automation services. It supports the creation of aggregated feeds that combine multiple sources into a single link and one gadget. New items can be imported into a gadget or information block, providing a preview with a direct link to the original source.

Pantheon is a module that creates an RSS feed from any web page and monitors for new content. It supports three output formats: RSS 2.0 with images, Atom 1.0, and JSON Feed 1.1. Access to the feed is provided via a permanent link secured by a secret key. Subscriptions can be set up in any RSS reader or the feed can be connected to automation services.

Word filters

Specify words that must be present in a record and words that cause the record to be excluded. For example, search only for the terms "tender" and "procurement" while excluding records containing the word "archive".

Import to gadget or information block

The module extracts only the record preview: title, image, short description, and link. The full page text is not downloaded. Previews appear in the desktop gadget or as elements in the information block with a link to the original source. By default, elements are inactive and require manager verification. The system automatically prevents duplicate creation.

Source monitoring

The module tracks the availability of the source website and detects changes in its structure. If access fails or the layout changes, the system notifies about the issue and its resolution. Above the feed list, a notification displays the text "No new entries are arriving".

Record changes

Mark the "Track" checkbox to monitor value changes in already published records. The module will notify you of data updates, such as a price change, using the format "was → is now".

The Pantheon module enables creating RSS feeds from any web page and monitoring for new content. When working with complex sources, you can select the User-Agent and page language. The system correctly handles images with lazy loading. To bypass IP address blocks imposed by hosting providers, the module supports proxy servers: you may use a shared proxy or configure a dedicated proxy for each individual feed.

Pantheon: Create an RSS feed from any web page and monitor new items

Tags and permissions

Tags group feeds in the list. Permissions are issued to user groups: view feeds or full access. Being an administrator is not required.

For developers, the module provides a webhook that transmits data in JSON format with HMAC-SHA256 signature protection. It implements seven D7 events that allow correcting records, canceling notifications or import processes, and forwarding new data to external systems.

Isolated builder

External web pages open in an isolated frame with scripts disabled by default. Configuring RSS feeds is available to employees without administrator rights.

Pantheon: Create an RSS feed from any web page and monitor new content

Source-friendly operation. A pause is enforced between requests to the same site, the feed uses caching, and compliance with robots.txt rules is optional. The feed can be paused at any time.

Pantheon: Create an RSS feed from any web page and monitor new items

Feeds are not indexed by search engines. The feed URL contains a secret key, and all server responses are sent with the X-Robots-Tag: noindex header. If the link was generated incorrectly, it can be regenerated.

Pantheon: Create an RSS feed from any web page and monitor new content

Everything runs on your server. No external services, API keys, or subscriptions are required to fetch pages and generate feeds. The site itself handles all loading and collection tasks.

The Pantheon module enables the creation of RSS feeds from any web page and monitors for new content. It requires PHP version 8.1 or higher, along with the DOM and mbstring extensions. The main module must be version 20.5.400 or newer. The installer automatically verifies all required components and reports any missing items.

The cURL and XMLWriter extensions are recommended but not mandatory. In the standard BitrixVM environment, these PHP extensions are disabled, yet the module installs and operates in a simplified mode. Page retrieval is handled via the built-in Bitrix HTTP client, while feed collection and validation proceed normally. The only limitations involve support for SOCKS and HTTPS proxies, as well as access to sites available exclusively over IPv6. Above the feed list, the module will suggest required actions and automatically switch to them once enabled.

Precise check schedule

The Bitrix agent triggers checks on site visits. If visit activity is low, add the module's configuration string to the system crontab to ensure checks run strictly on schedule. Above the feed list, the time of the last run is displayed as either 'by the Bitrix agent' or 'via cron'.

The module requires a MySQL or MariaDB database with UTF-8 encoding. Installation is not supported on 1C-Bitrix versions configured for PostgreSQL or on sites using windows-1251 encoding. The Information Blocks module must be installed to perform data import.

Pantheon: Create an RSS feed from any web page and monitor new items

The module analyzes the raw HTML code of a page without using a browser. To verify data availability, open the page in a browser and press Ctrl+U: if the entries are visible in the source code, the module can read them. The feed is generated based solely on the content of a single page. The module does not follow pagination links or navigate to detail pages to collect data.

Bot protection

Websites protected by Cloudflare or similar services may return a 403 error. Occasionally, changing the User-Agent header or using a proxy helps, but there is no guarantee. Pages requiring authentication are not supported.

Pantheon: Create an RSS feed from any web page and monitor new items

The trial version includes all features, but you can create no more than two standard feeds. Aggregated feeds remain unlimited. Purchasing the module removes all restrictions.

Pantheon: Create an RSS feed from any web page and monitor new items. Detailed documentation with illustrations for each setting, a ten-minute quick start, and ready-made scenarios are available on the developer's official website.

When needed, General iT can implement “Pantheon: Creating an RSS feed from any web page and monitoring new items”, configure the module and verify it against the current website setup.