Site map for AI (llms.txt)

What this solution does

The Xlogic AISitemap module automatically generates an llms.txt file in the site root or a subdirectory. This file contains a brief site description and a structured list of pages with links and explanations. AI assistants and search engines with artificial intelligence use this file to understand the site's topic and identify important sections without needing to crawl all pages.

The file is built from data in information blocks (services, products, articles, case studies) and a manual list. New items are automatically added to the file without further edits. The module allows including pages absent from information blocks, such as Contacts, About Us, or Delivery.

The system supports multisite installations by creating a separate file for each site. File size is controlled and does not exceed a specified limit, ensuring stable operation even with tens of thousands of items in the catalog.

Configuration includes selecting information blocks, defining their output order in the file, and setting group headers. Link descriptions are taken from a selected field: preview, detailed text, or a string property. Only names can be displayed. Description length is automatically truncated to 200 characters. Items are sorted by a specified rule: by sorting order, by newest first, or by name.

The module generates an llms.txt file for artificial intelligence by filtering information block sections based on one or more criteria and outputting them as links. Only materials accessible to site guests are included in the final file; sections and information blocks with restricted access are ignored.

A manual list of links can be created with options for grouping, adding descriptions, and configuring sorting. A brief site description is placed at the beginning of the file. All links are absolute and use the HTTP protocol or the HTTPS protocol.

There are limits on the number of links per group and the total file size in kilobytes. If a limit is exceeded, the file is truncated at the last complete line.

Updates occur on a schedule (from once an hour to once a week) and automatically one minute after adding, modifying, or deleting information block elements and sections. A series of edits triggers a single file rebuild.

The status of the last generation is displayed on the page, including the date, number of links, file size, and a link to the file. If the write operation fails, the reason for the error is shown. The file is written via a temporary file to ensure data integrity for search robots.

When the module is uninstalled, settings and the manual link list are preserved. Access to the functionality is provided via the menu item "Marketing → LLMS.txt for AI". The interface supports Russian and English languages.

System requirements: the main 1C-Bitrix module version 20.0.0 or higher. The module does not use paid external services and operates exclusively with your site's data.

The sitemap update is performed by a Bitrix agent. The process triggers on every site request and also runs according to the cron schedule when background agents are activated.

Write permissions must be granted to the web server user in the site root directory for correct operation.

The description from the property is available only for string properties without binding to other elements and without multiple values. HTML properties and dictionaries are not supported in this field.

Only active sections and elements valid by date are included in the sitemap.

For “Site map for AI (llms.txt)”, General iT can perform integration, configuration and a final check after installation.