Sotbit: Content Parser – websites, Excel, XML, YML, CSV, RSS

Increased resilience to potential threats in the solution.

Optimization and fixes:

Fixed a vulnerability when using the unserialize function.

Optimization and fixes:

Optimized parser operation when run via cron;

Optimized operation with pagination;

Optimized module operation with multiple characteristics for the "Offers from multiple containers" mode.

Optimization and fixes:

Module settings for new clients have been moved to the Sotbit menu item;

Other minor fixes.

Optimization and fixes:

Fixed an error exporting documents without the .doc extension;

Fixed an error creating elements when the "Create sections from XML file" checkbox is enabled;

Fixed multiplication when parsing by selector;

Fixed an error when viewing parser run results;

Other minor fixes.

NOTE! We strongly recommend performing a site backup before installation.

Optimization and fixes:

Improved compatibility with PHP 8.1

New functional capabilities:

A new API 2.0 of the Yandex Translator has been integrated.

Optimization and fixes:

Module settings for new clients have been moved to the SoBitrix menu item;

Other minor corrections.

Optimization and fixes:

Fixed the price attribute export for an offer with a single characteristic;

Fixed the parser export to another site;

Fixed the error logging functionality when parsing via an agent;

Fixed automatic authorization;

Optimized parsing of large files;

Redesigned the mechanism for determining the encoding of the donor site;

Other minor fixes.

New functional capabilities:

A new RSS parser type has been added;

A new Page parser type has been added.

Optimizations and fixes:

Image parsing has been optimized when the link is contained in the [data-lazy] attribute;

The "Check authorization" functionality has been optimized;

Saving products without an image has been optimized in case of an error;

Parser operation has been optimized to correctly handle relative links.

Optimization and fixes:

Optimized memory usage during parser operation;

Fixed error loading images via FTP into XML files;

Optimized markup group operation so that only one rule from the group can be applied at a time;

Fixed error deactivating or zeroing products;

Fixed pagination navigation when the initial link is set with a pagination navigation parameter;

Fixed loading bar display;

Fixed display of the number of elements after restart;

Optimized handling of additional XML file URLs;

Fixed display of the number of created sections in XML-type parser;

Fixed display of the field settings editor for each page of the document in XLS-type parsers;

Optimized loading of additional images in offers from XML files;

Optimized category creation in XML-type parser.

Optimization and fixes:

Fixed markup operation;

Fixed image loading from CSV files;

Fixed adding sections from XML file;

Fixed action on products from previous export in catalog mode;

Fixed image loading via FTP.

Optimization and fixes

A critical error in the "catalog" parser when exporting to a highload block has been fixed;

Errors in the "catalog" parser operating in the "offers with a single characteristic" mode have been fixed;

Errors in determining the encoding of the source website have been fixed;

Parsers that remain unlinked to an existing category are now moved to the root of the list;

Support for loading gzip-compressed images has been added;

Other minor fixes.

Optimization and fixes:

The "UTF-8 (fix)" encoding has been added for websites with non-standard UTF-8 encoding declarations;

An error in processing links with uppercase characters has been fixed;

The last modification date of the parser is now saved correctly;

Properties in lists are now sorted alphabetically, with their character code indicated in parentheses;

Processing of relative links to the detailed product page has been improved;

If the product price selector encounters a string with two or more dots ("22.58. rub./3pcs."), all characters starting from the second dot will be ignored (resulting in "22.58");

Cleaning of the parser's temporary files directory has been improved.

Optimization and fixes:

Fixed a rare error in incorrect processing of product names if the detail page uses UTF-8 encoding;

Fixed processing of the "&" symbol in the site URL;

Fixed an error loading images from previews in the "catalog" type parser;

Improved processing of relative links to the product detail page;

Fixed loading of PDF files into products.

- Fixed an error duplicating additional product images during parsing. Duplicates in products will disappear upon the first update of the corresponding field;

- Fixed vulnerabilities in the module code;

- Added a field for product preview descriptions to the XML parser.

- Fixed a bug with duplication of additional images;

- Fixed a bug with the detail description type.

- Fixed an error processing pages in WORK mode;

- Fixed the function for determining image types;

- Fixed an error processing products for the CSV type parser;

- Added the ability to activate products upon their update;

- Fixed the message about the end of the module's demo period;

- Fixed an error filtering products by properties;

- Fixed an error in uniqueizing trade offers;

- Fixed an error in the checkData() function.

- Fixed errors in working with sections in the XML parser

- Improved handling of image links where the extension is not explicitly specified

- Fixed errors in the operation of XML and catalog parsers in "work" mode

- Fixed errors in saving property values set by default

- Fixed image loading from links with get-parameters

- Fixed an error causing the XML parser to stop

- Fixed an error in processing multiple properties

- Fixed an error in saving infoblock elements

- Fixed an error causing incorrect parser stoppage and progress display exceeding 100%

- Added support for ISO-8859-1 encoding

- Fixed a rare error when loading additional product photos

- Fixed an error in automatically resizing images according to infoblock settings

- Fixed errors in parser exports

- Minor code optimizations

- Fixed errors in working with Bitrix version 18.0.6.

- Fixed errors in parser export.

- Debug code removed from the XLS parser.

- Added the ability to export parsers.

- Added the ability to process multiple properties.

- Clarified the description of parser authorization errors.

- Fixed the handling of relative links starting with "//"

- Fixed the parseCatalogSelectorProperties and parseCatalogSelectorPropertiesPreview functions;

- Fixed the functionality for updating additional prices;

- Fixed the image parsing function with get parameters;

- Fixed the URL parsing function;

- Fixed the procedure for parsing detail pages in addresses containing spaces.

- Added the ability for XML-type parsers to parse into highload blocks;

- Separated the procedure for processing the base price from other price types for the catalog-type parser;

- Changed the product update procedure: if a product has been moved to a section, the parser will not move the product to the section specified in the parser settings.

- Refactored the authorization check functionality from the module;

- Fixed a broken encoding error in XML parser properties.

- Optimized the URL checking procedure;

- Fixed an error where the parser did not stop upon reaching the set number of pages in the "Working with pagination" settings under the "Pagination" tab;

- Added a session extension procedure if parsing is not performed via an agent to prevent session failure;

- Fixed an error causing the parser to restart via an agent;

- Optimized encoding handling;

- Fixed the procedure for "what to do with products present in the previous export";

- Fixed the product filtering procedure by properties. Tab "Properties" -> "Filter products by properties";

- Added the ability to parse into the "purchase price" field in the "xml" parser type;

- Fixed the function for adding, removing, or changing field and property characters, tab "Properties";

- Conducted work to eliminate memory leaks for parser types "catalog" and "csv".

- Optimized the image parsing procedure;

- Optimized the menu.

- Fixed an error occurring at the end of the module's demo version;

- Fixed retrieval of the product count via informers;

- Fixed the character encoding change for the functionality "Add/remove/change field and property characters";

- Fixed the "Parsing properties and automatic creation" functionality on sites with non-UTF-8 encoding;

- Fixed parsing of properties where the attribute contains Russian text on sites with non-UTF-8 encoding;

- Fixed the logic for checking the product URL;

- Optimized the XLS parser code.

- Fixed the encoding for "Product name selector:"

- Parser type "catalog": fixed an error parsing URLs with anchors

- Parser type "xml": in the content for the selector "Product attribute name selector", data of the following type

- Fixed an error that occurred if, in a property of the information block dictionary type, "create new dictionary" was specified

XML parser type:

- Added the ability to link products to multiple sections if section IDs are specified via commas in the selector or attribute;

- Also implemented the ability to specify selectors for "Product category selector:" via commas

XML parser issues fixed:

working with local files;

splitting files into parts and processing them;

working with the option "What to do with products present in the previous export and absent in the current one" on the "Update / Uniqueness" tab.

- The XML parser now supports parsing category attributes (description, image, additional fields)

- Minor updates

- Added ability to load data into HL blocks

- Added parser types xls+catalog and xml+catalog

- Minor corrections

- Minor corrections

- Minor corrections and fixes

- Added ability to export stock levels to multiple warehouses

- Added ability to load images from xls files;

- Added ability to load products from csv and xls files into sections specified in the product (by name);

- Image upload via FTP for CSV, XLS parsers

- Image upload from file for XLS parser

- Minor fixes

- Support for parsing multiple price types implemented (for XML, Catalog, CSV, XLS parsers)

- Functionality for working with stock informers implemented (for XML, Catalog, CSV, XLS parsers)

- Splitting of large XML files implemented

- Mapping of categories from XML file to existing InfoBlock categories

- Filter by properties implemented (for XML parser)

- Minor issues fixed

- Parsing of trade offers from catalog page implemented (for Catalog parser)

- Ability to send email notifications about the start and completion of parsing added. Minor fixes

- "Smart logging" implemented

- Minor fixes

- Fixed authorization for XML, CSV, XLS parsers

- Minor changes

- Warehouses implemented

- XLS and XLSX file parsing implemented

CSV file parsing implemented

- Image parsing for offers (only for offers from a separate container)

- Uniquification of created sections during XML parsing

- Pagination step introduced

- Parsing of offers from multiple containers

- Fixed error when working with highload properties

- Fixed encoding error when working with XML

- Minor improvements

- Additional price change conditions by section implemented

- Fixed parsing error for sections in XML

- Other minor improvements and fixes

- Minor improvements

- Added functionality to update only current products without creating new ones

- Forced deletion of files from the temporary tmp folder

- Implemented functionality to reset stock levels if a product is missing in the export

- Fixed errors related to multi-part parsing

- Multi-part parsing! Now you can export a catalog with multiple sections using a single parser!

- Added functionality to parse product quantities

- Minor improvements and corrections

- Minor improvements and enhancements

- Added the ability to create sections with identical names (XML)

- Parsing of trade offers with separators x, xl, xxl, m (XML)

- Video tutorials have been added (XML)

- Implementation of trade offers in XML parsing

- Implementation of Services and Authorization tabs in XML parsing

- Refinement and bug fixes for XML parsing

- XML parsing has been implemented

- Added the ability to parse properties from element attributes

- Minor improvements

- Implementation of new events for developers

- Minor improvements to the solution

- Fixed an error with using infoblock settings during image resizing

- Events added: start of parsing, end of parsing, before creating an item, after creating an item

- Minor improvements

- Warning removal

- Fixing minor issues

- Minor fixes

- Fixing a critical error caused by a Bitrix update

- HTTP authentication added

- JS scripts improved

- JS scripts improved

- Minor improvements

- Improved product parameter handling

- Text translation capability (Yandex.Translate)

- Sending unique text to Yandex

- Improved pagination handling. You can now independently configure pagination logic if standard methods are insufficient.

- Minor improvements

- Added new offer parsing type with single characteristics

- Changed offer naming logic when the offer name is missing

- Minor improvements and fixes

- Fixing minor issues

- Added category functionality for RSS and page types

- Fixed critical error in the new parser category functionality

- Added ability to create category folders for parsers

- Ability to upload products to inactive sections

- Image loading from background images

- Refined price rounding logic

- Added the ability to delete or add characters or words to String (S) fields and properties

- Removed the detailed image from additional images

- Default property values have been moved to a separate block

- Minor improvements

- Parsing of tabular offers

- Ability to delete or deactivate products not involved in the current export

- Added support for Directory (highload) type properties

- Implemented an event-driven model

- Now all files in the description are saved to the server via the Media Library, and you can easily delete any file

- Minor improvements and enhancements

- Redesigned property visualization. Now it is more convenient and easier to manage property parsing

- Added the ability to add new properties directly from the parser

- Added the ability to parse properties from the preview

- Added support for HTML properties

- Added support for File (F) type properties. Now you can easily upload instructions and other documents

- Price rounding

- Fixed minor bugs

- Minor improvements

- Minor improvements

- Minor improvements to detailed description parsing. Now parsing can be performed using multiple selectors.

- Working with cookies

- Added the ability to add the attribute name to pagination

- Fixed an error of entering a symbolic code when running the parser via an agent (rss and page)

- Fixed a minor bug with the base tag

- Support for the https protocol

- Fixed minor bugs

- Fixed shortcomings

- Fixed a bug with tag deletion

- Update of informational text

- Added the ability to set the price format

- Fixed minor bugs

- Page parser refinement when parent equals link

- Parser works taking into account the base meta tag for relative links

- Fixed errors with relative links in page parsing

- Added selection of uniqueness type in page and RSS mode

- Possibility of parsing in page mode if the link is within the selector itself

Minor refinements

- Minor improvements and fixes

- Minor bugs fixed

- Added support for parsing Cyrillic domains

- Ability to parse multiple sections simultaneously

- Added support for parsing prices in offers

- Added default property values

- Fixed a minor bug when parsing properties by name

- Added activity date when parsing the Catalog type

- Minor bugs fixed

- Fixed a bug with HTML-type descriptions

- Fixed an error when parsing properties via the br tag

- Fixed a minor bug in determining the uniqueness of a news item/article

- During page parsing, the source remains unchanged, i.e., it is not converted to lowercase

- Added the ability to parse the product name from the detailed page

- Automatic creation of a unique symbolic code

- Saving the active tab when clicking the "Apply" button

- Fixed a bug when deleting element attributes

- Increased field sizes for deleting elements and attributes

- Added the ability to parse properties by name via the br tag

- Fixed minor bugs

- Fixed errors during parser authorization

- Debugged module functionality for PHP 5.4

- Added image parsing with uppercase extensions

- Fixed a bug when copying parsers

- Removal of unnecessary spaces in the description

- Changed the order of tag and element removal

- Fixed error: Class undefined.

- Added functionality for authorization on third-party sites.

- Added the ability to change prices based on multiple conditions.

- Fixed minor bugs

- Fixed encoding issues on some PHP versions

- Fixed parser operation in demo mode

- Fixed minor bugs

- Adjusted parser operation under agent

- Adjusted preloader operation

- Fixed minor bugs

- Added catalog parsing functionality

- Fixed minor bugs

- Fixed minor bugs

- Added the ability to parse not only RSS feeds but also news pages

- Added the ability to set a delay between requests to the source to bypass activity control systems

- Fixed minor bugs

- Added the ability to copy parsers

- AJAX parsing and a preloader have been implemented on the parser page

- Tag removal in titles, meta descriptions, and keywords

- Additional fields added to the filter and sorting of the parser list

Fixed minor bugs