Function Description

Initially, the topic plugin checks the request. If the route is V1/pacemaker/products and the module is enabled, the plugin modifies the request topic to async.bulk.pacemaker.post.save.

The Multiple Operation plugin invokes the Operation Service to verify two conditions: whether the requests include a pacemaker topic and if the number of products exceeds the configured operation threshold. If both conditions are met, the Operation Service consolidates the requests into a single, larger operation. Otherwise, it resets the topic.

The Publisher is responsible for queuing the operation. Since the request should be processed by the Magento Consumer, but needs to be recognized later by the Pacemaker Operation Handler, the operation itself includes the Pacemaker topic. However, the Publisher Pool Plugin ensures that the publisher used is the Magento Product Publisher. For this purpose, it modifies the parameters of the request in the before hook so that the Pacemaker topic is transformed into a Magento product topic.

The Magento consumer decodes the operation topic and identifies the appropriate handler. The module’s consumer plugin detects the topic and returns the Pacemaker Operation Handler. This handler then receives the decoded products from the encoder plugin and processes the operation accordingly.

The Pacemaker Operation Handler executes the 'OperationCsvExporter' which iterates over all products, decide if the product exists or have to be created and give the selected product to the ConverterChain.

The Converters convert the product to a csv array and give it back to the Csv Exporter. The Csv Exporter split the collected data in new and existing products and return the arrays to the operation Handler. At next the pacemaker operation Handler write the data to two separated csv files.

Then a upload model for each csv file should be created which can be shown in the magento backend, also a import_catalog pipeline should be created. Now you can start the heartbeat to run the import pipeline steps.