Magento Consumer/Pipeline Runner

Pipeline Runner

At least one Magento consumer must now get started, which processes the pipeline(s).

Local this can get executed with the following command:
bin/magento queue:consumers:start pipeline.runner.ampq
When using the MySQL MQ, the likewise provided runner can get started:
bin/magento queue:consumers:start pipeline.runner.db
  • In productive environments, the use of Supervisor gets recommended to control better the consumer processes concerning the processing of messages (--max-messages=1)

  • Alternatively, the Supervisor Consumer module is available, which controls the consumers with a Cron Daemon

Heartbeat

As the last step, the heartbeat must be executed to determine the next step to be processed and pass it to the running consumer with the message queue.

With the following command, the pipeline heartbeat can get executed:
bin/magento pipeline:heartbeat
  • The heartbeat is a minutely cron job, which can get configured on productive systems, e.g., with the crontab

  • After the execution of the heartbeat, the pipeline was successfully processed