Hello friends !!!<\/p>\n\n\n\n
We often use collections to fetch and work with data from our database in Magento 2 and mostly these work perfectly fine,
but when we talk to fetch and iterate a huge number of records in a single process it becomes extremely difficult because memory usage becomes a problem.
we can face most of the problems while dealing with large collections. so we need to look for an alternative solution. In this article, I\u2019m going to talk about how to handle huge result sets in Magento2.<\/p>\n\n\n\n
(Magento\\Framework\\Model\\ResourceModel\\Iterator) that enables us to iterate huge database result sets by applying callbacks to each row in the result. This is perfect when you have millions of records that you need to process without loading them all into memory.<\/p>\n\n\n\n
The purpose here is to only ever load a single row into memory at any time (unless you assign it to a variable outside the scope of the callback function passed to $iterator->walk()). If we achieve this then it does not matter how many rows we need to process, it should not increase our memory consumption. <\/p>\n\n\n\n
Let\u2019s understand this in an example:<\/p>\n\n\n\n
<?php\n\nuse Magento\\Framework\\App\\ResourceConnection;\nuse Magento\\Framework\\Model\\ResourceModel\\IteratorFactory;\n\nclass IteratorExample\n{\n \/** @var ResourceConnection *\/\n private $resourceConnection;\n \n \/** @var IteratorFactory *\/\n private $iteratorFactory;\n\n public function __construct(ResourceConnection $resourceConnection, IteratorFactory $iteratorFactory)\n {\n $this->resourceConnection = $resourceConnection;\n $this->iteratorFactory = $iteratorFactory;\n }\n \n public function processResults(): void\n {\n $connection = $this->resourceConnection->getConnection();\n $iterator = $this->iteratorFactory->create();\n \n $query = $connection->select()->from('table_name');\n\n $iterator->walk((string) $query, [function (array $result) {\n \/\/ do something with $result\n }], [], $connection);\n }\n}<\/pre>\n\n\n\nHope this will be helpful.
Thanks<\/p>\n","protected":false},"excerpt":{"rendered":"