Mila Njord
-
Mila Njord started the discussion How can I handle large amounts of data scraped from a website? in the forum General Web Scraping a year ago
How can I handle large amounts of data scraped from a website?
Divide your data into manageable chunks. Use pagination or batch processing to split up scraping tasks, which reduces the memory load.
-
Mila Njord changed their photo a year ago
-
Mila Njord became a registered member a year ago