-
Lencho Coenraad started the discussion Compare PHP and Python for scraping categories from The Warehouse New Zealand in the forum General Web Scraping a year ago
Compare PHP and Python for scraping categories from The Warehouse New Zealand
How does scraping product categories from The Warehouse, a leading retailer in New Zealand, differ between PHP and Python? Does PHP’s DOMDocument provide a more straightforward approach for parsing static HTML, or is Python’s BeautifulSoup more efficient for handling diverse content structures? How do both languages handle large-scale scraping…
-
Lencho Coenraad changed their photo a year ago
-
Lencho Coenraad became a registered member a year ago
-
Mawunyo Ajdin replied to the discussion Scrape product titles from Currys UK using Python in the forum General Web Scraping a year ago
Reply to Scrape product titles from Currys UK using Python
The script could be improved by implementing a retry mechanism in case of failed requests due to network issues or server errors. Adding a loop to attempt multiple retries with delays between requests would ensure reliability.
-
Mawunyo Ajdin replied to the discussion Extract shipping fees from Amazon UK product pages using Node.js in the forum General Web Scraping a year ago
Reply to Extract shipping fees from Amazon UK product pages using Node.js
Integrating error handling mechanisms would improve the robustness of the script. For example, if the shipping section fails to load or the selector changes, the script could log the error and attempt a retry. Additionally, capturing screenshots of the failed pages would assist in debugging.
-
Mawunyo Ajdin started the discussion Compare Go and Node.js for scraping store locations from Woolworths Australia in the forum General Web Scraping a year ago
Compare Go and Node.js for scraping store locations from Woolworths Australia
How does scraping store locations from Woolworths, one of Australia’s largest supermarket chains, differ between Go and Node.js? Does Go’s Colly library provide better performance for handling static content, or does Node.js with Puppeteer offer more flexibility for interacting with JavaScript-rendered elements like maps or location pop-ups?…
-
Mawunyo Ajdin changed their photo a year ago
-
Mawunyo Ajdin became a registered member a year ago
-
Aretha Melech replied to the discussion Use PHP to scrape discount banners from the homepage of Selfridges UK in the forum General Web Scraping a year ago
Reply to Use PHP to scrape discount banners from the homepage of Selfridges UK
Another enhancement could involve scheduling this script to run periodically to track changes in discounts or new promotions on the homepage. This could be done using cron jobs in a Linux environment.
-
Aretha Melech replied to the discussion Scrape delivery options from Dunelm UK using Go in the forum General Web Scraping a year ago
Reply to Scrape delivery options from Dunelm UK using Go
The script could be improved by adding error handling for pages where the delivery options section might not exist. A simple check could be added to log cases where no delivery information is found.
- Load More
