Samir Sergo
-
Samir Sergo replied to the discussion Use Go to scrape product prices from PChome Taiwan in the forum General Web Scraping 9 months ago
Reply to Use Go to scrape product prices from PChome Taiwan
If the prices are dynamically loaded via JavaScript, fetching the underlying API might be a more reliable approach. Examining the network requests in the browser’s developer tools could reveal the API endpoints used to load pricing data.
-
Samir Sergo replied to the discussion Use Node.js to scrape product availability from MediaWorld Italy in the forum General Web Scraping 9 months ago
Reply to Use Node.js to scrape product availability from MediaWorld Italy
Would it be helpful to add error handling for cases where the availability section fails to load? Logging specific errors could provide insights into why certain pages fail and help refine the script for future runs.
-
Samir Sergo started the discussion How to compare Puppeteer and Scrapy for scraping dynamic data? in the forum General Web Scraping 9 months ago
How to compare Puppeteer and Scrapy for scraping dynamic data?
Scraping dynamic data often requires tools that can handle JavaScript-rendered content. Puppeteer and Scrapy are two popular options, but they serve different purposes. Puppeteer is a Node.js library that controls a headless Chrome browser, making it ideal for scraping dynamic sites by rendering JavaScript exactly as a user would see it.…
-
Samir Sergo changed their photo 9 months ago
-
Samir Sergo became a registered member 9 months ago
