-
Deisy Swarna became a registered member a year ago
-
Nora Ramzan replied to the discussion Compare Python and Node.js to scrape product reviews from Momo Taiwan in the forum General Web Scraping a year ago
Compare Python and Node.js to scrape product reviews from Momo Taiwan
Node.js with Puppeteer is better suited for handling dynamic content since it can render JavaScript-heavy pages. It also allows for easier interaction with elements such as pop-ups or expandable sections, which are common on e-commerce sites like Momo.
-
Nora Ramzan replied to the discussion Use Node.js to scrape product titles from Books.com.tw in the forum General Web Scraping a year ago
Use Node.js to scrape product titles from Books.com.tw
If the product title element is dynamically loaded, Puppeteer is well-suited for the task. However, inspecting the network requests for API endpoints could reveal a direct way to fetch product data without rendering the entire page.
-
Nora Ramzan started the discussion How to extract sports team names and match schedules from a website? in the forum General Web Scraping a year ago
How to extract sports team names and match schedules from a website?
Scraping sports team names and match schedules can provide valuable data for analysis or personal use. Most sports websites structure this information in lists or tables, making it easy to locate with HTML inspection. For static pages, tools like BeautifulSoup are effective in extracting team names and match timings. Dynamic sites often…
-
Nora Ramzan changed their photo a year ago
-
Nora Ramzan became a registered member a year ago
-
Sunny Melanija replied to the discussion Use Python to scrape product availability from Ruten Taiwan in the forum General Web Scraping a year ago
Use Python to scrape product availability from Ruten Taiwan
Inspecting the network traffic in the browser’s developer tools could reveal API endpoints used by Ruten to fetch availability information. Querying these APIs directly might provide more reliable and efficient access to the data.
-
Sunny Melanija replied to the discussion Use Go to scrape product prices from PChome Taiwan in the forum General Web Scraping a year ago
Use Go to scrape product prices from PChome Taiwan
If the price structure varies by product category, adding conditional logic to handle different classes or tags could make the script more robust. For example, the scraper could first identify the category and adjust its queries accordingly.
-
Sunny Melanija started the discussion Scraping prices and availability from travel booking websites in the forum General Web Scraping a year ago
Scraping prices and availability from travel booking websites
Scraping prices and availability from travel booking websites is challenging due to their dynamic nature and frequent use of anti-scraping mechanisms. Most travel sites use JavaScript to render content like flight or hotel availability, requiring tools like Selenium or Puppeteer to scrape effectively. Another approach is to monitor…
-
Sunny Melanija changed their photo a year ago
- Load More