-
Ella Karl replied to the discussion Compare Ruby and Go to scrape shipping details from Yahoo! Taiwan in the forum General Web Scraping a year ago
Reply to Compare Ruby and Go to scrape shipping details from Yahoo! Taiwan
If the shipping details are dynamically loaded, neither Ruby’s Nokogiri nor Go’s Colly would suffice alone. In such cases, integrating tools like Selenium for Ruby or Playwright for Go would help render JavaScript and access the required data.
-
Ella Karl started the discussion How to scrape hotel prices from Expedia.com using JavaScript? in the forum General Web Scraping a year ago
How to scrape hotel prices from Expedia.com using JavaScript?
Scraping hotel prices from Expedia.com using JavaScript can be effectively done with Node.js and Puppeteer, a library that provides control over a headless browser. This approach allows you to handle dynamic content rendered by JavaScript, ensuring all hotel listings are fully loaded before data extraction. The process involves navigating to…
-
Ella Karl changed their photo a year ago
-
Ella Karl became a registered member a year ago
-
Segundo Jayme replied to the discussion Compare Python and Node.js to scrape product reviews from Momo Taiwan in the forum General Web Scraping a year ago
Reply to Compare Python and Node.js to scrape product reviews from Momo Taiwan
Concurrency is simpler to handle in Node.js due to its non-blocking I/O model. This makes it more efficient for scraping multiple pages simultaneously, compared to Python’s threading or multiprocessing libraries.
-
Segundo Jayme replied to the discussion Use Node.js to scrape product titles from Books.com.tw in the forum General Web Scraping a year ago
Reply to Use Node.js to scrape product titles from Books.com.tw
Adding error handling for missing elements or incorrect selectors would improve the script. For example, logging pages with unexpected structures can help refine the scraper for broader usage across Books.com.tw.
-
Segundo Jayme started the discussion How to scrape rental property data from Trulia.com using Ruby? in the forum General Web Scraping a year ago
How to scrape rental property data from Trulia.com using Ruby?
Scraping rental property data from Trulia.com using Ruby can help you collect useful information like property addresses, rental prices, and key features. By using Ruby’s open-uri library to fetch HTML content and the nokogiri gem for parsing, you can extract structured data from the page. The script navigates through the page…
-
Segundo Jayme changed their photo a year ago
-
Segundo Jayme became a registered member a year ago
-
Indiana Valentim replied to the discussion Use Python to scrape product availability from Ruten Taiwan in the forum General Web Scraping a year ago
Reply to Use Python to scrape product availability from Ruten Taiwan
The script could be improved by adding error handling for cases where the availability information is missing or the structure of the page changes. Logging these errors would make it easier to identify and resolve issues in future runs.
- Load More
