-
Pepca Antonijo started the discussion How can I track pricing trends on Pinduoduo using Ruby? in the forum General Web Scraping a year ago
How can I track pricing trends on Pinduoduo using Ruby?
Pinduoduo often uses AJAX to load price and product data, so Ruby’s Watir gem helps handle dynamic content effectively.
-
Pepca Antonijo changed their photo a year ago
-
Pepca Antonijo became a registered member a year ago
-
Meztli Karel replied to the discussion How do I scrape JD.com’s product prices and availability with Node.js? in the forum General Web Scraping a year ago
Reply to How do I scrape JD.com’s product prices and availability with Node.js?
Axios or Fetch allows direct access to JSON responses, especially if network requests reveal structured product data.
-
Meztli Karel started the discussion What’s the best way to gather Tmall product reviews with PHP? in the forum General Web Scraping a year ago
What’s the best way to gather Tmall product reviews with PHP?
Tmall’s product reviews often load dynamically, so using PHP with Panther (a headless browser integration) helps render content fully.
-
Meztli Karel changed their photo a year ago
-
Meztli Karel became a registered member a year ago
-
Zala Marius replied to the discussion How can I scrape for product reviews and ratings on e-commerce sites? in the forum General Web Scraping a year ago
Reply to How can I scrape for product reviews and ratings on e-commerce sites?
I add timestamps to scraped reviews to track how recent feedback is, which is helpful for analyzing trends over time.
-
Zala Marius replied to the discussion What are the best practices for scraping e-commerce sites that allow it? in the forum General Web Scraping a year ago
Reply to What are the best practices for scraping e-commerce sites that allow it?
If they offer an API for certain data, I use it instead of scraping HTML. APIs are generally more stable and reliable for data extraction.
-
Zala Marius replied to the discussion What’s the best way to scrape e-commerce sites for product specifications? in the forum General Web Scraping a year ago
Reply to What’s the best way to scrape e-commerce sites for product specifications?
I ensure that scraped data includes identifiers like SKUs, which help avoid duplication when tracking product updates over time.
- Load More
