-
Osman Devaki became a registered member a year ago
-
Shena Brigid replied to the discussion Scrape product name, price, and rating from a Thai e-commerce site with Node.js? in the forum General Web Scraping a year ago
Reply to Scrape product name, price, and rating from a Thai e-commerce site with Node.js?
I implement rotating proxies and delay requests to mimic real user behavior. These strategies help avoid IP bans or rate-limiting by the server.
-
Shena Brigid replied to the discussion How to send a JSON POST request using cURL? in the forum General Web Scraping a year ago
Reply to How to send a JSON POST request using cURL?
When debugging, I use the -v flag for verbose output to see detailed request and response information. This helps identify missing headers or incorrect payloads.
-
Shena Brigid started the discussion How can I scrape product name, price, and rating from Klook Thailand -Puppeteer? in the forum General Web Scraping a year ago
How can I scrape product name, price, and rating from Klook Thailand -Puppeteer?
To scrape the product name from Klook Thailand, you can use Puppeteer to navigate to the product page and target the HTML element that contains the product name. The name is typically stored within an h1 or span tag with a specific class. You’ll need to ensure that the page is fully loaded using waitForSelector() before extracting the text.
const…
-
Dovilas Kaarel replied to the discussion Tips for scraping Zalando e-commerce data using Python? in the forum General Web Scraping a year ago
Reply to Tips for scraping Zalando e-commerce data using Python?
-
Use proxies and user-agent rotation to avoid IP blocking, especially when scraping high-demand categories like fashion or footwear.
-
-
Shena Brigid changed their photo a year ago
-
Dovilas Kaarel replied to the discussion Best practices for scraping travel data from Agoda or Traveloka? in the forum General Web Scraping a year ago
Reply to Best practices for scraping travel data from Agoda or Traveloka?
-
Traveloka’s flight tracking data includes information on seat availability, which is useful for analyzing travel demand trends.
-
-
Dovilas Kaarel replied to the discussion How to track electronics trends on Shopee and Lazada in Asia? in the forum General Web Scraping a year ago
Reply to How to track electronics trends on Shopee and Lazada in Asia?
Using location-based proxies, I can capture data from country-specific Shopee and Lazada sites, as popular gadgets vary by region.
-
Dovilas Kaarel replied to the discussion How to gather trending product data from Shopee and Lazada in Southeast Asia? in the forum General Web Scraping a year ago
Reply to How to gather trending product data from Shopee and Lazada in Southeast Asia?
-
Rotating proxies for each country enables access to region-specific data, as trends vary widely between countries in Southeast Asia.
-
-
Dovilas Kaarel replied to the discussion What’s the best way to gather Rakuma listings using Python? in the forum General Web Scraping a year ago
Reply to What’s the best way to gather Rakuma listings using Python?
-
Setting up proxy rotation enables frequent checks on top categories like tech gadgets and fashion without getting blocked.
-
- Load More
