-
Nagendra Berna started the discussion How can I scrape product name, price, rating from HomePro Thailand -Puppeteer? in the forum General Web Scraping a year ago
How can I scrape product name, price, rating from HomePro Thailand -Puppeteer?
To scrape the product name from HomePro Thailand, you can use Puppeteer to extract the text from the specific HTML element that contains the name. Usually, the product name is located within a div or span tag. Using page.$eval() after ensuring the page has fully loaded will allow you to extract the product name easily.
const puppeteer…
-
Nagendra Berna changed their photo a year ago
-
Nagendra Berna became a registered member a year ago
-
Osman Devaki replied to the discussion Scrape product name, price, and stock from Tops Thailand using Puppeteer? in the forum General Web Scraping a year ago
Reply to Scrape product name, price, and stock from Tops Thailand using Puppeteer?
To handle responses, I use the -i flag to include headers in the output or redirect the response to a file for analysis. This helps debug issues with the request.
-
Osman Devaki replied to the discussion How can I scrape product details from JD Central Thailand using Python n Scrapy? in the forum General Web Scraping a year ago
Reply to How can I scrape product details from JD Central Thailand using Python n Scrapy?
One challenge of scraping Lazada Thailand is handling the rich media content such as images, JavaScript-loaded product details, and other dynamic elements. The static data can be scraped easily using BeautifulSoup, but if the site relies on JavaScript to load the products, you’ll need to find the API calls the site makes to load the data. This…
-
Osman Devaki started the discussion How can I scrape product name, price, availability from BigC Thailand -Puppeteer in the forum General Web Scraping a year ago
How can I scrape product name, price, availability from BigC Thailand -Puppeteer
To scrape the product name from BigC Thailand, you’ll first need to navigate to the specific product page and then locate the element containing the product name. It’s usually found within an h1 or span tag. You can extract the product name by using Puppeteer’s page.$eval() method after making sure the page is fully loaded.
const puppeteer =…
-
Osman Devaki changed their photo a year ago
-
Osman Devaki became a registered member a year ago
-
Shena Brigid replied to the discussion Scrape product name, price, and rating from a Thai e-commerce site with Node.js? in the forum General Web Scraping a year ago
Reply to Scrape product name, price, and rating from a Thai e-commerce site with Node.js?
I implement rotating proxies and delay requests to mimic real user behavior. These strategies help avoid IP bans or rate-limiting by the server.
-
Shena Brigid replied to the discussion How to send a JSON POST request using cURL? in the forum General Web Scraping a year ago
Reply to How to send a JSON POST request using cURL?
When debugging, I use the -v flag for verbose output to see detailed request and response information. This helps identify missing headers or incorrect payloads.
- Load More
