Scrape product name, price, and rating from a Thai e-commerce site with Node.js?

[Fathima Scilla]

To bypass detection, I use undetected-chromedriver, which prevents Selenium’s presence from being flagged by anti-bot mechanisms. This ensures smoother scraping.

[Shena Brigid]

I implement rotating proxies and delay requests to mimic real user behavior. These strategies help avoid IP bans or rate-limiting by the server.

[Nagendra Berna]

Storing scraped data in a structured database like PostgreSQL allows for efficient querying and analysis, making it easy to compare browser profiles or track changes over time.

[Astghik Kendra]

To scrape the product price, you can use Puppeteer to extract the price located in a span or div with a class related to pricing. Ensure that the element containing the price has fully loaded by waiting for the selector to appear. Once loaded, you can extract the price text and format it for use.

const puppeteer = require('puppeteer');
(async () => {
    const browser = await puppeteer.launch({ headless: true });
    const page = await browser.newPage();
    await page.goto('https://example.com/product-page');
    const price = await page.$eval('.product-price', el => el.innerText);
    console.log('Product Price:', price);
    await browser.close();
})();

[Candice Agata]

To scrape the product rating, use Puppeteer to find the rating element, which is often inside a div or span containing star icons or numerical ratings. After waiting for the element to load, extract the rating text using page.$eval(). This can help you gather insights into how well a product is reviewed.

const puppeteer = require('puppeteer');
(async () => {
    const browser = await puppeteer.launch({ headless: true });
    const page = await browser.newPage();
    await page.goto('https://example.com/product-page');
    const rating = await page.$eval('.product-rating', el => el.innerText);
    console.log('Product Rating:', rating);
    await browser.close();
})();