For large-scale tracking, I store price data in a database and compare it periodically to identify trends or price drops.

For infinite scrolling pages, I use Selenium’s execute_script method to automate scrolling and ensure all content is loaded before scraping begins

To scrape the product name from Tops Thailand, you can use Puppeteer to open the product page and locate the div or h1 tag containing the name. The product name is usually found in a specific class within these tags. After waiting for the page to load fully, use page.$eval() to extract the inner text.

const puppeteer =…

Read more