• By scraping both review text and star ratings, I can run sentiment analysis to identify positive and negative feedback trends.

• Real estate sites often display data via AJAX. I capture these network requests to access details like property value estimates and recent sales history.

• With Node.js’s asynchronous capabilities, run multiple scraping threads, collecting data across various categories like electronics and fashion.

• By capturing JSON responses from network requests, I can bypass the HTML structure, improving efficiency when scraping structured data.

• Randomizing headers and user-agents in requests reduces the chance of FNAC detecting and blocking the scraper.

• By capturing both the list price and sale price, I can analyze discount trends and identify seasonal sales patterns on Mercari.

Using rotating proxies reduces detection risk, as Rakuten’s servers monitor for frequent requests from single IPs.

• By saving reviews in MySQL, I create a database that supports trend analysis, tracking shifts in customer sentiment over time.

By tracking trends on multiple platforms, I compare flight prices and identify the best days to book for the lowest rates.

• Using headers that mimic common Japanese browsers reduces detection, allowing my Rust scraper to access more data reliably.