-
Afnan Ayumi replied to the discussion How to scrape movie titles and links on YesMovies.org (unblocked) using Python? in the forum General Web Scraping a year ago
Reply to How to scrape movie titles and links on YesMovies.org (unblocked) using Python?
To handle CAPTCHAs, I integrate third-party solving services like 2Captcha, though I aim to avoid triggering CAPTCHAs by reducing request frequency and mimicking real user behavior.
-
Afnan Ayumi started the discussion Use Node.js to scrape product availability from MediaWorld Italy in the forum General Web Scraping a year ago
Use Node.js to scrape product availability from MediaWorld Italy
How do you scrape product availability from MediaWorld Italy, one of the biggest electronics retailers in the country? Is the information displayed in a consistent HTML structure, or does it vary between products? Are there any dynamically loaded elements that could complicate the scraping process? What if the availability depends on the…
-
Afnan Ayumi changed their photo a year ago
-
Afnan Ayumi became a registered member a year ago
-
Judith Fructuoso replied to the discussion What are the differences between wget and curl for web scraping? in the forum General Web Scraping a year ago
Reply to What are the differences between wget and curl for web scraping?
For simple file downloads or mirroring websites, I prefer wget due to its ease of use and built-in recursion capabilities. It’s perfect for downloading large datasets.
-
Judith Fructuoso replied to the discussion How to scrape job postings using Google Jobs API with Node.js? in the forum General Web Scraping a year ago
Reply to How to scrape job postings using Google Jobs API with Node.js?
To handle API rate limits, I implement request throttling using libraries like bottleneck. This ensures I stay within the allowed request quota.
-
Judith Fructuoso started the discussion Extract customer reviews from Euronics Italy using Python in the forum General Web Scraping a year ago
Extract customer reviews from Euronics Italy using Python
Euronics is a leading electronics retailer in Italy, offering a wide variety of products ranging from home appliances to the latest gadgets. Scraping customer reviews from Euronics involves several steps, starting with analyzing the webpage structure. Reviews on Euronics are typically displayed in a dedicated section of the product…
-
Judith Fructuoso changed their photo a year ago
-
Judith Fructuoso became a registered member a year ago
-
Ada Ocean replied to the discussion How to scrape movie details from Viooz.ac using JavaScript and Puppeteer? in the forum General Web Scraping a year ago
Reply to How to scrape movie details from Viooz.ac using JavaScript and Puppeteer?
For pages with infinite scrolling, I use Puppeteer’s scroll automation to load all content incrementally. This guarantees that no movie data is missed.
- Load More
