-
Rutendo Urvashi replied to the discussion How to build a Wayfair price tracker using Python and BeautifulSoup? in the forum General Web Scraping a year ago
Reply to How to build a Wayfair price tracker using Python and BeautifulSoup?
Using rotating proxies and randomized headers reduces the risk of being blocked by the server, ensuring smoother operation over long scraping sessions.
-
Rutendo Urvashi replied to the discussion How can I scrape product reviews from Shopee Thailand using Node.js n Puppeteer? in the forum General Web Scraping a year ago
Reply to How can I scrape product reviews from Shopee Thailand using Node.js n Puppeteer?
Puppeteer is ideal for scraping Shopee Thailand because it handles JavaScript-rendered pages seamlessly. Scraping reviews involves targeting the right HTML elements that contain user ratings and comments. The challenge is often dealing with multiple review pages or infinite scrolling, so you may need to automate scrolling and capture reviews…
-
Rutendo Urvashi started the discussion How can I scrape product name, price, stock status from Extra Brazil Java Jsoup? in the forum General Web Scraping a year ago
How can I scrape product name, price, stock status from Extra Brazil Java Jsoup?
To scrape the product name from Extra Brazil, you can use Java with the Jsoup library. The product name is often located within an h1 or span tag with a specific class. Using Jsoup’s select() method, you can extract the name after fetching the page.
import org.jsoup.Jsoup; import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
public…
-
Rutendo Urvashi changed their photo a year ago
-
Rutendo Urvashi became a registered member a year ago
-
Varda Wilky replied to the discussion How to scrape movie details from Viooz.ac using JavaScript and Puppeteer? in the forum General Web Scraping a year ago
Reply to How to scrape movie details from Viooz.ac using JavaScript and Puppeteer?
I add error handling with try-catch blocks to gracefully handle issues like missing elements or network timeouts. This ensures the scraper continues running without crashing.
-
Varda Wilky replied to the discussion How to scrape browser profiles from XBrowser using Python and Selenium? in the forum General Web Scraping a year ago
Reply to How to scrape browser profiles from XBrowser using Python and Selenium?
Using proxies and rotating user-agent headers helps mimic real user behavior, reducing the chances of being blocked during repeated scraping sessions.
-
Varda Wilky started the discussion Scrape product specifications, seller ratings, delivery option Carrefour Brazil? in the forum General Web Scraping a year ago
Scrape product specifications, seller ratings, delivery option Carrefour Brazil?
To extract product specifications from Carrefour Brazil, you can use PHP with cURL to fetch the page content and DOMDocument to parse the HTML. Specifications are often listed in a table or a series of div elements. By navigating through the DOM, you can retrieve these details.
<?php // Initialize cURL
$ch = curl_init();
curl_setopt($ch,…
-
Varda Wilky changed their photo a year ago
-
Varda Wilky became a registered member a year ago
- Load More
